2024-05-27T12:21:43.902 INFO:root:teuthology version: 0.0.1.dev291+ge7ae758 2024-05-27T12:21:43.902 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_rishabh@teuthology --verbose --archive /home/teuthworker/archive/rishabh-2024-05-27_12:15:13-fs:volumes-rishabh-clone-stats-testing-default-smithi/7727884 --description fs:volumes/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/clone-progress}} --name rishabh-2024-05-27_12:15:13-fs:volumes-rishabh-clone-stats-testing-default-smithi -- /home/teuthworker/archive/rishabh-2024-05-27_12:15:13-fs:volumes-rishabh-clone-stats-testing-default-smithi/7727884/orig.config.yaml 2024-05-27T12:21:43.951 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-27T12:21:44.042 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2024-05-27_12:15:13-fs:volumes-rishabh-clone-stats-testing-default-smithi/7727884 branch: rishabh-clone-stats description: fs:volumes/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/clone-progress}} email: null first_in_suite: false job_id: '7727884' kernel: client: sha1: distro flavor: default kdb: 1 sha1: b9459a26b0888785d05c47deb35abc9d0354ab93 ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: rishabh-2024-05-27_12:15:13-fs:volumes-rishabh-clone-stats-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: rishabh-clone-stats ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug finisher: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_BACKFILLFULL sha1: 81797d879079e1a392b37a9c23a946594f658c50 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 81797d879079e1a392b37a9c23a946594f658c50 kclient: syntax: v1 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: mgr-vol-clone-stats sha1: 762bfab4bbf713ca5c79093d382422db341b04da owner: scheduled_rishabh@teuthology priority: 50 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 791 sha1: 81797d879079e1a392b37a9c23a946594f658c50 sleep_before_teardown: 0 suite: fs:volumes suite_branch: mgr-vol-clone-stats suite_path: /home/teuthworker/src/github.com_rishabh-d-dave_ceph_762bfab4bbf713ca5c79093d382422db341b04da/qa suite_relpath: qa suite_repo: https://github.com/rishabh-d-dave/ceph suite_sha1: 762bfab4bbf713ca5c79093d382422db341b04da syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi055.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKtoDscwtQMzsIT0B49qxQa1Em3cxyYnrjyDcJf8tpA9EvVujWNw27iS5c2pSLfA6VODtbUwSh2bJpkPo695eLc= smithi072.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCv+FgetGADL+eAhfXXVNXguGW6ZTAcVkX/vBKUomTlCIcJSJr8SQoJwPGq3srfWe4WnyRGv4vPZU+NWEmJRmPc= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_volumes.TestCloneProgressReporter teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: e7ae7580c417d6ab27fda98fecadca5d9f85d63e timestamp: 2024-05-27_12:15:13 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2698841 2024-05-27T12:21:44.042 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_rishabh-d-dave_ceph_762bfab4bbf713ca5c79093d382422db341b04da/qa; will attempt to use it 2024-05-27T12:21:44.043 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_rishabh-d-dave_ceph_762bfab4bbf713ca5c79093d382422db341b04da/qa/tasks 2024-05-27T12:21:44.043 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-05-27T12:21:44.045 INFO:teuthology.task.internal:Checking packages... 2024-05-27T12:21:44.065 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '81797d879079e1a392b37a9c23a946594f658c50' 2024-05-27T12:21:44.065 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-05-27T12:21:44.065 INFO:teuthology.packaging:ref: None 2024-05-27T12:21:44.066 INFO:teuthology.packaging:tag: None 2024-05-27T12:21:44.066 INFO:teuthology.packaging:branch: rishabh-clone-stats 2024-05-27T12:21:44.066 INFO:teuthology.packaging:sha1: 81797d879079e1a392b37a9c23a946594f658c50 2024-05-27T12:21:44.066 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=rishabh-clone-stats 2024-05-27T12:21:44.218 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3154.g81797d87 2024-05-27T12:21:44.219 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-05-27T12:21:44.225 INFO:teuthology.task.internal:no buildpackages task found 2024-05-27T12:21:44.225 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-05-27T12:21:44.272 INFO:teuthology.task.internal:Saving configuration 2024-05-27T12:21:44.289 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-05-27T12:21:44.298 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-27T12:21:44.323 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi055.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-05-27_12:15:13-fs:volumes-rishabh-clone-stats-testing-default-smithi/7727884', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-27 12:16:20.216936', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKtoDscwtQMzsIT0B49qxQa1Em3cxyYnrjyDcJf8tpA9EvVujWNw27iS5c2pSLfA6VODtbUwSh2bJpkPo695eLc='} 2024-05-27T12:21:44.347 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi072.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-05-27_12:15:13-fs:volumes-rishabh-clone-stats-testing-default-smithi/7727884', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-27 12:16:20.215393', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCv+FgetGADL+eAhfXXVNXguGW6ZTAcVkX/vBKUomTlCIcJSJr8SQoJwPGq3srfWe4WnyRGv4vPZU+NWEmJRmPc='} 2024-05-27T12:21:44.348 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-05-27T12:21:44.356 INFO:teuthology.task.internal:roles: ubuntu@smithi055.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-05-27T12:21:44.356 INFO:teuthology.task.internal:roles: ubuntu@smithi072.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-05-27T12:21:44.356 INFO:teuthology.run_tasks:Running task console_log... 2024-05-27T12:21:44.438 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f89bed57be0>, signals=[15]) 2024-05-27T12:21:44.439 INFO:teuthology.run_tasks:Running task internal.connect... 2024-05-27T12:21:44.446 INFO:teuthology.task.internal:Opening connections... 2024-05-27T12:21:44.446 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi055.front.sepia.ceph.com 2024-05-27T12:21:44.448 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-27T12:21:44.524 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi072.front.sepia.ceph.com 2024-05-27T12:21:44.525 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-27T12:21:44.645 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-05-27T12:21:44.654 DEBUG:teuthology.orchestra.run.smithi055:> uname -m 2024-05-27T12:21:44.673 INFO:teuthology.orchestra.run.smithi055.stdout:x86_64 2024-05-27T12:21:44.673 DEBUG:teuthology.orchestra.run.smithi055:> cat /etc/os-release 2024-05-27T12:21:44.733 INFO:teuthology.orchestra.run.smithi055.stdout:NAME="CentOS Stream" 2024-05-27T12:21:44.733 INFO:teuthology.orchestra.run.smithi055.stdout:VERSION="9" 2024-05-27T12:21:44.733 INFO:teuthology.orchestra.run.smithi055.stdout:ID="centos" 2024-05-27T12:21:44.733 INFO:teuthology.orchestra.run.smithi055.stdout:ID_LIKE="rhel fedora" 2024-05-27T12:21:44.733 INFO:teuthology.orchestra.run.smithi055.stdout:VERSION_ID="9" 2024-05-27T12:21:44.733 INFO:teuthology.orchestra.run.smithi055.stdout:PLATFORM_ID="platform:el9" 2024-05-27T12:21:44.733 INFO:teuthology.orchestra.run.smithi055.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-27T12:21:44.733 INFO:teuthology.orchestra.run.smithi055.stdout:ANSI_COLOR="0;31" 2024-05-27T12:21:44.733 INFO:teuthology.orchestra.run.smithi055.stdout:LOGO="fedora-logo-icon" 2024-05-27T12:21:44.733 INFO:teuthology.orchestra.run.smithi055.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-27T12:21:44.733 INFO:teuthology.orchestra.run.smithi055.stdout:HOME_URL="https://centos.org/" 2024-05-27T12:21:44.733 INFO:teuthology.orchestra.run.smithi055.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-27T12:21:44.734 INFO:teuthology.orchestra.run.smithi055.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-27T12:21:44.734 INFO:teuthology.orchestra.run.smithi055.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-27T12:21:44.734 INFO:teuthology.lock.ops:Updating smithi055.front.sepia.ceph.com on lock server 2024-05-27T12:21:44.764 DEBUG:teuthology.orchestra.run.smithi072:> uname -m 2024-05-27T12:21:44.782 INFO:teuthology.orchestra.run.smithi072.stdout:x86_64 2024-05-27T12:21:44.782 DEBUG:teuthology.orchestra.run.smithi072:> cat /etc/os-release 2024-05-27T12:21:44.840 INFO:teuthology.orchestra.run.smithi072.stdout:NAME="CentOS Stream" 2024-05-27T12:21:44.840 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION="9" 2024-05-27T12:21:44.840 INFO:teuthology.orchestra.run.smithi072.stdout:ID="centos" 2024-05-27T12:21:44.840 INFO:teuthology.orchestra.run.smithi072.stdout:ID_LIKE="rhel fedora" 2024-05-27T12:21:44.840 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION_ID="9" 2024-05-27T12:21:44.840 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM_ID="platform:el9" 2024-05-27T12:21:44.840 INFO:teuthology.orchestra.run.smithi072.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-27T12:21:44.840 INFO:teuthology.orchestra.run.smithi072.stdout:ANSI_COLOR="0;31" 2024-05-27T12:21:44.840 INFO:teuthology.orchestra.run.smithi072.stdout:LOGO="fedora-logo-icon" 2024-05-27T12:21:44.840 INFO:teuthology.orchestra.run.smithi072.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-27T12:21:44.841 INFO:teuthology.orchestra.run.smithi072.stdout:HOME_URL="https://centos.org/" 2024-05-27T12:21:44.841 INFO:teuthology.orchestra.run.smithi072.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-27T12:21:44.841 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-27T12:21:44.841 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-27T12:21:44.841 INFO:teuthology.lock.ops:Updating smithi072.front.sepia.ceph.com on lock server 2024-05-27T12:21:44.864 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-05-27T12:21:44.873 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-05-27T12:21:44.898 INFO:teuthology.task.internal:Checking for old test directory... 2024-05-27T12:21:44.899 DEBUG:teuthology.orchestra.run.smithi055:> test '!' -e /home/ubuntu/cephtest 2024-05-27T12:21:44.901 DEBUG:teuthology.orchestra.run.smithi072:> test '!' -e /home/ubuntu/cephtest 2024-05-27T12:21:44.917 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-05-27T12:21:44.933 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-05-27T12:21:44.934 DEBUG:teuthology.orchestra.run.smithi055:> test -z $(ls -A /var/lib/ceph) 2024-05-27T12:21:44.959 DEBUG:teuthology.orchestra.run.smithi072:> test -z $(ls -A /var/lib/ceph) 2024-05-27T12:21:44.985 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-05-27T12:21:45.032 INFO:teuthology.run_tasks:Running task kernel... 2024-05-27T12:21:45.046 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': 1, 'sha1': 'b9459a26b0888785d05c47deb35abc9d0354ab93'} 2024-05-27T12:21:45.047 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.2': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}, 'client.3': {'sha1': 'distro'}} 2024-05-27T12:21:45.047 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2024-05-27T12:21:45.047 DEBUG:teuthology.orchestra.run.smithi055:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-27T12:21:45.047 DEBUG:teuthology.orchestra.run.smithi072:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-27T12:21:45.062 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-27T12:21:45.063 DEBUG:teuthology.orchestra.run.smithi072:> uname -r 2024-05-27T12:21:45.064 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-27T12:21:45.065 DEBUG:teuthology.orchestra.run.smithi055:> uname -r 2024-05-27T12:21:45.118 INFO:teuthology.orchestra.run.smithi072.stdout:5.14.0-437.el9.x86_64 2024-05-27T12:21:45.119 INFO:teuthology.task.kernel:Running kernel on smithi072: 5.14.0-437.el9.x86_64 2024-05-27T12:21:45.119 DEBUG:teuthology.orchestra.run.smithi072:> sudo yum install -y kernel 2024-05-27T12:21:45.122 INFO:teuthology.orchestra.run.smithi055.stdout:5.14.0-437.el9.x86_64 2024-05-27T12:21:45.123 INFO:teuthology.task.kernel:Running kernel on smithi055: 5.14.0-437.el9.x86_64 2024-05-27T12:21:45.123 DEBUG:teuthology.orchestra.run.smithi055:> sudo yum install -y kernel 2024-05-27T12:21:48.628 INFO:teuthology.orchestra.run.smithi055.stdout:CentOS Stream 9 - BaseOS 4.1 MB/s | 8.1 MB 00:01 2024-05-27T12:21:49.503 INFO:teuthology.orchestra.run.smithi072.stdout:CentOS Stream 9 - BaseOS 4.0 MB/s | 8.1 MB 00:02 2024-05-27T12:21:50.603 INFO:teuthology.orchestra.run.smithi055.stdout:CentOS Stream 9 - AppStream 23 MB/s | 19 MB 00:00 2024-05-27T12:21:51.674 INFO:teuthology.orchestra.run.smithi072.stdout:CentOS Stream 9 - AppStream 18 MB/s | 19 MB 00:01 2024-05-27T12:21:56.226 INFO:teuthology.orchestra.run.smithi072.stdout:CentOS Stream 9 - CRB 6.4 MB/s | 6.2 MB 00:00 2024-05-27T12:21:56.471 INFO:teuthology.orchestra.run.smithi055.stdout:CentOS Stream 9 - CRB 3.0 MB/s | 6.2 MB 00:02 2024-05-27T12:21:57.777 INFO:teuthology.orchestra.run.smithi072.stdout:CentOS Stream 9 - Extras packages 41 kB/s | 17 kB 00:00 2024-05-27T12:21:58.138 INFO:teuthology.orchestra.run.smithi055.stdout:CentOS Stream 9 - Extras packages 36 kB/s | 17 kB 00:00 2024-05-27T12:21:59.567 INFO:teuthology.orchestra.run.smithi055.stdout:Extra Packages for Enterprise Linux 16 MB/s | 21 MB 00:01 2024-05-27T12:22:00.184 INFO:teuthology.orchestra.run.smithi072.stdout:Extra Packages for Enterprise Linux 9.3 MB/s | 21 MB 00:02 2024-05-27T12:22:05.123 INFO:teuthology.orchestra.run.smithi055.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-05-27T12:22:05.349 INFO:teuthology.orchestra.run.smithi072.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-05-27T12:22:07.113 INFO:teuthology.orchestra.run.smithi055.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-05-27T12:22:07.113 INFO:teuthology.orchestra.run.smithi055.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-05-27T12:22:07.202 INFO:teuthology.orchestra.run.smithi055.stdout:Dependencies resolved. 2024-05-27T12:22:07.208 INFO:teuthology.orchestra.run.smithi055.stdout:================================================================================ 2024-05-27T12:22:07.208 INFO:teuthology.orchestra.run.smithi055.stdout: Package Architecture Version Repository Size 2024-05-27T12:22:07.208 INFO:teuthology.orchestra.run.smithi055.stdout:================================================================================ 2024-05-27T12:22:07.208 INFO:teuthology.orchestra.run.smithi055.stdout:Installing: 2024-05-27T12:22:07.208 INFO:teuthology.orchestra.run.smithi055.stdout: kernel x86_64 5.14.0-447.el9 baseos 576 k 2024-05-27T12:22:07.208 INFO:teuthology.orchestra.run.smithi055.stdout:Installing dependencies: 2024-05-27T12:22:07.208 INFO:teuthology.orchestra.run.smithi055.stdout: kernel-core x86_64 5.14.0-447.el9 baseos 16 M 2024-05-27T12:22:07.208 INFO:teuthology.orchestra.run.smithi055.stdout: kernel-modules x86_64 5.14.0-447.el9 baseos 34 M 2024-05-27T12:22:07.208 INFO:teuthology.orchestra.run.smithi055.stdout: kernel-modules-core x86_64 5.14.0-447.el9 baseos 28 M 2024-05-27T12:22:07.208 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-27T12:22:07.208 INFO:teuthology.orchestra.run.smithi055.stdout:Transaction Summary 2024-05-27T12:22:07.208 INFO:teuthology.orchestra.run.smithi055.stdout:================================================================================ 2024-05-27T12:22:07.209 INFO:teuthology.orchestra.run.smithi055.stdout:Install 4 Packages 2024-05-27T12:22:07.209 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-27T12:22:07.209 INFO:teuthology.orchestra.run.smithi055.stdout:Total download size: 78 M 2024-05-27T12:22:07.209 INFO:teuthology.orchestra.run.smithi055.stdout:Installed size: 123 M 2024-05-27T12:22:07.209 INFO:teuthology.orchestra.run.smithi055.stdout:Downloading Packages: 2024-05-27T12:22:07.273 INFO:teuthology.orchestra.run.smithi072.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-05-27T12:22:07.273 INFO:teuthology.orchestra.run.smithi072.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-05-27T12:22:07.395 INFO:teuthology.orchestra.run.smithi072.stdout:Dependencies resolved. 2024-05-27T12:22:07.421 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2024-05-27T12:22:07.421 INFO:teuthology.orchestra.run.smithi072.stdout: Package Architecture Version Repository Size 2024-05-27T12:22:07.421 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2024-05-27T12:22:07.421 INFO:teuthology.orchestra.run.smithi072.stdout:Installing: 2024-05-27T12:22:07.421 INFO:teuthology.orchestra.run.smithi072.stdout: kernel x86_64 5.14.0-447.el9 baseos 576 k 2024-05-27T12:22:07.421 INFO:teuthology.orchestra.run.smithi072.stdout:Installing dependencies: 2024-05-27T12:22:07.421 INFO:teuthology.orchestra.run.smithi072.stdout: kernel-core x86_64 5.14.0-447.el9 baseos 16 M 2024-05-27T12:22:07.421 INFO:teuthology.orchestra.run.smithi072.stdout: kernel-modules x86_64 5.14.0-447.el9 baseos 34 M 2024-05-27T12:22:07.421 INFO:teuthology.orchestra.run.smithi072.stdout: kernel-modules-core x86_64 5.14.0-447.el9 baseos 28 M 2024-05-27T12:22:07.421 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-27T12:22:07.421 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction Summary 2024-05-27T12:22:07.422 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2024-05-27T12:22:07.422 INFO:teuthology.orchestra.run.smithi072.stdout:Install 4 Packages 2024-05-27T12:22:07.422 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-27T12:22:07.422 INFO:teuthology.orchestra.run.smithi072.stdout:Total download size: 78 M 2024-05-27T12:22:07.422 INFO:teuthology.orchestra.run.smithi072.stdout:Installed size: 123 M 2024-05-27T12:22:07.423 INFO:teuthology.orchestra.run.smithi072.stdout:Downloading Packages: 2024-05-27T12:22:07.666 INFO:teuthology.orchestra.run.smithi055.stdout:(1/4): kernel-5.14.0-447.el9.x86_64.rpm 2.1 MB/s | 576 kB 00:00 2024-05-27T12:22:07.685 INFO:teuthology.orchestra.run.smithi072.stdout:(1/4): kernel-5.14.0-447.el9.x86_64.rpm 3.9 MB/s | 576 kB 00:00 2024-05-27T12:22:08.086 INFO:teuthology.orchestra.run.smithi072.stdout:(2/4): kernel-core-5.14.0-447.el9.x86_64.rpm 29 MB/s | 16 MB 00:00 2024-05-27T12:22:08.621 INFO:teuthology.orchestra.run.smithi072.stdout:(3/4): kernel-modules-core-5.14.0-447.el9.x86_6 30 MB/s | 28 MB 00:00 2024-05-27T12:22:09.145 INFO:teuthology.orchestra.run.smithi072.stdout:(4/4): kernel-modules-5.14.0-447.el9.x86_64.rpm 21 MB/s | 34 MB 00:01 2024-05-27T12:22:09.145 INFO:teuthology.orchestra.run.smithi072.stdout:-------------------------------------------------------------------------------- 2024-05-27T12:22:09.145 INFO:teuthology.orchestra.run.smithi072.stdout:Total 45 MB/s | 78 MB 00:01 2024-05-27T12:22:09.831 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction check 2024-05-27T12:22:10.125 INFO:teuthology.orchestra.run.smithi055.stdout:(2/4): kernel-modules-core-5.14.0-447.el9.x86_6 11 MB/s | 28 MB 00:02 2024-05-27T12:22:10.165 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction check succeeded. 2024-05-27T12:22:10.165 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction test 2024-05-27T12:22:11.090 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction test succeeded. 2024-05-27T12:22:11.091 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction 2024-05-27T12:22:11.202 INFO:teuthology.orchestra.run.smithi055.stdout:(3/4): kernel-core-5.14.0-447.el9.x86_64.rpm 4.1 MB/s | 16 MB 00:03 2024-05-27T12:22:13.470 INFO:teuthology.orchestra.run.smithi072.stdout: Preparing : 1/1 2024-05-27T12:22:14.100 INFO:teuthology.orchestra.run.smithi055.stdout:(4/4): kernel-modules-5.14.0-447.el9.x86_64.rpm 5.1 MB/s | 34 MB 00:06 2024-05-27T12:22:14.100 INFO:teuthology.orchestra.run.smithi055.stdout:-------------------------------------------------------------------------------- 2024-05-27T12:22:14.100 INFO:teuthology.orchestra.run.smithi055.stdout:Total 11 MB/s | 78 MB 00:06 2024-05-27T12:22:14.120 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : kernel-modules-core-5.14.0-447.el9.x86_64 1/4 2024-05-27T12:22:14.225 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : kernel-core-5.14.0-447.el9.x86_64 2/4 2024-05-27T12:22:14.814 INFO:teuthology.orchestra.run.smithi055.stdout:Running transaction check 2024-05-27T12:22:15.249 INFO:teuthology.orchestra.run.smithi055.stdout:Transaction check succeeded. 2024-05-27T12:22:15.249 INFO:teuthology.orchestra.run.smithi055.stdout:Running transaction test 2024-05-27T12:22:16.224 INFO:teuthology.orchestra.run.smithi055.stdout:Transaction test succeeded. 2024-05-27T12:22:16.225 INFO:teuthology.orchestra.run.smithi055.stdout:Running transaction 2024-05-27T12:22:16.847 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: kernel-core-5.14.0-447.el9.x86_64 2/4 2024-05-27T12:22:17.058 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : kernel-modules-5.14.0-447.el9.x86_64 3/4 2024-05-27T12:22:18.761 INFO:teuthology.orchestra.run.smithi055.stdout: Preparing : 1/1 2024-05-27T12:22:19.452 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : kernel-modules-core-5.14.0-447.el9.x86_64 1/4 2024-05-27T12:22:19.542 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : kernel-core-5.14.0-447.el9.x86_64 2/4 2024-05-27T12:22:21.777 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: kernel-modules-5.14.0-447.el9.x86_64 3/4 2024-05-27T12:22:21.825 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : kernel-5.14.0-447.el9.x86_64 4/4 2024-05-27T12:22:22.344 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: kernel-core-5.14.0-447.el9.x86_64 2/4 2024-05-27T12:22:22.471 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : kernel-modules-5.14.0-447.el9.x86_64 3/4 2024-05-27T12:22:26.551 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: kernel-modules-core-5.14.0-447.el9.x86_64 4/4 2024-05-27T12:22:27.549 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: kernel-modules-5.14.0-447.el9.x86_64 3/4 2024-05-27T12:22:27.600 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : kernel-5.14.0-447.el9.x86_64 4/4 2024-05-27T12:22:32.694 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: kernel-modules-core-5.14.0-447.el9.x86_64 4/4 2024-05-27T12:22:58.069 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: kernel-core-5.14.0-447.el9.x86_64 4/4 2024-05-27T12:22:58.107 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: kernel-modules-5.14.0-447.el9.x86_64 4/4 2024-05-27T12:22:58.488 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: kernel-5.14.0-447.el9.x86_64 4/4 2024-05-27T12:22:58.488 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : kernel-5.14.0-447.el9.x86_64 1/4 2024-05-27T12:22:58.488 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : kernel-core-5.14.0-447.el9.x86_64 2/4 2024-05-27T12:22:58.488 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : kernel-modules-5.14.0-447.el9.x86_64 3/4 2024-05-27T12:22:59.567 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : kernel-modules-core-5.14.0-447.el9.x86_64 4/4 2024-05-27T12:22:59.567 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-27T12:22:59.567 INFO:teuthology.orchestra.run.smithi072.stdout:Installed: 2024-05-27T12:22:59.567 INFO:teuthology.orchestra.run.smithi072.stdout: kernel-5.14.0-447.el9.x86_64 2024-05-27T12:22:59.568 INFO:teuthology.orchestra.run.smithi072.stdout: kernel-core-5.14.0-447.el9.x86_64 2024-05-27T12:22:59.568 INFO:teuthology.orchestra.run.smithi072.stdout: kernel-modules-5.14.0-447.el9.x86_64 2024-05-27T12:22:59.568 INFO:teuthology.orchestra.run.smithi072.stdout: kernel-modules-core-5.14.0-447.el9.x86_64 2024-05-27T12:22:59.568 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-27T12:22:59.568 INFO:teuthology.orchestra.run.smithi072.stdout:Complete! 2024-05-27T12:23:00.012 DEBUG:teuthology.orchestra.run.smithi072:> rpm -q kernel | sort -rV | head -n 1 2024-05-27T12:23:00.110 INFO:teuthology.orchestra.run.smithi072.stdout:kernel-5.14.0-447.el9.x86_64 2024-05-27T12:23:00.110 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-447.el9.x86_64 2024-05-27T12:23:00.110 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-437.el9.x86_64 Expected: 5.14.0-447.el9.x86_64 2024-05-27T12:23:00.110 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-05-27T12:23:00.110 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-05-27T12:23:00.111 INFO:teuthology.task.kernel:Installing distro kernel on client.1... 2024-05-27T12:23:00.111 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi072.front.sepia.ceph.com, path=None, version=distro) 2024-05-27T12:23:00.111 DEBUG:teuthology.orchestra.run.smithi072:> rpm -q kernel | sort -rV | head -n 1 2024-05-27T12:23:00.162 INFO:teuthology.orchestra.run.smithi072.stdout:kernel-5.14.0-447.el9.x86_64 2024-05-27T12:23:00.162 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-447.el9.x86_64 2024-05-27T12:23:00.162 DEBUG:teuthology.orchestra.run.smithi072:> sudo rpm -qi grub2-tools 2024-05-27T12:23:00.196 INFO:teuthology.orchestra.run.smithi072.stdout:Name : grub2-tools 2024-05-27T12:23:00.196 INFO:teuthology.orchestra.run.smithi072.stdout:Epoch : 1 2024-05-27T12:23:00.196 INFO:teuthology.orchestra.run.smithi072.stdout:Version : 2.06 2024-05-27T12:23:00.196 INFO:teuthology.orchestra.run.smithi072.stdout:Release : 68.el9 2024-05-27T12:23:00.196 INFO:teuthology.orchestra.run.smithi072.stdout:Architecture: x86_64 2024-05-27T12:23:00.196 INFO:teuthology.orchestra.run.smithi072.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-05-27T12:23:00.196 INFO:teuthology.orchestra.run.smithi072.stdout:Group : Unspecified 2024-05-27T12:23:00.196 INFO:teuthology.orchestra.run.smithi072.stdout:Size : 8264254 2024-05-27T12:23:00.196 INFO:teuthology.orchestra.run.smithi072.stdout:License : GPLv3+ 2024-05-27T12:23:00.197 INFO:teuthology.orchestra.run.smithi072.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-05-27T12:23:00.197 INFO:teuthology.orchestra.run.smithi072.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-05-27T12:23:00.197 INFO:teuthology.orchestra.run.smithi072.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-05-27T12:23:00.197 INFO:teuthology.orchestra.run.smithi072.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-05-27T12:23:00.197 INFO:teuthology.orchestra.run.smithi072.stdout:Packager : builder@centos.org 2024-05-27T12:23:00.197 INFO:teuthology.orchestra.run.smithi072.stdout:Vendor : CentOS 2024-05-27T12:23:00.197 INFO:teuthology.orchestra.run.smithi072.stdout:URL : http://www.gnu.org/software/grub/ 2024-05-27T12:23:00.197 INFO:teuthology.orchestra.run.smithi072.stdout:Summary : Support tools for GRUB. 2024-05-27T12:23:00.197 INFO:teuthology.orchestra.run.smithi072.stdout:Description : 2024-05-27T12:23:00.197 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-27T12:23:00.197 INFO:teuthology.orchestra.run.smithi072.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-05-27T12:23:00.197 INFO:teuthology.orchestra.run.smithi072.stdout:customizable bootloader with modular architecture. It supports a rich 2024-05-27T12:23:00.197 INFO:teuthology.orchestra.run.smithi072.stdout:variety of kernel formats, file systems, computer architectures and 2024-05-27T12:23:00.197 INFO:teuthology.orchestra.run.smithi072.stdout:hardware devices. 2024-05-27T12:23:00.198 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-27T12:23:00.198 INFO:teuthology.orchestra.run.smithi072.stdout:This subpackage provides tools for support of all platforms. 2024-05-27T12:23:00.198 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-05-27T12:23:00.199 INFO:teuthology.task.kernel:Updating grub on smithi072 to boot 5.14.0-447.el9.x86_64 2024-05-27T12:23:00.199 DEBUG:teuthology.orchestra.run.smithi072:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-05-27T12:23:00.857 INFO:teuthology.orchestra.run.smithi072.stderr:Generating grub configuration file ... 2024-05-27T12:23:02.444 INFO:teuthology.orchestra.run.smithi072.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-05-27T12:23:02.467 INFO:teuthology.orchestra.run.smithi072.stderr:done 2024-05-27T12:23:02.469 DEBUG:teuthology.orchestra.run.smithi072:> mktemp 2024-05-27T12:23:02.496 INFO:teuthology.orchestra.run.smithi072.stdout:/tmp/tmp.nQ7UUiiexS 2024-05-27T12:23:02.496 DEBUG:teuthology.orchestra.run.smithi072:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.nQ7UUiiexS 2024-05-27T12:23:02.563 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 0666 /tmp/tmp.nQ7UUiiexS 2024-05-27T12:23:02.700 DEBUG:teuthology.orchestra.remote:smithi072:/tmp/tmp.nQ7UUiiexS is 6KB 2024-05-27T12:23:02.749 DEBUG:teuthology.orchestra.run.smithi072:> rm -fr /tmp/tmp.nQ7UUiiexS 2024-05-27T12:23:02.767 DEBUG:teuthology.orchestra.run.smithi072:> sudo /bin/ls /boot/loader/entries || true 2024-05-27T12:23:02.831 INFO:teuthology.orchestra.run.smithi072.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-05-27T12:23:02.831 INFO:teuthology.orchestra.run.smithi072.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-05-27T12:23:02.831 INFO:teuthology.orchestra.run.smithi072.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-05-27T12:23:02.832 INFO:teuthology.orchestra.run.smithi072.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-447.el9.x86_64.conf 2024-05-27T12:23:02.833 DEBUG:teuthology.orchestra.run.smithi072:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-5.14.0-447.el9.x86_64 2024-05-27T12:23:02.979 DEBUG:teuthology.orchestra.run.smithi072:> sudo shutdown -r now 2024-05-27T12:23:03.499 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: kernel-core-5.14.0-447.el9.x86_64 4/4 2024-05-27T12:23:03.539 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: kernel-modules-5.14.0-447.el9.x86_64 4/4 2024-05-27T12:23:03.890 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: kernel-5.14.0-447.el9.x86_64 4/4 2024-05-27T12:23:03.890 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : kernel-5.14.0-447.el9.x86_64 1/4 2024-05-27T12:23:03.890 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : kernel-core-5.14.0-447.el9.x86_64 2/4 2024-05-27T12:23:03.890 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : kernel-modules-5.14.0-447.el9.x86_64 3/4 2024-05-27T12:23:04.732 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : kernel-modules-core-5.14.0-447.el9.x86_64 4/4 2024-05-27T12:23:04.732 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-27T12:23:04.733 INFO:teuthology.orchestra.run.smithi055.stdout:Installed: 2024-05-27T12:23:04.733 INFO:teuthology.orchestra.run.smithi055.stdout: kernel-5.14.0-447.el9.x86_64 2024-05-27T12:23:04.733 INFO:teuthology.orchestra.run.smithi055.stdout: kernel-core-5.14.0-447.el9.x86_64 2024-05-27T12:23:04.733 INFO:teuthology.orchestra.run.smithi055.stdout: kernel-modules-5.14.0-447.el9.x86_64 2024-05-27T12:23:04.733 INFO:teuthology.orchestra.run.smithi055.stdout: kernel-modules-core-5.14.0-447.el9.x86_64 2024-05-27T12:23:04.733 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-27T12:23:04.733 INFO:teuthology.orchestra.run.smithi055.stdout:Complete! 2024-05-27T12:23:05.106 DEBUG:teuthology.orchestra.run.smithi055:> rpm -q kernel | sort -rV | head -n 1 2024-05-27T12:23:05.231 INFO:teuthology.orchestra.run.smithi055.stdout:kernel-5.14.0-447.el9.x86_64 2024-05-27T12:23:05.232 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-447.el9.x86_64 2024-05-27T12:23:05.232 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-437.el9.x86_64 Expected: 5.14.0-447.el9.x86_64 2024-05-27T12:23:05.232 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-05-27T12:23:05.232 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-05-27T12:23:05.232 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-05-27T12:23:05.232 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi055.front.sepia.ceph.com, path=None, version=distro) 2024-05-27T12:23:05.232 DEBUG:teuthology.orchestra.run.smithi055:> rpm -q kernel | sort -rV | head -n 1 2024-05-27T12:23:05.285 INFO:teuthology.orchestra.run.smithi055.stdout:kernel-5.14.0-447.el9.x86_64 2024-05-27T12:23:05.285 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-447.el9.x86_64 2024-05-27T12:23:05.286 DEBUG:teuthology.orchestra.run.smithi055:> sudo rpm -qi grub2-tools 2024-05-27T12:23:05.326 INFO:teuthology.orchestra.run.smithi055.stdout:Name : grub2-tools 2024-05-27T12:23:05.326 INFO:teuthology.orchestra.run.smithi055.stdout:Epoch : 1 2024-05-27T12:23:05.326 INFO:teuthology.orchestra.run.smithi055.stdout:Version : 2.06 2024-05-27T12:23:05.326 INFO:teuthology.orchestra.run.smithi055.stdout:Release : 68.el9 2024-05-27T12:23:05.326 INFO:teuthology.orchestra.run.smithi055.stdout:Architecture: x86_64 2024-05-27T12:23:05.326 INFO:teuthology.orchestra.run.smithi055.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-05-27T12:23:05.326 INFO:teuthology.orchestra.run.smithi055.stdout:Group : Unspecified 2024-05-27T12:23:05.326 INFO:teuthology.orchestra.run.smithi055.stdout:Size : 8264254 2024-05-27T12:23:05.326 INFO:teuthology.orchestra.run.smithi055.stdout:License : GPLv3+ 2024-05-27T12:23:05.326 INFO:teuthology.orchestra.run.smithi055.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-05-27T12:23:05.326 INFO:teuthology.orchestra.run.smithi055.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-05-27T12:23:05.327 INFO:teuthology.orchestra.run.smithi055.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-05-27T12:23:05.327 INFO:teuthology.orchestra.run.smithi055.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-05-27T12:23:05.327 INFO:teuthology.orchestra.run.smithi055.stdout:Packager : builder@centos.org 2024-05-27T12:23:05.327 INFO:teuthology.orchestra.run.smithi055.stdout:Vendor : CentOS 2024-05-27T12:23:05.327 INFO:teuthology.orchestra.run.smithi055.stdout:URL : http://www.gnu.org/software/grub/ 2024-05-27T12:23:05.327 INFO:teuthology.orchestra.run.smithi055.stdout:Summary : Support tools for GRUB. 2024-05-27T12:23:05.327 INFO:teuthology.orchestra.run.smithi055.stdout:Description : 2024-05-27T12:23:05.327 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-27T12:23:05.327 INFO:teuthology.orchestra.run.smithi055.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-05-27T12:23:05.327 INFO:teuthology.orchestra.run.smithi055.stdout:customizable bootloader with modular architecture. It supports a rich 2024-05-27T12:23:05.327 INFO:teuthology.orchestra.run.smithi055.stdout:variety of kernel formats, file systems, computer architectures and 2024-05-27T12:23:05.327 INFO:teuthology.orchestra.run.smithi055.stdout:hardware devices. 2024-05-27T12:23:05.327 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-27T12:23:05.327 INFO:teuthology.orchestra.run.smithi055.stdout:This subpackage provides tools for support of all platforms. 2024-05-27T12:23:05.328 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-05-27T12:23:05.328 INFO:teuthology.task.kernel:Updating grub on smithi055 to boot 5.14.0-447.el9.x86_64 2024-05-27T12:23:05.329 DEBUG:teuthology.orchestra.run.smithi055:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-05-27T12:23:05.968 INFO:teuthology.orchestra.run.smithi055.stderr:Generating grub configuration file ... 2024-05-27T12:23:07.334 INFO:teuthology.orchestra.run.smithi055.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-05-27T12:23:07.363 INFO:teuthology.orchestra.run.smithi055.stderr:done 2024-05-27T12:23:07.365 DEBUG:teuthology.orchestra.run.smithi055:> mktemp 2024-05-27T12:23:07.386 INFO:teuthology.orchestra.run.smithi055.stdout:/tmp/tmp.2ZRmUgNxLR 2024-05-27T12:23:07.386 DEBUG:teuthology.orchestra.run.smithi055:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.2ZRmUgNxLR 2024-05-27T12:23:07.458 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod 0666 /tmp/tmp.2ZRmUgNxLR 2024-05-27T12:23:07.595 DEBUG:teuthology.orchestra.remote:smithi055:/tmp/tmp.2ZRmUgNxLR is 6KB 2024-05-27T12:23:07.643 DEBUG:teuthology.orchestra.run.smithi055:> rm -fr /tmp/tmp.2ZRmUgNxLR 2024-05-27T12:23:07.658 DEBUG:teuthology.orchestra.run.smithi055:> sudo /bin/ls /boot/loader/entries || true 2024-05-27T12:23:07.719 INFO:teuthology.orchestra.run.smithi055.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-05-27T12:23:07.719 INFO:teuthology.orchestra.run.smithi055.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-05-27T12:23:07.719 INFO:teuthology.orchestra.run.smithi055.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-05-27T12:23:07.719 INFO:teuthology.orchestra.run.smithi055.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-447.el9.x86_64.conf 2024-05-27T12:23:07.721 DEBUG:teuthology.orchestra.run.smithi055:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-5.14.0-447.el9.x86_64 2024-05-27T12:23:07.863 DEBUG:teuthology.orchestra.run.smithi055:> sudo shutdown -r now 2024-05-27T12:23:33.004 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-05-27T12:23:33.005 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi072.front.sepia.ceph.com' 2024-05-27T12:23:33.006 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-27T12:23:37.870 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-05-27T12:23:37.871 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi055.front.sepia.ceph.com' 2024-05-27T12:23:37.871 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-27T12:24:07.459 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-05-27T12:24:16.466 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi072.front.sepia.ceph.com' 2024-05-27T12:24:16.468 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-27T12:24:34.850 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-05-27T12:24:37.875 DEBUG:teuthology.orchestra.remote:timed out 2024-05-27T12:24:46.861 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi072.front.sepia.ceph.com' 2024-05-27T12:24:46.862 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-27T12:24:46.876 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi055.front.sepia.ceph.com' 2024-05-27T12:24:46.876 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-27T12:24:47.228 DEBUG:teuthology.orchestra.run.smithi055:> true 2024-05-27T12:24:47.825 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi055.front.sepia.ceph.com' 2024-05-27T12:24:47.825 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-447.el9.x86_64"... 2024-05-27T12:24:47.825 DEBUG:teuthology.orchestra.run.smithi055:> uname -r 2024-05-27T12:24:47.847 INFO:teuthology.orchestra.run.smithi055.stdout:5.14.0-447.el9.x86_64 2024-05-27T12:24:47.847 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-447.el9.x86_64 vs 5.14.0-447.el9.x86_64 2024-05-27T12:24:47.847 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-27T12:24:47.848 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-05-27T12:24:48.849 DEBUG:teuthology.parallel:result is None 2024-05-27T12:24:50.621 DEBUG:teuthology.orchestra.run.smithi072:> true 2024-05-27T12:24:51.639 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi072.front.sepia.ceph.com' 2024-05-27T12:24:51.639 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "5.14.0-447.el9.x86_64"... 2024-05-27T12:24:51.639 DEBUG:teuthology.orchestra.run.smithi072:> uname -r 2024-05-27T12:24:51.655 INFO:teuthology.orchestra.run.smithi072.stdout:5.14.0-447.el9.x86_64 2024-05-27T12:24:51.656 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-447.el9.x86_64 vs 5.14.0-447.el9.x86_64 2024-05-27T12:24:51.656 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-27T12:24:51.656 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-05-27T12:24:52.657 DEBUG:teuthology.parallel:result is None 2024-05-27T12:24:52.657 INFO:teuthology.run_tasks:Running task internal.base... 2024-05-27T12:24:52.666 INFO:teuthology.task.internal:Creating test directory... 2024-05-27T12:24:52.666 DEBUG:teuthology.orchestra.run.smithi055:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-27T12:24:52.669 DEBUG:teuthology.orchestra.run.smithi072:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-27T12:24:52.686 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-05-27T12:24:52.709 INFO:teuthology.run_tasks:Running task internal.archive... 2024-05-27T12:24:52.740 INFO:teuthology.task.internal:Creating archive directory... 2024-05-27T12:24:52.741 DEBUG:teuthology.orchestra.run.smithi055:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-27T12:24:52.744 DEBUG:teuthology.orchestra.run.smithi072:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-27T12:24:52.785 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-05-27T12:24:52.796 INFO:teuthology.task.internal:Enabling coredump saving... 2024-05-27T12:24:52.796 DEBUG:teuthology.orchestra.run.smithi055:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-27T12:24:52.812 DEBUG:teuthology.orchestra.run.smithi072:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-27T12:24:52.893 INFO:teuthology.orchestra.run.smithi055.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-27T12:24:52.936 INFO:teuthology.orchestra.run.smithi055.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-27T12:24:53.019 INFO:teuthology.orchestra.run.smithi072.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-27T12:24:53.094 INFO:teuthology.orchestra.run.smithi072.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-27T12:24:53.095 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-05-27T12:24:53.105 INFO:teuthology.task.internal:Configuring sudo... 2024-05-27T12:24:53.105 DEBUG:teuthology.orchestra.run.smithi055:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-27T12:24:53.108 DEBUG:teuthology.orchestra.run.smithi072:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-27T12:24:53.136 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-05-27T12:24:53.146 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-05-27T12:24:53.146 DEBUG:teuthology.orchestra.run.smithi055:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-27T12:24:53.179 DEBUG:teuthology.orchestra.run.smithi072:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-27T12:24:53.195 DEBUG:teuthology.orchestra.run.smithi055:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-27T12:24:53.280 DEBUG:teuthology.orchestra.run.smithi055:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-27T12:24:53.335 DEBUG:teuthology.orchestra.run.smithi055:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-27T12:24:53.417 DEBUG:teuthology.orchestra.run.smithi055:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-27T12:24:53.466 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-05-27T12:24:53.466 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-27T12:24:53.535 DEBUG:teuthology.orchestra.run.smithi072:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-27T12:24:53.576 DEBUG:teuthology.orchestra.run.smithi072:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-27T12:24:53.622 DEBUG:teuthology.orchestra.run.smithi072:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-27T12:24:53.704 DEBUG:teuthology.orchestra.run.smithi072:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-27T12:24:53.744 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-05-27T12:24:53.744 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-27T12:24:53.818 DEBUG:teuthology.orchestra.run.smithi055:> sudo service rsyslog restart 2024-05-27T12:24:53.821 DEBUG:teuthology.orchestra.run.smithi072:> sudo service rsyslog restart 2024-05-27T12:24:53.858 INFO:teuthology.orchestra.run.smithi055.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-27T12:24:53.910 INFO:teuthology.orchestra.run.smithi072.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-27T12:24:54.255 INFO:teuthology.run_tasks:Running task internal.timer... 2024-05-27T12:24:54.263 INFO:teuthology.task.internal:Starting timer... 2024-05-27T12:24:54.263 INFO:teuthology.run_tasks:Running task pcp... 2024-05-27T12:24:54.301 INFO:teuthology.run_tasks:Running task selinux... 2024-05-27T12:24:54.333 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-05-27T12:24:54.334 DEBUG:teuthology.orchestra.run.smithi055:> sudo service auditd rotate 2024-05-27T12:24:54.388 INFO:teuthology.orchestra.run.smithi055.stdout:Rotating logs: 2024-05-27T12:24:54.390 DEBUG:teuthology.orchestra.run.smithi072:> sudo service auditd rotate 2024-05-27T12:24:54.511 INFO:teuthology.orchestra.run.smithi072.stdout:Rotating logs: 2024-05-27T12:24:54.513 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-05-27T12:24:54.513 DEBUG:teuthology.orchestra.run.smithi055:> /usr/sbin/getenforce 2024-05-27T12:24:54.545 INFO:teuthology.orchestra.run.smithi055.stdout:Permissive 2024-05-27T12:24:54.545 DEBUG:teuthology.orchestra.run.smithi072:> /usr/sbin/getenforce 2024-05-27T12:24:54.568 INFO:teuthology.orchestra.run.smithi072.stdout:Permissive 2024-05-27T12:24:54.568 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi055.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi072.front.sepia.ceph.com': 'permissive'} 2024-05-27T12:24:54.568 DEBUG:teuthology.orchestra.run.smithi055:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-27T12:24:54.615 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-27T12:24:54.615 DEBUG:teuthology.orchestra.run.smithi072:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-27T12:24:54.640 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-27T12:24:54.641 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-05-27T12:24:54.641 DEBUG:teuthology.orchestra.run.smithi055:> sudo /usr/sbin/setenforce permissive 2024-05-27T12:24:54.689 DEBUG:teuthology.orchestra.run.smithi072:> sudo /usr/sbin/setenforce permissive 2024-05-27T12:24:54.721 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-05-27T12:24:54.731 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-05-27T12:24:54.743 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-05-27T12:24:54.744 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi055.front.sepia.ceph.com,smithi072.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-05-27T12:29:18.995 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi055.front.sepia.ceph.com'), Remote(name='ubuntu@smithi072.front.sepia.ceph.com')] 2024-05-27T12:29:18.997 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi055.front.sepia.ceph.com' 2024-05-27T12:29:18.998 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-27T12:29:19.116 DEBUG:teuthology.orchestra.run.smithi055:> true 2024-05-27T12:29:19.203 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi055.front.sepia.ceph.com' 2024-05-27T12:29:19.204 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi072.front.sepia.ceph.com' 2024-05-27T12:29:19.204 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-27T12:29:19.281 DEBUG:teuthology.orchestra.run.smithi072:> true 2024-05-27T12:29:19.364 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi072.front.sepia.ceph.com' 2024-05-27T12:29:19.364 INFO:teuthology.run_tasks:Running task clock... 2024-05-27T12:29:19.379 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-05-27T12:29:19.379 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-27T12:29:19.380 DEBUG:teuthology.orchestra.run.smithi055:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-27T12:29:19.382 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-27T12:29:19.382 DEBUG:teuthology.orchestra.run.smithi072:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-27T12:29:19.413 INFO:teuthology.orchestra.run.smithi055.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-27T12:29:19.430 INFO:teuthology.orchestra.run.smithi055.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-27T12:29:19.438 INFO:teuthology.orchestra.run.smithi072.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-27T12:29:19.453 INFO:teuthology.orchestra.run.smithi072.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-27T12:29:19.456 INFO:teuthology.orchestra.run.smithi055.stderr:sudo: ntpd: command not found 2024-05-27T12:29:19.468 INFO:teuthology.orchestra.run.smithi055.stdout:506 Cannot talk to daemon 2024-05-27T12:29:19.477 INFO:teuthology.orchestra.run.smithi072.stderr:sudo: ntpd: command not found 2024-05-27T12:29:19.483 INFO:teuthology.orchestra.run.smithi055.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-27T12:29:19.488 INFO:teuthology.orchestra.run.smithi072.stdout:506 Cannot talk to daemon 2024-05-27T12:29:19.498 INFO:teuthology.orchestra.run.smithi055.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-27T12:29:19.502 INFO:teuthology.orchestra.run.smithi072.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-27T12:29:19.516 INFO:teuthology.orchestra.run.smithi072.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-27T12:29:19.553 INFO:teuthology.orchestra.run.smithi055.stderr:bash: line 1: ntpq: command not found 2024-05-27T12:29:19.556 INFO:teuthology.orchestra.run.smithi055.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-27T12:29:19.556 INFO:teuthology.orchestra.run.smithi055.stdout:=============================================================================== 2024-05-27T12:29:19.556 INFO:teuthology.orchestra.run.smithi055.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-27T12:29:19.556 INFO:teuthology.orchestra.run.smithi055.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-27T12:29:19.556 INFO:teuthology.orchestra.run.smithi055.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-27T12:29:19.557 INFO:teuthology.orchestra.run.smithi055.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-27T12:29:19.569 INFO:teuthology.orchestra.run.smithi072.stderr:bash: line 1: ntpq: command not found 2024-05-27T12:29:19.572 INFO:teuthology.orchestra.run.smithi072.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-27T12:29:19.572 INFO:teuthology.orchestra.run.smithi072.stdout:=============================================================================== 2024-05-27T12:29:19.572 INFO:teuthology.orchestra.run.smithi072.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-27T12:29:19.573 INFO:teuthology.orchestra.run.smithi072.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-27T12:29:19.573 INFO:teuthology.orchestra.run.smithi072.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-27T12:29:19.573 INFO:teuthology.orchestra.run.smithi072.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-27T12:29:19.574 INFO:teuthology.run_tasks:Running task install... 2024-05-27T12:29:19.582 DEBUG:teuthology.task.install:project ceph 2024-05-27T12:29:19.582 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '81797d879079e1a392b37a9c23a946594f658c50'}} 2024-05-27T12:29:19.582 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '81797d879079e1a392b37a9c23a946594f658c50'} 2024-05-27T12:29:19.583 INFO:teuthology.task.install:Using flavor: default 2024-05-27T12:29:19.588 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-05-27T12:29:19.588 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-05-27T12:29:19.589 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '81797d879079e1a392b37a9c23a946594f658c50', 'tag': None, 'wait_for_package': False} 2024-05-27T12:29:19.589 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=81797d879079e1a392b37a9c23a946594f658c50 2024-05-27T12:29:19.591 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '81797d879079e1a392b37a9c23a946594f658c50', 'tag': None, 'wait_for_package': False} 2024-05-27T12:29:19.591 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=81797d879079e1a392b37a9c23a946594f658c50 2024-05-27T12:29:19.815 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/rishabh-clone-stats/81797d879079e1a392b37a9c23a946594f658c50/centos/9/flavors/default/ 2024-05-27T12:29:19.815 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3154.g81797d87 2024-05-27T12:29:19.823 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/rishabh-clone-stats/81797d879079e1a392b37a9c23a946594f658c50/centos/9/flavors/default/ 2024-05-27T12:29:19.823 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3154.g81797d87 2024-05-27T12:29:19.927 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-clone-stats/81797d879079e1a392b37a9c23a946594f658c50/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-clone-stats/81797d879079e1a392b37a9c23a946594f658c50/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-clone-stats/81797d879079e1a392b37a9c23a946594f658c50/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-27T12:29:19.928 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-05-27T12:29:19.928 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-27T12:29:19.938 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-clone-stats/81797d879079e1a392b37a9c23a946594f658c50/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-clone-stats/81797d879079e1a392b37a9c23a946594f658c50/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-clone-stats/81797d879079e1a392b37a9c23a946594f658c50/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-27T12:29:19.938 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-05-27T12:29:19.938 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-27T12:29:19.955 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-05-27T12:29:19.955 DEBUG:teuthology.orchestra.run.smithi055:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/81797d879079e1a392b37a9c23a946594f658c50/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-27T12:29:19.967 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-05-27T12:29:19.967 DEBUG:teuthology.orchestra.run.smithi072:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/81797d879079e1a392b37a9c23a946594f658c50/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-27T12:29:20.022 DEBUG:teuthology.orchestra.run.smithi055:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-27T12:29:20.032 DEBUG:teuthology.orchestra.run.smithi072:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-27T12:29:20.098 DEBUG:teuthology.orchestra.run.smithi055:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-27T12:29:20.107 DEBUG:teuthology.orchestra.run.smithi072:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-27T12:29:20.164 INFO:teuthology.orchestra.run.smithi055.stdout:check_obsoletes = 1 2024-05-27T12:29:20.166 DEBUG:teuthology.orchestra.run.smithi055:> sudo yum clean all 2024-05-27T12:29:20.171 INFO:teuthology.orchestra.run.smithi072.stdout:check_obsoletes = 1 2024-05-27T12:29:20.173 DEBUG:teuthology.orchestra.run.smithi072:> sudo yum clean all 2024-05-27T12:29:20.398 INFO:teuthology.orchestra.run.smithi055.stdout:45 files removed 2024-05-27T12:29:20.398 INFO:teuthology.orchestra.run.smithi072.stdout:45 files removed 2024-05-27T12:29:20.426 DEBUG:teuthology.orchestra.run.smithi055:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-05-27T12:29:20.427 DEBUG:teuthology.orchestra.run.smithi072:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-05-27T12:29:21.114 INFO:teuthology.orchestra.run.smithi072.stdout:ceph packages for x86_64 203 kB/s | 83 kB 00:00 2024-05-27T12:29:21.185 INFO:teuthology.orchestra.run.smithi055.stdout:ceph packages for x86_64 179 kB/s | 83 kB 00:00 2024-05-27T12:29:21.593 INFO:teuthology.orchestra.run.smithi055.stdout:ceph noarch packages 33 kB/s | 12 kB 00:00 2024-05-27T12:29:21.598 INFO:teuthology.orchestra.run.smithi072.stdout:ceph noarch packages 27 kB/s | 12 kB 00:00 2024-05-27T12:29:21.944 INFO:teuthology.orchestra.run.smithi055.stdout:ceph source packages 6.2 kB/s | 1.9 kB 00:00 2024-05-27T12:29:22.016 INFO:teuthology.orchestra.run.smithi072.stdout:ceph source packages 5.1 kB/s | 1.9 kB 00:00 2024-05-27T12:29:22.585 INFO:teuthology.orchestra.run.smithi055.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 8.1 MB 00:00 2024-05-27T12:29:22.702 INFO:teuthology.orchestra.run.smithi072.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.1 MB 00:00 2024-05-27T12:29:24.270 INFO:teuthology.orchestra.run.smithi055.stdout:CentOS Stream 9 - AppStream 34 MB/s | 19 MB 00:00 2024-05-27T12:29:24.422 INFO:teuthology.orchestra.run.smithi072.stdout:CentOS Stream 9 - AppStream 28 MB/s | 19 MB 00:00 2024-05-27T12:29:28.346 INFO:teuthology.orchestra.run.smithi055.stdout:CentOS Stream 9 - CRB 16 MB/s | 6.2 MB 00:00 2024-05-27T12:29:29.772 INFO:teuthology.orchestra.run.smithi055.stdout:CentOS Stream 9 - Extras packages 79 kB/s | 17 kB 00:00 2024-05-27T12:29:30.415 INFO:teuthology.orchestra.run.smithi072.stdout:CentOS Stream 9 - CRB 2.5 MB/s | 6.2 MB 00:02 2024-05-27T12:29:31.794 INFO:teuthology.orchestra.run.smithi072.stdout:CentOS Stream 9 - Extras packages 74 kB/s | 17 kB 00:00 2024-05-27T12:29:36.859 INFO:teuthology.orchestra.run.smithi055.stdout:Extra Packages for Enterprise Linux 3.0 MB/s | 21 MB 00:06 2024-05-27T12:29:42.156 INFO:teuthology.orchestra.run.smithi055.stdout:lab-extras 37 kB/s | 1.7 kB 00:00 2024-05-27T12:29:44.450 INFO:teuthology.orchestra.run.smithi055.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-27T12:29:44.451 INFO:teuthology.orchestra.run.smithi055.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-27T12:29:44.462 INFO:teuthology.orchestra.run.smithi055.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-05-27T12:29:44.463 INFO:teuthology.orchestra.run.smithi055.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-05-27T12:29:44.463 INFO:teuthology.orchestra.run.smithi055.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-05-27T12:29:44.464 INFO:teuthology.orchestra.run.smithi055.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-05-27T12:29:44.466 INFO:teuthology.orchestra.run.smithi055.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-05-27T12:29:44.468 INFO:teuthology.orchestra.run.smithi055.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-05-27T12:29:44.469 INFO:teuthology.orchestra.run.smithi055.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-05-27T12:29:44.535 INFO:teuthology.orchestra.run.smithi055.stdout:Dependencies resolved. 2024-05-27T12:29:44.578 INFO:teuthology.orchestra.run.smithi055.stdout:======================================================================================= 2024-05-27T12:29:44.579 INFO:teuthology.orchestra.run.smithi055.stdout: Package Arch Version Repository Size 2024-05-27T12:29:44.579 INFO:teuthology.orchestra.run.smithi055.stdout:======================================================================================= 2024-05-27T12:29:44.579 INFO:teuthology.orchestra.run.smithi055.stdout:Installing: 2024-05-27T12:29:44.579 INFO:teuthology.orchestra.run.smithi055.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-05-27T12:29:44.579 INFO:teuthology.orchestra.run.smithi055.stdout: ceph x86_64 2:19.0.0-3154.g81797d87.el9 ceph 6.6 k 2024-05-27T12:29:44.579 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-base x86_64 2:19.0.0-3154.g81797d87.el9 ceph 5.4 M 2024-05-27T12:29:44.579 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-fuse x86_64 2:19.0.0-3154.g81797d87.el9 ceph 890 k 2024-05-27T12:29:44.579 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3154.g81797d87.el9 ceph 145 k 2024-05-27T12:29:44.579 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mgr x86_64 2:19.0.0-3154.g81797d87.el9 ceph 1.5 M 2024-05-27T12:29:44.579 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3154.g81797d87.el9 ceph-noarch 142 k 2024-05-27T12:29:44.579 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3154.g81797d87.el9 ceph-noarch 3.5 M 2024-05-27T12:29:44.580 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3154.g81797d87.el9 ceph-noarch 7.4 M 2024-05-27T12:29:44.580 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mgr-rook noarch 2:19.0.0-3154.g81797d87.el9 ceph-noarch 49 k 2024-05-27T12:29:44.580 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-radosgw x86_64 2:19.0.0-3154.g81797d87.el9 ceph 11 M 2024-05-27T12:29:44.580 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-test x86_64 2:19.0.0-3154.g81797d87.el9 ceph 49 M 2024-05-27T12:29:44.580 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-volume noarch 2:19.0.0-3154.g81797d87.el9 ceph-noarch 273 k 2024-05-27T12:29:44.580 INFO:teuthology.orchestra.run.smithi055.stdout: cephadm noarch 2:19.0.0-3154.g81797d87.el9 ceph-noarch 763 k 2024-05-27T12:29:44.580 INFO:teuthology.orchestra.run.smithi055.stdout: cephfs-mirror x86_64 2:19.0.0-3154.g81797d87.el9 ceph 224 k 2024-05-27T12:29:44.580 INFO:teuthology.orchestra.run.smithi055.stdout: cephfs-shell x86_64 2:19.0.0-3154.g81797d87.el9 ceph 27 k 2024-05-27T12:29:44.580 INFO:teuthology.orchestra.run.smithi055.stdout: cephfs-top noarch 2:19.0.0-3154.g81797d87.el9 ceph-noarch 18 k 2024-05-27T12:29:44.580 INFO:teuthology.orchestra.run.smithi055.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-05-27T12:29:44.580 INFO:teuthology.orchestra.run.smithi055.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-05-27T12:29:44.581 INFO:teuthology.orchestra.run.smithi055.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-05-27T12:29:44.581 INFO:teuthology.orchestra.run.smithi055.stdout: libcephfs-devel x86_64 2:19.0.0-3154.g81797d87.el9 ceph 32 k 2024-05-27T12:29:44.581 INFO:teuthology.orchestra.run.smithi055.stdout: libcephfs2 x86_64 2:19.0.0-3154.g81797d87.el9 ceph 747 k 2024-05-27T12:29:44.581 INFO:teuthology.orchestra.run.smithi055.stdout: librados-devel x86_64 2:19.0.0-3154.g81797d87.el9 ceph 127 k 2024-05-27T12:29:44.581 INFO:teuthology.orchestra.run.smithi055.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-05-27T12:29:44.581 INFO:teuthology.orchestra.run.smithi055.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-05-27T12:29:44.581 INFO:teuthology.orchestra.run.smithi055.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-05-27T12:29:44.581 INFO:teuthology.orchestra.run.smithi055.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-05-27T12:29:44.581 INFO:teuthology.orchestra.run.smithi055.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-05-27T12:29:44.581 INFO:teuthology.orchestra.run.smithi055.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-05-27T12:29:44.581 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cephfs x86_64 2:19.0.0-3154.g81797d87.el9 ceph 161 k 2024-05-27T12:29:44.581 INFO:teuthology.orchestra.run.smithi055.stdout: python3-rados x86_64 2:19.0.0-3154.g81797d87.el9 ceph 321 k 2024-05-27T12:29:44.582 INFO:teuthology.orchestra.run.smithi055.stdout: python3-rbd x86_64 2:19.0.0-3154.g81797d87.el9 ceph 298 k 2024-05-27T12:29:44.582 INFO:teuthology.orchestra.run.smithi055.stdout: python3-rgw x86_64 2:19.0.0-3154.g81797d87.el9 ceph 99 k 2024-05-27T12:29:44.582 INFO:teuthology.orchestra.run.smithi055.stdout: rbd-fuse x86_64 2:19.0.0-3154.g81797d87.el9 ceph 85 k 2024-05-27T12:29:44.582 INFO:teuthology.orchestra.run.smithi055.stdout: rbd-mirror x86_64 2:19.0.0-3154.g81797d87.el9 ceph 3.1 M 2024-05-27T12:29:44.582 INFO:teuthology.orchestra.run.smithi055.stdout: rbd-nbd x86_64 2:19.0.0-3154.g81797d87.el9 ceph 170 k 2024-05-27T12:29:44.582 INFO:teuthology.orchestra.run.smithi055.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-05-27T12:29:44.582 INFO:teuthology.orchestra.run.smithi055.stdout:Upgrading: 2024-05-27T12:29:44.582 INFO:teuthology.orchestra.run.smithi055.stdout: NetworkManager x86_64 1:1.47.90-1.el9 baseos 2.3 M 2024-05-27T12:29:44.582 INFO:teuthology.orchestra.run.smithi055.stdout: NetworkManager-libnm x86_64 1:1.47.90-1.el9 baseos 1.8 M 2024-05-27T12:29:44.582 INFO:teuthology.orchestra.run.smithi055.stdout: NetworkManager-team x86_64 1:1.47.90-1.el9 baseos 41 k 2024-05-27T12:29:44.582 INFO:teuthology.orchestra.run.smithi055.stdout: NetworkManager-tui x86_64 1:1.47.90-1.el9 baseos 248 k 2024-05-27T12:29:44.582 INFO:teuthology.orchestra.run.smithi055.stdout: elfutils-debuginfod-client x86_64 0.191-4.el9 baseos 37 k 2024-05-27T12:29:44.583 INFO:teuthology.orchestra.run.smithi055.stdout: elfutils-libelf x86_64 0.191-4.el9 baseos 207 k 2024-05-27T12:29:44.583 INFO:teuthology.orchestra.run.smithi055.stdout: elfutils-libs x86_64 0.191-4.el9 baseos 260 k 2024-05-27T12:29:44.583 INFO:teuthology.orchestra.run.smithi055.stdout: librados2 x86_64 2:19.0.0-3154.g81797d87.el9 ceph 3.4 M 2024-05-27T12:29:44.583 INFO:teuthology.orchestra.run.smithi055.stdout: librbd1 x86_64 2:19.0.0-3154.g81797d87.el9 ceph 3.1 M 2024-05-27T12:29:44.583 INFO:teuthology.orchestra.run.smithi055.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-05-27T12:29:44.583 INFO:teuthology.orchestra.run.smithi055.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-05-27T12:29:44.583 INFO:teuthology.orchestra.run.smithi055.stdout:Installing dependencies: 2024-05-27T12:29:44.583 INFO:teuthology.orchestra.run.smithi055.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-05-27T12:29:44.583 INFO:teuthology.orchestra.run.smithi055.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-05-27T12:29:44.583 INFO:teuthology.orchestra.run.smithi055.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-05-27T12:29:44.583 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-common x86_64 2:19.0.0-3154.g81797d87.el9 ceph 21 M 2024-05-27T12:29:44.584 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3154.g81797d87.el9 ceph-noarch 34 k 2024-05-27T12:29:44.584 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mds x86_64 2:19.0.0-3154.g81797d87.el9 ceph 2.4 M 2024-05-27T12:29:44.584 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3154.g81797d87.el9 ceph-noarch 252 k 2024-05-27T12:29:44.584 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mon x86_64 2:19.0.0-3154.g81797d87.el9 ceph 4.7 M 2024-05-27T12:29:44.584 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-osd x86_64 2:19.0.0-3154.g81797d87.el9 ceph 17 M 2024-05-27T12:29:44.584 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3154.g81797d87.el9 ceph-noarch 16 k 2024-05-27T12:29:44.584 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-selinux x86_64 2:19.0.0-3154.g81797d87.el9 ceph 25 k 2024-05-27T12:29:44.584 INFO:teuthology.orchestra.run.smithi055.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-27T12:29:44.584 INFO:teuthology.orchestra.run.smithi055.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-27T12:29:44.584 INFO:teuthology.orchestra.run.smithi055.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-27T12:29:44.584 INFO:teuthology.orchestra.run.smithi055.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-27T12:29:44.584 INFO:teuthology.orchestra.run.smithi055.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-27T12:29:44.584 INFO:teuthology.orchestra.run.smithi055.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-05-27T12:29:44.585 INFO:teuthology.orchestra.run.smithi055.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-05-27T12:29:44.585 INFO:teuthology.orchestra.run.smithi055.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-05-27T12:29:44.585 INFO:teuthology.orchestra.run.smithi055.stdout: libcephsqlite x86_64 2:19.0.0-3154.g81797d87.el9 ceph 163 k 2024-05-27T12:29:44.585 INFO:teuthology.orchestra.run.smithi055.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-27T12:29:44.585 INFO:teuthology.orchestra.run.smithi055.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-27T12:29:44.585 INFO:teuthology.orchestra.run.smithi055.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-27T12:29:44.585 INFO:teuthology.orchestra.run.smithi055.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-27T12:29:44.585 INFO:teuthology.orchestra.run.smithi055.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-27T12:29:44.585 INFO:teuthology.orchestra.run.smithi055.stdout: libradosstriper1 x86_64 2:19.0.0-3154.g81797d87.el9 ceph 501 k 2024-05-27T12:29:44.585 INFO:teuthology.orchestra.run.smithi055.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-27T12:29:44.585 INFO:teuthology.orchestra.run.smithi055.stdout: librgw2 x86_64 2:19.0.0-3154.g81797d87.el9 ceph 5.4 M 2024-05-27T12:29:44.585 INFO:teuthology.orchestra.run.smithi055.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-27T12:29:44.585 INFO:teuthology.orchestra.run.smithi055.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-05-27T12:29:44.586 INFO:teuthology.orchestra.run.smithi055.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-27T12:29:44.586 INFO:teuthology.orchestra.run.smithi055.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-05-27T12:29:44.586 INFO:teuthology.orchestra.run.smithi055.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-05-27T12:29:44.586 INFO:teuthology.orchestra.run.smithi055.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-05-27T12:29:44.586 INFO:teuthology.orchestra.run.smithi055.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-27T12:29:44.586 INFO:teuthology.orchestra.run.smithi055.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-27T12:29:44.586 INFO:teuthology.orchestra.run.smithi055.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-05-27T12:29:44.586 INFO:teuthology.orchestra.run.smithi055.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-05-27T12:29:44.586 INFO:teuthology.orchestra.run.smithi055.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-05-27T12:29:44.586 INFO:teuthology.orchestra.run.smithi055.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-05-27T12:29:44.586 INFO:teuthology.orchestra.run.smithi055.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-27T12:29:44.587 INFO:teuthology.orchestra.run.smithi055.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-05-27T12:29:44.587 INFO:teuthology.orchestra.run.smithi055.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-27T12:29:44.587 INFO:teuthology.orchestra.run.smithi055.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-27T12:29:44.587 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-27T12:29:44.587 INFO:teuthology.orchestra.run.smithi055.stdout: python3-ceph-argparse x86_64 2:19.0.0-3154.g81797d87.el9 ceph 45 k 2024-05-27T12:29:44.587 INFO:teuthology.orchestra.run.smithi055.stdout: python3-ceph-common x86_64 2:19.0.0-3154.g81797d87.el9 ceph 135 k 2024-05-27T12:29:44.587 INFO:teuthology.orchestra.run.smithi055.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-27T12:29:44.587 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-27T12:29:44.587 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-27T12:29:44.587 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-27T12:29:44.587 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-05-27T12:29:44.587 INFO:teuthology.orchestra.run.smithi055.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-05-27T12:29:44.587 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-27T12:29:44.588 INFO:teuthology.orchestra.run.smithi055.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-27T12:29:44.588 INFO:teuthology.orchestra.run.smithi055.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-27T12:29:44.588 INFO:teuthology.orchestra.run.smithi055.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-05-27T12:29:44.588 INFO:teuthology.orchestra.run.smithi055.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-05-27T12:29:44.588 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-27T12:29:44.588 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-27T12:29:44.588 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-05-27T12:29:44.588 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-27T12:29:44.588 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-27T12:29:44.588 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-05-27T12:29:44.589 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-27T12:29:44.589 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-27T12:29:44.589 INFO:teuthology.orchestra.run.smithi055.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-27T12:29:44.589 INFO:teuthology.orchestra.run.smithi055.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-27T12:29:44.589 INFO:teuthology.orchestra.run.smithi055.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-27T12:29:44.589 INFO:teuthology.orchestra.run.smithi055.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-27T12:29:44.589 INFO:teuthology.orchestra.run.smithi055.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-27T12:29:44.589 INFO:teuthology.orchestra.run.smithi055.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-27T12:29:44.589 INFO:teuthology.orchestra.run.smithi055.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-27T12:29:44.589 INFO:teuthology.orchestra.run.smithi055.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-27T12:29:44.589 INFO:teuthology.orchestra.run.smithi055.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-27T12:29:44.589 INFO:teuthology.orchestra.run.smithi055.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-05-27T12:29:44.590 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-27T12:29:44.590 INFO:teuthology.orchestra.run.smithi055.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-27T12:29:44.590 INFO:teuthology.orchestra.run.smithi055.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-27T12:29:44.590 INFO:teuthology.orchestra.run.smithi055.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-27T12:29:44.590 INFO:teuthology.orchestra.run.smithi055.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-05-27T12:29:44.590 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-27T12:29:44.590 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-27T12:29:44.590 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-27T12:29:44.590 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-27T12:29:44.590 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-05-27T12:29:44.590 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-27T12:29:44.590 INFO:teuthology.orchestra.run.smithi055.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-27T12:29:44.590 INFO:teuthology.orchestra.run.smithi055.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-27T12:29:44.591 INFO:teuthology.orchestra.run.smithi055.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-27T12:29:44.591 INFO:teuthology.orchestra.run.smithi055.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-27T12:29:44.591 INFO:teuthology.orchestra.run.smithi055.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-27T12:29:44.591 INFO:teuthology.orchestra.run.smithi055.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-27T12:29:44.591 INFO:teuthology.orchestra.run.smithi055.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-27T12:29:44.591 INFO:teuthology.orchestra.run.smithi055.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-27T12:29:44.591 INFO:teuthology.orchestra.run.smithi055.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-27T12:29:44.591 INFO:teuthology.orchestra.run.smithi055.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-27T12:29:44.591 INFO:teuthology.orchestra.run.smithi055.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-05-27T12:29:44.591 INFO:teuthology.orchestra.run.smithi055.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-27T12:29:44.591 INFO:teuthology.orchestra.run.smithi055.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-27T12:29:44.591 INFO:teuthology.orchestra.run.smithi055.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-27T12:29:44.592 INFO:teuthology.orchestra.run.smithi055.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-27T12:29:44.592 INFO:teuthology.orchestra.run.smithi055.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-05-27T12:29:44.592 INFO:teuthology.orchestra.run.smithi055.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-05-27T12:29:44.592 INFO:teuthology.orchestra.run.smithi055.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-05-27T12:29:44.592 INFO:teuthology.orchestra.run.smithi055.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-27T12:29:44.592 INFO:teuthology.orchestra.run.smithi055.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-27T12:29:44.592 INFO:teuthology.orchestra.run.smithi055.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-05-27T12:29:44.592 INFO:teuthology.orchestra.run.smithi055.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-27T12:29:44.592 INFO:teuthology.orchestra.run.smithi055.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-05-27T12:29:44.592 INFO:teuthology.orchestra.run.smithi055.stdout:Installing weak dependencies: 2024-05-27T12:29:44.592 INFO:teuthology.orchestra.run.smithi055.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-05-27T12:29:44.592 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-27T12:29:44.592 INFO:teuthology.orchestra.run.smithi055.stdout:Transaction Summary 2024-05-27T12:29:44.593 INFO:teuthology.orchestra.run.smithi055.stdout:======================================================================================= 2024-05-27T12:29:44.593 INFO:teuthology.orchestra.run.smithi055.stdout:Install 148 Packages 2024-05-27T12:29:44.593 INFO:teuthology.orchestra.run.smithi055.stdout:Upgrade 11 Packages 2024-05-27T12:29:44.593 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-27T12:29:44.593 INFO:teuthology.orchestra.run.smithi055.stdout:Total download size: 226 M 2024-05-27T12:29:44.593 INFO:teuthology.orchestra.run.smithi055.stdout:Downloading Packages: 2024-05-27T12:29:45.849 INFO:teuthology.orchestra.run.smithi055.stdout:(1/159): ceph-19.0.0-3154.g81797d87.el9.x86_64. 31 kB/s | 6.6 kB 00:00 2024-05-27T12:29:46.367 INFO:teuthology.orchestra.run.smithi055.stdout:(2/159): ceph-fuse-19.0.0-3154.g81797d87.el9.x8 1.7 MB/s | 890 kB 00:00 2024-05-27T12:29:46.458 INFO:teuthology.orchestra.run.smithi055.stdout:(3/159): ceph-immutable-object-cache-19.0.0-315 1.5 MB/s | 145 kB 00:00 2024-05-27T12:29:46.950 INFO:teuthology.orchestra.run.smithi055.stdout:(4/159): ceph-common-19.0.0-3154.g81797d87.el9. 16 MB/s | 21 MB 00:01 2024-05-27T12:29:47.067 INFO:teuthology.orchestra.run.smithi055.stdout:(5/159): ceph-mgr-19.0.0-3154.g81797d87.el9.x86 13 MB/s | 1.5 MB 00:00 2024-05-27T12:29:47.359 INFO:teuthology.orchestra.run.smithi055.stdout:(6/159): ceph-mon-19.0.0-3154.g81797d87.el9.x86 16 MB/s | 4.7 MB 00:00 2024-05-27T12:29:47.526 INFO:teuthology.orchestra.run.smithi055.stdout:(7/159): ceph-mds-19.0.0-3154.g81797d87.el9.x86 2.2 MB/s | 2.4 MB 00:01 2024-05-27T12:29:47.793 INFO:teuthology.orchestra.run.smithi055.stdout:(8/159): ceph-base-19.0.0-3154.g81797d87.el9.x8 2.5 MB/s | 5.4 MB 00:02 2024-05-27T12:29:47.877 INFO:teuthology.orchestra.run.smithi055.stdout:(9/159): ceph-selinux-19.0.0-3154.g81797d87.el9 302 kB/s | 25 kB 00:00 2024-05-27T12:29:48.227 INFO:teuthology.orchestra.run.smithi055.stdout:(10/159): ceph-osd-19.0.0-3154.g81797d87.el9.x8 19 MB/s | 17 MB 00:00 2024-05-27T12:29:48.278 INFO:teuthology.orchestra.run.smithi055.stdout:(11/159): cephfs-mirror-19.0.0-3154.g81797d87.e 4.4 MB/s | 224 kB 00:00 2024-05-27T12:29:48.336 INFO:teuthology.orchestra.run.smithi055.stdout:(12/159): cephfs-shell-19.0.0-3154.g81797d87.el 465 kB/s | 27 kB 00:00 2024-05-27T12:29:48.395 INFO:teuthology.orchestra.run.smithi055.stdout:(13/159): libcephfs-devel-19.0.0-3154.g81797d87 543 kB/s | 32 kB 00:00 2024-05-27T12:29:48.487 INFO:teuthology.orchestra.run.smithi055.stdout:(14/159): libcephfs2-19.0.0-3154.g81797d87.el9. 8.0 MB/s | 747 kB 00:00 2024-05-27T12:29:48.537 INFO:teuthology.orchestra.run.smithi055.stdout:(15/159): libcephsqlite-19.0.0-3154.g81797d87.e 3.2 MB/s | 163 kB 00:00 2024-05-27T12:29:48.587 INFO:teuthology.orchestra.run.smithi055.stdout:(16/159): librados-devel-19.0.0-3154.g81797d87. 2.5 MB/s | 127 kB 00:00 2024-05-27T12:29:48.663 INFO:teuthology.orchestra.run.smithi055.stdout:(17/159): libradosstriper1-19.0.0-3154.g81797d8 6.5 MB/s | 501 kB 00:00 2024-05-27T12:29:49.080 INFO:teuthology.orchestra.run.smithi055.stdout:(18/159): librgw2-19.0.0-3154.g81797d87.el9.x86 13 MB/s | 5.4 MB 00:00 2024-05-27T12:29:49.147 INFO:teuthology.orchestra.run.smithi055.stdout:(19/159): python3-ceph-argparse-19.0.0-3154.g81 681 kB/s | 45 kB 00:00 2024-05-27T12:29:49.222 INFO:teuthology.orchestra.run.smithi055.stdout:(20/159): python3-ceph-common-19.0.0-3154.g8179 1.8 MB/s | 135 kB 00:00 2024-05-27T12:29:49.297 INFO:teuthology.orchestra.run.smithi055.stdout:(21/159): python3-cephfs-19.0.0-3154.g81797d87. 2.1 MB/s | 161 kB 00:00 2024-05-27T12:29:49.372 INFO:teuthology.orchestra.run.smithi055.stdout:(22/159): python3-rados-19.0.0-3154.g81797d87.e 4.2 MB/s | 321 kB 00:00 2024-05-27T12:29:49.448 INFO:teuthology.orchestra.run.smithi055.stdout:(23/159): python3-rbd-19.0.0-3154.g81797d87.el9 3.9 MB/s | 298 kB 00:00 2024-05-27T12:29:49.515 INFO:teuthology.orchestra.run.smithi055.stdout:(24/159): python3-rgw-19.0.0-3154.g81797d87.el9 1.5 MB/s | 99 kB 00:00 2024-05-27T12:29:49.573 INFO:teuthology.orchestra.run.smithi055.stdout:(25/159): rbd-fuse-19.0.0-3154.g81797d87.el9.x8 1.4 MB/s | 85 kB 00:00 2024-05-27T12:29:49.874 INFO:teuthology.orchestra.run.smithi055.stdout:(26/159): rbd-mirror-19.0.0-3154.g81797d87.el9. 10 MB/s | 3.1 MB 00:00 2024-05-27T12:29:49.949 INFO:teuthology.orchestra.run.smithi055.stdout:(27/159): rbd-nbd-19.0.0-3154.g81797d87.el9.x86 2.2 MB/s | 170 kB 00:00 2024-05-27T12:29:50.000 INFO:teuthology.orchestra.run.smithi055.stdout:(28/159): ceph-grafana-dashboards-19.0.0-3154.g 684 kB/s | 34 kB 00:00 2024-05-27T12:29:50.050 INFO:teuthology.orchestra.run.smithi055.stdout:(29/159): ceph-mgr-cephadm-19.0.0-3154.g81797d8 2.8 MB/s | 142 kB 00:00 2024-05-27T12:29:50.408 INFO:teuthology.orchestra.run.smithi055.stdout:(30/159): ceph-mgr-dashboard-19.0.0-3154.g81797 9.9 MB/s | 3.5 MB 00:00 2024-05-27T12:29:51.125 INFO:teuthology.orchestra.run.smithi055.stdout:(31/159): ceph-mgr-diskprediction-local-19.0.0- 10 MB/s | 7.4 MB 00:00 2024-05-27T12:29:51.192 INFO:teuthology.orchestra.run.smithi055.stdout:(32/159): ceph-mgr-modules-core-19.0.0-3154.g81 3.7 MB/s | 252 kB 00:00 2024-05-27T12:29:51.234 INFO:teuthology.orchestra.run.smithi055.stdout:(33/159): ceph-mgr-rook-19.0.0-3154.g81797d87.e 1.2 MB/s | 49 kB 00:00 2024-05-27T12:29:51.685 INFO:teuthology.orchestra.run.smithi055.stdout:(34/159): ceph-test-19.0.0-3154.g81797d87.el9.x 13 MB/s | 49 MB 00:03 2024-05-27T12:29:51.710 INFO:teuthology.orchestra.run.smithi055.stdout:(35/159): ceph-prometheus-alerts-19.0.0-3154.g8 35 kB/s | 16 kB 00:00 2024-05-27T12:29:51.827 INFO:teuthology.orchestra.run.smithi055.stdout:(36/159): ceph-radosgw-19.0.0-3154.g81797d87.el 2.5 MB/s | 11 MB 00:04 2024-05-27T12:29:51.852 INFO:teuthology.orchestra.run.smithi055.stdout:(37/159): ceph-volume-19.0.0-3154.g81797d87.el9 1.6 MB/s | 273 kB 00:00 2024-05-27T12:29:51.886 INFO:teuthology.orchestra.run.smithi055.stdout:(38/159): cephadm-19.0.0-3154.g81797d87.el9.noa 4.2 MB/s | 763 kB 00:00 2024-05-27T12:29:51.911 INFO:teuthology.orchestra.run.smithi055.stdout:(39/159): cephfs-top-19.0.0-3154.g81797d87.el9. 218 kB/s | 18 kB 00:00 2024-05-27T12:29:51.954 INFO:teuthology.orchestra.run.smithi055.stdout:(40/159): fuse-2.9.9-15.el9.x86_64.rpm 799 kB/s | 80 kB 00:00 2024-05-27T12:29:52.003 INFO:teuthology.orchestra.run.smithi055.stdout:(41/159): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.9 MB/s | 253 kB 00:00 2024-05-27T12:29:52.045 INFO:teuthology.orchestra.run.smithi055.stdout:(42/159): libquadmath-11.4.1-3.el9.x86_64.rpm 1.4 MB/s | 195 kB 00:00 2024-05-27T12:29:52.079 INFO:teuthology.orchestra.run.smithi055.stdout:(43/159): libgfortran-11.4.1-3.el9.x86_64.rpm 4.1 MB/s | 803 kB 00:00 2024-05-27T12:29:52.105 INFO:teuthology.orchestra.run.smithi055.stdout:(44/159): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-05-27T12:29:52.129 INFO:teuthology.orchestra.run.smithi055.stdout:(45/159): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-05-27T12:29:52.155 INFO:teuthology.orchestra.run.smithi055.stdout:(46/159): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-05-27T12:29:52.180 INFO:teuthology.orchestra.run.smithi055.stdout:(47/159): python3-urllib3-1.26.5-5.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-05-27T12:29:52.222 INFO:teuthology.orchestra.run.smithi055.stdout:(48/159): python3-cryptography-36.0.1-4.el9.x86 5.6 MB/s | 1.2 MB 00:00 2024-05-27T12:29:52.339 INFO:teuthology.orchestra.run.smithi055.stdout:(49/159): automake-1.16.2-8.el9.noarch.rpm 3.7 MB/s | 689 kB 00:00 2024-05-27T12:29:52.364 INFO:teuthology.orchestra.run.smithi055.stdout:(50/159): boost-program-options-1.75.0-8.el9.x8 754 kB/s | 107 kB 00:00 2024-05-27T12:29:52.390 INFO:teuthology.orchestra.run.smithi055.stdout:(51/159): elfutils-libelf-devel-0.191-4.el9.x86 431 kB/s | 22 kB 00:00 2024-05-27T12:29:52.423 INFO:teuthology.orchestra.run.smithi055.stdout:(52/159): bison-3.7.4-5.el9.x86_64.rpm 3.8 MB/s | 943 kB 00:00 2024-05-27T12:29:52.448 INFO:teuthology.orchestra.run.smithi055.stdout:(53/159): flexiblas-3.0.4-8.el9.x86_64.rpm 560 kB/s | 33 kB 00:00 2024-05-27T12:29:52.474 INFO:teuthology.orchestra.run.smithi055.stdout:(54/159): flex-2.6.4-9.el9.x86_64.rpm 2.8 MB/s | 313 kB 00:00 2024-05-27T12:29:52.499 INFO:teuthology.orchestra.run.smithi055.stdout:(55/159): flexiblas-openblas-openmp-3.0.4-8.el9 362 kB/s | 18 kB 00:00 2024-05-27T12:29:52.524 INFO:teuthology.orchestra.run.smithi055.stdout:(56/159): libaio-devel-0.3.111-13.el9.x86_64.rp 222 kB/s | 11 kB 00:00 2024-05-27T12:29:52.550 INFO:teuthology.orchestra.run.smithi055.stdout:(57/159): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-05-27T12:29:52.575 INFO:teuthology.orchestra.run.smithi055.stdout:(58/159): librabbitmq-0.11.0-7.el9.x86_64.rpm 899 kB/s | 45 kB 00:00 2024-05-27T12:29:52.608 INFO:teuthology.orchestra.run.smithi055.stdout:(59/159): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 662 kB 00:00 2024-05-27T12:29:52.642 INFO:teuthology.orchestra.run.smithi055.stdout:(60/159): libtool-2.4.6-45.el9.x86_64.rpm 8.5 MB/s | 582 kB 00:00 2024-05-27T12:29:52.667 INFO:teuthology.orchestra.run.smithi055.stdout:(61/159): libuuid-devel-2.37.4-18.el9.x86_64.rp 434 kB/s | 25 kB 00:00 2024-05-27T12:29:52.673 INFO:teuthology.orchestra.run.smithi072.stdout:Extra Packages for Enterprise Linux 1.0 MB/s | 21 MB 00:20 2024-05-27T12:29:52.693 INFO:teuthology.orchestra.run.smithi055.stdout:(62/159): libzstd-devel-1.5.1-2.el9.x86_64.rpm 944 kB/s | 47 kB 00:00 2024-05-27T12:29:52.718 INFO:teuthology.orchestra.run.smithi055.stdout:(63/159): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.7 MB/s | 292 kB 00:00 2024-05-27T12:29:52.743 INFO:teuthology.orchestra.run.smithi055.stdout:(64/159): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 188 kB 00:00 2024-05-27T12:29:52.769 INFO:teuthology.orchestra.run.smithi055.stdout:(65/159): openblas-0.3.21-2.el9.x86_64.rpm 696 kB/s | 35 kB 00:00 2024-05-27T12:29:52.836 INFO:teuthology.orchestra.run.smithi055.stdout:(66/159): flexiblas-netlib-3.0.4-8.el9.x86_64.r 7.3 MB/s | 3.0 MB 00:00 2024-05-27T12:29:52.928 INFO:teuthology.orchestra.run.smithi055.stdout:(67/159): openblas-openmp-0.3.21-2.el9.x86_64.r 26 MB/s | 4.7 MB 00:00 2024-05-27T12:29:53.003 INFO:teuthology.orchestra.run.smithi055.stdout:(68/159): openssl-devel-3.2.1-1.el9.x86_64.rpm 19 MB/s | 4.4 MB 00:00 2024-05-27T12:29:53.045 INFO:teuthology.orchestra.run.smithi055.stdout:(69/159): postgresql-13.14-1.el9.x86_64.rpm 7.6 MB/s | 1.6 MB 00:00 2024-05-27T12:29:53.070 INFO:teuthology.orchestra.run.smithi055.stdout:(70/159): postgresql-private-libs-13.14-1.el9.x 2.0 MB/s | 133 kB 00:00 2024-05-27T12:29:53.112 INFO:teuthology.orchestra.run.smithi055.stdout:(71/159): postgresql-contrib-13.14-1.el9.x86_64 4.8 MB/s | 911 kB 00:00 2024-05-27T12:29:53.154 INFO:teuthology.orchestra.run.smithi055.stdout:(72/159): protobuf-3.14.0-13.el9.x86_64.rpm 12 MB/s | 1.0 MB 00:00 2024-05-27T12:29:53.181 INFO:teuthology.orchestra.run.smithi055.stdout:(73/159): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 87 kB 00:00 2024-05-27T12:29:53.221 INFO:teuthology.orchestra.run.smithi055.stdout:(74/159): python3-colorama-0.4.6-3.el9.noarch.r 1.4 MB/s | 61 kB 00:00 2024-05-27T12:29:53.305 INFO:teuthology.orchestra.run.smithi055.stdout:(75/159): postgresql-server-13.14-1.el9.x86_64. 22 MB/s | 5.8 MB 00:00 2024-05-27T12:29:53.330 INFO:teuthology.orchestra.run.smithi055.stdout:(76/159): python3-devel-3.9.18-3.el9.x86_64.rpm 2.2 MB/s | 244 kB 00:00 2024-05-27T12:29:53.356 INFO:teuthology.orchestra.run.smithi055.stdout:(77/159): python3-jinja2-2.11.3-6.el9.noarch.rp 4.9 MB/s | 248 kB 00:00 2024-05-27T12:29:53.372 INFO:teuthology.orchestra.run.smithi055.stdout:(78/159): python3-jsonpatch-1.21-16.el9.noarch. 614 kB/s | 26 kB 00:00 2024-05-27T12:29:53.390 INFO:teuthology.orchestra.run.smithi055.stdout:(79/159): python3-jsonpointer-2.0-4.el9.noarch. 573 kB/s | 19 kB 00:00 2024-05-27T12:29:53.415 INFO:teuthology.orchestra.run.smithi055.stdout:(80/159): python3-mako-1.1.4-6.el9.noarch.rpm 4.0 MB/s | 172 kB 00:00 2024-05-27T12:29:53.432 INFO:teuthology.orchestra.run.smithi055.stdout:(81/159): python3-markupsafe-1.1.1-12.el9.x86_6 835 kB/s | 35 kB 00:00 2024-05-27T12:29:53.515 INFO:teuthology.orchestra.run.smithi055.stdout:(82/159): python3-babel-2.9.1-2.el9.noarch.rpm 17 MB/s | 6.0 MB 00:00 2024-05-27T12:29:53.541 INFO:teuthology.orchestra.run.smithi055.stdout:(83/159): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.3 MB/s | 250 kB 00:00 2024-05-27T12:29:53.566 INFO:teuthology.orchestra.run.smithi055.stdout:(84/159): python3-oauthlib-3.1.1-5.el9.noarch.r 4.3 MB/s | 222 kB 00:00 2024-05-27T12:29:53.591 INFO:teuthology.orchestra.run.smithi055.stdout:(85/159): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-05-27T12:29:53.616 INFO:teuthology.orchestra.run.smithi055.stdout:(86/159): python3-prettytable-0.7.2-27.el9.noar 841 kB/s | 42 kB 00:00 2024-05-27T12:29:53.642 INFO:teuthology.orchestra.run.smithi055.stdout:(87/159): python3-protobuf-3.14.0-13.el9.noarch 5.2 MB/s | 269 kB 00:00 2024-05-27T12:29:53.667 INFO:teuthology.orchestra.run.smithi055.stdout:(88/159): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-05-27T12:29:53.693 INFO:teuthology.orchestra.run.smithi055.stdout:(89/159): python3-pyasn1-modules-0.4.8-6.el9.no 5.4 MB/s | 279 kB 00:00 2024-05-27T12:29:53.718 INFO:teuthology.orchestra.run.smithi055.stdout:(90/159): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-05-27T12:29:53.743 INFO:teuthology.orchestra.run.smithi055.stdout:(91/159): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-05-27T12:29:53.827 INFO:teuthology.orchestra.run.smithi055.stdout:(92/159): python3-numpy-1.20.1-5.el9.x86_64.rpm 12 MB/s | 5.1 MB 00:00 2024-05-27T12:29:53.852 INFO:teuthology.orchestra.run.smithi055.stdout:(93/159): python3-toml-0.10.2-6.el9.noarch.rpm 382 kB/s | 42 kB 00:00 2024-05-27T12:29:53.878 INFO:teuthology.orchestra.run.smithi055.stdout:(94/159): python3-wcwidth-0.2.5-8.el9.noarch.rp 878 kB/s | 44 kB 00:00 2024-05-27T12:29:53.903 INFO:teuthology.orchestra.run.smithi055.stdout:(95/159): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-05-27T12:29:53.928 INFO:teuthology.orchestra.run.smithi055.stdout:(96/159): qatlib-service-24.02.0-1.el9.x86_64.r 713 kB/s | 36 kB 00:00 2024-05-27T12:29:53.954 INFO:teuthology.orchestra.run.smithi055.stdout:(97/159): qatzip-libs-1.2.0-1.el9.x86_64.rpm 945 kB/s | 47 kB 00:00 2024-05-27T12:29:53.979 INFO:teuthology.orchestra.run.smithi055.stdout:(98/159): socat-1.7.4.1-5.el9.x86_64.rpm 5.9 MB/s | 305 kB 00:00 2024-05-27T12:29:54.021 INFO:teuthology.orchestra.run.smithi055.stdout:(99/159): uuid-1.6.2-55.el9.x86_64.rpm 863 kB/s | 58 kB 00:00 2024-05-27T12:29:54.046 INFO:teuthology.orchestra.run.smithi055.stdout:(100/159): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 1.4 MB/s | 94 kB 00:00 2024-05-27T12:29:54.072 INFO:teuthology.orchestra.run.smithi055.stdout:(101/159): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-05-27T12:29:54.097 INFO:teuthology.orchestra.run.smithi055.stdout:(102/159): zlib-devel-1.2.11-41.el9.x86_64.rpm 895 kB/s | 45 kB 00:00 2024-05-27T12:29:54.122 INFO:teuthology.orchestra.run.smithi055.stdout:(103/159): lua-devel-5.4.4-4.el9.x86_64.rpm 445 kB/s | 22 kB 00:00 2024-05-27T12:29:54.222 INFO:teuthology.orchestra.run.smithi055.stdout:(104/159): protobuf-compiler-3.14.0-13.el9.x86_ 6.7 MB/s | 863 kB 00:00 2024-05-27T12:29:54.389 INFO:teuthology.orchestra.run.smithi055.stdout:(105/159): python3-scipy-1.6.2-8.el9.x86_64.rpm 24 MB/s | 16 MB 00:00 2024-05-27T12:29:54.556 INFO:teuthology.orchestra.run.smithi055.stdout:(106/159): grpc-data-1.46.7-10.el9.noarch.rpm 140 kB/s | 19 kB 00:00 2024-05-27T12:29:54.623 INFO:teuthology.orchestra.run.smithi055.stdout:(107/159): abseil-cpp-20211102.0-3.el9.x86_64.r 1.1 MB/s | 548 kB 00:00 2024-05-27T12:29:54.665 INFO:teuthology.orchestra.run.smithi055.stdout:(108/159): libarrow-doc-9.0.0-11.el9.noarch.rpm 624 kB/s | 26 kB 00:00 2024-05-27T12:29:54.690 INFO:teuthology.orchestra.run.smithi055.stdout:(109/159): gperftools-libs-2.9.1-2.el9.x86_64.r 661 kB/s | 309 kB 00:00 2024-05-27T12:29:54.716 INFO:teuthology.orchestra.run.smithi055.stdout:(110/159): liboath-2.6.7-2.el9.x86_64.rpm 970 kB/s | 49 kB 00:00 2024-05-27T12:29:54.766 INFO:teuthology.orchestra.run.smithi055.stdout:(111/159): libunwind-1.6.2-1.el9.x86_64.rpm 894 kB/s | 67 kB 00:00 2024-05-27T12:29:54.791 INFO:teuthology.orchestra.run.smithi055.stdout:(112/159): luarocks-3.9.2-5.el9.noarch.rpm 2.0 MB/s | 151 kB 00:00 2024-05-27T12:29:54.992 INFO:teuthology.orchestra.run.smithi055.stdout:(113/159): python3-asyncssh-2.13.2-5.el9.noarch 2.7 MB/s | 548 kB 00:00 2024-05-27T12:29:55.034 INFO:teuthology.orchestra.run.smithi055.stdout:(114/159): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.0 MB/s | 43 kB 00:00 2024-05-27T12:29:55.084 INFO:teuthology.orchestra.run.smithi055.stdout:(115/159): python3-cachetools-4.2.4-1.el9.noarc 646 kB/s | 32 kB 00:00 2024-05-27T12:29:55.126 INFO:teuthology.orchestra.run.smithi055.stdout:(116/159): python3-certifi-2021.10.8-2.el9.noar 361 kB/s | 15 kB 00:00 2024-05-27T12:29:55.184 INFO:teuthology.orchestra.run.smithi055.stdout:(117/159): parquet-libs-9.0.0-11.el9.x86_64.rpm 2.0 MB/s | 839 kB 00:00 2024-05-27T12:29:55.243 INFO:teuthology.orchestra.run.smithi055.stdout:(118/159): python3-cheroot-8.6.0-4.el9.noarch.r 1.4 MB/s | 172 kB 00:00 2024-05-27T12:29:55.360 INFO:teuthology.orchestra.run.smithi055.stdout:(119/159): python3-cherrypy-18.6.1-2.el9.noarch 2.0 MB/s | 358 kB 00:00 2024-05-27T12:29:55.385 INFO:teuthology.orchestra.run.smithi055.stdout:(120/159): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.1 MB/s | 303 kB 00:00 2024-05-27T12:29:55.469 INFO:teuthology.orchestra.run.smithi055.stdout:(121/159): python3-google-auth-2.29.0-1.el9.noa 1.8 MB/s | 206 kB 00:00 2024-05-27T12:29:55.545 INFO:teuthology.orchestra.run.smithi055.stdout:(122/159): python3-grpcio-tools-1.46.7-10.el9.x 1.9 MB/s | 144 kB 00:00 2024-05-27T12:29:55.586 INFO:teuthology.orchestra.run.smithi055.stdout:(123/159): python3-jaraco-8.2.1-3.el9.noarch.rp 258 kB/s | 11 kB 00:00 2024-05-27T12:29:55.629 INFO:teuthology.orchestra.run.smithi055.stdout:(124/159): python3-jaraco-classes-3.2.1-5.el9.n 424 kB/s | 18 kB 00:00 2024-05-27T12:29:55.670 INFO:teuthology.orchestra.run.smithi055.stdout:(125/159): python3-jaraco-collections-3.0.0-8.e 559 kB/s | 23 kB 00:00 2024-05-27T12:29:55.712 INFO:teuthology.orchestra.run.smithi055.stdout:(126/159): python3-jaraco-functools-3.5.0-2.el9 466 kB/s | 19 kB 00:00 2024-05-27T12:29:55.755 INFO:teuthology.orchestra.run.smithi055.stdout:(127/159): python3-jaraco-text-3.2.0-6.el9.noar 474 kB/s | 20 kB 00:00 2024-05-27T12:29:56.072 INFO:teuthology.orchestra.run.smithi055.stdout:(128/159): python3-grpcio-1.46.7-10.el9.x86_64. 3.0 MB/s | 2.0 MB 00:00 2024-05-27T12:29:56.113 INFO:teuthology.orchestra.run.smithi055.stdout:(129/159): python3-logutils-0.3.5-21.el9.noarch 1.1 MB/s | 46 kB 00:00 2024-05-27T12:29:56.164 INFO:teuthology.orchestra.run.smithi055.stdout:(130/159): python3-kubernetes-26.1.0-2.el9.noar 2.5 MB/s | 1.0 MB 00:00 2024-05-27T12:29:56.189 INFO:teuthology.orchestra.run.smithi055.stdout:(131/159): python3-more-itertools-8.12.0-2.el9. 1.0 MB/s | 79 kB 00:00 2024-05-27T12:29:56.214 INFO:teuthology.orchestra.run.smithi055.stdout:(132/159): python3-natsort-7.1.1-5.el9.noarch.r 1.1 MB/s | 58 kB 00:00 2024-05-27T12:29:56.256 INFO:teuthology.orchestra.run.smithi055.stdout:(133/159): python3-portend-3.1.0-2.el9.noarch.r 394 kB/s | 16 kB 00:00 2024-05-27T12:29:56.324 INFO:teuthology.orchestra.run.smithi055.stdout:(134/159): libarrow-9.0.0-11.el9.x86_64.rpm 2.5 MB/s | 4.4 MB 00:01 2024-05-27T12:29:56.357 INFO:teuthology.orchestra.run.smithi055.stdout:(135/159): python3-pyOpenSSL-21.0.0-1.el9.noarc 898 kB/s | 90 kB 00:00 2024-05-27T12:29:56.382 INFO:teuthology.orchestra.run.smithi055.stdout:(136/159): python3-pyperclip-1.8.2-2.el9.noarch 482 kB/s | 28 kB 00:00 2024-05-27T12:29:56.416 INFO:teuthology.orchestra.run.smithi055.stdout:(137/159): python3-pecan-1.4.2-3.el9.noarch.rpm 1.2 MB/s | 272 kB 00:00 2024-05-27T12:29:56.441 INFO:teuthology.orchestra.run.smithi055.stdout:(138/159): python3-repoze-lru-0.7-16.el9.noarch 367 kB/s | 31 kB 00:00 2024-05-27T12:29:56.466 INFO:teuthology.orchestra.run.smithi055.stdout:(139/159): python3-rsa-4.9-2.el9.noarch.rpm 1.1 MB/s | 59 kB 00:00 2024-05-27T12:29:56.492 INFO:teuthology.orchestra.run.smithi055.stdout:(140/159): python3-tempora-5.0.0-2.el9.noarch.r 713 kB/s | 36 kB 00:00 2024-05-27T12:29:56.517 INFO:teuthology.orchestra.run.smithi055.stdout:(141/159): python3-typing-extensions-4.4.0-2.el 1.0 MB/s | 51 kB 00:00 2024-05-27T12:29:56.534 INFO:teuthology.orchestra.run.smithi055.stdout:(142/159): python3-routes-2.5.1-5.el9.noarch.rp 1.2 MB/s | 188 kB 00:00 2024-05-27T12:29:56.576 INFO:teuthology.orchestra.run.smithi055.stdout:(143/159): python3-websocket-client-1.2.3-2.el9 1.5 MB/s | 90 kB 00:00 2024-05-27T12:29:56.601 INFO:teuthology.orchestra.run.smithi055.stdout:(144/159): python3-webob-1.8.7-6.el9.noarch.rpm 2.1 MB/s | 230 kB 00:00 2024-05-27T12:29:56.626 INFO:teuthology.orchestra.run.smithi055.stdout:(145/159): python3-zc-lockfile-2.0-10.el9.noarc 398 kB/s | 20 kB 00:00 2024-05-27T12:29:56.685 INFO:teuthology.orchestra.run.smithi055.stdout:(146/159): re2-20211101-3.el9.x86_64.rpm 2.2 MB/s | 192 kB 00:00 2024-05-27T12:29:56.793 INFO:teuthology.orchestra.run.smithi055.stdout:(147/159): python3-werkzeug-2.0.3-3.el9.1.noarc 1.6 MB/s | 427 kB 00:00 2024-05-27T12:29:57.152 INFO:teuthology.orchestra.run.smithi055.stdout:(148/159): thrift-0.15.0-2.el9.x86_64.rpm 3.0 MB/s | 1.6 MB 00:00 2024-05-27T12:29:57.219 INFO:teuthology.orchestra.run.smithi055.stdout:(149/159): librbd1-19.0.0-3154.g81797d87.el9.x8 7.4 MB/s | 3.1 MB 00:00 2024-05-27T12:29:57.328 INFO:teuthology.orchestra.run.smithi055.stdout:(150/159): NetworkManager-1.47.90-1.el9.x86_64. 13 MB/s | 2.3 MB 00:00 2024-05-27T12:29:57.370 INFO:teuthology.orchestra.run.smithi055.stdout:(151/159): NetworkManager-team-1.47.90-1.el9.x8 1.0 MB/s | 41 kB 00:00 2024-05-27T12:29:57.429 INFO:teuthology.orchestra.run.smithi055.stdout:(152/159): NetworkManager-libnm-1.47.90-1.el9.x 8.6 MB/s | 1.8 MB 00:00 2024-05-27T12:29:57.454 INFO:teuthology.orchestra.run.smithi055.stdout:(153/159): NetworkManager-tui-1.47.90-1.el9.x86 2.9 MB/s | 248 kB 00:00 2024-05-27T12:29:57.471 INFO:teuthology.orchestra.run.smithi055.stdout:(154/159): elfutils-debuginfod-client-0.191-4.e 873 kB/s | 37 kB 00:00 2024-05-27T12:29:57.496 INFO:teuthology.orchestra.run.smithi055.stdout:(155/159): elfutils-libelf-0.191-4.el9.x86_64.r 4.8 MB/s | 207 kB 00:00 2024-05-27T12:29:57.552 INFO:teuthology.orchestra.run.smithi055.stdout:(156/159): elfutils-libs-0.191-4.el9.x86_64.rpm 3.2 MB/s | 260 kB 00:00 2024-05-27T12:29:57.597 INFO:teuthology.orchestra.run.smithi055.stdout:(157/159): openssl-3.2.1-1.el9.x86_64.rpm 13 MB/s | 1.3 MB 00:00 2024-05-27T12:29:57.655 INFO:teuthology.orchestra.run.smithi055.stdout:(158/159): openssl-libs-3.2.1-1.el9.x86_64.rpm 23 MB/s | 2.4 MB 00:00 2024-05-27T12:29:57.747 INFO:teuthology.orchestra.run.smithi055.stdout:(159/159): librados2-19.0.0-3154.g81797d87.el9. 3.2 MB/s | 3.4 MB 00:01 2024-05-27T12:29:57.753 INFO:teuthology.orchestra.run.smithi055.stdout:-------------------------------------------------------------------------------- 2024-05-27T12:29:57.753 INFO:teuthology.orchestra.run.smithi055.stdout:Total 17 MB/s | 226 MB 00:13 2024-05-27T12:29:57.755 INFO:teuthology.orchestra.run.smithi072.stdout:lab-extras 39 kB/s | 1.7 kB 00:00 2024-05-27T12:29:59.031 INFO:teuthology.orchestra.run.smithi055.stdout:Running transaction check 2024-05-27T12:29:59.206 INFO:teuthology.orchestra.run.smithi055.stdout:Transaction check succeeded. 2024-05-27T12:29:59.206 INFO:teuthology.orchestra.run.smithi055.stdout:Running transaction test 2024-05-27T12:30:00.017 INFO:teuthology.orchestra.run.smithi072.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-27T12:30:00.018 INFO:teuthology.orchestra.run.smithi072.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-27T12:30:00.028 INFO:teuthology.orchestra.run.smithi072.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-05-27T12:30:00.029 INFO:teuthology.orchestra.run.smithi072.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-05-27T12:30:00.030 INFO:teuthology.orchestra.run.smithi072.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-05-27T12:30:00.031 INFO:teuthology.orchestra.run.smithi072.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-05-27T12:30:00.032 INFO:teuthology.orchestra.run.smithi072.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-05-27T12:30:00.034 INFO:teuthology.orchestra.run.smithi072.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-05-27T12:30:00.035 INFO:teuthology.orchestra.run.smithi072.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-05-27T12:30:00.099 INFO:teuthology.orchestra.run.smithi072.stdout:Dependencies resolved. 2024-05-27T12:30:00.125 INFO:teuthology.orchestra.run.smithi072.stdout:======================================================================================= 2024-05-27T12:30:00.125 INFO:teuthology.orchestra.run.smithi072.stdout: Package Arch Version Repository Size 2024-05-27T12:30:00.125 INFO:teuthology.orchestra.run.smithi072.stdout:======================================================================================= 2024-05-27T12:30:00.125 INFO:teuthology.orchestra.run.smithi072.stdout:Installing: 2024-05-27T12:30:00.125 INFO:teuthology.orchestra.run.smithi072.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-05-27T12:30:00.125 INFO:teuthology.orchestra.run.smithi072.stdout: ceph x86_64 2:19.0.0-3154.g81797d87.el9 ceph 6.6 k 2024-05-27T12:30:00.125 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-base x86_64 2:19.0.0-3154.g81797d87.el9 ceph 5.4 M 2024-05-27T12:30:00.125 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-fuse x86_64 2:19.0.0-3154.g81797d87.el9 ceph 890 k 2024-05-27T12:30:00.125 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3154.g81797d87.el9 ceph 145 k 2024-05-27T12:30:00.126 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr x86_64 2:19.0.0-3154.g81797d87.el9 ceph 1.5 M 2024-05-27T12:30:00.126 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3154.g81797d87.el9 ceph-noarch 142 k 2024-05-27T12:30:00.126 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3154.g81797d87.el9 ceph-noarch 3.5 M 2024-05-27T12:30:00.126 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3154.g81797d87.el9 ceph-noarch 7.4 M 2024-05-27T12:30:00.126 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-rook noarch 2:19.0.0-3154.g81797d87.el9 ceph-noarch 49 k 2024-05-27T12:30:00.126 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-radosgw x86_64 2:19.0.0-3154.g81797d87.el9 ceph 11 M 2024-05-27T12:30:00.126 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-test x86_64 2:19.0.0-3154.g81797d87.el9 ceph 49 M 2024-05-27T12:30:00.126 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-volume noarch 2:19.0.0-3154.g81797d87.el9 ceph-noarch 273 k 2024-05-27T12:30:00.126 INFO:teuthology.orchestra.run.smithi072.stdout: cephadm noarch 2:19.0.0-3154.g81797d87.el9 ceph-noarch 763 k 2024-05-27T12:30:00.127 INFO:teuthology.orchestra.run.smithi072.stdout: cephfs-mirror x86_64 2:19.0.0-3154.g81797d87.el9 ceph 224 k 2024-05-27T12:30:00.127 INFO:teuthology.orchestra.run.smithi072.stdout: cephfs-shell x86_64 2:19.0.0-3154.g81797d87.el9 ceph 27 k 2024-05-27T12:30:00.127 INFO:teuthology.orchestra.run.smithi072.stdout: cephfs-top noarch 2:19.0.0-3154.g81797d87.el9 ceph-noarch 18 k 2024-05-27T12:30:00.127 INFO:teuthology.orchestra.run.smithi072.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-05-27T12:30:00.127 INFO:teuthology.orchestra.run.smithi072.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-05-27T12:30:00.127 INFO:teuthology.orchestra.run.smithi072.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-05-27T12:30:00.127 INFO:teuthology.orchestra.run.smithi072.stdout: libcephfs-devel x86_64 2:19.0.0-3154.g81797d87.el9 ceph 32 k 2024-05-27T12:30:00.128 INFO:teuthology.orchestra.run.smithi072.stdout: libcephfs2 x86_64 2:19.0.0-3154.g81797d87.el9 ceph 747 k 2024-05-27T12:30:00.128 INFO:teuthology.orchestra.run.smithi072.stdout: librados-devel x86_64 2:19.0.0-3154.g81797d87.el9 ceph 127 k 2024-05-27T12:30:00.128 INFO:teuthology.orchestra.run.smithi072.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-05-27T12:30:00.128 INFO:teuthology.orchestra.run.smithi072.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-05-27T12:30:00.128 INFO:teuthology.orchestra.run.smithi072.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-05-27T12:30:00.128 INFO:teuthology.orchestra.run.smithi072.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-05-27T12:30:00.128 INFO:teuthology.orchestra.run.smithi072.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-05-27T12:30:00.128 INFO:teuthology.orchestra.run.smithi072.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-05-27T12:30:00.128 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cephfs x86_64 2:19.0.0-3154.g81797d87.el9 ceph 161 k 2024-05-27T12:30:00.128 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rados x86_64 2:19.0.0-3154.g81797d87.el9 ceph 321 k 2024-05-27T12:30:00.128 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rbd x86_64 2:19.0.0-3154.g81797d87.el9 ceph 298 k 2024-05-27T12:30:00.128 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rgw x86_64 2:19.0.0-3154.g81797d87.el9 ceph 99 k 2024-05-27T12:30:00.128 INFO:teuthology.orchestra.run.smithi072.stdout: rbd-fuse x86_64 2:19.0.0-3154.g81797d87.el9 ceph 85 k 2024-05-27T12:30:00.129 INFO:teuthology.orchestra.run.smithi072.stdout: rbd-mirror x86_64 2:19.0.0-3154.g81797d87.el9 ceph 3.1 M 2024-05-27T12:30:00.129 INFO:teuthology.orchestra.run.smithi072.stdout: rbd-nbd x86_64 2:19.0.0-3154.g81797d87.el9 ceph 170 k 2024-05-27T12:30:00.129 INFO:teuthology.orchestra.run.smithi072.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-05-27T12:30:00.129 INFO:teuthology.orchestra.run.smithi072.stdout:Upgrading: 2024-05-27T12:30:00.129 INFO:teuthology.orchestra.run.smithi072.stdout: NetworkManager x86_64 1:1.47.90-1.el9 baseos 2.3 M 2024-05-27T12:30:00.129 INFO:teuthology.orchestra.run.smithi072.stdout: NetworkManager-libnm x86_64 1:1.47.90-1.el9 baseos 1.8 M 2024-05-27T12:30:00.129 INFO:teuthology.orchestra.run.smithi072.stdout: NetworkManager-team x86_64 1:1.47.90-1.el9 baseos 41 k 2024-05-27T12:30:00.129 INFO:teuthology.orchestra.run.smithi072.stdout: NetworkManager-tui x86_64 1:1.47.90-1.el9 baseos 248 k 2024-05-27T12:30:00.129 INFO:teuthology.orchestra.run.smithi072.stdout: elfutils-debuginfod-client x86_64 0.191-4.el9 baseos 37 k 2024-05-27T12:30:00.129 INFO:teuthology.orchestra.run.smithi072.stdout: elfutils-libelf x86_64 0.191-4.el9 baseos 207 k 2024-05-27T12:30:00.129 INFO:teuthology.orchestra.run.smithi072.stdout: elfutils-libs x86_64 0.191-4.el9 baseos 260 k 2024-05-27T12:30:00.129 INFO:teuthology.orchestra.run.smithi072.stdout: librados2 x86_64 2:19.0.0-3154.g81797d87.el9 ceph 3.4 M 2024-05-27T12:30:00.129 INFO:teuthology.orchestra.run.smithi072.stdout: librbd1 x86_64 2:19.0.0-3154.g81797d87.el9 ceph 3.1 M 2024-05-27T12:30:00.130 INFO:teuthology.orchestra.run.smithi072.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-05-27T12:30:00.130 INFO:teuthology.orchestra.run.smithi072.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-05-27T12:30:00.130 INFO:teuthology.orchestra.run.smithi072.stdout:Installing dependencies: 2024-05-27T12:30:00.130 INFO:teuthology.orchestra.run.smithi072.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-05-27T12:30:00.130 INFO:teuthology.orchestra.run.smithi072.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-05-27T12:30:00.130 INFO:teuthology.orchestra.run.smithi072.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-05-27T12:30:00.130 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-common x86_64 2:19.0.0-3154.g81797d87.el9 ceph 21 M 2024-05-27T12:30:00.130 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3154.g81797d87.el9 ceph-noarch 34 k 2024-05-27T12:30:00.130 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mds x86_64 2:19.0.0-3154.g81797d87.el9 ceph 2.4 M 2024-05-27T12:30:00.130 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3154.g81797d87.el9 ceph-noarch 252 k 2024-05-27T12:30:00.130 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mon x86_64 2:19.0.0-3154.g81797d87.el9 ceph 4.7 M 2024-05-27T12:30:00.130 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-osd x86_64 2:19.0.0-3154.g81797d87.el9 ceph 17 M 2024-05-27T12:30:00.130 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3154.g81797d87.el9 ceph-noarch 16 k 2024-05-27T12:30:00.131 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-selinux x86_64 2:19.0.0-3154.g81797d87.el9 ceph 25 k 2024-05-27T12:30:00.131 INFO:teuthology.orchestra.run.smithi072.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-27T12:30:00.131 INFO:teuthology.orchestra.run.smithi072.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-27T12:30:00.131 INFO:teuthology.orchestra.run.smithi072.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-27T12:30:00.131 INFO:teuthology.orchestra.run.smithi072.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-27T12:30:00.131 INFO:teuthology.orchestra.run.smithi072.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-27T12:30:00.131 INFO:teuthology.orchestra.run.smithi072.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-05-27T12:30:00.132 INFO:teuthology.orchestra.run.smithi072.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-05-27T12:30:00.132 INFO:teuthology.orchestra.run.smithi072.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-05-27T12:30:00.132 INFO:teuthology.orchestra.run.smithi072.stdout: libcephsqlite x86_64 2:19.0.0-3154.g81797d87.el9 ceph 163 k 2024-05-27T12:30:00.132 INFO:teuthology.orchestra.run.smithi072.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-27T12:30:00.132 INFO:teuthology.orchestra.run.smithi072.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-27T12:30:00.132 INFO:teuthology.orchestra.run.smithi072.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-27T12:30:00.132 INFO:teuthology.orchestra.run.smithi072.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-27T12:30:00.133 INFO:teuthology.orchestra.run.smithi072.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-27T12:30:00.133 INFO:teuthology.orchestra.run.smithi072.stdout: libradosstriper1 x86_64 2:19.0.0-3154.g81797d87.el9 ceph 501 k 2024-05-27T12:30:00.133 INFO:teuthology.orchestra.run.smithi072.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-27T12:30:00.133 INFO:teuthology.orchestra.run.smithi072.stdout: librgw2 x86_64 2:19.0.0-3154.g81797d87.el9 ceph 5.4 M 2024-05-27T12:30:00.133 INFO:teuthology.orchestra.run.smithi072.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-27T12:30:00.133 INFO:teuthology.orchestra.run.smithi072.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-05-27T12:30:00.133 INFO:teuthology.orchestra.run.smithi072.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-27T12:30:00.133 INFO:teuthology.orchestra.run.smithi072.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-05-27T12:30:00.134 INFO:teuthology.orchestra.run.smithi072.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-05-27T12:30:00.134 INFO:teuthology.orchestra.run.smithi072.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-05-27T12:30:00.134 INFO:teuthology.orchestra.run.smithi072.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-27T12:30:00.134 INFO:teuthology.orchestra.run.smithi072.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-27T12:30:00.134 INFO:teuthology.orchestra.run.smithi072.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-05-27T12:30:00.134 INFO:teuthology.orchestra.run.smithi072.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-05-27T12:30:00.134 INFO:teuthology.orchestra.run.smithi072.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-05-27T12:30:00.134 INFO:teuthology.orchestra.run.smithi072.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-05-27T12:30:00.134 INFO:teuthology.orchestra.run.smithi072.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-27T12:30:00.135 INFO:teuthology.orchestra.run.smithi072.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-05-27T12:30:00.135 INFO:teuthology.orchestra.run.smithi072.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-27T12:30:00.135 INFO:teuthology.orchestra.run.smithi072.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-27T12:30:00.135 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-27T12:30:00.135 INFO:teuthology.orchestra.run.smithi072.stdout: python3-ceph-argparse x86_64 2:19.0.0-3154.g81797d87.el9 ceph 45 k 2024-05-27T12:30:00.135 INFO:teuthology.orchestra.run.smithi072.stdout: python3-ceph-common x86_64 2:19.0.0-3154.g81797d87.el9 ceph 135 k 2024-05-27T12:30:00.135 INFO:teuthology.orchestra.run.smithi072.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-27T12:30:00.135 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-27T12:30:00.135 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-27T12:30:00.135 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-27T12:30:00.135 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-05-27T12:30:00.135 INFO:teuthology.orchestra.run.smithi072.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-05-27T12:30:00.135 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-27T12:30:00.136 INFO:teuthology.orchestra.run.smithi072.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-27T12:30:00.136 INFO:teuthology.orchestra.run.smithi072.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-27T12:30:00.136 INFO:teuthology.orchestra.run.smithi072.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-05-27T12:30:00.136 INFO:teuthology.orchestra.run.smithi072.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-05-27T12:30:00.136 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-27T12:30:00.136 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-27T12:30:00.136 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-05-27T12:30:00.136 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-27T12:30:00.137 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-27T12:30:00.137 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-05-27T12:30:00.137 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-27T12:30:00.137 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-27T12:30:00.137 INFO:teuthology.orchestra.run.smithi072.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-27T12:30:00.137 INFO:teuthology.orchestra.run.smithi072.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-27T12:30:00.137 INFO:teuthology.orchestra.run.smithi072.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-27T12:30:00.137 INFO:teuthology.orchestra.run.smithi072.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-27T12:30:00.137 INFO:teuthology.orchestra.run.smithi072.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-27T12:30:00.137 INFO:teuthology.orchestra.run.smithi072.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-27T12:30:00.137 INFO:teuthology.orchestra.run.smithi072.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-27T12:30:00.138 INFO:teuthology.orchestra.run.smithi072.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-27T12:30:00.138 INFO:teuthology.orchestra.run.smithi072.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-27T12:30:00.138 INFO:teuthology.orchestra.run.smithi072.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-05-27T12:30:00.138 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-27T12:30:00.138 INFO:teuthology.orchestra.run.smithi072.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-27T12:30:00.138 INFO:teuthology.orchestra.run.smithi072.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-27T12:30:00.138 INFO:teuthology.orchestra.run.smithi072.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-27T12:30:00.138 INFO:teuthology.orchestra.run.smithi072.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-05-27T12:30:00.138 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-27T12:30:00.138 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-27T12:30:00.139 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-27T12:30:00.139 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-27T12:30:00.139 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-05-27T12:30:00.139 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-27T12:30:00.139 INFO:teuthology.orchestra.run.smithi072.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-27T12:30:00.139 INFO:teuthology.orchestra.run.smithi072.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-27T12:30:00.139 INFO:teuthology.orchestra.run.smithi072.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-27T12:30:00.139 INFO:teuthology.orchestra.run.smithi072.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-27T12:30:00.139 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-27T12:30:00.139 INFO:teuthology.orchestra.run.smithi072.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-27T12:30:00.139 INFO:teuthology.orchestra.run.smithi072.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-27T12:30:00.139 INFO:teuthology.orchestra.run.smithi072.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-27T12:30:00.139 INFO:teuthology.orchestra.run.smithi072.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-27T12:30:00.139 INFO:teuthology.orchestra.run.smithi072.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-27T12:30:00.140 INFO:teuthology.orchestra.run.smithi072.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-05-27T12:30:00.140 INFO:teuthology.orchestra.run.smithi072.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-27T12:30:00.140 INFO:teuthology.orchestra.run.smithi072.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-27T12:30:00.140 INFO:teuthology.orchestra.run.smithi072.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-27T12:30:00.140 INFO:teuthology.orchestra.run.smithi072.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-27T12:30:00.140 INFO:teuthology.orchestra.run.smithi072.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-05-27T12:30:00.140 INFO:teuthology.orchestra.run.smithi072.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-05-27T12:30:00.140 INFO:teuthology.orchestra.run.smithi072.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-05-27T12:30:00.140 INFO:teuthology.orchestra.run.smithi072.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-27T12:30:00.140 INFO:teuthology.orchestra.run.smithi072.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-27T12:30:00.140 INFO:teuthology.orchestra.run.smithi072.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-05-27T12:30:00.140 INFO:teuthology.orchestra.run.smithi072.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-27T12:30:00.140 INFO:teuthology.orchestra.run.smithi072.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-05-27T12:30:00.141 INFO:teuthology.orchestra.run.smithi072.stdout:Installing weak dependencies: 2024-05-27T12:30:00.141 INFO:teuthology.orchestra.run.smithi072.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-05-27T12:30:00.141 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-27T12:30:00.141 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction Summary 2024-05-27T12:30:00.141 INFO:teuthology.orchestra.run.smithi072.stdout:======================================================================================= 2024-05-27T12:30:00.141 INFO:teuthology.orchestra.run.smithi072.stdout:Install 148 Packages 2024-05-27T12:30:00.141 INFO:teuthology.orchestra.run.smithi072.stdout:Upgrade 11 Packages 2024-05-27T12:30:00.141 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-27T12:30:00.142 INFO:teuthology.orchestra.run.smithi072.stdout:Total download size: 226 M 2024-05-27T12:30:00.142 INFO:teuthology.orchestra.run.smithi072.stdout:Downloading Packages: 2024-05-27T12:30:00.601 INFO:teuthology.orchestra.run.smithi072.stdout:(1/159): ceph-19.0.0-3154.g81797d87.el9.x86_64. 31 kB/s | 6.6 kB 00:00 2024-05-27T12:30:01.002 INFO:teuthology.orchestra.run.smithi072.stdout:(2/159): ceph-fuse-19.0.0-3154.g81797d87.el9.x8 2.2 MB/s | 890 kB 00:00 2024-05-27T12:30:01.269 INFO:teuthology.orchestra.run.smithi072.stdout:(3/159): ceph-base-19.0.0-3154.g81797d87.el9.x8 6.1 MB/s | 5.4 MB 00:00 2024-05-27T12:30:01.428 INFO:teuthology.orchestra.run.smithi072.stdout:(4/159): ceph-immutable-object-cache-19.0.0-315 340 kB/s | 145 kB 00:00 2024-05-27T12:30:01.528 INFO:teuthology.orchestra.run.smithi072.stdout:(5/159): ceph-mds-19.0.0-3154.g81797d87.el9.x86 9.1 MB/s | 2.4 MB 00:00 2024-05-27T12:30:01.547 INFO:teuthology.orchestra.run.smithi055.stdout:Transaction test succeeded. 2024-05-27T12:30:01.547 INFO:teuthology.orchestra.run.smithi055.stdout:Running transaction 2024-05-27T12:30:01.887 INFO:teuthology.orchestra.run.smithi072.stdout:(6/159): ceph-mgr-19.0.0-3154.g81797d87.el9.x86 3.3 MB/s | 1.5 MB 00:00 2024-05-27T12:30:01.996 INFO:teuthology.orchestra.run.smithi072.stdout:(7/159): ceph-mon-19.0.0-3154.g81797d87.el9.x86 10 MB/s | 4.7 MB 00:00 2024-05-27T12:30:02.797 INFO:teuthology.orchestra.run.smithi072.stdout:(8/159): ceph-common-19.0.0-3154.g81797d87.el9. 8.8 MB/s | 21 MB 00:02 2024-05-27T12:30:02.856 INFO:teuthology.orchestra.run.smithi072.stdout:(9/159): ceph-selinux-19.0.0-3154.g81797d87.el9 431 kB/s | 25 kB 00:00 2024-05-27T12:30:03.181 INFO:teuthology.orchestra.run.smithi072.stdout:(10/159): ceph-radosgw-19.0.0-3154.g81797d87.el 8.9 MB/s | 11 MB 00:01 2024-05-27T12:30:03.265 INFO:teuthology.orchestra.run.smithi072.stdout:(11/159): cephfs-mirror-19.0.0-3154.g81797d87.e 2.6 MB/s | 224 kB 00:00 2024-05-27T12:30:03.340 INFO:teuthology.orchestra.run.smithi072.stdout:(12/159): cephfs-shell-19.0.0-3154.g81797d87.el 360 kB/s | 27 kB 00:00 2024-05-27T12:30:03.409 INFO:teuthology.orchestra.run.smithi072.stdout:(13/159): libcephfs-devel-19.0.0-3154.g81797d87 464 kB/s | 32 kB 00:00 2024-05-27T12:30:03.560 INFO:teuthology.orchestra.run.smithi072.stdout:(14/159): libcephfs2-19.0.0-3154.g81797d87.el9. 4.9 MB/s | 747 kB 00:00 2024-05-27T12:30:03.644 INFO:teuthology.orchestra.run.smithi072.stdout:(15/159): libcephsqlite-19.0.0-3154.g81797d87.e 1.9 MB/s | 163 kB 00:00 2024-05-27T12:30:03.719 INFO:teuthology.orchestra.run.smithi072.stdout:(16/159): librados-devel-19.0.0-3154.g81797d87. 1.6 MB/s | 127 kB 00:00 2024-05-27T12:30:03.820 INFO:teuthology.orchestra.run.smithi072.stdout:(17/159): libradosstriper1-19.0.0-3154.g81797d8 4.9 MB/s | 501 kB 00:00 2024-05-27T12:30:04.454 INFO:teuthology.orchestra.run.smithi072.stdout:(18/159): librgw2-19.0.0-3154.g81797d87.el9.x86 8.5 MB/s | 5.4 MB 00:00 2024-05-27T12:30:04.538 INFO:teuthology.orchestra.run.smithi072.stdout:(19/159): python3-ceph-argparse-19.0.0-3154.g81 540 kB/s | 45 kB 00:00 2024-05-27T12:30:04.621 INFO:teuthology.orchestra.run.smithi072.stdout:(20/159): python3-ceph-common-19.0.0-3154.g8179 1.6 MB/s | 135 kB 00:00 2024-05-27T12:30:04.714 INFO:teuthology.orchestra.run.smithi072.stdout:(21/159): python3-cephfs-19.0.0-3154.g81797d87. 1.7 MB/s | 161 kB 00:00 2024-05-27T12:30:04.814 INFO:teuthology.orchestra.run.smithi072.stdout:(22/159): python3-rados-19.0.0-3154.g81797d87.e 3.1 MB/s | 321 kB 00:00 2024-05-27T12:30:04.915 INFO:teuthology.orchestra.run.smithi072.stdout:(23/159): python3-rbd-19.0.0-3154.g81797d87.el9 2.9 MB/s | 298 kB 00:00 2024-05-27T12:30:05.191 INFO:teuthology.orchestra.run.smithi072.stdout:(24/159): ceph-osd-19.0.0-3154.g81797d87.el9.x8 5.1 MB/s | 17 MB 00:03 2024-05-27T12:30:05.225 INFO:teuthology.orchestra.run.smithi072.stdout:(25/159): python3-rgw-19.0.0-3154.g81797d87.el9 322 kB/s | 99 kB 00:00 2024-05-27T12:30:05.259 INFO:teuthology.orchestra.run.smithi072.stdout:(26/159): rbd-fuse-19.0.0-3154.g81797d87.el9.x8 1.2 MB/s | 85 kB 00:00 2024-05-27T12:30:05.344 INFO:teuthology.orchestra.run.smithi072.stdout:(27/159): rbd-nbd-19.0.0-3154.g81797d87.el9.x86 2.0 MB/s | 170 kB 00:00 2024-05-27T12:30:05.445 INFO:teuthology.orchestra.run.smithi072.stdout:(28/159): ceph-grafana-dashboards-19.0.0-3154.g 342 kB/s | 34 kB 00:00 2024-05-27T12:30:05.545 INFO:teuthology.orchestra.run.smithi072.stdout:(29/159): ceph-mgr-cephadm-19.0.0-3154.g81797d8 1.4 MB/s | 142 kB 00:00 2024-05-27T12:30:05.620 INFO:teuthology.orchestra.run.smithi072.stdout:(30/159): rbd-mirror-19.0.0-3154.g81797d87.el9. 7.8 MB/s | 3.1 MB 00:00 2024-05-27T12:30:06.838 INFO:teuthology.orchestra.run.smithi072.stdout:(31/159): ceph-test-19.0.0-3154.g81797d87.el9.x 12 MB/s | 49 MB 00:03 2024-05-27T12:30:06.922 INFO:teuthology.orchestra.run.smithi072.stdout:(32/159): ceph-mgr-dashboard-19.0.0-3154.g81797 2.6 MB/s | 3.5 MB 00:01 2024-05-27T12:30:06.973 INFO:teuthology.orchestra.run.smithi072.stdout:(33/159): ceph-mgr-modules-core-19.0.0-3154.g81 1.8 MB/s | 252 kB 00:00 2024-05-27T12:30:06.998 INFO:teuthology.orchestra.run.smithi072.stdout:(34/159): ceph-mgr-rook-19.0.0-3154.g81797d87.e 654 kB/s | 49 kB 00:00 2024-05-27T12:30:07.132 INFO:teuthology.orchestra.run.smithi072.stdout:(35/159): ceph-mgr-diskprediction-local-19.0.0- 4.9 MB/s | 7.4 MB 00:01 2024-05-27T12:30:07.158 INFO:teuthology.orchestra.run.smithi072.stdout:(36/159): ceph-prometheus-alerts-19.0.0-3154.g8 89 kB/s | 16 kB 00:00 2024-05-27T12:30:07.191 INFO:teuthology.orchestra.run.smithi072.stdout:(37/159): ceph-volume-19.0.0-3154.g81797d87.el9 1.4 MB/s | 273 kB 00:00 2024-05-27T12:30:07.217 INFO:teuthology.orchestra.run.smithi072.stdout:(38/159): cephfs-top-19.0.0-3154.g81797d87.el9. 309 kB/s | 18 kB 00:00 2024-05-27T12:30:07.268 INFO:teuthology.orchestra.run.smithi072.stdout:(39/159): cephadm-19.0.0-3154.g81797d87.el9.noa 5.5 MB/s | 763 kB 00:00 2024-05-27T12:30:07.735 INFO:teuthology.orchestra.run.smithi072.stdout:(40/159): fuse-2.9.9-15.el9.x86_64.rpm 148 kB/s | 80 kB 00:00 2024-05-27T12:30:07.820 INFO:teuthology.orchestra.run.smithi072.stdout:(41/159): libquadmath-11.4.1-3.el9.x86_64.rpm 354 kB/s | 195 kB 00:00 2024-05-27T12:30:07.876 INFO:teuthology.orchestra.run.smithi055.stdout: Preparing : 1/1 2024-05-27T12:30:07.944 INFO:teuthology.orchestra.run.smithi055.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/170 2024-05-27T12:30:07.987 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/170 2024-05-27T12:30:08.021 INFO:teuthology.orchestra.run.smithi072.stdout:(42/159): python3-cffi-1.14.5-5.el9.x86_64.rpm 887 kB/s | 253 kB 00:00 2024-05-27T12:30:08.054 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/170 2024-05-27T12:30:08.071 INFO:teuthology.orchestra.run.smithi072.stdout:(43/159): libgfortran-11.4.1-3.el9.x86_64.rpm 940 kB/s | 803 kB 00:00 2024-05-27T12:30:08.095 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/170 2024-05-27T12:30:08.123 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/170 2024-05-27T12:30:08.188 INFO:teuthology.orchestra.run.smithi072.stdout:(44/159): python3-ply-3.11-14.el9.noarch.rpm 636 kB/s | 106 kB 00:00 2024-05-27T12:30:08.189 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/170 2024-05-27T12:30:08.239 INFO:teuthology.orchestra.run.smithi072.stdout:(45/159): python3-cryptography-36.0.1-4.el9.x86 2.9 MB/s | 1.2 MB 00:00 2024-05-27T12:30:08.290 INFO:teuthology.orchestra.run.smithi072.stdout:(46/159): python3-pycparser-2.20-6.el9.noarch.r 699 kB/s | 135 kB 00:00 2024-05-27T12:30:08.365 INFO:teuthology.orchestra.run.smithi072.stdout:(47/159): python3-requests-2.25.1-8.el9.noarch. 710 kB/s | 125 kB 00:00 2024-05-27T12:30:08.415 INFO:teuthology.orchestra.run.smithi072.stdout:(48/159): python3-urllib3-1.26.5-5.el9.noarch.r 1.4 MB/s | 215 kB 00:00 2024-05-27T12:30:08.599 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/170 2024-05-27T12:30:08.663 INFO:teuthology.orchestra.run.smithi055.stdout: Upgrading : librados2-2:19.0.0-3154.g81797d87.el9.x86_64 8/170 2024-05-27T12:30:08.793 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: librados2-2:19.0.0-3154.g81797d87.el9.x86_64 8/170 2024-05-27T12:30:08.814 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libcephfs2-2:19.0.0-3154.g81797d87.el9.x86_64 9/170 2024-05-27T12:30:08.849 INFO:teuthology.orchestra.run.smithi072.stdout:(49/159): boost-program-options-1.75.0-8.el9.x8 246 kB/s | 107 kB 00:00 2024-05-27T12:30:08.907 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: libcephfs2-2:19.0.0-3154.g81797d87.el9.x86_64 9/170 2024-05-27T12:30:08.927 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-rados-2:19.0.0-3154.g81797d87.el9.x86_64 10/170 2024-05-27T12:30:08.958 INFO:teuthology.orchestra.run.smithi072.stdout:(50/159): elfutils-libelf-devel-0.191-4.el9.x86 200 kB/s | 22 kB 00:00 2024-05-27T12:30:08.978 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/170 2024-05-27T12:30:09.143 INFO:teuthology.orchestra.run.smithi072.stdout:(51/159): automake-1.16.2-8.el9.noarch.rpm 832 kB/s | 689 kB 00:00 2024-05-27T12:30:09.186 INFO:teuthology.orchestra.run.smithi055.stdout: Upgrading : elfutils-libelf-0.191-4.el9.x86_64 12/170 2024-05-27T12:30:09.201 INFO:teuthology.orchestra.run.smithi072.stdout:(52/159): bison-3.7.4-5.el9.x86_64.rpm 1.1 MB/s | 943 kB 00:00 2024-05-27T12:30:09.235 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : postgresql-13.14-1.el9.x86_64 13/170 2024-05-27T12:30:09.261 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libcephsqlite-2:19.0.0-3154.g81797d87.el9.x86_64 14/170 2024-05-27T12:30:09.277 INFO:teuthology.orchestra.run.smithi072.stdout:(53/159): flexiblas-3.0.4-8.el9.x86_64.rpm 243 kB/s | 33 kB 00:00 2024-05-27T12:30:09.310 INFO:teuthology.orchestra.run.smithi072.stdout:(54/159): flex-2.6.4-9.el9.x86_64.rpm 890 kB/s | 313 kB 00:00 2024-05-27T12:30:09.367 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3154.g81797d87.el9.x86_64 14/170 2024-05-27T12:30:09.394 INFO:teuthology.orchestra.run.smithi072.stdout:(55/159): flexiblas-openblas-openmp-3.0.4-8.el9 155 kB/s | 18 kB 00:00 2024-05-27T12:30:09.396 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libradosstriper1-2:19.0.0-3154.g81797d87.el9.x86 15/170 2024-05-27T12:30:09.430 INFO:teuthology.orchestra.run.smithi072.stdout:(56/159): libaio-devel-0.3.111-13.el9.x86_64.rp 93 kB/s | 11 kB 00:00 2024-05-27T12:30:09.459 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3154.g81797d87.el9.x86 15/170 2024-05-27T12:30:09.480 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/170 2024-05-27T12:30:09.505 INFO:teuthology.orchestra.run.smithi072.stdout:(57/159): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.4 MB/s | 160 kB 00:00 2024-05-27T12:30:09.508 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/170 2024-05-27T12:30:09.539 INFO:teuthology.orchestra.run.smithi072.stdout:(58/159): librabbitmq-0.11.0-7.el9.x86_64.rpm 415 kB/s | 45 kB 00:00 2024-05-27T12:30:09.700 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/170 2024-05-27T12:30:09.760 INFO:teuthology.orchestra.run.smithi072.stdout:(59/159): flexiblas-netlib-3.0.4-8.el9.x86_64.r 5.4 MB/s | 3.0 MB 00:00 2024-05-27T12:30:09.790 INFO:teuthology.orchestra.run.smithi072.stdout:(60/159): librdkafka-1.6.1-102.el9.x86_64.rpm 2.3 MB/s | 662 kB 00:00 2024-05-27T12:30:09.824 INFO:teuthology.orchestra.run.smithi072.stdout:(61/159): libtool-2.4.6-45.el9.x86_64.rpm 2.0 MB/s | 582 kB 00:00 2024-05-27T12:30:09.858 INFO:teuthology.orchestra.run.smithi072.stdout:(62/159): libuuid-devel-2.37.4-18.el9.x86_64.rp 251 kB/s | 25 kB 00:00 2024-05-27T12:30:09.867 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/170 2024-05-27T12:30:09.892 INFO:teuthology.orchestra.run.smithi072.stdout:(63/159): libzstd-devel-1.5.1-2.el9.x86_64.rpm 468 kB/s | 47 kB 00:00 2024-05-27T12:30:09.934 INFO:teuthology.orchestra.run.smithi072.stdout:(64/159): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.6 MB/s | 292 kB 00:00 2024-05-27T12:30:09.993 INFO:teuthology.orchestra.run.smithi072.stdout:(65/159): openblas-0.3.21-2.el9.x86_64.rpm 349 kB/s | 35 kB 00:00 2024-05-27T12:30:09.994 INFO:teuthology.orchestra.run.smithi055.stdout: Upgrading : NetworkManager-libnm-1:1.47.90-1.el9.x86_64 18/170 2024-05-27T12:30:10.038 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.90-1.el9.x86_64 18/170 2024-05-27T12:30:10.135 INFO:teuthology.orchestra.run.smithi072.stdout:(66/159): lua-5.4.4-4.el9.x86_64.rpm 680 kB/s | 188 kB 00:00 2024-05-27T12:30:10.140 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: NetworkManager-1:1.47.90-1.el9.x86_64 19/170 2024-05-27T12:30:10.206 INFO:teuthology.orchestra.run.smithi055.stdout: Upgrading : NetworkManager-1:1.47.90-1.el9.x86_64 19/170 2024-05-27T12:30:10.277 INFO:teuthology.orchestra.run.smithi072.stdout:(67/159): postgresql-13.14-1.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-05-27T12:30:10.434 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: NetworkManager-1:1.47.90-1.el9.x86_64 19/170 2024-05-27T12:30:10.536 INFO:teuthology.orchestra.run.smithi072.stdout:(68/159): openblas-openmp-0.3.21-2.el9.x86_64.r 7.9 MB/s | 4.7 MB 00:00 2024-05-27T12:30:10.539 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : re2-1:20211101-3.el9.x86_64 20/170 2024-05-27T12:30:10.629 INFO:teuthology.orchestra.run.smithi072.stdout:(69/159): openssl-devel-3.2.1-1.el9.x86_64.rpm 7.0 MB/s | 4.4 MB 00:00 2024-05-27T12:30:10.635 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/170 2024-05-27T12:30:10.654 INFO:teuthology.orchestra.run.smithi072.stdout:(70/159): postgresql-private-libs-13.14-1.el9.x 1.1 MB/s | 133 kB 00:00 2024-05-27T12:30:10.678 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 22/170 2024-05-27T12:30:10.714 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : liboath-2.6.7-2.el9.x86_64 23/170 2024-05-27T12:30:10.789 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 24/170 2024-05-27T12:30:10.790 INFO:teuthology.orchestra.run.smithi072.stdout:(71/159): protobuf-3.14.0-13.el9.x86_64.rpm 7.5 MB/s | 1.0 MB 00:00 2024-05-27T12:30:10.830 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 25/170 2024-05-27T12:30:10.873 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/170 2024-05-27T12:30:10.906 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/170 2024-05-27T12:30:10.906 INFO:teuthology.orchestra.run.smithi072.stdout:(72/159): python3-attrs-20.3.0-7.el9.noarch.rpm 748 kB/s | 87 kB 00:00 2024-05-27T12:30:10.933 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/170 2024-05-27T12:30:11.005 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/170 2024-05-27T12:30:11.065 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 30/170 2024-05-27T12:30:11.094 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/170 2024-05-27T12:30:11.129 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 32/170 2024-05-27T12:30:11.208 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 33/170 2024-05-27T12:30:11.240 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-ceph-common-2:19.0.0-3154.g81797d87.el9. 34/170 2024-05-27T12:30:11.266 INFO:teuthology.orchestra.run.smithi072.stdout:(73/159): postgresql-server-13.14-1.el9.x86_64. 9.1 MB/s | 5.8 MB 00:00 2024-05-27T12:30:11.284 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-ceph-argparse-2:19.0.0-3154.g81797d87.el 35/170 2024-05-27T12:30:11.312 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-cephfs-2:19.0.0-3154.g81797d87.el9.x86_6 36/170 2024-05-27T12:30:11.375 INFO:teuthology.orchestra.run.smithi072.stdout:(74/159): python3-colorama-0.4.6-3.el9.noarch.r 564 kB/s | 61 kB 00:00 2024-05-27T12:30:11.384 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/170 2024-05-27T12:30:11.428 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/170 2024-05-27T12:30:11.500 INFO:teuthology.orchestra.run.smithi072.stdout:(75/159): python3-babel-2.9.1-2.el9.noarch.rpm 10 MB/s | 6.0 MB 00:00 2024-05-27T12:30:11.505 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/170 2024-05-27T12:30:11.534 INFO:teuthology.orchestra.run.smithi072.stdout:(76/159): python3-devel-3.9.18-3.el9.x86_64.rpm 1.5 MB/s | 244 kB 00:00 2024-05-27T12:30:11.610 INFO:teuthology.orchestra.run.smithi072.stdout:(77/159): python3-jinja2-2.11.3-6.el9.noarch.rp 2.2 MB/s | 248 kB 00:00 2024-05-27T12:30:11.636 INFO:teuthology.orchestra.run.smithi072.stdout:(78/159): python3-jsonpatch-1.21-16.el9.noarch. 254 kB/s | 26 kB 00:00 2024-05-27T12:30:11.642 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/170 2024-05-27T12:30:11.698 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/170 2024-05-27T12:30:11.711 INFO:teuthology.orchestra.run.smithi072.stdout:(79/159): python3-jsonpointer-2.0-4.el9.noarch. 190 kB/s | 19 kB 00:00 2024-05-27T12:30:11.745 INFO:teuthology.orchestra.run.smithi072.stdout:(80/159): python3-mako-1.1.4-6.el9.noarch.rpm 1.5 MB/s | 172 kB 00:00 2024-05-27T12:30:11.787 INFO:teuthology.orchestra.run.smithi072.stdout:(81/159): postgresql-contrib-13.14-1.el9.x86_64 603 kB/s | 911 kB 00:01 2024-05-27T12:30:11.813 INFO:teuthology.orchestra.run.smithi072.stdout:(82/159): python3-markupsafe-1.1.1-12.el9.x86_6 342 kB/s | 35 kB 00:00 2024-05-27T12:30:12.138 INFO:teuthology.orchestra.run.smithi072.stdout:(83/159): python3-numpy-f2py-1.20.1-5.el9.x86_6 714 kB/s | 250 kB 00:00 2024-05-27T12:30:12.172 INFO:teuthology.orchestra.run.smithi072.stdout:(84/159): python3-oauthlib-3.1.1-5.el9.noarch.r 619 kB/s | 222 kB 00:00 2024-05-27T12:30:12.275 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/170 2024-05-27T12:30:12.283 INFO:teuthology.orchestra.run.smithi072.stdout:(85/159): python3-numpy-1.20.1-5.el9.x86_64.rpm 9.5 MB/s | 5.1 MB 00:00 2024-05-27T12:30:12.300 INFO:teuthology.orchestra.run.smithi072.stdout:(86/159): python3-prettytable-0.7.2-27.el9.noar 332 kB/s | 42 kB 00:00 2024-05-27T12:30:12.359 INFO:teuthology.orchestra.run.smithi072.stdout:(87/159): python3-packaging-20.9-5.el9.noarch.r 351 kB/s | 77 kB 00:00 2024-05-27T12:30:12.361 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/170 2024-05-27T12:30:12.396 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/170 2024-05-27T12:30:12.442 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/170 2024-05-27T12:30:12.490 INFO:teuthology.orchestra.run.smithi055.stdout: Upgrading : elfutils-libs-0.191-4.el9.x86_64 46/170 2024-05-27T12:30:12.529 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : librados-devel-2:19.0.0-3154.g81797d87.el9.x86_6 47/170 2024-05-27T12:30:12.559 INFO:teuthology.orchestra.run.smithi072.stdout:(88/159): python3-pyasn1-0.4.8-6.el9.noarch.rpm 613 kB/s | 159 kB 00:00 2024-05-27T12:30:12.571 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 48/170 2024-05-27T12:30:12.660 INFO:teuthology.orchestra.run.smithi072.stdout:(89/159): python3-pytz-2021.1-5.el9.noarch.rpm 509 kB/s | 51 kB 00:00 2024-05-27T12:30:12.719 INFO:teuthology.orchestra.run.smithi072.stdout:(90/159): python3-protobuf-3.14.0-13.el9.noarch 618 kB/s | 269 kB 00:00 2024-05-27T12:30:12.728 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 49/170 2024-05-27T12:30:12.761 INFO:teuthology.orchestra.run.smithi072.stdout:(91/159): python3-requests-oauthlib-1.3.0-12.el 532 kB/s | 54 kB 00:00 2024-05-27T12:30:12.789 INFO:teuthology.orchestra.run.smithi055.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 50/170 2024-05-27T12:30:12.795 INFO:teuthology.orchestra.run.smithi072.stdout:(92/159): python3-pyasn1-modules-0.4.8-6.el9.no 640 kB/s | 279 kB 00:00 2024-05-27T12:30:12.846 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 51/170 2024-05-27T12:30:12.862 INFO:teuthology.orchestra.run.smithi072.stdout:(93/159): python3-toml-0.10.2-6.el9.noarch.rpm 414 kB/s | 42 kB 00:00 2024-05-27T12:30:12.896 INFO:teuthology.orchestra.run.smithi072.stdout:(94/159): python3-wcwidth-0.2.5-8.el9.noarch.rp 438 kB/s | 44 kB 00:00 2024-05-27T12:30:12.920 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/170 2024-05-27T12:30:12.956 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 53/170 2024-05-27T12:30:12.994 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 54/170 2024-05-27T12:30:12.996 INFO:teuthology.orchestra.run.smithi072.stdout:(95/159): qatlib-service-24.02.0-1.el9.x86_64.r 358 kB/s | 36 kB 00:00 2024-05-27T12:30:13.041 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/170 2024-05-27T12:30:13.076 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/170 2024-05-27T12:30:13.097 INFO:teuthology.orchestra.run.smithi072.stdout:(96/159): qatzip-libs-1.2.0-1.el9.x86_64.rpm 472 kB/s | 47 kB 00:00 2024-05-27T12:30:13.119 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/170 2024-05-27T12:30:13.162 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/170 2024-05-27T12:30:13.206 INFO:teuthology.orchestra.run.smithi072.stdout:(97/159): qatlib-24.02.0-1.el9.x86_64.rpm 642 kB/s | 221 kB 00:00 2024-05-27T12:30:13.306 INFO:teuthology.orchestra.run.smithi072.stdout:(98/159): uuid-1.6.2-55.el9.x86_64.rpm 577 kB/s | 58 kB 00:00 2024-05-27T12:30:13.393 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/170 2024-05-27T12:30:13.472 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/170 2024-05-27T12:30:13.499 INFO:teuthology.orchestra.run.smithi072.stdout:(99/159): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 488 kB/s | 94 kB 00:00 2024-05-27T12:30:13.514 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 61/170 2024-05-27T12:30:13.534 INFO:teuthology.orchestra.run.smithi072.stdout:(100/159): socat-1.7.4.1-5.el9.x86_64.rpm 698 kB/s | 305 kB 00:00 2024-05-27T12:30:13.611 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/170 2024-05-27T12:30:13.646 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 63/170 2024-05-27T12:30:13.668 INFO:teuthology.orchestra.run.smithi072.stdout:(101/159): zlib-devel-1.2.11-41.el9.x86_64.rpm 335 kB/s | 45 kB 00:00 2024-05-27T12:30:13.687 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/170 2024-05-27T12:30:13.693 INFO:teuthology.orchestra.run.smithi072.stdout:(102/159): xmlstarlet-1.6.1-20.el9.x86_64.rpm 327 kB/s | 64 kB 00:00 2024-05-27T12:30:13.765 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 65/170 2024-05-27T12:30:13.875 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/170 2024-05-27T12:30:14.123 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/170 2024-05-27T12:30:14.244 INFO:teuthology.orchestra.run.smithi072.stdout:(103/159): lua-devel-5.4.4-4.el9.x86_64.rpm 39 kB/s | 22 kB 00:00 2024-05-27T12:30:14.353 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/170 2024-05-27T12:30:14.394 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/170 2024-05-27T12:30:14.422 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/170 2024-05-27T12:30:14.457 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/170 2024-05-27T12:30:14.496 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/170 2024-05-27T12:30:14.511 INFO:teuthology.orchestra.run.smithi072.stdout:(104/159): abseil-cpp-20211102.0-3.el9.x86_64.r 2.0 MB/s | 548 kB 00:00 2024-05-27T12:30:14.535 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/170 2024-05-27T12:30:14.565 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/170 2024-05-27T12:30:14.578 INFO:teuthology.orchestra.run.smithi072.stdout:(105/159): gperftools-libs-2.9.1-2.el9.x86_64.r 4.5 MB/s | 309 kB 00:00 2024-05-27T12:30:14.600 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/170 2024-05-27T12:30:14.629 INFO:teuthology.orchestra.run.smithi072.stdout:(106/159): grpc-data-1.46.7-10.el9.noarch.rpm 386 kB/s | 19 kB 00:00 2024-05-27T12:30:14.635 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/170 2024-05-27T12:30:14.671 INFO:teuthology.orchestra.run.smithi072.stdout:(107/159): protobuf-compiler-3.14.0-13.el9.x86_ 883 kB/s | 863 kB 00:00 2024-05-27T12:30:14.677 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/170 2024-05-27T12:30:14.712 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/170 2024-05-27T12:30:14.801 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/170 2024-05-27T12:30:14.843 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/170 2024-05-27T12:30:14.847 INFO:teuthology.orchestra.run.smithi072.stdout:(108/159): libarrow-9.0.0-11.el9.x86_64.rpm 20 MB/s | 4.4 MB 00:00 2024-05-27T12:30:14.864 INFO:teuthology.orchestra.run.smithi072.stdout:(109/159): libarrow-doc-9.0.0-11.el9.noarch.rpm 135 kB/s | 26 kB 00:00 2024-05-27T12:30:14.882 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/170 2024-05-27T12:30:14.898 INFO:teuthology.orchestra.run.smithi072.stdout:(110/159): liboath-2.6.7-2.el9.x86_64.rpm 956 kB/s | 49 kB 00:00 2024-05-27T12:30:14.930 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/170 2024-05-27T12:30:14.982 INFO:teuthology.orchestra.run.smithi072.stdout:(111/159): luarocks-3.9.2-5.el9.noarch.rpm 1.8 MB/s | 151 kB 00:00 2024-05-27T12:30:15.007 INFO:teuthology.orchestra.run.smithi072.stdout:(112/159): libunwind-1.6.2-1.el9.x86_64.rpm 471 kB/s | 67 kB 00:00 2024-05-27T12:30:15.041 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-packaging-20.9-5.el9.noarch 83/170 2024-05-27T12:30:15.058 INFO:teuthology.orchestra.run.smithi072.stdout:(113/159): parquet-libs-9.0.0-11.el9.x86_64.rpm 11 MB/s | 839 kB 00:00 2024-05-27T12:30:15.093 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 84/170 2024-05-27T12:30:15.169 INFO:teuthology.orchestra.run.smithi072.stdout:(114/159): python3-asyncssh-2.13.2-5.el9.noarch 3.3 MB/s | 548 kB 00:00 2024-05-27T12:30:15.194 INFO:teuthology.orchestra.run.smithi072.stdout:(115/159): python3-bcrypt-3.2.2-1.el9.x86_64.rp 320 kB/s | 43 kB 00:00 2024-05-27T12:30:15.228 INFO:teuthology.orchestra.run.smithi072.stdout:(116/159): python3-cachetools-4.2.4-1.el9.noarc 546 kB/s | 32 kB 00:00 2024-05-27T12:30:15.253 INFO:teuthology.orchestra.run.smithi072.stdout:(117/159): python3-certifi-2021.10.8-2.el9.noar 254 kB/s | 15 kB 00:00 2024-05-27T12:30:15.296 INFO:teuthology.orchestra.run.smithi072.stdout:(118/159): python3-cheroot-8.6.0-4.el9.noarch.r 2.5 MB/s | 172 kB 00:00 2024-05-27T12:30:15.330 INFO:teuthology.orchestra.run.smithi072.stdout:(119/159): python3-cherrypy-18.6.1-2.el9.noarch 4.6 MB/s | 358 kB 00:00 2024-05-27T12:30:15.372 INFO:teuthology.orchestra.run.smithi072.stdout:(120/159): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.9 MB/s | 303 kB 00:00 2024-05-27T12:30:15.406 INFO:teuthology.orchestra.run.smithi072.stdout:(121/159): python3-google-auth-2.29.0-1.el9.noa 2.6 MB/s | 206 kB 00:00 2024-05-27T12:30:15.473 INFO:teuthology.orchestra.run.smithi072.stdout:(122/159): python3-grpcio-1.46.7-10.el9.x86_64. 20 MB/s | 2.0 MB 00:00 2024-05-27T12:30:15.498 INFO:teuthology.orchestra.run.smithi072.stdout:(123/159): python3-grpcio-tools-1.46.7-10.el9.x 1.5 MB/s | 144 kB 00:00 2024-05-27T12:30:15.532 INFO:teuthology.orchestra.run.smithi072.stdout:(124/159): python3-jaraco-8.2.1-3.el9.noarch.rp 181 kB/s | 11 kB 00:00 2024-05-27T12:30:15.550 INFO:teuthology.orchestra.run.smithi072.stdout:(125/159): python3-jaraco-classes-3.2.1-5.el9.n 346 kB/s | 18 kB 00:00 2024-05-27T12:30:15.584 INFO:teuthology.orchestra.run.smithi072.stdout:(126/159): python3-jaraco-collections-3.0.0-8.e 454 kB/s | 23 kB 00:00 2024-05-27T12:30:15.602 INFO:teuthology.orchestra.run.smithi072.stdout:(127/159): python3-jaraco-functools-3.5.0-2.el9 384 kB/s | 19 kB 00:00 2024-05-27T12:30:15.636 INFO:teuthology.orchestra.run.smithi072.stdout:(128/159): python3-jaraco-text-3.2.0-6.el9.noar 389 kB/s | 20 kB 00:00 2024-05-27T12:30:15.712 INFO:teuthology.orchestra.run.smithi072.stdout:(129/159): python3-kubernetes-26.1.0-2.el9.noar 9.2 MB/s | 1.0 MB 00:00 2024-05-27T12:30:15.737 INFO:teuthology.orchestra.run.smithi072.stdout:(130/159): python3-logutils-0.3.5-21.el9.noarch 451 kB/s | 46 kB 00:00 2024-05-27T12:30:15.771 INFO:teuthology.orchestra.run.smithi072.stdout:(131/159): python3-more-itertools-8.12.0-2.el9. 1.3 MB/s | 79 kB 00:00 2024-05-27T12:30:15.797 INFO:teuthology.orchestra.run.smithi072.stdout:(132/159): python3-natsort-7.1.1-5.el9.noarch.r 977 kB/s | 58 kB 00:00 2024-05-27T12:30:15.854 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 85/170 2024-05-27T12:30:15.866 INFO:teuthology.orchestra.run.smithi072.stdout:(133/159): python3-pecan-1.4.2-3.el9.noarch.rpm 2.9 MB/s | 272 kB 00:00 2024-05-27T12:30:15.890 INFO:teuthology.orchestra.run.smithi072.stdout:(134/159): python3-portend-3.1.0-2.el9.noarch.r 178 kB/s | 16 kB 00:00 2024-05-27T12:30:15.906 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 86/170 2024-05-27T12:30:15.932 INFO:teuthology.orchestra.run.smithi072.stdout:(135/159): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.3 MB/s | 90 kB 00:00 2024-05-27T12:30:15.945 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 87/170 2024-05-27T12:30:15.957 INFO:teuthology.orchestra.run.smithi072.stdout:(136/159): python3-pyperclip-1.8.2-2.el9.noarch 419 kB/s | 28 kB 00:00 2024-05-27T12:30:15.984 INFO:teuthology.orchestra.run.smithi072.stdout:(137/159): python3-repoze-lru-0.7-16.el9.noarch 604 kB/s | 31 kB 00:00 2024-05-27T12:30:16.009 INFO:teuthology.orchestra.run.smithi072.stdout:(138/159): python3-routes-2.5.1-5.el9.noarch.rp 3.6 MB/s | 188 kB 00:00 2024-05-27T12:30:16.035 INFO:teuthology.orchestra.run.smithi072.stdout:(139/159): python3-rsa-4.9-2.el9.noarch.rpm 1.1 MB/s | 59 kB 00:00 2024-05-27T12:30:16.043 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 88/170 2024-05-27T12:30:16.078 INFO:teuthology.orchestra.run.smithi072.stdout:(140/159): python3-tempora-5.0.0-2.el9.noarch.r 530 kB/s | 36 kB 00:00 2024-05-27T12:30:16.103 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 89/170 2024-05-27T12:30:16.108 INFO:teuthology.orchestra.run.smithi072.stdout:(141/159): python3-typing-extensions-4.4.0-2.el 755 kB/s | 51 kB 00:00 2024-05-27T12:30:16.142 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 90/170 2024-05-27T12:30:16.144 INFO:teuthology.orchestra.run.smithi072.stdout:(142/159): python3-webob-1.8.7-6.el9.noarch.rpm 3.3 MB/s | 230 kB 00:00 2024-05-27T12:30:16.170 INFO:teuthology.orchestra.run.smithi072.stdout:(143/159): python3-websocket-client-1.2.3-2.el9 1.3 MB/s | 90 kB 00:00 2024-05-27T12:30:16.213 INFO:teuthology.orchestra.run.smithi072.stdout:(144/159): python3-werkzeug-2.0.3-3.el9.1.noarc 6.0 MB/s | 427 kB 00:00 2024-05-27T12:30:16.236 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 91/170 2024-05-27T12:30:16.239 INFO:teuthology.orchestra.run.smithi072.stdout:(145/159): python3-zc-lockfile-2.0-10.el9.noarc 289 kB/s | 20 kB 00:00 2024-05-27T12:30:16.268 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 92/170 2024-05-27T12:30:16.275 INFO:teuthology.orchestra.run.smithi072.stdout:(146/159): re2-20211101-3.el9.x86_64.rpm 3.2 MB/s | 192 kB 00:00 2024-05-27T12:30:16.332 INFO:teuthology.orchestra.run.smithi072.stdout:(147/159): thrift-0.15.0-2.el9.x86_64.rpm 17 MB/s | 1.6 MB 00:00 2024-05-27T12:30:16.451 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : openblas-0.3.21-2.el9.x86_64 93/170 2024-05-27T12:30:16.491 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 94/170 2024-05-27T12:30:16.571 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 95/170 2024-05-27T12:30:16.782 INFO:teuthology.orchestra.run.smithi072.stdout:(148/159): librbd1-19.0.0-3154.g81797d87.el9.x8 7.0 MB/s | 3.1 MB 00:00 2024-05-27T12:30:16.891 INFO:teuthology.orchestra.run.smithi072.stdout:(149/159): librados2-19.0.0-3154.g81797d87.el9. 5.5 MB/s | 3.4 MB 00:00 2024-05-27T12:30:17.075 INFO:teuthology.orchestra.run.smithi072.stdout:(150/159): NetworkManager-1.47.90-1.el9.x86_64. 7.9 MB/s | 2.3 MB 00:00 2024-05-27T12:30:17.126 INFO:teuthology.orchestra.run.smithi072.stdout:(151/159): NetworkManager-libnm-1.47.90-1.el9.x 7.7 MB/s | 1.8 MB 00:00 2024-05-27T12:30:17.234 INFO:teuthology.orchestra.run.smithi072.stdout:(152/159): NetworkManager-team-1.47.90-1.el9.x8 261 kB/s | 41 kB 00:00 2024-05-27T12:30:17.263 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 96/170 2024-05-27T12:30:17.301 INFO:teuthology.orchestra.run.smithi072.stdout:(153/159): NetworkManager-tui-1.47.90-1.el9.x86 1.6 MB/s | 248 kB 00:00 2024-05-27T12:30:17.360 INFO:teuthology.orchestra.run.smithi072.stdout:(154/159): elfutils-debuginfod-client-0.191-4.e 291 kB/s | 37 kB 00:00 2024-05-27T12:30:17.386 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 97/170 2024-05-27T12:30:17.444 INFO:teuthology.orchestra.run.smithi072.stdout:(155/159): elfutils-libelf-0.191-4.el9.x86_64.r 1.4 MB/s | 207 kB 00:00 2024-05-27T12:30:17.503 INFO:teuthology.orchestra.run.smithi072.stdout:(156/159): elfutils-libs-0.191-4.el9.x86_64.rpm 1.8 MB/s | 260 kB 00:00 2024-05-27T12:30:17.645 INFO:teuthology.orchestra.run.smithi072.stdout:(157/159): openssl-3.2.1-1.el9.x86_64.rpm 6.7 MB/s | 1.3 MB 00:00 2024-05-27T12:30:17.738 INFO:teuthology.orchestra.run.smithi072.stdout:(158/159): openssl-libs-3.2.1-1.el9.x86_64.rpm 10 MB/s | 2.4 MB 00:00 2024-05-27T12:30:18.714 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 98/170 2024-05-27T12:30:18.797 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 99/170 2024-05-27T12:30:18.817 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 100/170 2024-05-27T12:30:18.876 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 101/170 2024-05-27T12:30:19.222 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 102/170 2024-05-27T12:30:19.264 INFO:teuthology.orchestra.run.smithi055.stdout: Upgrading : librbd1-2:19.0.0-3154.g81797d87.el9.x86_64 103/170 2024-05-27T12:30:19.355 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: librbd1-2:19.0.0-3154.g81797d87.el9.x86_64 103/170 2024-05-27T12:30:19.386 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-rbd-2:19.0.0-3154.g81797d87.el9.x86_64 104/170 2024-05-27T12:30:19.422 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 105/170 2024-05-27T12:30:19.926 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 106/170 2024-05-27T12:30:19.959 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : librgw2-2:19.0.0-3154.g81797d87.el9.x86_64 107/170 2024-05-27T12:30:20.031 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: librgw2-2:19.0.0-3154.g81797d87.el9.x86_64 107/170 2024-05-27T12:30:20.061 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-rgw-2:19.0.0-3154.g81797d87.el9.x86_64 108/170 2024-05-27T12:30:22.434 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-common-2:19.0.0-3154.g81797d87.el9.x86_64 109/170 2024-05-27T12:30:22.466 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-common-2:19.0.0-3154.g81797d87.el9.x86_64 109/170 2024-05-27T12:30:23.039 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-common-2:19.0.0-3154.g81797d87.el9.x86_64 109/170 2024-05-27T12:30:23.087 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-base-2:19.0.0-3154.g81797d87.el9.x86_64 110/170 2024-05-27T12:30:23.184 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-base-2:19.0.0-3154.g81797d87.el9.x86_64 110/170 2024-05-27T12:30:23.184 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-27T12:30:23.184 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-27T12:30:23.184 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-27T12:30:23.213 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-selinux-2:19.0.0-3154.g81797d87.el9.x86_64 111/170 2024-05-27T12:30:25.815 INFO:teuthology.orchestra.run.smithi072.stdout:(159/159): python3-scipy-1.6.2-8.el9.x86_64.rpm 1.2 MB/s | 16 MB 00:13 2024-05-27T12:30:25.818 INFO:teuthology.orchestra.run.smithi072.stdout:-------------------------------------------------------------------------------- 2024-05-27T12:30:25.819 INFO:teuthology.orchestra.run.smithi072.stdout:Total 8.8 MB/s | 226 MB 00:25 2024-05-27T12:30:27.013 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction check 2024-05-27T12:30:27.172 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction check succeeded. 2024-05-27T12:30:27.173 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction test 2024-05-27T12:30:29.432 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction test succeeded. 2024-05-27T12:30:29.432 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction 2024-05-27T12:30:35.438 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3154.g81797d87.el9.x86_64 111/170 2024-05-27T12:30:35.438 INFO:teuthology.orchestra.run.smithi055.stdout:skipping the directory /sys 2024-05-27T12:30:35.438 INFO:teuthology.orchestra.run.smithi055.stdout:skipping the directory /proc 2024-05-27T12:30:35.439 INFO:teuthology.orchestra.run.smithi055.stdout:skipping the directory /mnt 2024-05-27T12:30:35.439 INFO:teuthology.orchestra.run.smithi055.stdout:skipping the directory /var/tmp 2024-05-27T12:30:35.439 INFO:teuthology.orchestra.run.smithi055.stdout:skipping the directory /home 2024-05-27T12:30:35.439 INFO:teuthology.orchestra.run.smithi055.stdout:skipping the directory /root 2024-05-27T12:30:35.439 INFO:teuthology.orchestra.run.smithi055.stdout:skipping the directory /tmp 2024-05-27T12:30:35.439 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-27T12:30:35.617 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-volume-2:19.0.0-3154.g81797d87.el9.noarch 112/170 2024-05-27T12:30:35.633 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-volume-2:19.0.0-3154.g81797d87.el9.noarch 112/170 2024-05-27T12:30:35.633 INFO:teuthology.orchestra.run.smithi055.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-27T12:30:35.633 INFO:teuthology.orchestra.run.smithi055.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-05-27T12:30:35.633 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-27T12:30:35.900 INFO:teuthology.orchestra.run.smithi072.stdout: Preparing : 1/1 2024-05-27T12:30:36.013 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/170 2024-05-27T12:30:36.052 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/170 2024-05-27T12:30:36.133 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/170 2024-05-27T12:30:36.176 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/170 2024-05-27T12:30:36.202 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/170 2024-05-27T12:30:36.263 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/170 2024-05-27T12:30:36.593 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/170 2024-05-27T12:30:36.772 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : librados2-2:19.0.0-3154.g81797d87.el9.x86_64 8/170 2024-05-27T12:30:36.899 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: librados2-2:19.0.0-3154.g81797d87.el9.x86_64 8/170 2024-05-27T12:30:36.926 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libcephfs2-2:19.0.0-3154.g81797d87.el9.x86_64 9/170 2024-05-27T12:30:37.018 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libcephfs2-2:19.0.0-3154.g81797d87.el9.x86_64 9/170 2024-05-27T12:30:37.047 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-rados-2:19.0.0-3154.g81797d87.el9.x86_64 10/170 2024-05-27T12:30:37.108 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/170 2024-05-27T12:30:37.195 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-osd-2:19.0.0-3154.g81797d87.el9.x86_64 113/170 2024-05-27T12:30:37.223 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-osd-2:19.0.0-3154.g81797d87.el9.x86_64 113/170 2024-05-27T12:30:37.224 INFO:teuthology.orchestra.run.smithi055.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-27T12:30:37.224 INFO:teuthology.orchestra.run.smithi055.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-27T12:30:37.224 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-27T12:30:37.224 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-27T12:30:37.224 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-27T12:30:37.317 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : elfutils-libelf-0.191-4.el9.x86_64 12/170 2024-05-27T12:30:37.382 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : postgresql-13.14-1.el9.x86_64 13/170 2024-05-27T12:30:37.413 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libcephsqlite-2:19.0.0-3154.g81797d87.el9.x86_64 14/170 2024-05-27T12:30:37.464 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-mds-2:19.0.0-3154.g81797d87.el9.x86_64 114/170 2024-05-27T12:30:37.489 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-mds-2:19.0.0-3154.g81797d87.el9.x86_64 114/170 2024-05-27T12:30:37.489 INFO:teuthology.orchestra.run.smithi055.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-27T12:30:37.489 INFO:teuthology.orchestra.run.smithi055.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-27T12:30:37.489 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-27T12:30:37.489 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-27T12:30:37.489 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-27T12:30:37.508 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3154.g81797d87.el9.x86_64 14/170 2024-05-27T12:30:37.540 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libradosstriper1-2:19.0.0-3154.g81797d87.el9.x86 15/170 2024-05-27T12:30:37.586 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3154.g81797d87.el9.x86 15/170 2024-05-27T12:30:37.618 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/170 2024-05-27T12:30:37.645 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/170 2024-05-27T12:30:37.821 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/170 2024-05-27T12:30:37.965 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-mon-2:19.0.0-3154.g81797d87.el9.x86_64 115/170 2024-05-27T12:30:37.991 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-mon-2:19.0.0-3154.g81797d87.el9.x86_64 115/170 2024-05-27T12:30:37.991 INFO:teuthology.orchestra.run.smithi055.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-27T12:30:37.991 INFO:teuthology.orchestra.run.smithi055.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-27T12:30:37.991 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-27T12:30:37.991 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-27T12:30:37.991 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-27T12:30:37.995 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/170 2024-05-27T12:30:38.105 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : automake-1.16.2-8.el9.noarch 116/170 2024-05-27T12:30:38.162 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-ply-3.11-14.el9.noarch 117/170 2024-05-27T12:30:38.172 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : NetworkManager-libnm-1:1.47.90-1.el9.x86_64 18/170 2024-05-27T12:30:38.232 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.90-1.el9.x86_64 18/170 2024-05-27T12:30:38.245 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 118/170 2024-05-27T12:30:38.337 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: NetworkManager-1:1.47.90-1.el9.x86_64 19/170 2024-05-27T12:30:38.448 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 119/170 2024-05-27T12:30:38.469 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : NetworkManager-1:1.47.90-1.el9.x86_64 19/170 2024-05-27T12:30:38.501 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 120/170 2024-05-27T12:30:38.581 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 121/170 2024-05-27T12:30:38.680 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 122/170 2024-05-27T12:30:38.688 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: NetworkManager-1:1.47.90-1.el9.x86_64 19/170 2024-05-27T12:30:38.795 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : re2-1:20211101-3.el9.x86_64 20/170 2024-05-27T12:30:38.824 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 123/170 2024-05-27T12:30:38.868 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 124/170 2024-05-27T12:30:38.890 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/170 2024-05-27T12:30:38.900 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 125/170 2024-05-27T12:30:38.927 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : fuse-2.9.9-15.el9.x86_64 126/170 2024-05-27T12:30:38.942 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 22/170 2024-05-27T12:30:38.981 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : liboath-2.6.7-2.el9.x86_64 23/170 2024-05-27T12:30:39.058 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 24/170 2024-05-27T12:30:39.092 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 25/170 2024-05-27T12:30:39.136 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/170 2024-05-27T12:30:39.185 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/170 2024-05-27T12:30:39.216 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/170 2024-05-27T12:30:39.284 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/170 2024-05-27T12:30:39.347 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 30/170 2024-05-27T12:30:39.379 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/170 2024-05-27T12:30:39.380 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: cephadm-2:19.0.0-3154.g81797d87.el9.noarch 127/170 2024-05-27T12:30:39.410 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : cephadm-2:19.0.0-3154.g81797d87.el9.noarch 127/170 2024-05-27T12:30:39.424 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 32/170 2024-05-27T12:30:39.442 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3154.g81797d87.e 128/170 2024-05-27T12:30:39.500 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 33/170 2024-05-27T12:30:39.505 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3154.g81797d87. 129/170 2024-05-27T12:30:39.535 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-ceph-common-2:19.0.0-3154.g81797d87.el9. 34/170 2024-05-27T12:30:39.541 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3154.g81797d87.el9.noa 130/170 2024-05-27T12:30:39.579 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-ceph-argparse-2:19.0.0-3154.g81797d87.el 35/170 2024-05-27T12:30:39.608 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-cephfs-2:19.0.0-3154.g81797d87.el9.x86_6 36/170 2024-05-27T12:30:39.687 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/170 2024-05-27T12:30:39.734 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/170 2024-05-27T12:30:39.817 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/170 2024-05-27T12:30:39.963 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/170 2024-05-27T12:30:40.015 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/170 2024-05-27T12:30:40.547 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/170 2024-05-27T12:30:40.632 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3154.g81797d87.el9.noa 130/170 2024-05-27T12:30:40.640 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/170 2024-05-27T12:30:40.668 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3154.g81797d87.el9.n 131/170 2024-05-27T12:30:40.677 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/170 2024-05-27T12:30:40.710 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/170 2024-05-27T12:30:40.755 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : elfutils-libs-0.191-4.el9.x86_64 46/170 2024-05-27T12:30:40.794 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : librados-devel-2:19.0.0-3154.g81797d87.el9.x86_6 47/170 2024-05-27T12:30:40.838 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 48/170 2024-05-27T12:30:41.007 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 49/170 2024-05-27T12:30:41.077 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 50/170 2024-05-27T12:30:41.132 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 51/170 2024-05-27T12:30:41.208 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/170 2024-05-27T12:30:41.256 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 53/170 2024-05-27T12:30:41.284 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 54/170 2024-05-27T12:30:41.340 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/170 2024-05-27T12:30:41.376 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/170 2024-05-27T12:30:41.421 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/170 2024-05-27T12:30:41.472 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/170 2024-05-27T12:30:41.618 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/170 2024-05-27T12:30:41.669 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/170 2024-05-27T12:30:41.682 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3154.g81797d87.el9.n 131/170 2024-05-27T12:30:41.710 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3154.g817 132/170 2024-05-27T12:30:41.711 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 61/170 2024-05-27T12:30:41.815 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/170 2024-05-27T12:30:41.819 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3154.g817 132/170 2024-05-27T12:30:41.855 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 63/170 2024-05-27T12:30:41.897 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/170 2024-05-27T12:30:41.931 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 65/170 2024-05-27T12:30:41.964 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/170 2024-05-27T12:30:41.989 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3154.g81797d87.el 133/170 2024-05-27T12:30:42.012 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-mgr-2:19.0.0-3154.g81797d87.el9.x86_64 134/170 2024-05-27T12:30:42.039 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3154.g81797d87.el9.x86_64 134/170 2024-05-27T12:30:42.039 INFO:teuthology.orchestra.run.smithi055.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-27T12:30:42.039 INFO:teuthology.orchestra.run.smithi055.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-27T12:30:42.039 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-27T12:30:42.039 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-27T12:30:42.039 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-27T12:30:42.078 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/170 2024-05-27T12:30:42.097 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-mgr-rook-2:19.0.0-3154.g81797d87.el9.noarch 135/170 2024-05-27T12:30:42.108 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3154.g81797d87.el9.noarch 135/170 2024-05-27T12:30:42.210 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-2:19.0.0-3154.g81797d87.el9.x86_64 136/170 2024-05-27T12:30:42.213 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/170 2024-05-27T12:30:42.261 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/170 2024-05-27T12:30:42.269 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-fuse-2:19.0.0-3154.g81797d87.el9.x86_64 137/170 2024-05-27T12:30:42.290 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/170 2024-05-27T12:30:42.325 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/170 2024-05-27T12:30:42.366 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/170 2024-05-27T12:30:42.407 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/170 2024-05-27T12:30:42.438 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/170 2024-05-27T12:30:42.472 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/170 2024-05-27T12:30:42.506 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/170 2024-05-27T12:30:42.548 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/170 2024-05-27T12:30:42.583 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/170 2024-05-27T12:30:42.705 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/170 2024-05-27T12:30:42.750 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/170 2024-05-27T12:30:42.790 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/170 2024-05-27T12:30:42.837 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/170 2024-05-27T12:30:42.945 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-packaging-20.9-5.el9.noarch 83/170 2024-05-27T12:30:43.004 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 84/170 2024-05-27T12:30:43.238 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libtool-2.4.6-45.el9.x86_64 138/170 2024-05-27T12:30:43.275 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-radosgw-2:19.0.0-3154.g81797d87.el9.x86_64 139/170 2024-05-27T12:30:43.300 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3154.g81797d87.el9.x86_64 139/170 2024-05-27T12:30:43.300 INFO:teuthology.orchestra.run.smithi055.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-27T12:30:43.300 INFO:teuthology.orchestra.run.smithi055.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-27T12:30:43.300 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-27T12:30:43.300 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-27T12:30:43.300 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-27T12:30:43.342 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3154.g81797 140/170 2024-05-27T12:30:43.366 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3154.g81797 140/170 2024-05-27T12:30:43.367 INFO:teuthology.orchestra.run.smithi055.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-27T12:30:43.367 INFO:teuthology.orchestra.run.smithi055.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-27T12:30:43.367 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-27T12:30:43.418 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : cephfs-mirror-2:19.0.0-3154.g81797d87.el9.x86_64 141/170 2024-05-27T12:30:43.443 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3154.g81797d87.el9.x86_64 141/170 2024-05-27T12:30:43.443 INFO:teuthology.orchestra.run.smithi055.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-27T12:30:43.443 INFO:teuthology.orchestra.run.smithi055.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-05-27T12:30:43.443 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-27T12:30:43.443 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-27T12:30:43.443 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-27T12:30:43.735 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 85/170 2024-05-27T12:30:43.760 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : rbd-mirror-2:19.0.0-3154.g81797d87.el9.x86_64 142/170 2024-05-27T12:30:43.785 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3154.g81797d87.el9.x86_64 142/170 2024-05-27T12:30:43.785 INFO:teuthology.orchestra.run.smithi055.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-27T12:30:43.785 INFO:teuthology.orchestra.run.smithi055.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-27T12:30:43.786 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-27T12:30:43.786 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-27T12:30:43.786 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-27T12:30:43.788 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 86/170 2024-05-27T12:30:43.824 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 87/170 2024-05-27T12:30:43.926 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 88/170 2024-05-27T12:30:43.980 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 89/170 2024-05-27T12:30:44.034 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 90/170 2024-05-27T12:30:44.123 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 91/170 2024-05-27T12:30:44.165 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 92/170 2024-05-27T12:30:44.341 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : openblas-0.3.21-2.el9.x86_64 93/170 2024-05-27T12:30:44.372 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 94/170 2024-05-27T12:30:44.452 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 95/170 2024-05-27T12:30:45.115 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 96/170 2024-05-27T12:30:45.244 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 97/170 2024-05-27T12:30:46.509 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 98/170 2024-05-27T12:30:46.616 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 99/170 2024-05-27T12:30:46.644 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 100/170 2024-05-27T12:30:46.678 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 101/170 2024-05-27T12:30:46.994 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 102/170 2024-05-27T12:30:47.053 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : librbd1-2:19.0.0-3154.g81797d87.el9.x86_64 103/170 2024-05-27T12:30:47.142 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: librbd1-2:19.0.0-3154.g81797d87.el9.x86_64 103/170 2024-05-27T12:30:47.175 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-rbd-2:19.0.0-3154.g81797d87.el9.x86_64 104/170 2024-05-27T12:30:47.221 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 105/170 2024-05-27T12:30:47.701 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 106/170 2024-05-27T12:30:47.767 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : librgw2-2:19.0.0-3154.g81797d87.el9.x86_64 107/170 2024-05-27T12:30:47.839 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: librgw2-2:19.0.0-3154.g81797d87.el9.x86_64 107/170 2024-05-27T12:30:47.871 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-rgw-2:19.0.0-3154.g81797d87.el9.x86_64 108/170 2024-05-27T12:30:48.647 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-test-2:19.0.0-3154.g81797d87.el9.x86_64 143/170 2024-05-27T12:30:48.689 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : rbd-fuse-2:19.0.0-3154.g81797d87.el9.x86_64 144/170 2024-05-27T12:30:48.730 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : rbd-nbd-2:19.0.0-3154.g81797d87.el9.x86_64 145/170 2024-05-27T12:30:48.762 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 146/170 2024-05-27T12:30:48.789 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 147/170 2024-05-27T12:30:48.992 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : cephfs-shell-2:19.0.0-3154.g81797d87.el9.x86_64 148/170 2024-05-27T12:30:49.035 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 149/170 2024-05-27T12:30:49.067 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libcephfs-devel-2:19.0.0-3154.g81797d87.el9.x86_ 150/170 2024-05-27T12:30:49.116 INFO:teuthology.orchestra.run.smithi055.stdout: Upgrading : elfutils-debuginfod-client-0.191-4.el9.x86_64 151/170 2024-05-27T12:30:49.146 INFO:teuthology.orchestra.run.smithi055.stdout: Upgrading : NetworkManager-team-1:1.47.90-1.el9.x86_64 152/170 2024-05-27T12:30:49.192 INFO:teuthology.orchestra.run.smithi055.stdout: Upgrading : NetworkManager-tui-1:1.47.90-1.el9.x86_64 153/170 2024-05-27T12:30:49.834 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 154/170 2024-05-27T12:30:49.881 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 154/170 2024-05-27T12:30:49.903 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 154/170 2024-05-27T12:30:50.484 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-common-2:19.0.0-3154.g81797d87.el9.x86_64 109/170 2024-05-27T12:30:50.526 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-common-2:19.0.0-3154.g81797d87.el9.x86_64 109/170 2024-05-27T12:30:50.793 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : cephfs-top-2:19.0.0-3154.g81797d87.el9.noarch 155/170 2024-05-27T12:30:50.894 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 156/170 2024-05-27T12:30:50.937 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 157/170 2024-05-27T12:30:51.042 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : flex-2.6.4-9.el9.x86_64 158/170 2024-05-27T12:30:51.071 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-common-2:19.0.0-3154.g81797d87.el9.x86_64 109/170 2024-05-27T12:30:51.081 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : bison-3.7.4-5.el9.x86_64 159/170 2024-05-27T12:30:51.114 INFO:teuthology.orchestra.run.smithi055.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/170 2024-05-27T12:30:51.117 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-base-2:19.0.0-3154.g81797d87.el9.x86_64 110/170 2024-05-27T12:30:51.140 INFO:teuthology.orchestra.run.smithi055.stdout: Cleanup : elfutils-debuginfod-client-0.190-2.el9.x86_64 161/170 2024-05-27T12:30:51.166 INFO:teuthology.orchestra.run.smithi055.stdout: Cleanup : elfutils-libs-0.190-2.el9.x86_64 162/170 2024-05-27T12:30:51.167 INFO:teuthology.orchestra.run.smithi055.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 163/170 2024-05-27T12:30:51.208 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-base-2:19.0.0-3154.g81797d87.el9.x86_64 110/170 2024-05-27T12:30:51.208 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-27T12:30:51.208 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-27T12:30:51.208 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-27T12:30:51.237 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-selinux-2:19.0.0-3154.g81797d87.el9.x86_64 111/170 2024-05-27T12:30:51.251 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 163/170 2024-05-27T12:30:51.284 INFO:teuthology.orchestra.run.smithi055.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 164/170 2024-05-27T12:30:51.284 INFO:teuthology.orchestra.run.smithi055.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 165/170 2024-05-27T12:30:51.368 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 165/170 2024-05-27T12:30:51.393 INFO:teuthology.orchestra.run.smithi055.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 166/170 2024-05-27T12:30:51.399 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 167/170 2024-05-27T12:30:51.399 INFO:teuthology.orchestra.run.smithi055.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 167/170 2024-05-27T12:30:51.617 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 167/170 2024-05-27T12:30:51.617 INFO:teuthology.orchestra.run.smithi055.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 168/170 2024-05-27T12:30:51.704 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 168/170 2024-05-27T12:30:51.729 INFO:teuthology.orchestra.run.smithi055.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 169/170 2024-05-27T12:30:51.797 INFO:teuthology.orchestra.run.smithi055.stdout: Cleanup : elfutils-libelf-0.190-2.el9.x86_64 170/170 2024-05-27T12:30:57.304 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: elfutils-libelf-0.190-2.el9.x86_64 170/170 2024-05-27T12:30:57.305 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-2:19.0.0-3154.g81797d87.el9.x86_64 1/170 2024-05-27T12:30:57.305 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-base-2:19.0.0-3154.g81797d87.el9.x86_64 2/170 2024-05-27T12:30:57.305 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-common-2:19.0.0-3154.g81797d87.el9.x86_64 3/170 2024-05-27T12:30:57.305 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-fuse-2:19.0.0-3154.g81797d87.el9.x86_64 4/170 2024-05-27T12:30:57.305 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3154.g81797 5/170 2024-05-27T12:30:57.305 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-mds-2:19.0.0-3154.g81797d87.el9.x86_64 6/170 2024-05-27T12:30:57.305 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-mgr-2:19.0.0-3154.g81797d87.el9.x86_64 7/170 2024-05-27T12:30:57.305 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-mon-2:19.0.0-3154.g81797d87.el9.x86_64 8/170 2024-05-27T12:30:57.305 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-osd-2:19.0.0-3154.g81797d87.el9.x86_64 9/170 2024-05-27T12:30:57.305 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-radosgw-2:19.0.0-3154.g81797d87.el9.x86_64 10/170 2024-05-27T12:30:57.305 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-selinux-2:19.0.0-3154.g81797d87.el9.x86_64 11/170 2024-05-27T12:30:57.305 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-test-2:19.0.0-3154.g81797d87.el9.x86_64 12/170 2024-05-27T12:30:57.306 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : cephfs-mirror-2:19.0.0-3154.g81797d87.el9.x86_64 13/170 2024-05-27T12:30:57.306 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : cephfs-shell-2:19.0.0-3154.g81797d87.el9.x86_64 14/170 2024-05-27T12:30:57.306 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libcephfs-devel-2:19.0.0-3154.g81797d87.el9.x86_ 15/170 2024-05-27T12:30:57.306 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libcephfs2-2:19.0.0-3154.g81797d87.el9.x86_64 16/170 2024-05-27T12:30:57.306 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libcephsqlite-2:19.0.0-3154.g81797d87.el9.x86_64 17/170 2024-05-27T12:30:57.306 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : librados-devel-2:19.0.0-3154.g81797d87.el9.x86_6 18/170 2024-05-27T12:30:57.306 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libradosstriper1-2:19.0.0-3154.g81797d87.el9.x86 19/170 2024-05-27T12:30:57.306 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : librgw2-2:19.0.0-3154.g81797d87.el9.x86_64 20/170 2024-05-27T12:30:57.306 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3154.g81797d87.el 21/170 2024-05-27T12:30:57.307 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-ceph-common-2:19.0.0-3154.g81797d87.el9. 22/170 2024-05-27T12:30:57.307 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-cephfs-2:19.0.0-3154.g81797d87.el9.x86_6 23/170 2024-05-27T12:30:57.307 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-rados-2:19.0.0-3154.g81797d87.el9.x86_64 24/170 2024-05-27T12:30:57.307 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-rbd-2:19.0.0-3154.g81797d87.el9.x86_64 25/170 2024-05-27T12:30:57.307 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-rgw-2:19.0.0-3154.g81797d87.el9.x86_64 26/170 2024-05-27T12:30:57.307 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : rbd-fuse-2:19.0.0-3154.g81797d87.el9.x86_64 27/170 2024-05-27T12:30:57.307 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : rbd-mirror-2:19.0.0-3154.g81797d87.el9.x86_64 28/170 2024-05-27T12:30:57.307 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : rbd-nbd-2:19.0.0-3154.g81797d87.el9.x86_64 29/170 2024-05-27T12:30:57.307 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3154.g81797d87. 30/170 2024-05-27T12:30:57.307 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3154.g81797d87.el9.noa 31/170 2024-05-27T12:30:57.307 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3154.g81797d87.el9.n 32/170 2024-05-27T12:30:57.307 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3154.g817 33/170 2024-05-27T12:30:57.307 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3154.g81797d87.el 34/170 2024-05-27T12:30:57.308 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3154.g81797d87.el9.noarch 35/170 2024-05-27T12:30:57.308 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3154.g81797d87.e 36/170 2024-05-27T12:30:57.308 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-volume-2:19.0.0-3154.g81797d87.el9.noarch 37/170 2024-05-27T12:30:57.308 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : cephadm-2:19.0.0-3154.g81797d87.el9.noarch 38/170 2024-05-27T12:30:57.308 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : cephfs-top-2:19.0.0-3154.g81797d87.el9.noarch 39/170 2024-05-27T12:30:57.308 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/170 2024-05-27T12:30:57.308 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/170 2024-05-27T12:30:57.308 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/170 2024-05-27T12:30:57.308 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/170 2024-05-27T12:30:57.308 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/170 2024-05-27T12:30:57.308 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/170 2024-05-27T12:30:57.308 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/170 2024-05-27T12:30:57.308 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/170 2024-05-27T12:30:57.308 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/170 2024-05-27T12:30:57.309 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/170 2024-05-27T12:30:57.309 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/170 2024-05-27T12:30:57.309 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/170 2024-05-27T12:30:57.309 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/170 2024-05-27T12:30:57.309 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/170 2024-05-27T12:30:57.309 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/170 2024-05-27T12:30:57.309 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/170 2024-05-27T12:30:57.309 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/170 2024-05-27T12:30:57.309 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/170 2024-05-27T12:30:57.309 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/170 2024-05-27T12:30:57.309 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/170 2024-05-27T12:30:57.309 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/170 2024-05-27T12:30:57.309 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/170 2024-05-27T12:30:57.310 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/170 2024-05-27T12:30:57.310 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/170 2024-05-27T12:30:57.310 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/170 2024-05-27T12:30:57.310 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/170 2024-05-27T12:30:57.310 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/170 2024-05-27T12:30:57.310 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/170 2024-05-27T12:30:57.310 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/170 2024-05-27T12:30:57.310 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/170 2024-05-27T12:30:57.310 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/170 2024-05-27T12:30:57.310 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/170 2024-05-27T12:30:57.310 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/170 2024-05-27T12:30:57.310 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/170 2024-05-27T12:30:57.311 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/170 2024-05-27T12:30:57.311 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/170 2024-05-27T12:30:57.311 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/170 2024-05-27T12:30:57.311 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 77/170 2024-05-27T12:30:57.311 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/170 2024-05-27T12:30:57.311 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/170 2024-05-27T12:30:57.311 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/170 2024-05-27T12:30:57.311 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/170 2024-05-27T12:30:57.311 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/170 2024-05-27T12:30:57.311 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/170 2024-05-27T12:30:57.311 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/170 2024-05-27T12:30:57.311 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/170 2024-05-27T12:30:57.311 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/170 2024-05-27T12:30:57.312 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/170 2024-05-27T12:30:57.312 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/170 2024-05-27T12:30:57.312 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/170 2024-05-27T12:30:57.312 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/170 2024-05-27T12:30:57.312 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/170 2024-05-27T12:30:57.312 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/170 2024-05-27T12:30:57.312 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/170 2024-05-27T12:30:57.312 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/170 2024-05-27T12:30:57.312 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/170 2024-05-27T12:30:57.312 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/170 2024-05-27T12:30:57.312 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/170 2024-05-27T12:30:57.312 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/170 2024-05-27T12:30:57.312 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 99/170 2024-05-27T12:30:57.312 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/170 2024-05-27T12:30:57.313 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 101/170 2024-05-27T12:30:57.313 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/170 2024-05-27T12:30:57.313 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/170 2024-05-27T12:30:57.313 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/170 2024-05-27T12:30:57.313 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/170 2024-05-27T12:30:57.313 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/170 2024-05-27T12:30:57.313 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/170 2024-05-27T12:30:57.313 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/170 2024-05-27T12:30:57.313 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/170 2024-05-27T12:30:57.313 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/170 2024-05-27T12:30:57.313 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/170 2024-05-27T12:30:57.313 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/170 2024-05-27T12:30:57.313 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/170 2024-05-27T12:30:57.314 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/170 2024-05-27T12:30:57.314 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/170 2024-05-27T12:30:57.314 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/170 2024-05-27T12:30:57.314 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/170 2024-05-27T12:30:57.314 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 118/170 2024-05-27T12:30:57.314 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/170 2024-05-27T12:30:57.314 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/170 2024-05-27T12:30:57.314 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/170 2024-05-27T12:30:57.314 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/170 2024-05-27T12:30:57.314 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/170 2024-05-27T12:30:57.314 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/170 2024-05-27T12:30:57.314 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/170 2024-05-27T12:30:57.314 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/170 2024-05-27T12:30:57.315 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/170 2024-05-27T12:30:57.315 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/170 2024-05-27T12:30:57.315 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/170 2024-05-27T12:30:57.315 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/170 2024-05-27T12:30:57.315 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/170 2024-05-27T12:30:57.315 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/170 2024-05-27T12:30:57.315 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/170 2024-05-27T12:30:57.315 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/170 2024-05-27T12:30:57.315 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/170 2024-05-27T12:30:57.315 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/170 2024-05-27T12:30:57.315 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/170 2024-05-27T12:30:57.315 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/170 2024-05-27T12:30:57.315 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/170 2024-05-27T12:30:57.315 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/170 2024-05-27T12:30:57.315 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/170 2024-05-27T12:30:57.316 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/170 2024-05-27T12:30:57.316 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/170 2024-05-27T12:30:57.316 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/170 2024-05-27T12:30:57.316 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/170 2024-05-27T12:30:57.316 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/170 2024-05-27T12:30:57.316 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/170 2024-05-27T12:30:57.316 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/170 2024-05-27T12:30:57.316 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : librados2-2:19.0.0-3154.g81797d87.el9.x86_64 149/170 2024-05-27T12:30:57.316 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/170 2024-05-27T12:30:57.316 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : librbd1-2:19.0.0-3154.g81797d87.el9.x86_64 151/170 2024-05-27T12:30:57.316 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/170 2024-05-27T12:30:57.317 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : NetworkManager-1:1.47.90-1.el9.x86_64 153/170 2024-05-27T12:30:57.317 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 154/170 2024-05-27T12:30:57.317 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : NetworkManager-libnm-1:1.47.90-1.el9.x86_64 155/170 2024-05-27T12:30:57.317 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 156/170 2024-05-27T12:30:57.317 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : NetworkManager-team-1:1.47.90-1.el9.x86_64 157/170 2024-05-27T12:30:57.317 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 158/170 2024-05-27T12:30:57.317 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : NetworkManager-tui-1:1.47.90-1.el9.x86_64 159/170 2024-05-27T12:30:57.317 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/170 2024-05-27T12:30:57.317 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : elfutils-debuginfod-client-0.191-4.el9.x86_64 161/170 2024-05-27T12:30:57.317 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 162/170 2024-05-27T12:30:57.317 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : elfutils-libelf-0.191-4.el9.x86_64 163/170 2024-05-27T12:30:57.317 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 164/170 2024-05-27T12:30:57.317 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : elfutils-libs-0.191-4.el9.x86_64 165/170 2024-05-27T12:30:57.318 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 166/170 2024-05-27T12:30:57.318 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 167/170 2024-05-27T12:30:57.318 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 168/170 2024-05-27T12:30:57.318 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 169/170 2024-05-27T12:31:00.006 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 170/170 2024-05-27T12:31:00.006 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-27T12:31:00.007 INFO:teuthology.orchestra.run.smithi055.stdout:Upgraded: 2024-05-27T12:31:00.007 INFO:teuthology.orchestra.run.smithi055.stdout: NetworkManager-1:1.47.90-1.el9.x86_64 2024-05-27T12:31:00.007 INFO:teuthology.orchestra.run.smithi055.stdout: NetworkManager-libnm-1:1.47.90-1.el9.x86_64 2024-05-27T12:31:00.007 INFO:teuthology.orchestra.run.smithi055.stdout: NetworkManager-team-1:1.47.90-1.el9.x86_64 2024-05-27T12:31:00.007 INFO:teuthology.orchestra.run.smithi055.stdout: NetworkManager-tui-1:1.47.90-1.el9.x86_64 2024-05-27T12:31:00.007 INFO:teuthology.orchestra.run.smithi055.stdout: elfutils-debuginfod-client-0.191-4.el9.x86_64 2024-05-27T12:31:00.007 INFO:teuthology.orchestra.run.smithi055.stdout: elfutils-libelf-0.191-4.el9.x86_64 2024-05-27T12:31:00.007 INFO:teuthology.orchestra.run.smithi055.stdout: elfutils-libs-0.191-4.el9.x86_64 2024-05-27T12:31:00.007 INFO:teuthology.orchestra.run.smithi055.stdout: librados2-2:19.0.0-3154.g81797d87.el9.x86_64 2024-05-27T12:31:00.007 INFO:teuthology.orchestra.run.smithi055.stdout: librbd1-2:19.0.0-3154.g81797d87.el9.x86_64 2024-05-27T12:31:00.007 INFO:teuthology.orchestra.run.smithi055.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-05-27T12:31:00.007 INFO:teuthology.orchestra.run.smithi055.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-05-27T12:31:00.008 INFO:teuthology.orchestra.run.smithi055.stdout:Installed: 2024-05-27T12:31:00.008 INFO:teuthology.orchestra.run.smithi055.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-05-27T12:31:00.008 INFO:teuthology.orchestra.run.smithi055.stdout: automake-1.16.2-8.el9.noarch 2024-05-27T12:31:00.008 INFO:teuthology.orchestra.run.smithi055.stdout: bison-3.7.4-5.el9.x86_64 2024-05-27T12:31:00.008 INFO:teuthology.orchestra.run.smithi055.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-05-27T12:31:00.008 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-2:19.0.0-3154.g81797d87.el9.x86_64 2024-05-27T12:31:00.008 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-base-2:19.0.0-3154.g81797d87.el9.x86_64 2024-05-27T12:31:00.008 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-common-2:19.0.0-3154.g81797d87.el9.x86_64 2024-05-27T12:31:00.008 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-fuse-2:19.0.0-3154.g81797d87.el9.x86_64 2024-05-27T12:31:00.008 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-grafana-dashboards-2:19.0.0-3154.g81797d87.el9.noarch 2024-05-27T12:31:00.008 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-immutable-object-cache-2:19.0.0-3154.g81797d87.el9.x86_64 2024-05-27T12:31:00.008 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mds-2:19.0.0-3154.g81797d87.el9.x86_64 2024-05-27T12:31:00.009 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mgr-2:19.0.0-3154.g81797d87.el9.x86_64 2024-05-27T12:31:00.009 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mgr-cephadm-2:19.0.0-3154.g81797d87.el9.noarch 2024-05-27T12:31:00.009 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mgr-dashboard-2:19.0.0-3154.g81797d87.el9.noarch 2024-05-27T12:31:00.009 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3154.g81797d87.el9.noarch 2024-05-27T12:31:00.009 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mgr-modules-core-2:19.0.0-3154.g81797d87.el9.noarch 2024-05-27T12:31:00.009 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mgr-rook-2:19.0.0-3154.g81797d87.el9.noarch 2024-05-27T12:31:00.009 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mon-2:19.0.0-3154.g81797d87.el9.x86_64 2024-05-27T12:31:00.009 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-osd-2:19.0.0-3154.g81797d87.el9.x86_64 2024-05-27T12:31:00.009 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-prometheus-alerts-2:19.0.0-3154.g81797d87.el9.noarch 2024-05-27T12:31:00.009 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-radosgw-2:19.0.0-3154.g81797d87.el9.x86_64 2024-05-27T12:31:00.009 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-selinux-2:19.0.0-3154.g81797d87.el9.x86_64 2024-05-27T12:31:00.010 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-test-2:19.0.0-3154.g81797d87.el9.x86_64 2024-05-27T12:31:00.010 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-volume-2:19.0.0-3154.g81797d87.el9.noarch 2024-05-27T12:31:00.010 INFO:teuthology.orchestra.run.smithi055.stdout: cephadm-2:19.0.0-3154.g81797d87.el9.noarch 2024-05-27T12:31:00.010 INFO:teuthology.orchestra.run.smithi055.stdout: cephfs-mirror-2:19.0.0-3154.g81797d87.el9.x86_64 2024-05-27T12:31:00.010 INFO:teuthology.orchestra.run.smithi055.stdout: cephfs-shell-2:19.0.0-3154.g81797d87.el9.x86_64 2024-05-27T12:31:00.010 INFO:teuthology.orchestra.run.smithi055.stdout: cephfs-top-2:19.0.0-3154.g81797d87.el9.noarch 2024-05-27T12:31:00.010 INFO:teuthology.orchestra.run.smithi055.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-05-27T12:31:00.010 INFO:teuthology.orchestra.run.smithi055.stdout: flex-2.6.4-9.el9.x86_64 2024-05-27T12:31:00.010 INFO:teuthology.orchestra.run.smithi055.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-27T12:31:00.010 INFO:teuthology.orchestra.run.smithi055.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-27T12:31:00.010 INFO:teuthology.orchestra.run.smithi055.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-27T12:31:00.010 INFO:teuthology.orchestra.run.smithi055.stdout: fuse-2.9.9-15.el9.x86_64 2024-05-27T12:31:00.011 INFO:teuthology.orchestra.run.smithi055.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-27T12:31:00.011 INFO:teuthology.orchestra.run.smithi055.stdout: grpc-data-1.46.7-10.el9.noarch 2024-05-27T12:31:00.011 INFO:teuthology.orchestra.run.smithi055.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-05-27T12:31:00.011 INFO:teuthology.orchestra.run.smithi055.stdout: libarrow-9.0.0-11.el9.x86_64 2024-05-27T12:31:00.011 INFO:teuthology.orchestra.run.smithi055.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-05-27T12:31:00.011 INFO:teuthology.orchestra.run.smithi055.stdout: libcephfs-devel-2:19.0.0-3154.g81797d87.el9.x86_64 2024-05-27T12:31:00.011 INFO:teuthology.orchestra.run.smithi055.stdout: libcephfs2-2:19.0.0-3154.g81797d87.el9.x86_64 2024-05-27T12:31:00.011 INFO:teuthology.orchestra.run.smithi055.stdout: libcephsqlite-2:19.0.0-3154.g81797d87.el9.x86_64 2024-05-27T12:31:00.011 INFO:teuthology.orchestra.run.smithi055.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-27T12:31:00.011 INFO:teuthology.orchestra.run.smithi055.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-27T12:31:00.011 INFO:teuthology.orchestra.run.smithi055.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-27T12:31:00.011 INFO:teuthology.orchestra.run.smithi055.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-27T12:31:00.011 INFO:teuthology.orchestra.run.smithi055.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-27T12:31:00.011 INFO:teuthology.orchestra.run.smithi055.stdout: librados-devel-2:19.0.0-3154.g81797d87.el9.x86_64 2024-05-27T12:31:00.012 INFO:teuthology.orchestra.run.smithi055.stdout: libradosstriper1-2:19.0.0-3154.g81797d87.el9.x86_64 2024-05-27T12:31:00.012 INFO:teuthology.orchestra.run.smithi055.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-27T12:31:00.012 INFO:teuthology.orchestra.run.smithi055.stdout: librgw2-2:19.0.0-3154.g81797d87.el9.x86_64 2024-05-27T12:31:00.012 INFO:teuthology.orchestra.run.smithi055.stdout: libtool-2.4.6-45.el9.x86_64 2024-05-27T12:31:00.012 INFO:teuthology.orchestra.run.smithi055.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-27T12:31:00.012 INFO:teuthology.orchestra.run.smithi055.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-05-27T12:31:00.012 INFO:teuthology.orchestra.run.smithi055.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-05-27T12:31:00.012 INFO:teuthology.orchestra.run.smithi055.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-27T12:31:00.012 INFO:teuthology.orchestra.run.smithi055.stdout: lua-5.4.4-4.el9.x86_64 2024-05-27T12:31:00.012 INFO:teuthology.orchestra.run.smithi055.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-05-27T12:31:00.012 INFO:teuthology.orchestra.run.smithi055.stdout: luarocks-3.9.2-5.el9.noarch 2024-05-27T12:31:00.012 INFO:teuthology.orchestra.run.smithi055.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-27T12:31:00.012 INFO:teuthology.orchestra.run.smithi055.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-27T12:31:00.013 INFO:teuthology.orchestra.run.smithi055.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-05-27T12:31:00.013 INFO:teuthology.orchestra.run.smithi055.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-05-27T12:31:00.013 INFO:teuthology.orchestra.run.smithi055.stdout: postgresql-13.14-1.el9.x86_64 2024-05-27T12:31:00.013 INFO:teuthology.orchestra.run.smithi055.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-05-27T12:31:00.013 INFO:teuthology.orchestra.run.smithi055.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-05-27T12:31:00.013 INFO:teuthology.orchestra.run.smithi055.stdout: postgresql-server-13.14-1.el9.x86_64 2024-05-27T12:31:00.013 INFO:teuthology.orchestra.run.smithi055.stdout: protobuf-3.14.0-13.el9.x86_64 2024-05-27T12:31:00.013 INFO:teuthology.orchestra.run.smithi055.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-05-27T12:31:00.013 INFO:teuthology.orchestra.run.smithi055.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-27T12:31:00.013 INFO:teuthology.orchestra.run.smithi055.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-05-27T12:31:00.013 INFO:teuthology.orchestra.run.smithi055.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-27T12:31:00.013 INFO:teuthology.orchestra.run.smithi055.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-27T12:31:00.013 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-27T12:31:00.013 INFO:teuthology.orchestra.run.smithi055.stdout: python3-ceph-argparse-2:19.0.0-3154.g81797d87.el9.x86_64 2024-05-27T12:31:00.014 INFO:teuthology.orchestra.run.smithi055.stdout: python3-ceph-common-2:19.0.0-3154.g81797d87.el9.x86_64 2024-05-27T12:31:00.014 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cephfs-2:19.0.0-3154.g81797d87.el9.x86_64 2024-05-27T12:31:00.014 INFO:teuthology.orchestra.run.smithi055.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-27T12:31:00.014 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-27T12:31:00.014 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-27T12:31:00.014 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-27T12:31:00.014 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-05-27T12:31:00.014 INFO:teuthology.orchestra.run.smithi055.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-05-27T12:31:00.014 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-27T12:31:00.014 INFO:teuthology.orchestra.run.smithi055.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-27T12:31:00.014 INFO:teuthology.orchestra.run.smithi055.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-27T12:31:00.014 INFO:teuthology.orchestra.run.smithi055.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-05-27T12:31:00.014 INFO:teuthology.orchestra.run.smithi055.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-05-27T12:31:00.015 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-27T12:31:00.015 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-27T12:31:00.015 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-27T12:31:00.015 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-27T12:31:00.015 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-27T12:31:00.015 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-05-27T12:31:00.015 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-27T12:31:00.015 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-27T12:31:00.015 INFO:teuthology.orchestra.run.smithi055.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-27T12:31:00.015 INFO:teuthology.orchestra.run.smithi055.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-27T12:31:00.015 INFO:teuthology.orchestra.run.smithi055.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-27T12:31:00.015 INFO:teuthology.orchestra.run.smithi055.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-27T12:31:00.015 INFO:teuthology.orchestra.run.smithi055.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-27T12:31:00.016 INFO:teuthology.orchestra.run.smithi055.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-27T12:31:00.016 INFO:teuthology.orchestra.run.smithi055.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-27T12:31:00.016 INFO:teuthology.orchestra.run.smithi055.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-27T12:31:00.016 INFO:teuthology.orchestra.run.smithi055.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-27T12:31:00.016 INFO:teuthology.orchestra.run.smithi055.stdout: python3-packaging-20.9-5.el9.noarch 2024-05-27T12:31:00.016 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-27T12:31:00.016 INFO:teuthology.orchestra.run.smithi055.stdout: python3-ply-3.11-14.el9.noarch 2024-05-27T12:31:00.016 INFO:teuthology.orchestra.run.smithi055.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-27T12:31:00.016 INFO:teuthology.orchestra.run.smithi055.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-27T12:31:00.016 INFO:teuthology.orchestra.run.smithi055.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-05-27T12:31:00.016 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-27T12:31:00.016 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-27T12:31:00.016 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-27T12:31:00.017 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-27T12:31:00.017 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-05-27T12:31:00.017 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-27T12:31:00.017 INFO:teuthology.orchestra.run.smithi055.stdout: python3-rados-2:19.0.0-3154.g81797d87.el9.x86_64 2024-05-27T12:31:00.017 INFO:teuthology.orchestra.run.smithi055.stdout: python3-rbd-2:19.0.0-3154.g81797d87.el9.x86_64 2024-05-27T12:31:00.017 INFO:teuthology.orchestra.run.smithi055.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-27T12:31:00.017 INFO:teuthology.orchestra.run.smithi055.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-27T12:31:00.017 INFO:teuthology.orchestra.run.smithi055.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-27T12:31:00.017 INFO:teuthology.orchestra.run.smithi055.stdout: python3-rgw-2:19.0.0-3154.g81797d87.el9.x86_64 2024-05-27T12:31:00.017 INFO:teuthology.orchestra.run.smithi055.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-27T12:31:00.017 INFO:teuthology.orchestra.run.smithi055.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-27T12:31:00.017 INFO:teuthology.orchestra.run.smithi055.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-27T12:31:00.017 INFO:teuthology.orchestra.run.smithi055.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-27T12:31:00.017 INFO:teuthology.orchestra.run.smithi055.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-27T12:31:00.018 INFO:teuthology.orchestra.run.smithi055.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-27T12:31:00.018 INFO:teuthology.orchestra.run.smithi055.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-27T12:31:00.018 INFO:teuthology.orchestra.run.smithi055.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-05-27T12:31:00.018 INFO:teuthology.orchestra.run.smithi055.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-27T12:31:00.018 INFO:teuthology.orchestra.run.smithi055.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-27T12:31:00.018 INFO:teuthology.orchestra.run.smithi055.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-27T12:31:00.018 INFO:teuthology.orchestra.run.smithi055.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-27T12:31:00.018 INFO:teuthology.orchestra.run.smithi055.stdout: qatlib-24.02.0-1.el9.x86_64 2024-05-27T12:31:00.018 INFO:teuthology.orchestra.run.smithi055.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-05-27T12:31:00.018 INFO:teuthology.orchestra.run.smithi055.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-05-27T12:31:00.018 INFO:teuthology.orchestra.run.smithi055.stdout: rbd-fuse-2:19.0.0-3154.g81797d87.el9.x86_64 2024-05-27T12:31:00.018 INFO:teuthology.orchestra.run.smithi055.stdout: rbd-mirror-2:19.0.0-3154.g81797d87.el9.x86_64 2024-05-27T12:31:00.018 INFO:teuthology.orchestra.run.smithi055.stdout: rbd-nbd-2:19.0.0-3154.g81797d87.el9.x86_64 2024-05-27T12:31:00.019 INFO:teuthology.orchestra.run.smithi055.stdout: re2-1:20211101-3.el9.x86_64 2024-05-27T12:31:00.019 INFO:teuthology.orchestra.run.smithi055.stdout: socat-1.7.4.1-5.el9.x86_64 2024-05-27T12:31:00.019 INFO:teuthology.orchestra.run.smithi055.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-27T12:31:00.019 INFO:teuthology.orchestra.run.smithi055.stdout: uuid-1.6.2-55.el9.x86_64 2024-05-27T12:31:00.019 INFO:teuthology.orchestra.run.smithi055.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-05-27T12:31:00.019 INFO:teuthology.orchestra.run.smithi055.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-05-27T12:31:00.019 INFO:teuthology.orchestra.run.smithi055.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-05-27T12:31:00.019 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-27T12:31:00.020 INFO:teuthology.orchestra.run.smithi055.stdout:Complete! 2024-05-27T12:31:00.453 DEBUG:teuthology.parallel:result is None 2024-05-27T12:31:06.619 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3154.g81797d87.el9.x86_64 111/170 2024-05-27T12:31:06.620 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /sys 2024-05-27T12:31:06.620 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /proc 2024-05-27T12:31:06.620 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /mnt 2024-05-27T12:31:06.620 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /var/tmp 2024-05-27T12:31:06.620 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /home 2024-05-27T12:31:06.620 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /root 2024-05-27T12:31:06.620 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /tmp 2024-05-27T12:31:06.620 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-27T12:31:06.796 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-volume-2:19.0.0-3154.g81797d87.el9.noarch 112/170 2024-05-27T12:31:06.810 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-volume-2:19.0.0-3154.g81797d87.el9.noarch 112/170 2024-05-27T12:31:06.810 INFO:teuthology.orchestra.run.smithi072.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-27T12:31:06.810 INFO:teuthology.orchestra.run.smithi072.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-05-27T12:31:06.811 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-27T12:31:08.315 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-osd-2:19.0.0-3154.g81797d87.el9.x86_64 113/170 2024-05-27T12:31:08.341 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-osd-2:19.0.0-3154.g81797d87.el9.x86_64 113/170 2024-05-27T12:31:08.341 INFO:teuthology.orchestra.run.smithi072.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-27T12:31:08.341 INFO:teuthology.orchestra.run.smithi072.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-27T12:31:08.341 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-27T12:31:08.341 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-27T12:31:08.342 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-27T12:31:08.586 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mds-2:19.0.0-3154.g81797d87.el9.x86_64 114/170 2024-05-27T12:31:08.610 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mds-2:19.0.0-3154.g81797d87.el9.x86_64 114/170 2024-05-27T12:31:08.610 INFO:teuthology.orchestra.run.smithi072.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-27T12:31:08.610 INFO:teuthology.orchestra.run.smithi072.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-27T12:31:08.610 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-27T12:31:08.611 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-27T12:31:08.611 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-27T12:31:09.064 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mon-2:19.0.0-3154.g81797d87.el9.x86_64 115/170 2024-05-27T12:31:09.087 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mon-2:19.0.0-3154.g81797d87.el9.x86_64 115/170 2024-05-27T12:31:09.087 INFO:teuthology.orchestra.run.smithi072.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-27T12:31:09.087 INFO:teuthology.orchestra.run.smithi072.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-27T12:31:09.087 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-27T12:31:09.087 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-27T12:31:09.087 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-27T12:31:09.195 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : automake-1.16.2-8.el9.noarch 116/170 2024-05-27T12:31:09.253 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-ply-3.11-14.el9.noarch 117/170 2024-05-27T12:31:09.328 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 118/170 2024-05-27T12:31:09.514 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 119/170 2024-05-27T12:31:09.571 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 120/170 2024-05-27T12:31:09.642 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 121/170 2024-05-27T12:31:09.739 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 122/170 2024-05-27T12:31:09.898 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 123/170 2024-05-27T12:31:09.951 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 124/170 2024-05-27T12:31:09.992 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 125/170 2024-05-27T12:31:10.020 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : fuse-2.9.9-15.el9.x86_64 126/170 2024-05-27T12:31:10.449 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: cephadm-2:19.0.0-3154.g81797d87.el9.noarch 127/170 2024-05-27T12:31:10.490 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : cephadm-2:19.0.0-3154.g81797d87.el9.noarch 127/170 2024-05-27T12:31:10.523 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3154.g81797d87.e 128/170 2024-05-27T12:31:10.585 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3154.g81797d87. 129/170 2024-05-27T12:31:10.615 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3154.g81797d87.el9.noa 130/170 2024-05-27T12:31:11.647 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3154.g81797d87.el9.noa 130/170 2024-05-27T12:31:11.687 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3154.g81797d87.el9.n 131/170 2024-05-27T12:31:12.651 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3154.g81797d87.el9.n 131/170 2024-05-27T12:31:12.679 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3154.g817 132/170 2024-05-27T12:31:12.782 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3154.g817 132/170 2024-05-27T12:31:12.946 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3154.g81797d87.el 133/170 2024-05-27T12:31:12.976 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mgr-2:19.0.0-3154.g81797d87.el9.x86_64 134/170 2024-05-27T12:31:13.000 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3154.g81797d87.el9.x86_64 134/170 2024-05-27T12:31:13.000 INFO:teuthology.orchestra.run.smithi072.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-27T12:31:13.000 INFO:teuthology.orchestra.run.smithi072.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-27T12:31:13.000 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-27T12:31:13.000 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-27T12:31:13.000 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-27T12:31:13.045 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mgr-rook-2:19.0.0-3154.g81797d87.el9.noarch 135/170 2024-05-27T12:31:13.057 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3154.g81797d87.el9.noarch 135/170 2024-05-27T12:31:13.153 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-2:19.0.0-3154.g81797d87.el9.x86_64 136/170 2024-05-27T12:31:13.214 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-fuse-2:19.0.0-3154.g81797d87.el9.x86_64 137/170 2024-05-27T12:31:14.141 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libtool-2.4.6-45.el9.x86_64 138/170 2024-05-27T12:31:14.180 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-radosgw-2:19.0.0-3154.g81797d87.el9.x86_64 139/170 2024-05-27T12:31:14.203 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3154.g81797d87.el9.x86_64 139/170 2024-05-27T12:31:14.203 INFO:teuthology.orchestra.run.smithi072.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-27T12:31:14.203 INFO:teuthology.orchestra.run.smithi072.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-27T12:31:14.203 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-27T12:31:14.204 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-27T12:31:14.204 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-27T12:31:14.244 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3154.g81797 140/170 2024-05-27T12:31:14.267 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3154.g81797 140/170 2024-05-27T12:31:14.267 INFO:teuthology.orchestra.run.smithi072.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-27T12:31:14.267 INFO:teuthology.orchestra.run.smithi072.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-27T12:31:14.267 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-27T12:31:14.320 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : cephfs-mirror-2:19.0.0-3154.g81797d87.el9.x86_64 141/170 2024-05-27T12:31:14.343 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3154.g81797d87.el9.x86_64 141/170 2024-05-27T12:31:14.344 INFO:teuthology.orchestra.run.smithi072.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-27T12:31:14.344 INFO:teuthology.orchestra.run.smithi072.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-05-27T12:31:14.344 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-27T12:31:14.344 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-27T12:31:14.344 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-27T12:31:14.646 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : rbd-mirror-2:19.0.0-3154.g81797d87.el9.x86_64 142/170 2024-05-27T12:31:14.669 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3154.g81797d87.el9.x86_64 142/170 2024-05-27T12:31:14.670 INFO:teuthology.orchestra.run.smithi072.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-27T12:31:14.670 INFO:teuthology.orchestra.run.smithi072.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-27T12:31:14.670 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-27T12:31:14.670 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-27T12:31:14.670 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-27T12:31:19.299 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-test-2:19.0.0-3154.g81797d87.el9.x86_64 143/170 2024-05-27T12:31:19.349 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : rbd-fuse-2:19.0.0-3154.g81797d87.el9.x86_64 144/170 2024-05-27T12:31:19.399 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : rbd-nbd-2:19.0.0-3154.g81797d87.el9.x86_64 145/170 2024-05-27T12:31:19.433 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 146/170 2024-05-27T12:31:19.469 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 147/170 2024-05-27T12:31:19.659 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : cephfs-shell-2:19.0.0-3154.g81797d87.el9.x86_64 148/170 2024-05-27T12:31:19.721 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 149/170 2024-05-27T12:31:19.753 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libcephfs-devel-2:19.0.0-3154.g81797d87.el9.x86_ 150/170 2024-05-27T12:31:19.795 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : elfutils-debuginfod-client-0.191-4.el9.x86_64 151/170 2024-05-27T12:31:19.834 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : NetworkManager-team-1:1.47.90-1.el9.x86_64 152/170 2024-05-27T12:31:19.889 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : NetworkManager-tui-1:1.47.90-1.el9.x86_64 153/170 2024-05-27T12:31:20.518 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 154/170 2024-05-27T12:31:20.572 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 154/170 2024-05-27T12:31:20.592 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 154/170 2024-05-27T12:31:21.425 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : cephfs-top-2:19.0.0-3154.g81797d87.el9.noarch 155/170 2024-05-27T12:31:21.533 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 156/170 2024-05-27T12:31:21.583 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 157/170 2024-05-27T12:31:21.682 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : flex-2.6.4-9.el9.x86_64 158/170 2024-05-27T12:31:21.725 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : bison-3.7.4-5.el9.x86_64 159/170 2024-05-27T12:31:21.758 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/170 2024-05-27T12:31:21.792 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : elfutils-debuginfod-client-0.190-2.el9.x86_64 161/170 2024-05-27T12:31:21.828 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : elfutils-libs-0.190-2.el9.x86_64 162/170 2024-05-27T12:31:21.828 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 163/170 2024-05-27T12:31:21.922 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 163/170 2024-05-27T12:31:21.964 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 164/170 2024-05-27T12:31:21.964 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 165/170 2024-05-27T12:31:22.057 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 165/170 2024-05-27T12:31:22.092 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 166/170 2024-05-27T12:31:22.097 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 167/170 2024-05-27T12:31:22.097 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 167/170 2024-05-27T12:31:22.287 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 167/170 2024-05-27T12:31:22.287 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 168/170 2024-05-27T12:31:22.380 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 168/170 2024-05-27T12:31:22.414 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 169/170 2024-05-27T12:31:22.490 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : elfutils-libelf-0.190-2.el9.x86_64 170/170 2024-05-27T12:31:32.431 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: elfutils-libelf-0.190-2.el9.x86_64 170/170 2024-05-27T12:31:32.432 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-2:19.0.0-3154.g81797d87.el9.x86_64 1/170 2024-05-27T12:31:32.432 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-base-2:19.0.0-3154.g81797d87.el9.x86_64 2/170 2024-05-27T12:31:32.432 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-common-2:19.0.0-3154.g81797d87.el9.x86_64 3/170 2024-05-27T12:31:32.432 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-fuse-2:19.0.0-3154.g81797d87.el9.x86_64 4/170 2024-05-27T12:31:32.432 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3154.g81797 5/170 2024-05-27T12:31:32.432 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mds-2:19.0.0-3154.g81797d87.el9.x86_64 6/170 2024-05-27T12:31:32.432 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mgr-2:19.0.0-3154.g81797d87.el9.x86_64 7/170 2024-05-27T12:31:32.432 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mon-2:19.0.0-3154.g81797d87.el9.x86_64 8/170 2024-05-27T12:31:32.433 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-osd-2:19.0.0-3154.g81797d87.el9.x86_64 9/170 2024-05-27T12:31:32.433 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-radosgw-2:19.0.0-3154.g81797d87.el9.x86_64 10/170 2024-05-27T12:31:32.433 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-selinux-2:19.0.0-3154.g81797d87.el9.x86_64 11/170 2024-05-27T12:31:32.433 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-test-2:19.0.0-3154.g81797d87.el9.x86_64 12/170 2024-05-27T12:31:32.433 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : cephfs-mirror-2:19.0.0-3154.g81797d87.el9.x86_64 13/170 2024-05-27T12:31:32.433 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : cephfs-shell-2:19.0.0-3154.g81797d87.el9.x86_64 14/170 2024-05-27T12:31:32.433 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libcephfs-devel-2:19.0.0-3154.g81797d87.el9.x86_ 15/170 2024-05-27T12:31:32.433 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libcephfs2-2:19.0.0-3154.g81797d87.el9.x86_64 16/170 2024-05-27T12:31:32.433 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libcephsqlite-2:19.0.0-3154.g81797d87.el9.x86_64 17/170 2024-05-27T12:31:32.434 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librados-devel-2:19.0.0-3154.g81797d87.el9.x86_6 18/170 2024-05-27T12:31:32.434 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libradosstriper1-2:19.0.0-3154.g81797d87.el9.x86 19/170 2024-05-27T12:31:32.434 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librgw2-2:19.0.0-3154.g81797d87.el9.x86_64 20/170 2024-05-27T12:31:32.434 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3154.g81797d87.el 21/170 2024-05-27T12:31:32.434 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-ceph-common-2:19.0.0-3154.g81797d87.el9. 22/170 2024-05-27T12:31:32.434 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-cephfs-2:19.0.0-3154.g81797d87.el9.x86_6 23/170 2024-05-27T12:31:32.434 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-rados-2:19.0.0-3154.g81797d87.el9.x86_64 24/170 2024-05-27T12:31:32.435 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-rbd-2:19.0.0-3154.g81797d87.el9.x86_64 25/170 2024-05-27T12:31:32.435 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-rgw-2:19.0.0-3154.g81797d87.el9.x86_64 26/170 2024-05-27T12:31:32.435 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : rbd-fuse-2:19.0.0-3154.g81797d87.el9.x86_64 27/170 2024-05-27T12:31:32.435 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : rbd-mirror-2:19.0.0-3154.g81797d87.el9.x86_64 28/170 2024-05-27T12:31:32.435 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : rbd-nbd-2:19.0.0-3154.g81797d87.el9.x86_64 29/170 2024-05-27T12:31:32.435 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3154.g81797d87. 30/170 2024-05-27T12:31:32.435 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3154.g81797d87.el9.noa 31/170 2024-05-27T12:31:32.435 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3154.g81797d87.el9.n 32/170 2024-05-27T12:31:32.435 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3154.g817 33/170 2024-05-27T12:31:32.435 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3154.g81797d87.el 34/170 2024-05-27T12:31:32.435 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3154.g81797d87.el9.noarch 35/170 2024-05-27T12:31:32.436 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3154.g81797d87.e 36/170 2024-05-27T12:31:32.436 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-volume-2:19.0.0-3154.g81797d87.el9.noarch 37/170 2024-05-27T12:31:32.437 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : cephadm-2:19.0.0-3154.g81797d87.el9.noarch 38/170 2024-05-27T12:31:32.437 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : cephfs-top-2:19.0.0-3154.g81797d87.el9.noarch 39/170 2024-05-27T12:31:32.437 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/170 2024-05-27T12:31:32.437 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/170 2024-05-27T12:31:32.437 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/170 2024-05-27T12:31:32.437 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/170 2024-05-27T12:31:32.437 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/170 2024-05-27T12:31:32.437 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/170 2024-05-27T12:31:32.437 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/170 2024-05-27T12:31:32.437 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/170 2024-05-27T12:31:32.437 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/170 2024-05-27T12:31:32.437 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/170 2024-05-27T12:31:32.437 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/170 2024-05-27T12:31:32.438 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/170 2024-05-27T12:31:32.438 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/170 2024-05-27T12:31:32.438 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/170 2024-05-27T12:31:32.438 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/170 2024-05-27T12:31:32.438 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/170 2024-05-27T12:31:32.438 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/170 2024-05-27T12:31:32.438 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/170 2024-05-27T12:31:32.438 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/170 2024-05-27T12:31:32.438 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/170 2024-05-27T12:31:32.438 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/170 2024-05-27T12:31:32.438 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/170 2024-05-27T12:31:32.439 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/170 2024-05-27T12:31:32.439 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/170 2024-05-27T12:31:32.439 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/170 2024-05-27T12:31:32.439 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/170 2024-05-27T12:31:32.439 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/170 2024-05-27T12:31:32.439 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/170 2024-05-27T12:31:32.439 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/170 2024-05-27T12:31:32.439 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/170 2024-05-27T12:31:32.439 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/170 2024-05-27T12:31:32.439 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/170 2024-05-27T12:31:32.439 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/170 2024-05-27T12:31:32.439 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/170 2024-05-27T12:31:32.439 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/170 2024-05-27T12:31:32.440 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/170 2024-05-27T12:31:32.440 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/170 2024-05-27T12:31:32.440 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 77/170 2024-05-27T12:31:32.440 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/170 2024-05-27T12:31:32.440 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/170 2024-05-27T12:31:32.440 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/170 2024-05-27T12:31:32.440 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/170 2024-05-27T12:31:32.440 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/170 2024-05-27T12:31:32.440 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/170 2024-05-27T12:31:32.440 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/170 2024-05-27T12:31:32.440 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/170 2024-05-27T12:31:32.440 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/170 2024-05-27T12:31:32.441 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/170 2024-05-27T12:31:32.441 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/170 2024-05-27T12:31:32.441 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/170 2024-05-27T12:31:32.441 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/170 2024-05-27T12:31:32.441 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/170 2024-05-27T12:31:32.441 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/170 2024-05-27T12:31:32.441 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/170 2024-05-27T12:31:32.441 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/170 2024-05-27T12:31:32.441 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/170 2024-05-27T12:31:32.441 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/170 2024-05-27T12:31:32.441 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/170 2024-05-27T12:31:32.441 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/170 2024-05-27T12:31:32.441 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 99/170 2024-05-27T12:31:32.441 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/170 2024-05-27T12:31:32.442 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 101/170 2024-05-27T12:31:32.442 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/170 2024-05-27T12:31:32.442 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/170 2024-05-27T12:31:32.442 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/170 2024-05-27T12:31:32.442 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/170 2024-05-27T12:31:32.442 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/170 2024-05-27T12:31:32.442 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/170 2024-05-27T12:31:32.442 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/170 2024-05-27T12:31:32.442 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/170 2024-05-27T12:31:32.442 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/170 2024-05-27T12:31:32.442 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/170 2024-05-27T12:31:32.442 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/170 2024-05-27T12:31:32.443 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/170 2024-05-27T12:31:32.443 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/170 2024-05-27T12:31:32.443 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/170 2024-05-27T12:31:32.443 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/170 2024-05-27T12:31:32.443 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/170 2024-05-27T12:31:32.443 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 118/170 2024-05-27T12:31:32.443 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/170 2024-05-27T12:31:32.443 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/170 2024-05-27T12:31:32.443 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/170 2024-05-27T12:31:32.443 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/170 2024-05-27T12:31:32.443 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/170 2024-05-27T12:31:32.443 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/170 2024-05-27T12:31:32.443 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/170 2024-05-27T12:31:32.444 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/170 2024-05-27T12:31:32.444 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/170 2024-05-27T12:31:32.444 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/170 2024-05-27T12:31:32.444 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/170 2024-05-27T12:31:32.444 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/170 2024-05-27T12:31:32.444 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/170 2024-05-27T12:31:32.444 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/170 2024-05-27T12:31:32.444 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/170 2024-05-27T12:31:32.444 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/170 2024-05-27T12:31:32.444 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/170 2024-05-27T12:31:32.445 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/170 2024-05-27T12:31:32.445 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/170 2024-05-27T12:31:32.445 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/170 2024-05-27T12:31:32.445 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/170 2024-05-27T12:31:32.445 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/170 2024-05-27T12:31:32.445 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/170 2024-05-27T12:31:32.445 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/170 2024-05-27T12:31:32.445 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/170 2024-05-27T12:31:32.445 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/170 2024-05-27T12:31:32.446 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/170 2024-05-27T12:31:32.446 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/170 2024-05-27T12:31:32.446 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/170 2024-05-27T12:31:32.446 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/170 2024-05-27T12:31:32.446 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librados2-2:19.0.0-3154.g81797d87.el9.x86_64 149/170 2024-05-27T12:31:32.446 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/170 2024-05-27T12:31:32.446 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librbd1-2:19.0.0-3154.g81797d87.el9.x86_64 151/170 2024-05-27T12:31:32.446 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/170 2024-05-27T12:31:32.446 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : NetworkManager-1:1.47.90-1.el9.x86_64 153/170 2024-05-27T12:31:32.446 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 154/170 2024-05-27T12:31:32.446 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : NetworkManager-libnm-1:1.47.90-1.el9.x86_64 155/170 2024-05-27T12:31:32.446 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 156/170 2024-05-27T12:31:32.447 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : NetworkManager-team-1:1.47.90-1.el9.x86_64 157/170 2024-05-27T12:31:32.447 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 158/170 2024-05-27T12:31:32.447 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : NetworkManager-tui-1:1.47.90-1.el9.x86_64 159/170 2024-05-27T12:31:32.447 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/170 2024-05-27T12:31:32.447 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : elfutils-debuginfod-client-0.191-4.el9.x86_64 161/170 2024-05-27T12:31:32.447 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 162/170 2024-05-27T12:31:32.447 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : elfutils-libelf-0.191-4.el9.x86_64 163/170 2024-05-27T12:31:32.448 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 164/170 2024-05-27T12:31:32.448 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : elfutils-libs-0.191-4.el9.x86_64 165/170 2024-05-27T12:31:32.448 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 166/170 2024-05-27T12:31:32.448 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 167/170 2024-05-27T12:31:32.448 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 168/170 2024-05-27T12:31:32.449 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 169/170 2024-05-27T12:31:35.182 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 170/170 2024-05-27T12:31:35.182 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-27T12:31:35.183 INFO:teuthology.orchestra.run.smithi072.stdout:Upgraded: 2024-05-27T12:31:35.183 INFO:teuthology.orchestra.run.smithi072.stdout: NetworkManager-1:1.47.90-1.el9.x86_64 2024-05-27T12:31:35.183 INFO:teuthology.orchestra.run.smithi072.stdout: NetworkManager-libnm-1:1.47.90-1.el9.x86_64 2024-05-27T12:31:35.183 INFO:teuthology.orchestra.run.smithi072.stdout: NetworkManager-team-1:1.47.90-1.el9.x86_64 2024-05-27T12:31:35.183 INFO:teuthology.orchestra.run.smithi072.stdout: NetworkManager-tui-1:1.47.90-1.el9.x86_64 2024-05-27T12:31:35.183 INFO:teuthology.orchestra.run.smithi072.stdout: elfutils-debuginfod-client-0.191-4.el9.x86_64 2024-05-27T12:31:35.183 INFO:teuthology.orchestra.run.smithi072.stdout: elfutils-libelf-0.191-4.el9.x86_64 2024-05-27T12:31:35.183 INFO:teuthology.orchestra.run.smithi072.stdout: elfutils-libs-0.191-4.el9.x86_64 2024-05-27T12:31:35.183 INFO:teuthology.orchestra.run.smithi072.stdout: librados2-2:19.0.0-3154.g81797d87.el9.x86_64 2024-05-27T12:31:35.183 INFO:teuthology.orchestra.run.smithi072.stdout: librbd1-2:19.0.0-3154.g81797d87.el9.x86_64 2024-05-27T12:31:35.183 INFO:teuthology.orchestra.run.smithi072.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-05-27T12:31:35.183 INFO:teuthology.orchestra.run.smithi072.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-05-27T12:31:35.184 INFO:teuthology.orchestra.run.smithi072.stdout:Installed: 2024-05-27T12:31:35.184 INFO:teuthology.orchestra.run.smithi072.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-05-27T12:31:35.184 INFO:teuthology.orchestra.run.smithi072.stdout: automake-1.16.2-8.el9.noarch 2024-05-27T12:31:35.184 INFO:teuthology.orchestra.run.smithi072.stdout: bison-3.7.4-5.el9.x86_64 2024-05-27T12:31:35.184 INFO:teuthology.orchestra.run.smithi072.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-05-27T12:31:35.184 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-2:19.0.0-3154.g81797d87.el9.x86_64 2024-05-27T12:31:35.184 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-base-2:19.0.0-3154.g81797d87.el9.x86_64 2024-05-27T12:31:35.184 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-common-2:19.0.0-3154.g81797d87.el9.x86_64 2024-05-27T12:31:35.184 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-fuse-2:19.0.0-3154.g81797d87.el9.x86_64 2024-05-27T12:31:35.184 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-grafana-dashboards-2:19.0.0-3154.g81797d87.el9.noarch 2024-05-27T12:31:35.184 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-immutable-object-cache-2:19.0.0-3154.g81797d87.el9.x86_64 2024-05-27T12:31:35.185 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mds-2:19.0.0-3154.g81797d87.el9.x86_64 2024-05-27T12:31:35.185 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-2:19.0.0-3154.g81797d87.el9.x86_64 2024-05-27T12:31:35.185 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-cephadm-2:19.0.0-3154.g81797d87.el9.noarch 2024-05-27T12:31:35.185 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-dashboard-2:19.0.0-3154.g81797d87.el9.noarch 2024-05-27T12:31:35.185 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3154.g81797d87.el9.noarch 2024-05-27T12:31:35.185 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-modules-core-2:19.0.0-3154.g81797d87.el9.noarch 2024-05-27T12:31:35.185 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-rook-2:19.0.0-3154.g81797d87.el9.noarch 2024-05-27T12:31:35.185 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mon-2:19.0.0-3154.g81797d87.el9.x86_64 2024-05-27T12:31:35.185 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-osd-2:19.0.0-3154.g81797d87.el9.x86_64 2024-05-27T12:31:35.185 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-prometheus-alerts-2:19.0.0-3154.g81797d87.el9.noarch 2024-05-27T12:31:35.185 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-radosgw-2:19.0.0-3154.g81797d87.el9.x86_64 2024-05-27T12:31:35.185 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-selinux-2:19.0.0-3154.g81797d87.el9.x86_64 2024-05-27T12:31:35.185 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-test-2:19.0.0-3154.g81797d87.el9.x86_64 2024-05-27T12:31:35.186 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-volume-2:19.0.0-3154.g81797d87.el9.noarch 2024-05-27T12:31:35.186 INFO:teuthology.orchestra.run.smithi072.stdout: cephadm-2:19.0.0-3154.g81797d87.el9.noarch 2024-05-27T12:31:35.186 INFO:teuthology.orchestra.run.smithi072.stdout: cephfs-mirror-2:19.0.0-3154.g81797d87.el9.x86_64 2024-05-27T12:31:35.186 INFO:teuthology.orchestra.run.smithi072.stdout: cephfs-shell-2:19.0.0-3154.g81797d87.el9.x86_64 2024-05-27T12:31:35.186 INFO:teuthology.orchestra.run.smithi072.stdout: cephfs-top-2:19.0.0-3154.g81797d87.el9.noarch 2024-05-27T12:31:35.186 INFO:teuthology.orchestra.run.smithi072.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-05-27T12:31:35.186 INFO:teuthology.orchestra.run.smithi072.stdout: flex-2.6.4-9.el9.x86_64 2024-05-27T12:31:35.186 INFO:teuthology.orchestra.run.smithi072.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-27T12:31:35.186 INFO:teuthology.orchestra.run.smithi072.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-27T12:31:35.186 INFO:teuthology.orchestra.run.smithi072.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-27T12:31:35.186 INFO:teuthology.orchestra.run.smithi072.stdout: fuse-2.9.9-15.el9.x86_64 2024-05-27T12:31:35.186 INFO:teuthology.orchestra.run.smithi072.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-27T12:31:35.186 INFO:teuthology.orchestra.run.smithi072.stdout: grpc-data-1.46.7-10.el9.noarch 2024-05-27T12:31:35.187 INFO:teuthology.orchestra.run.smithi072.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-05-27T12:31:35.187 INFO:teuthology.orchestra.run.smithi072.stdout: libarrow-9.0.0-11.el9.x86_64 2024-05-27T12:31:35.187 INFO:teuthology.orchestra.run.smithi072.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-05-27T12:31:35.187 INFO:teuthology.orchestra.run.smithi072.stdout: libcephfs-devel-2:19.0.0-3154.g81797d87.el9.x86_64 2024-05-27T12:31:35.187 INFO:teuthology.orchestra.run.smithi072.stdout: libcephfs2-2:19.0.0-3154.g81797d87.el9.x86_64 2024-05-27T12:31:35.187 INFO:teuthology.orchestra.run.smithi072.stdout: libcephsqlite-2:19.0.0-3154.g81797d87.el9.x86_64 2024-05-27T12:31:35.187 INFO:teuthology.orchestra.run.smithi072.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-27T12:31:35.187 INFO:teuthology.orchestra.run.smithi072.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-27T12:31:35.187 INFO:teuthology.orchestra.run.smithi072.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-27T12:31:35.187 INFO:teuthology.orchestra.run.smithi072.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-27T12:31:35.187 INFO:teuthology.orchestra.run.smithi072.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-27T12:31:35.187 INFO:teuthology.orchestra.run.smithi072.stdout: librados-devel-2:19.0.0-3154.g81797d87.el9.x86_64 2024-05-27T12:31:35.187 INFO:teuthology.orchestra.run.smithi072.stdout: libradosstriper1-2:19.0.0-3154.g81797d87.el9.x86_64 2024-05-27T12:31:35.187 INFO:teuthology.orchestra.run.smithi072.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-27T12:31:35.188 INFO:teuthology.orchestra.run.smithi072.stdout: librgw2-2:19.0.0-3154.g81797d87.el9.x86_64 2024-05-27T12:31:35.188 INFO:teuthology.orchestra.run.smithi072.stdout: libtool-2.4.6-45.el9.x86_64 2024-05-27T12:31:35.188 INFO:teuthology.orchestra.run.smithi072.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-27T12:31:35.188 INFO:teuthology.orchestra.run.smithi072.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-05-27T12:31:35.188 INFO:teuthology.orchestra.run.smithi072.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-05-27T12:31:35.188 INFO:teuthology.orchestra.run.smithi072.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-27T12:31:35.188 INFO:teuthology.orchestra.run.smithi072.stdout: lua-5.4.4-4.el9.x86_64 2024-05-27T12:31:35.188 INFO:teuthology.orchestra.run.smithi072.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-05-27T12:31:35.188 INFO:teuthology.orchestra.run.smithi072.stdout: luarocks-3.9.2-5.el9.noarch 2024-05-27T12:31:35.188 INFO:teuthology.orchestra.run.smithi072.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-27T12:31:35.188 INFO:teuthology.orchestra.run.smithi072.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-27T12:31:35.188 INFO:teuthology.orchestra.run.smithi072.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-05-27T12:31:35.189 INFO:teuthology.orchestra.run.smithi072.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-05-27T12:31:35.189 INFO:teuthology.orchestra.run.smithi072.stdout: postgresql-13.14-1.el9.x86_64 2024-05-27T12:31:35.189 INFO:teuthology.orchestra.run.smithi072.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-05-27T12:31:35.189 INFO:teuthology.orchestra.run.smithi072.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-05-27T12:31:35.189 INFO:teuthology.orchestra.run.smithi072.stdout: postgresql-server-13.14-1.el9.x86_64 2024-05-27T12:31:35.189 INFO:teuthology.orchestra.run.smithi072.stdout: protobuf-3.14.0-13.el9.x86_64 2024-05-27T12:31:35.189 INFO:teuthology.orchestra.run.smithi072.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-05-27T12:31:35.189 INFO:teuthology.orchestra.run.smithi072.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-27T12:31:35.189 INFO:teuthology.orchestra.run.smithi072.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-05-27T12:31:35.189 INFO:teuthology.orchestra.run.smithi072.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-27T12:31:35.189 INFO:teuthology.orchestra.run.smithi072.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-27T12:31:35.189 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-27T12:31:35.190 INFO:teuthology.orchestra.run.smithi072.stdout: python3-ceph-argparse-2:19.0.0-3154.g81797d87.el9.x86_64 2024-05-27T12:31:35.190 INFO:teuthology.orchestra.run.smithi072.stdout: python3-ceph-common-2:19.0.0-3154.g81797d87.el9.x86_64 2024-05-27T12:31:35.190 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cephfs-2:19.0.0-3154.g81797d87.el9.x86_64 2024-05-27T12:31:35.190 INFO:teuthology.orchestra.run.smithi072.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-27T12:31:35.190 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-27T12:31:35.190 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-27T12:31:35.190 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-27T12:31:35.190 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-05-27T12:31:35.190 INFO:teuthology.orchestra.run.smithi072.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-05-27T12:31:35.190 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-27T12:31:35.190 INFO:teuthology.orchestra.run.smithi072.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-27T12:31:35.190 INFO:teuthology.orchestra.run.smithi072.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-27T12:31:35.191 INFO:teuthology.orchestra.run.smithi072.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-05-27T12:31:35.191 INFO:teuthology.orchestra.run.smithi072.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-05-27T12:31:35.191 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-27T12:31:35.191 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-27T12:31:35.191 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-27T12:31:35.191 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-27T12:31:35.191 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-27T12:31:35.191 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-05-27T12:31:35.191 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-27T12:31:35.191 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-27T12:31:35.191 INFO:teuthology.orchestra.run.smithi072.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-27T12:31:35.191 INFO:teuthology.orchestra.run.smithi072.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-27T12:31:35.191 INFO:teuthology.orchestra.run.smithi072.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-27T12:31:35.192 INFO:teuthology.orchestra.run.smithi072.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-27T12:31:35.192 INFO:teuthology.orchestra.run.smithi072.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-27T12:31:35.192 INFO:teuthology.orchestra.run.smithi072.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-27T12:31:35.192 INFO:teuthology.orchestra.run.smithi072.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-27T12:31:35.192 INFO:teuthology.orchestra.run.smithi072.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-27T12:31:35.192 INFO:teuthology.orchestra.run.smithi072.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-27T12:31:35.192 INFO:teuthology.orchestra.run.smithi072.stdout: python3-packaging-20.9-5.el9.noarch 2024-05-27T12:31:35.192 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-27T12:31:35.192 INFO:teuthology.orchestra.run.smithi072.stdout: python3-ply-3.11-14.el9.noarch 2024-05-27T12:31:35.192 INFO:teuthology.orchestra.run.smithi072.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-27T12:31:35.192 INFO:teuthology.orchestra.run.smithi072.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-27T12:31:35.192 INFO:teuthology.orchestra.run.smithi072.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-05-27T12:31:35.192 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-27T12:31:35.192 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-27T12:31:35.193 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-27T12:31:35.193 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-27T12:31:35.193 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-05-27T12:31:35.193 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-27T12:31:35.193 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rados-2:19.0.0-3154.g81797d87.el9.x86_64 2024-05-27T12:31:35.193 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rbd-2:19.0.0-3154.g81797d87.el9.x86_64 2024-05-27T12:31:35.193 INFO:teuthology.orchestra.run.smithi072.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-27T12:31:35.193 INFO:teuthology.orchestra.run.smithi072.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-27T12:31:35.193 INFO:teuthology.orchestra.run.smithi072.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-27T12:31:35.193 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rgw-2:19.0.0-3154.g81797d87.el9.x86_64 2024-05-27T12:31:35.193 INFO:teuthology.orchestra.run.smithi072.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-27T12:31:35.193 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-27T12:31:35.193 INFO:teuthology.orchestra.run.smithi072.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-27T12:31:35.193 INFO:teuthology.orchestra.run.smithi072.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-27T12:31:35.194 INFO:teuthology.orchestra.run.smithi072.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-27T12:31:35.194 INFO:teuthology.orchestra.run.smithi072.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-27T12:31:35.194 INFO:teuthology.orchestra.run.smithi072.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-27T12:31:35.194 INFO:teuthology.orchestra.run.smithi072.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-05-27T12:31:35.194 INFO:teuthology.orchestra.run.smithi072.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-27T12:31:35.194 INFO:teuthology.orchestra.run.smithi072.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-27T12:31:35.194 INFO:teuthology.orchestra.run.smithi072.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-27T12:31:35.194 INFO:teuthology.orchestra.run.smithi072.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-27T12:31:35.194 INFO:teuthology.orchestra.run.smithi072.stdout: qatlib-24.02.0-1.el9.x86_64 2024-05-27T12:31:35.194 INFO:teuthology.orchestra.run.smithi072.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-05-27T12:31:35.194 INFO:teuthology.orchestra.run.smithi072.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-05-27T12:31:35.194 INFO:teuthology.orchestra.run.smithi072.stdout: rbd-fuse-2:19.0.0-3154.g81797d87.el9.x86_64 2024-05-27T12:31:35.194 INFO:teuthology.orchestra.run.smithi072.stdout: rbd-mirror-2:19.0.0-3154.g81797d87.el9.x86_64 2024-05-27T12:31:35.195 INFO:teuthology.orchestra.run.smithi072.stdout: rbd-nbd-2:19.0.0-3154.g81797d87.el9.x86_64 2024-05-27T12:31:35.195 INFO:teuthology.orchestra.run.smithi072.stdout: re2-1:20211101-3.el9.x86_64 2024-05-27T12:31:35.195 INFO:teuthology.orchestra.run.smithi072.stdout: socat-1.7.4.1-5.el9.x86_64 2024-05-27T12:31:35.195 INFO:teuthology.orchestra.run.smithi072.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-27T12:31:35.195 INFO:teuthology.orchestra.run.smithi072.stdout: uuid-1.6.2-55.el9.x86_64 2024-05-27T12:31:35.195 INFO:teuthology.orchestra.run.smithi072.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-05-27T12:31:35.195 INFO:teuthology.orchestra.run.smithi072.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-05-27T12:31:35.195 INFO:teuthology.orchestra.run.smithi072.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-05-27T12:31:35.195 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-27T12:31:35.195 INFO:teuthology.orchestra.run.smithi072.stdout:Complete! 2024-05-27T12:31:35.771 DEBUG:teuthology.parallel:result is None 2024-05-27T12:31:35.772 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=81797d879079e1a392b37a9c23a946594f658c50 2024-05-27T12:31:35.921 DEBUG:teuthology.orchestra.run.smithi055:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-27T12:31:35.949 INFO:teuthology.orchestra.run.smithi055.stdout:19.0.0-3154.g81797d87.el9 2024-05-27T12:31:35.950 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3154.g81797d87.el9 2024-05-27T12:31:35.950 INFO:teuthology.task.install:The correct ceph version 19.0.0-3154.g81797d87 is installed. 2024-05-27T12:31:35.952 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=81797d879079e1a392b37a9c23a946594f658c50 2024-05-27T12:31:36.174 DEBUG:teuthology.orchestra.run.smithi072:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-27T12:31:36.201 INFO:teuthology.orchestra.run.smithi072.stdout:19.0.0-3154.g81797d87.el9 2024-05-27T12:31:36.201 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3154.g81797d87.el9 2024-05-27T12:31:36.201 INFO:teuthology.task.install:The correct ceph version 19.0.0-3154.g81797d87 is installed. 2024-05-27T12:31:36.203 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-05-27T12:31:36.203 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-05-27T12:31:36.203 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-27T12:31:36.237 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-05-27T12:31:36.238 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-27T12:31:36.274 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-05-27T12:31:36.274 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-05-27T12:31:36.274 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd of=/usr/bin/daemon-helper 2024-05-27T12:31:36.308 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-27T12:31:36.378 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-05-27T12:31:36.378 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/usr/bin/daemon-helper 2024-05-27T12:31:36.407 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-27T12:31:36.475 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-05-27T12:31:36.476 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-05-27T12:31:36.476 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-27T12:31:36.505 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-27T12:31:36.574 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-05-27T12:31:36.574 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-27T12:31:36.602 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-27T12:31:36.670 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-05-27T12:31:36.670 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-05-27T12:31:36.670 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd of=/usr/bin/stdin-killer 2024-05-27T12:31:36.697 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-27T12:31:36.764 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-05-27T12:31:36.764 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/usr/bin/stdin-killer 2024-05-27T12:31:36.791 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-27T12:31:36.858 INFO:teuthology.run_tasks:Running task ceph... 2024-05-27T12:31:36.936 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-05-27T12:31:36.937 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod 777 /var/log/ceph 2024-05-27T12:31:36.939 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 777 /var/log/ceph 2024-05-27T12:31:36.970 INFO:tasks.ceph:Disabling ceph logrotate... 2024-05-27T12:31:36.970 DEBUG:teuthology.orchestra.run.smithi055:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-27T12:31:37.012 DEBUG:teuthology.orchestra.run.smithi072:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-27T12:31:37.037 INFO:tasks.ceph:Creating extra log directories... 2024-05-27T12:31:37.037 DEBUG:teuthology.orchestra.run.smithi055:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-27T12:31:37.079 DEBUG:teuthology.orchestra.run.smithi072:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-27T12:31:37.111 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-05-27T12:31:37.111 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-05-27T12:31:37.111 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-05-27T12:31:37.111 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-05-27T12:31:37.111 DEBUG:teuthology.orchestra.run.smithi055:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-05-27T12:31:37.162 DEBUG:teuthology.orchestra.run.smithi055:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-05-27T12:31:37.276 DEBUG:teuthology.orchestra.run.smithi055:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-05-27T12:31:37.303 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-05-27T12:31:37.303 DEBUG:teuthology.orchestra.run.smithi072:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-05-27T12:31:37.319 DEBUG:teuthology.orchestra.run.smithi072:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-05-27T12:31:37.432 DEBUG:teuthology.orchestra.run.smithi072:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-05-27T12:31:37.462 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-05-27T12:31:37.462 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-05-27T12:31:37.462 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/rishabh-2024-05-27_12:15:13-fs:volumes-rishabh-clone-stats-testing-default-smithi/7727884', 'branch': 'rishabh-clone-stats', 'description': 'fs:volumes/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/clone-progress}}', 'email': None, 'first_in_suite': False, 'job_id': '7727884', 'kernel': {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': 1, 'sha1': 'b9459a26b0888785d05c47deb35abc9d0354ab93'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'rishabh-2024-05-27_12:15:13-fs:volumes-rishabh-clone-stats-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'rishabh-clone-stats'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '81797d879079e1a392b37a9c23a946594f658c50'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '81797d879079e1a392b37a9c23a946594f658c50'}}, 'kclient': {'syntax': 'v1'}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0', 'scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'mgr-vol-clone-stats', 'sha1': '762bfab4bbf713ca5c79093d382422db341b04da'}}, 'owner': 'scheduled_rishabh@teuthology', 'priority': 50, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 791, 'sha1': '81797d879079e1a392b37a9c23a946594f658c50', 'sleep_before_teardown': 0, 'suite': 'fs:volumes', 'suite_branch': 'mgr-vol-clone-stats', 'suite_path': '/home/teuthworker/src/github.com_rishabh-d-dave_ceph_762bfab4bbf713ca5c79093d382422db341b04da/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/rishabh-d-dave/ceph', 'suite_sha1': '762bfab4bbf713ca5c79093d382422db341b04da', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi055.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKtoDscwtQMzsIT0B49qxQa1Em3cxyYnrjyDcJf8tpA9EvVujWNw27iS5c2pSLfA6VODtbUwSh2bJpkPo695eLc=', 'smithi072.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCv+FgetGADL+eAhfXXVNXguGW6ZTAcVkX/vBKUomTlCIcJSJr8SQoJwPGq3srfWe4WnyRGv4vPZU+NWEmJRmPc='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': 1, 'sha1': 'b9459a26b0888785d05c47deb35abc9d0354ab93'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '81797d879079e1a392b37a9c23a946594f658c50'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '81797d879079e1a392b37a9c23a946594f658c50', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_volumes.TestCloneProgressReporter']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': 'e7ae7580c417d6ab27fda98fecadca5d9f85d63e', 'timestamp': '2024-05-27_12:15:13', 'tube': 'smithi', 'user': 'rishabh', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2698841'} 2024-05-27T12:31:37.463 DEBUG:teuthology.orchestra.run.smithi055:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-27T12:31:37.465 DEBUG:teuthology.orchestra.run.smithi072:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-27T12:31:37.513 DEBUG:teuthology.orchestra.run.smithi055:> sudo install -d -m0777 -- /var/run/ceph 2024-05-27T12:31:37.521 DEBUG:teuthology.orchestra.run.smithi072:> sudo install -d -m0777 -- /var/run/ceph 2024-05-27T12:31:37.578 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-05-27T12:31:37.578 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/scratch_devs of=/dev/stdout 2024-05-27T12:31:37.601 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-27T12:31:37.601 DEBUG:teuthology.orchestra.run.smithi055:> stat /dev/vg_nvme/lv_1 2024-05-27T12:31:37.657 INFO:teuthology.orchestra.run.smithi055.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-27T12:31:37.657 INFO:teuthology.orchestra.run.smithi055.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-27T12:31:37.657 INFO:teuthology.orchestra.run.smithi055.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-05-27T12:31:37.657 INFO:teuthology.orchestra.run.smithi055.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-27T12:31:37.657 INFO:teuthology.orchestra.run.smithi055.stdout:Context: system_u:object_r:device_t:s0 2024-05-27T12:31:37.657 INFO:teuthology.orchestra.run.smithi055.stdout:Access: 2024-05-27 12:30:52.173955545 +0000 2024-05-27T12:31:37.657 INFO:teuthology.orchestra.run.smithi055.stdout:Modify: 2024-05-27 12:28:39.153848143 +0000 2024-05-27T12:31:37.657 INFO:teuthology.orchestra.run.smithi055.stdout:Change: 2024-05-27 12:28:39.153848143 +0000 2024-05-27T12:31:37.657 INFO:teuthology.orchestra.run.smithi055.stdout: Birth: 2024-05-27 12:28:39.153848143 +0000 2024-05-27T12:31:37.658 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-27T12:31:37.721 INFO:teuthology.orchestra.run.smithi055.stderr:1+0 records in 2024-05-27T12:31:37.721 INFO:teuthology.orchestra.run.smithi055.stderr:1+0 records out 2024-05-27T12:31:37.721 INFO:teuthology.orchestra.run.smithi055.stderr:512 bytes copied, 0.0002798 s, 1.8 MB/s 2024-05-27T12:31:37.722 DEBUG:teuthology.orchestra.run.smithi055:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-27T12:31:37.780 DEBUG:teuthology.orchestra.run.smithi055:> stat /dev/vg_nvme/lv_2 2024-05-27T12:31:37.837 INFO:teuthology.orchestra.run.smithi055.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-27T12:31:37.837 INFO:teuthology.orchestra.run.smithi055.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-27T12:31:37.837 INFO:teuthology.orchestra.run.smithi055.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-05-27T12:31:37.837 INFO:teuthology.orchestra.run.smithi055.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-27T12:31:37.837 INFO:teuthology.orchestra.run.smithi055.stdout:Context: system_u:object_r:device_t:s0 2024-05-27T12:31:37.837 INFO:teuthology.orchestra.run.smithi055.stdout:Access: 2024-05-27 12:30:52.173955545 +0000 2024-05-27T12:31:37.837 INFO:teuthology.orchestra.run.smithi055.stdout:Modify: 2024-05-27 12:28:39.507841823 +0000 2024-05-27T12:31:37.837 INFO:teuthology.orchestra.run.smithi055.stdout:Change: 2024-05-27 12:28:39.507841823 +0000 2024-05-27T12:31:37.837 INFO:teuthology.orchestra.run.smithi055.stdout: Birth: 2024-05-27 12:28:39.507841823 +0000 2024-05-27T12:31:37.837 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-27T12:31:37.901 INFO:teuthology.orchestra.run.smithi055.stderr:1+0 records in 2024-05-27T12:31:37.901 INFO:teuthology.orchestra.run.smithi055.stderr:1+0 records out 2024-05-27T12:31:37.901 INFO:teuthology.orchestra.run.smithi055.stderr:512 bytes copied, 0.00027506 s, 1.9 MB/s 2024-05-27T12:31:37.903 DEBUG:teuthology.orchestra.run.smithi055:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-27T12:31:37.959 DEBUG:teuthology.orchestra.run.smithi055:> stat /dev/vg_nvme/lv_3 2024-05-27T12:31:38.016 INFO:teuthology.orchestra.run.smithi055.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-27T12:31:38.017 INFO:teuthology.orchestra.run.smithi055.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-27T12:31:38.017 INFO:teuthology.orchestra.run.smithi055.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-05-27T12:31:38.017 INFO:teuthology.orchestra.run.smithi055.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-27T12:31:38.017 INFO:teuthology.orchestra.run.smithi055.stdout:Context: system_u:object_r:device_t:s0 2024-05-27T12:31:38.017 INFO:teuthology.orchestra.run.smithi055.stdout:Access: 2024-05-27 12:30:52.173955545 +0000 2024-05-27T12:31:38.017 INFO:teuthology.orchestra.run.smithi055.stdout:Modify: 2024-05-27 12:28:39.842835842 +0000 2024-05-27T12:31:38.017 INFO:teuthology.orchestra.run.smithi055.stdout:Change: 2024-05-27 12:28:39.842835842 +0000 2024-05-27T12:31:38.017 INFO:teuthology.orchestra.run.smithi055.stdout: Birth: 2024-05-27 12:28:39.842835842 +0000 2024-05-27T12:31:38.017 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-27T12:31:38.081 INFO:teuthology.orchestra.run.smithi055.stderr:1+0 records in 2024-05-27T12:31:38.081 INFO:teuthology.orchestra.run.smithi055.stderr:1+0 records out 2024-05-27T12:31:38.081 INFO:teuthology.orchestra.run.smithi055.stderr:512 bytes copied, 0.000262073 s, 2.0 MB/s 2024-05-27T12:31:38.083 DEBUG:teuthology.orchestra.run.smithi055:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-27T12:31:38.139 DEBUG:teuthology.orchestra.run.smithi055:> stat /dev/vg_nvme/lv_4 2024-05-27T12:31:38.196 INFO:teuthology.orchestra.run.smithi055.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-27T12:31:38.196 INFO:teuthology.orchestra.run.smithi055.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-27T12:31:38.196 INFO:teuthology.orchestra.run.smithi055.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-05-27T12:31:38.196 INFO:teuthology.orchestra.run.smithi055.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-27T12:31:38.196 INFO:teuthology.orchestra.run.smithi055.stdout:Context: system_u:object_r:device_t:s0 2024-05-27T12:31:38.196 INFO:teuthology.orchestra.run.smithi055.stdout:Access: 2024-05-27 12:30:52.174955527 +0000 2024-05-27T12:31:38.196 INFO:teuthology.orchestra.run.smithi055.stdout:Modify: 2024-05-27 12:28:40.213829219 +0000 2024-05-27T12:31:38.196 INFO:teuthology.orchestra.run.smithi055.stdout:Change: 2024-05-27 12:28:40.213829219 +0000 2024-05-27T12:31:38.196 INFO:teuthology.orchestra.run.smithi055.stdout: Birth: 2024-05-27 12:28:40.213829219 +0000 2024-05-27T12:31:38.197 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-27T12:31:38.260 INFO:teuthology.orchestra.run.smithi055.stderr:1+0 records in 2024-05-27T12:31:38.260 INFO:teuthology.orchestra.run.smithi055.stderr:1+0 records out 2024-05-27T12:31:38.260 INFO:teuthology.orchestra.run.smithi055.stderr:512 bytes copied, 0.000285773 s, 1.8 MB/s 2024-05-27T12:31:38.261 DEBUG:teuthology.orchestra.run.smithi055:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-27T12:31:38.319 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-27T12:31:38.319 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-05-27T12:31:38.319 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/scratch_devs of=/dev/stdout 2024-05-27T12:31:38.335 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-27T12:31:38.335 DEBUG:teuthology.orchestra.run.smithi072:> stat /dev/vg_nvme/lv_1 2024-05-27T12:31:38.391 INFO:teuthology.orchestra.run.smithi072.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-27T12:31:38.391 INFO:teuthology.orchestra.run.smithi072.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-27T12:31:38.391 INFO:teuthology.orchestra.run.smithi072.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-05-27T12:31:38.391 INFO:teuthology.orchestra.run.smithi072.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-27T12:31:38.391 INFO:teuthology.orchestra.run.smithi072.stdout:Context: system_u:object_r:device_t:s0 2024-05-27T12:31:38.391 INFO:teuthology.orchestra.run.smithi072.stdout:Access: 2024-05-27 12:31:22.858433451 +0000 2024-05-27T12:31:38.391 INFO:teuthology.orchestra.run.smithi072.stdout:Modify: 2024-05-27 12:28:39.143492518 +0000 2024-05-27T12:31:38.391 INFO:teuthology.orchestra.run.smithi072.stdout:Change: 2024-05-27 12:28:39.143492518 +0000 2024-05-27T12:31:38.392 INFO:teuthology.orchestra.run.smithi072.stdout: Birth: 2024-05-27 12:28:39.143492518 +0000 2024-05-27T12:31:38.392 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-27T12:31:38.455 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records in 2024-05-27T12:31:38.455 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records out 2024-05-27T12:31:38.455 INFO:teuthology.orchestra.run.smithi072.stderr:512 bytes copied, 0.000207489 s, 2.5 MB/s 2024-05-27T12:31:38.456 DEBUG:teuthology.orchestra.run.smithi072:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-27T12:31:38.513 DEBUG:teuthology.orchestra.run.smithi072:> stat /dev/vg_nvme/lv_2 2024-05-27T12:31:38.567 INFO:teuthology.orchestra.run.smithi072.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-27T12:31:38.568 INFO:teuthology.orchestra.run.smithi072.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-27T12:31:38.568 INFO:teuthology.orchestra.run.smithi072.stdout:Device: 5h/5d Inode: 683 Links: 1 2024-05-27T12:31:38.568 INFO:teuthology.orchestra.run.smithi072.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-27T12:31:38.568 INFO:teuthology.orchestra.run.smithi072.stdout:Context: system_u:object_r:device_t:s0 2024-05-27T12:31:38.568 INFO:teuthology.orchestra.run.smithi072.stdout:Access: 2024-05-27 12:31:22.858433451 +0000 2024-05-27T12:31:38.568 INFO:teuthology.orchestra.run.smithi072.stdout:Modify: 2024-05-27 12:28:39.465485678 +0000 2024-05-27T12:31:38.568 INFO:teuthology.orchestra.run.smithi072.stdout:Change: 2024-05-27 12:28:39.465485678 +0000 2024-05-27T12:31:38.568 INFO:teuthology.orchestra.run.smithi072.stdout: Birth: 2024-05-27 12:28:39.465485678 +0000 2024-05-27T12:31:38.568 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-27T12:31:38.630 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records in 2024-05-27T12:31:38.631 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records out 2024-05-27T12:31:38.631 INFO:teuthology.orchestra.run.smithi072.stderr:512 bytes copied, 0.000218168 s, 2.3 MB/s 2024-05-27T12:31:38.632 DEBUG:teuthology.orchestra.run.smithi072:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-27T12:31:38.688 DEBUG:teuthology.orchestra.run.smithi072:> stat /dev/vg_nvme/lv_3 2024-05-27T12:31:38.743 INFO:teuthology.orchestra.run.smithi072.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-27T12:31:38.743 INFO:teuthology.orchestra.run.smithi072.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-27T12:31:38.744 INFO:teuthology.orchestra.run.smithi072.stdout:Device: 5h/5d Inode: 702 Links: 1 2024-05-27T12:31:38.744 INFO:teuthology.orchestra.run.smithi072.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-27T12:31:38.744 INFO:teuthology.orchestra.run.smithi072.stdout:Context: system_u:object_r:device_t:s0 2024-05-27T12:31:38.744 INFO:teuthology.orchestra.run.smithi072.stdout:Access: 2024-05-27 12:31:22.859433430 +0000 2024-05-27T12:31:38.744 INFO:teuthology.orchestra.run.smithi072.stdout:Modify: 2024-05-27 12:28:39.798478603 +0000 2024-05-27T12:31:38.744 INFO:teuthology.orchestra.run.smithi072.stdout:Change: 2024-05-27 12:28:39.798478603 +0000 2024-05-27T12:31:38.744 INFO:teuthology.orchestra.run.smithi072.stdout: Birth: 2024-05-27 12:28:39.798478603 +0000 2024-05-27T12:31:38.744 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-27T12:31:38.806 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records in 2024-05-27T12:31:38.806 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records out 2024-05-27T12:31:38.806 INFO:teuthology.orchestra.run.smithi072.stderr:512 bytes copied, 0.000226643 s, 2.3 MB/s 2024-05-27T12:31:38.808 DEBUG:teuthology.orchestra.run.smithi072:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-27T12:31:38.864 DEBUG:teuthology.orchestra.run.smithi072:> stat /dev/vg_nvme/lv_4 2024-05-27T12:31:38.919 INFO:teuthology.orchestra.run.smithi072.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-27T12:31:38.920 INFO:teuthology.orchestra.run.smithi072.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-27T12:31:38.920 INFO:teuthology.orchestra.run.smithi072.stdout:Device: 5h/5d Inode: 721 Links: 1 2024-05-27T12:31:38.920 INFO:teuthology.orchestra.run.smithi072.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-27T12:31:38.920 INFO:teuthology.orchestra.run.smithi072.stdout:Context: system_u:object_r:device_t:s0 2024-05-27T12:31:38.920 INFO:teuthology.orchestra.run.smithi072.stdout:Access: 2024-05-27 12:31:22.859433430 +0000 2024-05-27T12:31:38.920 INFO:teuthology.orchestra.run.smithi072.stdout:Modify: 2024-05-27 12:28:40.140471339 +0000 2024-05-27T12:31:38.920 INFO:teuthology.orchestra.run.smithi072.stdout:Change: 2024-05-27 12:28:40.140471339 +0000 2024-05-27T12:31:38.920 INFO:teuthology.orchestra.run.smithi072.stdout: Birth: 2024-05-27 12:28:40.140471339 +0000 2024-05-27T12:31:38.920 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-27T12:31:38.983 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records in 2024-05-27T12:31:38.983 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records out 2024-05-27T12:31:38.983 INFO:teuthology.orchestra.run.smithi072.stderr:512 bytes copied, 0.000334006 s, 1.5 MB/s 2024-05-27T12:31:38.984 DEBUG:teuthology.orchestra.run.smithi072:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-27T12:31:39.040 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-27T12:31:39.040 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi055.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi072.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-05-27T12:31:39.040 INFO:tasks.ceph:Generating config... 2024-05-27T12:31:39.042 INFO:tasks.ceph:[client] client mount timeout = 600 2024-05-27T12:31:39.042 INFO:tasks.ceph:[client] debug client = 20 2024-05-27T12:31:39.042 INFO:tasks.ceph:[client] debug ms = 1 2024-05-27T12:31:39.042 INFO:tasks.ceph:[client] pid file = 2024-05-27T12:31:39.042 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-05-27T12:31:39.042 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-05-27T12:31:39.042 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-05-27T12:31:39.042 INFO:tasks.ceph:[mds] debug mds = 20 2024-05-27T12:31:39.042 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-05-27T12:31:39.042 INFO:tasks.ceph:[mds] debug ms = 1 2024-05-27T12:31:39.042 INFO:tasks.ceph:[mds] mds debug frag = True 2024-05-27T12:31:39.042 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-05-27T12:31:39.043 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-05-27T12:31:39.043 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-05-27T12:31:39.043 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-05-27T12:31:39.043 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-05-27T12:31:39.043 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-05-27T12:31:39.043 INFO:tasks.ceph:[mgr] debug client = 20 2024-05-27T12:31:39.043 INFO:tasks.ceph:[mgr] debug finisher = 20 2024-05-27T12:31:39.043 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-05-27T12:31:39.043 INFO:tasks.ceph:[mgr] debug ms = 1 2024-05-27T12:31:39.043 INFO:tasks.ceph:[mon] debug mon = 20 2024-05-27T12:31:39.043 INFO:tasks.ceph:[mon] debug ms = 1 2024-05-27T12:31:39.044 INFO:tasks.ceph:[mon] debug paxos = 20 2024-05-27T12:31:39.044 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-05-27T12:31:39.044 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-05-27T12:31:39.044 INFO:tasks.ceph:[osd] bdev async discard = True 2024-05-27T12:31:39.044 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-05-27T12:31:39.044 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-05-27T12:31:39.044 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-05-27T12:31:39.044 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-05-27T12:31:39.044 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-05-27T12:31:39.044 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-05-27T12:31:39.044 INFO:tasks.ceph:[osd] debug ms = 1 2024-05-27T12:31:39.044 INFO:tasks.ceph:[osd] debug osd = 20 2024-05-27T12:31:39.044 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-05-27T12:31:39.044 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-05-27T12:31:39.045 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-05-27T12:31:39.045 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-05-27T12:31:39.045 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-05-27T12:31:39.045 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-05-27T12:31:39.045 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-05-27T12:31:39.045 INFO:tasks.ceph:Setting up mon.a... 2024-05-27T12:31:39.045 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-05-27T12:31:39.125 INFO:teuthology.orchestra.run.smithi055.stdout:creating /etc/ceph/ceph.keyring 2024-05-27T12:31:39.128 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-05-27T12:31:39.178 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-27T12:31:39.206 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.55'), ('mon.b', '172.21.15.72'), ('mon.c', '[v2:172.21.15.72:3301,v1:172.21.15.72:6790]')] 2024-05-27T12:31:39.206 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.55,172.21.15.72,[v2:172.21.15.72:3301,v1:172.21.15.72:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20, 'debug finisher': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-05-27T12:31:39.207 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-05-27T12:31:39.207 DEBUG:teuthology.orchestra.run.smithi055:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-05-27T12:31:39.263 DEBUG:teuthology.orchestra.run.smithi055:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.55 --add b 172.21.15.72 --addv c '[v2:172.21.15.72:3301,v1:172.21.15.72:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-05-27T12:31:39.353 INFO:teuthology.orchestra.run.smithi055.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-05-27T12:31:39.353 INFO:teuthology.orchestra.run.smithi055.stdout:monmaptool: generated fsid c3ff4e3b-8dae-4856-9593-e5cc66c59982 2024-05-27T12:31:39.353 INFO:teuthology.orchestra.run.smithi055.stdout:setting min_mon_release = quincy 2024-05-27T12:31:39.353 INFO:teuthology.orchestra.run.smithi055.stdout:epoch 0 2024-05-27T12:31:39.353 INFO:teuthology.orchestra.run.smithi055.stdout:fsid c3ff4e3b-8dae-4856-9593-e5cc66c59982 2024-05-27T12:31:39.353 INFO:teuthology.orchestra.run.smithi055.stdout:last_changed 2024-05-27T12:31:39.354818+0000 2024-05-27T12:31:39.353 INFO:teuthology.orchestra.run.smithi055.stdout:created 2024-05-27T12:31:39.354818+0000 2024-05-27T12:31:39.353 INFO:teuthology.orchestra.run.smithi055.stdout:min_mon_release 17 (quincy) 2024-05-27T12:31:39.353 INFO:teuthology.orchestra.run.smithi055.stdout:election_strategy: 1 2024-05-27T12:31:39.353 INFO:teuthology.orchestra.run.smithi055.stdout:0: [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] mon.a 2024-05-27T12:31:39.353 INFO:teuthology.orchestra.run.smithi055.stdout:1: [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] mon.b 2024-05-27T12:31:39.353 INFO:teuthology.orchestra.run.smithi055.stdout:2: [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] mon.c 2024-05-27T12:31:39.354 INFO:teuthology.orchestra.run.smithi055.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-05-27T12:31:39.355 DEBUG:teuthology.orchestra.run.smithi055:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-05-27T12:31:39.371 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID c3ff4e3b-8dae-4856-9593-e5cc66c59982... 2024-05-27T12:31:39.372 DEBUG:teuthology.orchestra.run.smithi055:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-27T12:31:39.413 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-27T12:31:39.455 INFO:teuthology.orchestra.run.smithi055.stdout:[global] 2024-05-27T12:31:39.455 INFO:teuthology.orchestra.run.smithi055.stdout: chdir = "" 2024-05-27T12:31:39.456 INFO:teuthology.orchestra.run.smithi055.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-27T12:31:39.456 INFO:teuthology.orchestra.run.smithi055.stdout: auth supported = cephx 2024-05-27T12:31:39.456 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-27T12:31:39.456 INFO:teuthology.orchestra.run.smithi055.stdout: filestore xattr use omap = true 2024-05-27T12:31:39.456 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-27T12:31:39.456 INFO:teuthology.orchestra.run.smithi055.stdout: mon clock drift allowed = 1.000 2024-05-27T12:31:39.456 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-27T12:31:39.456 INFO:teuthology.orchestra.run.smithi055.stdout: osd crush chooseleaf type = 0 2024-05-27T12:31:39.456 INFO:teuthology.orchestra.run.smithi055.stdout: auth debug = true 2024-05-27T12:31:39.456 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-27T12:31:39.456 INFO:teuthology.orchestra.run.smithi055.stdout: ms die on old message = true 2024-05-27T12:31:39.456 INFO:teuthology.orchestra.run.smithi055.stdout: ms die on bug = true 2024-05-27T12:31:39.456 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-27T12:31:39.456 INFO:teuthology.orchestra.run.smithi055.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-27T12:31:39.457 INFO:teuthology.orchestra.run.smithi055.stdout: mon pg warn max object skew = 0 2024-05-27T12:31:39.457 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-27T12:31:39.457 INFO:teuthology.orchestra.run.smithi055.stdout: # disable pg_autoscaler by default for new pools 2024-05-27T12:31:39.457 INFO:teuthology.orchestra.run.smithi055.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-27T12:31:39.457 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-27T12:31:39.457 INFO:teuthology.orchestra.run.smithi055.stdout: osd pool default size = 2 2024-05-27T12:31:39.457 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-27T12:31:39.457 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd allow primary affinity = true 2024-05-27T12:31:39.457 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd allow pg remap = true 2024-05-27T12:31:39.457 INFO:teuthology.orchestra.run.smithi055.stdout: mon warn on legacy crush tunables = false 2024-05-27T12:31:39.457 INFO:teuthology.orchestra.run.smithi055.stdout: mon warn on crush straw calc version zero = false 2024-05-27T12:31:39.457 INFO:teuthology.orchestra.run.smithi055.stdout: mon warn on no sortbitwise = false 2024-05-27T12:31:39.457 INFO:teuthology.orchestra.run.smithi055.stdout: mon warn on osd down out interval zero = false 2024-05-27T12:31:39.457 INFO:teuthology.orchestra.run.smithi055.stdout: mon warn on too few osds = false 2024-05-27T12:31:39.458 INFO:teuthology.orchestra.run.smithi055.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-27T12:31:39.458 INFO:teuthology.orchestra.run.smithi055.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-27T12:31:39.458 INFO:teuthology.orchestra.run.smithi055.stdout: mon_allow_pool_size_one = true 2024-05-27T12:31:39.458 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-27T12:31:39.458 INFO:teuthology.orchestra.run.smithi055.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-27T12:31:39.458 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-27T12:31:39.458 INFO:teuthology.orchestra.run.smithi055.stdout: osd default data pool replay window = 5 2024-05-27T12:31:39.458 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-27T12:31:39.458 INFO:teuthology.orchestra.run.smithi055.stdout: mon allow pool delete = true 2024-05-27T12:31:39.458 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-27T12:31:39.458 INFO:teuthology.orchestra.run.smithi055.stdout: mon cluster log file level = debug 2024-05-27T12:31:39.458 INFO:teuthology.orchestra.run.smithi055.stdout: debug asserts on shutdown = true 2024-05-27T12:31:39.458 INFO:teuthology.orchestra.run.smithi055.stdout: mon health detail to clog = false 2024-05-27T12:31:39.459 INFO:teuthology.orchestra.run.smithi055.stdout: mon host = "172.21.15.55,172.21.15.72,[v2:172.21.15.72:3301,v1:172.21.15.72:6790]" 2024-05-27T12:31:39.459 INFO:teuthology.orchestra.run.smithi055.stdout: ms die on skipped message = False 2024-05-27T12:31:39.459 INFO:teuthology.orchestra.run.smithi055.stdout: fsid = c3ff4e3b-8dae-4856-9593-e5cc66c59982 2024-05-27T12:31:39.459 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-27T12:31:39.459 INFO:teuthology.orchestra.run.smithi055.stdout:[osd] 2024-05-27T12:31:39.459 INFO:teuthology.orchestra.run.smithi055.stdout: osd journal size = 100 2024-05-27T12:31:39.459 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-27T12:31:39.459 INFO:teuthology.orchestra.run.smithi055.stdout: osd scrub load threshold = 5.0 2024-05-27T12:31:39.459 INFO:teuthology.orchestra.run.smithi055.stdout: osd scrub max interval = 600 2024-05-27T12:31:39.459 INFO:teuthology.orchestra.run.smithi055.stdout: osd mclock profile = high_recovery_ops 2024-05-27T12:31:39.459 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-27T12:31:39.459 INFO:teuthology.orchestra.run.smithi055.stdout: osd recover clone overlap = true 2024-05-27T12:31:39.459 INFO:teuthology.orchestra.run.smithi055.stdout: osd recovery max chunk = 1048576 2024-05-27T12:31:39.459 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-27T12:31:39.460 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug shutdown = true 2024-05-27T12:31:39.460 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug op order = true 2024-05-27T12:31:39.460 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug verify stray on activate = true 2024-05-27T12:31:39.460 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug trim objects = true 2024-05-27T12:31:39.460 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-27T12:31:39.460 INFO:teuthology.orchestra.run.smithi055.stdout: osd open classes on start = true 2024-05-27T12:31:39.460 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug pg log writeout = true 2024-05-27T12:31:39.460 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-27T12:31:39.460 INFO:teuthology.orchestra.run.smithi055.stdout: osd deep scrub update digest min age = 30 2024-05-27T12:31:39.460 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-27T12:31:39.460 INFO:teuthology.orchestra.run.smithi055.stdout: osd map max advance = 10 2024-05-27T12:31:39.460 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-27T12:31:39.460 INFO:teuthology.orchestra.run.smithi055.stdout: journal zero on create = true 2024-05-27T12:31:39.460 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-27T12:31:39.460 INFO:teuthology.orchestra.run.smithi055.stdout: filestore ondisk finisher threads = 3 2024-05-27T12:31:39.461 INFO:teuthology.orchestra.run.smithi055.stdout: filestore apply finisher threads = 3 2024-05-27T12:31:39.461 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-27T12:31:39.461 INFO:teuthology.orchestra.run.smithi055.stdout: bdev debug aio = true 2024-05-27T12:31:39.461 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug misdirected ops = true 2024-05-27T12:31:39.461 INFO:teuthology.orchestra.run.smithi055.stdout: bdev async discard = True 2024-05-27T12:31:39.461 INFO:teuthology.orchestra.run.smithi055.stdout: bdev enable discard = True 2024-05-27T12:31:39.461 INFO:teuthology.orchestra.run.smithi055.stdout: bluestore allocator = bitmap 2024-05-27T12:31:39.461 INFO:teuthology.orchestra.run.smithi055.stdout: bluestore block size = 96636764160 2024-05-27T12:31:39.461 INFO:teuthology.orchestra.run.smithi055.stdout: bluestore fsck on mount = True 2024-05-27T12:31:39.461 INFO:teuthology.orchestra.run.smithi055.stdout: debug bluefs = 1/20 2024-05-27T12:31:39.461 INFO:teuthology.orchestra.run.smithi055.stdout: debug bluestore = 1/20 2024-05-27T12:31:39.461 INFO:teuthology.orchestra.run.smithi055.stdout: debug ms = 1 2024-05-27T12:31:39.461 INFO:teuthology.orchestra.run.smithi055.stdout: debug osd = 20 2024-05-27T12:31:39.461 INFO:teuthology.orchestra.run.smithi055.stdout: debug rocksdb = 4/10 2024-05-27T12:31:39.462 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd backfillfull_ratio = 0.85 2024-05-27T12:31:39.462 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd full ratio = 0.9 2024-05-27T12:31:39.462 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd nearfull ratio = 0.8 2024-05-27T12:31:39.462 INFO:teuthology.orchestra.run.smithi055.stdout: osd failsafe full ratio = 0.95 2024-05-27T12:31:39.462 INFO:teuthology.orchestra.run.smithi055.stdout: osd objectstore = bluestore 2024-05-27T12:31:39.462 INFO:teuthology.orchestra.run.smithi055.stdout: osd op complaint time = 180 2024-05-27T12:31:39.462 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-27T12:31:39.462 INFO:teuthology.orchestra.run.smithi055.stdout:[mgr] 2024-05-27T12:31:39.462 INFO:teuthology.orchestra.run.smithi055.stdout: debug ms = 1 2024-05-27T12:31:39.462 INFO:teuthology.orchestra.run.smithi055.stdout: debug mgr = 20 2024-05-27T12:31:39.462 INFO:teuthology.orchestra.run.smithi055.stdout: debug mon = 20 2024-05-27T12:31:39.462 INFO:teuthology.orchestra.run.smithi055.stdout: debug auth = 20 2024-05-27T12:31:39.462 INFO:teuthology.orchestra.run.smithi055.stdout: mon reweight min pgs per osd = 4 2024-05-27T12:31:39.463 INFO:teuthology.orchestra.run.smithi055.stdout: mon reweight min bytes per osd = 10 2024-05-27T12:31:39.463 INFO:teuthology.orchestra.run.smithi055.stdout: mgr/telemetry/nag = false 2024-05-27T12:31:39.463 INFO:teuthology.orchestra.run.smithi055.stdout: debug client = 20 2024-05-27T12:31:39.463 INFO:teuthology.orchestra.run.smithi055.stdout: debug finisher = 20 2024-05-27T12:31:39.463 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-27T12:31:39.463 INFO:teuthology.orchestra.run.smithi055.stdout:[mon] 2024-05-27T12:31:39.463 INFO:teuthology.orchestra.run.smithi055.stdout: debug ms = 1 2024-05-27T12:31:39.463 INFO:teuthology.orchestra.run.smithi055.stdout: debug mon = 20 2024-05-27T12:31:39.463 INFO:teuthology.orchestra.run.smithi055.stdout: debug paxos = 20 2024-05-27T12:31:39.463 INFO:teuthology.orchestra.run.smithi055.stdout: debug auth = 20 2024-05-27T12:31:39.463 INFO:teuthology.orchestra.run.smithi055.stdout: mon data avail warn = 5 2024-05-27T12:31:39.463 INFO:teuthology.orchestra.run.smithi055.stdout: mon mgr mkfs grace = 240 2024-05-27T12:31:39.466 INFO:teuthology.orchestra.run.smithi055.stdout: mon reweight min pgs per osd = 4 2024-05-27T12:31:39.466 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd reporter subtree level = osd 2024-05-27T12:31:39.466 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd prime pg temp = true 2024-05-27T12:31:39.466 INFO:teuthology.orchestra.run.smithi055.stdout: mon reweight min bytes per osd = 10 2024-05-27T12:31:39.466 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-27T12:31:39.466 INFO:teuthology.orchestra.run.smithi055.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-27T12:31:39.467 INFO:teuthology.orchestra.run.smithi055.stdout: auth mon ticket ttl = 660 # 11m 2024-05-27T12:31:39.467 INFO:teuthology.orchestra.run.smithi055.stdout: auth service ticket ttl = 240 # 4m 2024-05-27T12:31:39.467 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-27T12:31:39.467 INFO:teuthology.orchestra.run.smithi055.stdout: # don't complain about insecure global_id in the test suite 2024-05-27T12:31:39.467 INFO:teuthology.orchestra.run.smithi055.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-27T12:31:39.467 INFO:teuthology.orchestra.run.smithi055.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-27T12:31:39.467 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-27T12:31:39.467 INFO:teuthology.orchestra.run.smithi055.stdout: # 1m isn't quite enough 2024-05-27T12:31:39.467 INFO:teuthology.orchestra.run.smithi055.stdout: mon_down_mkfs_grace = 2m 2024-05-27T12:31:39.467 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-27T12:31:39.467 INFO:teuthology.orchestra.run.smithi055.stdout: mon_warn_on_filestore_osds = false 2024-05-27T12:31:39.467 INFO:teuthology.orchestra.run.smithi055.stdout: mon down mkfs grace = 300 2024-05-27T12:31:39.467 INFO:teuthology.orchestra.run.smithi055.stdout: mon op complaint time = 120 2024-05-27T12:31:39.467 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-27T12:31:39.467 INFO:teuthology.orchestra.run.smithi055.stdout:[client] 2024-05-27T12:31:39.468 INFO:teuthology.orchestra.run.smithi055.stdout: rgw cache enabled = true 2024-05-27T12:31:39.468 INFO:teuthology.orchestra.run.smithi055.stdout: rgw enable ops log = true 2024-05-27T12:31:39.468 INFO:teuthology.orchestra.run.smithi055.stdout: rgw enable usage log = true 2024-05-27T12:31:39.468 INFO:teuthology.orchestra.run.smithi055.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-27T12:31:39.468 INFO:teuthology.orchestra.run.smithi055.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-27T12:31:39.468 INFO:teuthology.orchestra.run.smithi055.stdout: client mount timeout = 600 2024-05-27T12:31:39.468 INFO:teuthology.orchestra.run.smithi055.stdout: debug client = 20 2024-05-27T12:31:39.468 INFO:teuthology.orchestra.run.smithi055.stdout: debug ms = 1 2024-05-27T12:31:39.468 INFO:teuthology.orchestra.run.smithi055.stdout: pid file = "" 2024-05-27T12:31:39.468 INFO:teuthology.orchestra.run.smithi055.stdout: rados mon op timeout = 900 2024-05-27T12:31:39.468 INFO:teuthology.orchestra.run.smithi055.stdout: rados osd op timeout = 900 2024-05-27T12:31:39.468 INFO:teuthology.orchestra.run.smithi055.stdout:[mon.a] 2024-05-27T12:31:39.468 INFO:teuthology.orchestra.run.smithi055.stdout:[mon.b] 2024-05-27T12:31:39.468 INFO:teuthology.orchestra.run.smithi055.stdout:[mon.c] 2024-05-27T12:31:39.469 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.a] 2024-05-27T12:31:39.469 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.c] 2024-05-27T12:31:39.469 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.b] 2024-05-27T12:31:39.469 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.d] 2024-05-27T12:31:39.469 INFO:teuthology.orchestra.run.smithi055.stdout:[mds] 2024-05-27T12:31:39.469 INFO:teuthology.orchestra.run.smithi055.stdout: debug mds = 20 2024-05-27T12:31:39.469 INFO:teuthology.orchestra.run.smithi055.stdout: debug mds balancer = 20 2024-05-27T12:31:39.469 INFO:teuthology.orchestra.run.smithi055.stdout: debug ms = 1 2024-05-27T12:31:39.469 INFO:teuthology.orchestra.run.smithi055.stdout: mds debug frag = True 2024-05-27T12:31:39.469 INFO:teuthology.orchestra.run.smithi055.stdout: mds debug scatterstat = True 2024-05-27T12:31:39.469 INFO:teuthology.orchestra.run.smithi055.stdout: mds op complaint time = 180 2024-05-27T12:31:39.469 INFO:teuthology.orchestra.run.smithi055.stdout: mds verify scatter = True 2024-05-27T12:31:39.469 INFO:teuthology.orchestra.run.smithi055.stdout: osd op complaint time = 180 2024-05-27T12:31:39.469 INFO:teuthology.orchestra.run.smithi055.stdout: rados mon op timeout = 900 2024-05-27T12:31:39.469 INFO:teuthology.orchestra.run.smithi055.stdout: rados osd op timeout = 900 2024-05-27T12:31:39.472 INFO:teuthology.orchestra.run.smithi072.stdout:[global] 2024-05-27T12:31:39.472 INFO:teuthology.orchestra.run.smithi072.stdout: chdir = "" 2024-05-27T12:31:39.472 INFO:teuthology.orchestra.run.smithi072.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-27T12:31:39.472 INFO:teuthology.orchestra.run.smithi072.stdout: auth supported = cephx 2024-05-27T12:31:39.472 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-27T12:31:39.472 INFO:teuthology.orchestra.run.smithi072.stdout: filestore xattr use omap = true 2024-05-27T12:31:39.472 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-27T12:31:39.472 INFO:teuthology.orchestra.run.smithi072.stdout: mon clock drift allowed = 1.000 2024-05-27T12:31:39.473 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-27T12:31:39.473 INFO:teuthology.orchestra.run.smithi072.stdout: osd crush chooseleaf type = 0 2024-05-27T12:31:39.473 INFO:teuthology.orchestra.run.smithi072.stdout: auth debug = true 2024-05-27T12:31:39.473 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-27T12:31:39.473 INFO:teuthology.orchestra.run.smithi072.stdout: ms die on old message = true 2024-05-27T12:31:39.473 INFO:teuthology.orchestra.run.smithi072.stdout: ms die on bug = true 2024-05-27T12:31:39.473 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-27T12:31:39.473 INFO:teuthology.orchestra.run.smithi072.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-27T12:31:39.474 INFO:teuthology.orchestra.run.smithi072.stdout: mon pg warn max object skew = 0 2024-05-27T12:31:39.474 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-27T12:31:39.474 INFO:teuthology.orchestra.run.smithi072.stdout: # disable pg_autoscaler by default for new pools 2024-05-27T12:31:39.474 INFO:teuthology.orchestra.run.smithi072.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-27T12:31:39.474 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-27T12:31:39.474 INFO:teuthology.orchestra.run.smithi072.stdout: osd pool default size = 2 2024-05-27T12:31:39.474 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-27T12:31:39.474 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd allow primary affinity = true 2024-05-27T12:31:39.474 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd allow pg remap = true 2024-05-27T12:31:39.474 INFO:teuthology.orchestra.run.smithi072.stdout: mon warn on legacy crush tunables = false 2024-05-27T12:31:39.474 INFO:teuthology.orchestra.run.smithi072.stdout: mon warn on crush straw calc version zero = false 2024-05-27T12:31:39.474 INFO:teuthology.orchestra.run.smithi072.stdout: mon warn on no sortbitwise = false 2024-05-27T12:31:39.475 INFO:teuthology.orchestra.run.smithi072.stdout: mon warn on osd down out interval zero = false 2024-05-27T12:31:39.475 INFO:teuthology.orchestra.run.smithi072.stdout: mon warn on too few osds = false 2024-05-27T12:31:39.475 INFO:teuthology.orchestra.run.smithi072.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-27T12:31:39.475 INFO:teuthology.orchestra.run.smithi072.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-27T12:31:39.475 INFO:teuthology.orchestra.run.smithi072.stdout: mon_allow_pool_size_one = true 2024-05-27T12:31:39.475 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-27T12:31:39.475 INFO:teuthology.orchestra.run.smithi072.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-27T12:31:39.475 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-27T12:31:39.475 INFO:teuthology.orchestra.run.smithi072.stdout: osd default data pool replay window = 5 2024-05-27T12:31:39.475 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-27T12:31:39.475 INFO:teuthology.orchestra.run.smithi072.stdout: mon allow pool delete = true 2024-05-27T12:31:39.475 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-27T12:31:39.475 INFO:teuthology.orchestra.run.smithi072.stdout: mon cluster log file level = debug 2024-05-27T12:31:39.475 INFO:teuthology.orchestra.run.smithi072.stdout: debug asserts on shutdown = true 2024-05-27T12:31:39.476 INFO:teuthology.orchestra.run.smithi072.stdout: mon health detail to clog = false 2024-05-27T12:31:39.476 INFO:teuthology.orchestra.run.smithi072.stdout: mon host = "172.21.15.55,172.21.15.72,[v2:172.21.15.72:3301,v1:172.21.15.72:6790]" 2024-05-27T12:31:39.476 INFO:teuthology.orchestra.run.smithi072.stdout: ms die on skipped message = False 2024-05-27T12:31:39.476 INFO:teuthology.orchestra.run.smithi072.stdout: fsid = c3ff4e3b-8dae-4856-9593-e5cc66c59982 2024-05-27T12:31:39.476 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-27T12:31:39.476 INFO:teuthology.orchestra.run.smithi072.stdout:[osd] 2024-05-27T12:31:39.476 INFO:teuthology.orchestra.run.smithi072.stdout: osd journal size = 100 2024-05-27T12:31:39.476 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-27T12:31:39.476 INFO:teuthology.orchestra.run.smithi072.stdout: osd scrub load threshold = 5.0 2024-05-27T12:31:39.476 INFO:teuthology.orchestra.run.smithi072.stdout: osd scrub max interval = 600 2024-05-27T12:31:39.476 INFO:teuthology.orchestra.run.smithi072.stdout: osd mclock profile = high_recovery_ops 2024-05-27T12:31:39.477 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-27T12:31:39.477 INFO:teuthology.orchestra.run.smithi072.stdout: osd recover clone overlap = true 2024-05-27T12:31:39.477 INFO:teuthology.orchestra.run.smithi072.stdout: osd recovery max chunk = 1048576 2024-05-27T12:31:39.477 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-27T12:31:39.477 INFO:teuthology.orchestra.run.smithi072.stdout: osd debug shutdown = true 2024-05-27T12:31:39.477 INFO:teuthology.orchestra.run.smithi072.stdout: osd debug op order = true 2024-05-27T12:31:39.477 INFO:teuthology.orchestra.run.smithi072.stdout: osd debug verify stray on activate = true 2024-05-27T12:31:39.477 INFO:teuthology.orchestra.run.smithi072.stdout: osd debug trim objects = true 2024-05-27T12:31:39.477 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-27T12:31:39.477 INFO:teuthology.orchestra.run.smithi072.stdout: osd open classes on start = true 2024-05-27T12:31:39.477 INFO:teuthology.orchestra.run.smithi072.stdout: osd debug pg log writeout = true 2024-05-27T12:31:39.477 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-27T12:31:39.478 INFO:teuthology.orchestra.run.smithi072.stdout: osd deep scrub update digest min age = 30 2024-05-27T12:31:39.478 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-27T12:31:39.478 INFO:teuthology.orchestra.run.smithi072.stdout: osd map max advance = 10 2024-05-27T12:31:39.478 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-27T12:31:39.478 INFO:teuthology.orchestra.run.smithi072.stdout: journal zero on create = true 2024-05-27T12:31:39.478 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-27T12:31:39.478 INFO:teuthology.orchestra.run.smithi072.stdout: filestore ondisk finisher threads = 3 2024-05-27T12:31:39.478 INFO:teuthology.orchestra.run.smithi072.stdout: filestore apply finisher threads = 3 2024-05-27T12:31:39.478 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-27T12:31:39.478 INFO:teuthology.orchestra.run.smithi072.stdout: bdev debug aio = true 2024-05-27T12:31:39.478 INFO:teuthology.orchestra.run.smithi072.stdout: osd debug misdirected ops = true 2024-05-27T12:31:39.478 INFO:teuthology.orchestra.run.smithi072.stdout: bdev async discard = True 2024-05-27T12:31:39.478 INFO:teuthology.orchestra.run.smithi072.stdout: bdev enable discard = True 2024-05-27T12:31:39.479 INFO:teuthology.orchestra.run.smithi072.stdout: bluestore allocator = bitmap 2024-05-27T12:31:39.479 INFO:teuthology.orchestra.run.smithi072.stdout: bluestore block size = 96636764160 2024-05-27T12:31:39.479 INFO:teuthology.orchestra.run.smithi072.stdout: bluestore fsck on mount = True 2024-05-27T12:31:39.479 INFO:teuthology.orchestra.run.smithi072.stdout: debug bluefs = 1/20 2024-05-27T12:31:39.479 INFO:teuthology.orchestra.run.smithi072.stdout: debug bluestore = 1/20 2024-05-27T12:31:39.479 INFO:teuthology.orchestra.run.smithi072.stdout: debug ms = 1 2024-05-27T12:31:39.479 INFO:teuthology.orchestra.run.smithi072.stdout: debug osd = 20 2024-05-27T12:31:39.479 INFO:teuthology.orchestra.run.smithi072.stdout: debug rocksdb = 4/10 2024-05-27T12:31:39.479 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd backfillfull_ratio = 0.85 2024-05-27T12:31:39.479 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd full ratio = 0.9 2024-05-27T12:31:39.479 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd nearfull ratio = 0.8 2024-05-27T12:31:39.479 INFO:teuthology.orchestra.run.smithi072.stdout: osd failsafe full ratio = 0.95 2024-05-27T12:31:39.479 INFO:teuthology.orchestra.run.smithi072.stdout: osd objectstore = bluestore 2024-05-27T12:31:39.479 INFO:teuthology.orchestra.run.smithi072.stdout: osd op complaint time = 180 2024-05-27T12:31:39.480 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-27T12:31:39.480 INFO:teuthology.orchestra.run.smithi072.stdout:[mgr] 2024-05-27T12:31:39.480 INFO:teuthology.orchestra.run.smithi072.stdout: debug ms = 1 2024-05-27T12:31:39.480 INFO:teuthology.orchestra.run.smithi072.stdout: debug mgr = 20 2024-05-27T12:31:39.480 INFO:teuthology.orchestra.run.smithi072.stdout: debug mon = 20 2024-05-27T12:31:39.480 INFO:teuthology.orchestra.run.smithi072.stdout: debug auth = 20 2024-05-27T12:31:39.480 INFO:teuthology.orchestra.run.smithi072.stdout: mon reweight min pgs per osd = 4 2024-05-27T12:31:39.480 INFO:teuthology.orchestra.run.smithi072.stdout: mon reweight min bytes per osd = 10 2024-05-27T12:31:39.480 INFO:teuthology.orchestra.run.smithi072.stdout: mgr/telemetry/nag = false 2024-05-27T12:31:39.480 INFO:teuthology.orchestra.run.smithi072.stdout: debug client = 20 2024-05-27T12:31:39.480 INFO:teuthology.orchestra.run.smithi072.stdout: debug finisher = 20 2024-05-27T12:31:39.480 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-27T12:31:39.480 INFO:teuthology.orchestra.run.smithi072.stdout:[mon] 2024-05-27T12:31:39.480 INFO:teuthology.orchestra.run.smithi072.stdout: debug ms = 1 2024-05-27T12:31:39.481 INFO:teuthology.orchestra.run.smithi072.stdout: debug mon = 20 2024-05-27T12:31:39.481 INFO:teuthology.orchestra.run.smithi072.stdout: debug paxos = 20 2024-05-27T12:31:39.481 INFO:teuthology.orchestra.run.smithi072.stdout: debug auth = 20 2024-05-27T12:31:39.481 INFO:teuthology.orchestra.run.smithi072.stdout: mon data avail warn = 5 2024-05-27T12:31:39.481 INFO:teuthology.orchestra.run.smithi072.stdout: mon mgr mkfs grace = 240 2024-05-27T12:31:39.481 INFO:teuthology.orchestra.run.smithi072.stdout: mon reweight min pgs per osd = 4 2024-05-27T12:31:39.481 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd reporter subtree level = osd 2024-05-27T12:31:39.481 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd prime pg temp = true 2024-05-27T12:31:39.481 INFO:teuthology.orchestra.run.smithi072.stdout: mon reweight min bytes per osd = 10 2024-05-27T12:31:39.482 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-27T12:31:39.482 INFO:teuthology.orchestra.run.smithi072.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-27T12:31:39.482 INFO:teuthology.orchestra.run.smithi072.stdout: auth mon ticket ttl = 660 # 11m 2024-05-27T12:31:39.482 INFO:teuthology.orchestra.run.smithi072.stdout: auth service ticket ttl = 240 # 4m 2024-05-27T12:31:39.482 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-27T12:31:39.482 INFO:teuthology.orchestra.run.smithi072.stdout: # don't complain about insecure global_id in the test suite 2024-05-27T12:31:39.482 INFO:teuthology.orchestra.run.smithi072.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-27T12:31:39.482 INFO:teuthology.orchestra.run.smithi072.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-27T12:31:39.482 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-27T12:31:39.482 INFO:teuthology.orchestra.run.smithi072.stdout: # 1m isn't quite enough 2024-05-27T12:31:39.482 INFO:teuthology.orchestra.run.smithi072.stdout: mon_down_mkfs_grace = 2m 2024-05-27T12:31:39.482 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-27T12:31:39.483 INFO:teuthology.orchestra.run.smithi072.stdout: mon_warn_on_filestore_osds = false 2024-05-27T12:31:39.483 INFO:teuthology.orchestra.run.smithi072.stdout: mon down mkfs grace = 300 2024-05-27T12:31:39.483 INFO:teuthology.orchestra.run.smithi072.stdout: mon op complaint time = 120 2024-05-27T12:31:39.483 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-05-27T12:31:39.483 INFO:teuthology.orchestra.run.smithi072.stdout:[client] 2024-05-27T12:31:39.483 INFO:teuthology.orchestra.run.smithi072.stdout: rgw cache enabled = true 2024-05-27T12:31:39.483 INFO:teuthology.orchestra.run.smithi072.stdout: rgw enable ops log = true 2024-05-27T12:31:39.483 INFO:teuthology.orchestra.run.smithi072.stdout: rgw enable usage log = true 2024-05-27T12:31:39.483 INFO:teuthology.orchestra.run.smithi072.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-27T12:31:39.484 INFO:teuthology.orchestra.run.smithi072.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-27T12:31:39.484 INFO:teuthology.orchestra.run.smithi072.stdout: client mount timeout = 600 2024-05-27T12:31:39.484 INFO:teuthology.orchestra.run.smithi072.stdout: debug client = 20 2024-05-27T12:31:39.484 INFO:teuthology.orchestra.run.smithi072.stdout: debug ms = 1 2024-05-27T12:31:39.484 INFO:teuthology.orchestra.run.smithi072.stdout: pid file = "" 2024-05-27T12:31:39.484 INFO:teuthology.orchestra.run.smithi072.stdout: rados mon op timeout = 900 2024-05-27T12:31:39.484 INFO:teuthology.orchestra.run.smithi072.stdout: rados osd op timeout = 900 2024-05-27T12:31:39.484 INFO:teuthology.orchestra.run.smithi072.stdout:[mon.a] 2024-05-27T12:31:39.484 INFO:teuthology.orchestra.run.smithi072.stdout:[mon.b] 2024-05-27T12:31:39.484 INFO:teuthology.orchestra.run.smithi072.stdout:[mon.c] 2024-05-27T12:31:39.484 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.a] 2024-05-27T12:31:39.484 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.c] 2024-05-27T12:31:39.484 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.b] 2024-05-27T12:31:39.484 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.d] 2024-05-27T12:31:39.484 INFO:teuthology.orchestra.run.smithi072.stdout:[mds] 2024-05-27T12:31:39.485 INFO:teuthology.orchestra.run.smithi072.stdout: debug mds = 20 2024-05-27T12:31:39.485 INFO:teuthology.orchestra.run.smithi072.stdout: debug mds balancer = 20 2024-05-27T12:31:39.485 INFO:teuthology.orchestra.run.smithi072.stdout: debug ms = 1 2024-05-27T12:31:39.485 INFO:teuthology.orchestra.run.smithi072.stdout: mds debug frag = True 2024-05-27T12:31:39.485 INFO:teuthology.orchestra.run.smithi072.stdout: mds debug scatterstat = True 2024-05-27T12:31:39.485 INFO:teuthology.orchestra.run.smithi072.stdout: mds op complaint time = 180 2024-05-27T12:31:39.485 INFO:teuthology.orchestra.run.smithi072.stdout: mds verify scatter = True 2024-05-27T12:31:39.485 INFO:teuthology.orchestra.run.smithi072.stdout: osd op complaint time = 180 2024-05-27T12:31:39.485 INFO:teuthology.orchestra.run.smithi072.stdout: rados mon op timeout = 900 2024-05-27T12:31:39.485 INFO:teuthology.orchestra.run.smithi072.stdout: rados osd op timeout = 900 2024-05-27T12:31:39.485 INFO:tasks.ceph:Creating admin key on mon.a... 2024-05-27T12:31:39.486 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-05-27T12:31:39.568 INFO:tasks.ceph:Copying monmap to all nodes... 2024-05-27T12:31:39.569 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-05-27T12:31:39.569 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-05-27T12:31:39.584 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-05-27T12:31:39.584 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-05-27T12:31:39.641 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi055.front.sepia.ceph.com 2024-05-27T12:31:39.641 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-05-27T12:31:39.641 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-27T12:31:39.641 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-27T12:31:39.716 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-05-27T12:31:39.717 DEBUG:teuthology.orchestra.run.smithi055:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-27T12:31:39.773 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi072.front.sepia.ceph.com 2024-05-27T12:31:39.773 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-05-27T12:31:39.773 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-27T12:31:39.773 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-27T12:31:39.808 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-05-27T12:31:39.808 DEBUG:teuthology.orchestra.run.smithi072:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-27T12:31:39.864 INFO:tasks.ceph:Setting up mon nodes... 2024-05-27T12:31:39.864 INFO:tasks.ceph:Setting up mgr nodes... 2024-05-27T12:31:39.864 DEBUG:teuthology.orchestra.run.smithi055:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-05-27T12:31:39.916 INFO:teuthology.orchestra.run.smithi055.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-05-27T12:31:39.920 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-05-27T12:31:39.978 INFO:teuthology.orchestra.run.smithi072.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-05-27T12:31:39.981 INFO:tasks.ceph:Setting up mds nodes... 2024-05-27T12:31:39.981 DEBUG:teuthology.orchestra.run.smithi055:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-05-27T12:31:40.034 INFO:teuthology.orchestra.run.smithi055.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-05-27T12:31:40.037 DEBUG:teuthology.orchestra.run.smithi055:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-05-27T12:31:40.062 DEBUG:teuthology.orchestra.run.smithi055:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-05-27T12:31:40.155 INFO:teuthology.orchestra.run.smithi055.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-05-27T12:31:40.157 DEBUG:teuthology.orchestra.run.smithi055:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-05-27T12:31:40.183 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-05-27T12:31:40.235 INFO:teuthology.orchestra.run.smithi072.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-05-27T12:31:40.237 DEBUG:teuthology.orchestra.run.smithi072:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-05-27T12:31:40.262 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-05-27T12:31:40.353 INFO:teuthology.orchestra.run.smithi072.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-05-27T12:31:40.355 DEBUG:teuthology.orchestra.run.smithi072:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-05-27T12:31:40.380 INFO:tasks.ceph_client:Setting up client nodes... 2024-05-27T12:31:40.381 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-05-27T12:31:40.423 INFO:teuthology.orchestra.run.smithi055.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-05-27T12:31:40.436 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-05-27T12:31:40.519 INFO:teuthology.orchestra.run.smithi055.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-05-27T12:31:40.532 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-05-27T12:31:40.573 INFO:teuthology.orchestra.run.smithi072.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-05-27T12:31:40.586 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-05-27T12:31:40.666 INFO:teuthology.orchestra.run.smithi072.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-05-27T12:31:40.679 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-05-27T12:31:40.679 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi055.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi072.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-05-27T12:31:40.679 DEBUG:teuthology.orchestra.run.smithi055:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-05-27T12:31:40.705 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-27T12:31:40.705 INFO:tasks.ceph:role: osd.0 2024-05-27T12:31:40.705 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi055.front.sepia.ceph.com 2024-05-27T12:31:40.706 DEBUG:teuthology.orchestra.run.smithi055:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-05-27T12:31:40.798 INFO:teuthology.orchestra.run.smithi055.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-05-27T12:31:40.798 INFO:teuthology.orchestra.run.smithi055.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-27T12:31:40.798 INFO:teuthology.orchestra.run.smithi055.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-27T12:31:40.799 INFO:teuthology.orchestra.run.smithi055.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-27T12:31:40.799 INFO:teuthology.orchestra.run.smithi055.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-27T12:31:40.799 INFO:teuthology.orchestra.run.smithi055.stdout: = sunit=0 swidth=0 blks 2024-05-27T12:31:40.799 INFO:teuthology.orchestra.run.smithi055.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-27T12:31:40.799 INFO:teuthology.orchestra.run.smithi055.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-27T12:31:40.799 INFO:teuthology.orchestra.run.smithi055.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-27T12:31:40.799 INFO:teuthology.orchestra.run.smithi055.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-27T12:31:42.112 INFO:teuthology.orchestra.run.smithi055.stdout:Discarding blocks...Done. 2024-05-27T12:31:42.115 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi055.front.sepia.ceph.com -o noatime 2024-05-27T12:31:42.115 DEBUG:teuthology.orchestra.run.smithi055:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-05-27T12:31:42.157 DEBUG:teuthology.orchestra.run.smithi055:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-05-27T12:31:42.232 DEBUG:teuthology.orchestra.run.smithi055:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-05-27T12:31:42.302 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-27T12:31:42.302 INFO:tasks.ceph:role: osd.1 2024-05-27T12:31:42.302 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi055.front.sepia.ceph.com 2024-05-27T12:31:42.302 DEBUG:teuthology.orchestra.run.smithi055:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-05-27T12:31:42.398 INFO:teuthology.orchestra.run.smithi055.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-05-27T12:31:42.398 INFO:teuthology.orchestra.run.smithi055.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-27T12:31:42.398 INFO:teuthology.orchestra.run.smithi055.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-27T12:31:42.398 INFO:teuthology.orchestra.run.smithi055.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-27T12:31:42.398 INFO:teuthology.orchestra.run.smithi055.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-27T12:31:42.398 INFO:teuthology.orchestra.run.smithi055.stdout: = sunit=0 swidth=0 blks 2024-05-27T12:31:42.398 INFO:teuthology.orchestra.run.smithi055.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-27T12:31:42.398 INFO:teuthology.orchestra.run.smithi055.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-27T12:31:42.398 INFO:teuthology.orchestra.run.smithi055.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-27T12:31:42.398 INFO:teuthology.orchestra.run.smithi055.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-27T12:31:43.713 INFO:teuthology.orchestra.run.smithi055.stdout:Discarding blocks...Done. 2024-05-27T12:31:43.715 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi055.front.sepia.ceph.com -o noatime 2024-05-27T12:31:43.715 DEBUG:teuthology.orchestra.run.smithi055:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-05-27T12:31:43.760 DEBUG:teuthology.orchestra.run.smithi055:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-05-27T12:31:43.793 DEBUG:teuthology.orchestra.run.smithi055:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-05-27T12:31:43.861 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-27T12:31:43.861 INFO:tasks.ceph:role: osd.2 2024-05-27T12:31:43.861 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi055.front.sepia.ceph.com 2024-05-27T12:31:43.861 DEBUG:teuthology.orchestra.run.smithi055:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-05-27T12:31:43.955 INFO:teuthology.orchestra.run.smithi055.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-05-27T12:31:43.955 INFO:teuthology.orchestra.run.smithi055.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-27T12:31:43.956 INFO:teuthology.orchestra.run.smithi055.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-27T12:31:43.956 INFO:teuthology.orchestra.run.smithi055.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-27T12:31:43.956 INFO:teuthology.orchestra.run.smithi055.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-27T12:31:43.956 INFO:teuthology.orchestra.run.smithi055.stdout: = sunit=0 swidth=0 blks 2024-05-27T12:31:43.956 INFO:teuthology.orchestra.run.smithi055.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-27T12:31:43.956 INFO:teuthology.orchestra.run.smithi055.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-27T12:31:43.956 INFO:teuthology.orchestra.run.smithi055.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-27T12:31:43.956 INFO:teuthology.orchestra.run.smithi055.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-27T12:31:45.280 INFO:teuthology.orchestra.run.smithi055.stdout:Discarding blocks...Done. 2024-05-27T12:31:45.283 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi055.front.sepia.ceph.com -o noatime 2024-05-27T12:31:45.283 DEBUG:teuthology.orchestra.run.smithi055:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-05-27T12:31:45.321 DEBUG:teuthology.orchestra.run.smithi055:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-05-27T12:31:45.396 DEBUG:teuthology.orchestra.run.smithi055:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-05-27T12:31:45.464 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-27T12:31:45.464 INFO:tasks.ceph:role: osd.3 2024-05-27T12:31:45.464 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi055.front.sepia.ceph.com 2024-05-27T12:31:45.465 DEBUG:teuthology.orchestra.run.smithi055:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-05-27T12:31:45.560 INFO:teuthology.orchestra.run.smithi055.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-05-27T12:31:45.560 INFO:teuthology.orchestra.run.smithi055.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-27T12:31:45.560 INFO:teuthology.orchestra.run.smithi055.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-27T12:31:45.560 INFO:teuthology.orchestra.run.smithi055.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-27T12:31:45.560 INFO:teuthology.orchestra.run.smithi055.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-27T12:31:45.560 INFO:teuthology.orchestra.run.smithi055.stdout: = sunit=0 swidth=0 blks 2024-05-27T12:31:45.560 INFO:teuthology.orchestra.run.smithi055.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-27T12:31:45.560 INFO:teuthology.orchestra.run.smithi055.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-27T12:31:45.560 INFO:teuthology.orchestra.run.smithi055.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-27T12:31:45.561 INFO:teuthology.orchestra.run.smithi055.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-27T12:31:46.901 INFO:teuthology.orchestra.run.smithi055.stdout:Discarding blocks...Done. 2024-05-27T12:31:46.903 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi055.front.sepia.ceph.com -o noatime 2024-05-27T12:31:46.903 DEBUG:teuthology.orchestra.run.smithi055:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-05-27T12:31:46.939 DEBUG:teuthology.orchestra.run.smithi055:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-05-27T12:31:47.012 DEBUG:teuthology.orchestra.run.smithi055:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-27T12:31:47.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:31:47.113+0000 7f47d6bcb640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-05-27T12:31:47.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:31:47.114+0000 7f47d6bcb640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-05-27T12:31:47.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:31:47.114+0000 7f47d6bcb640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-27T12:31:47.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:31:47.114+0000 7f47d6bcb640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-27T12:31:47.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:31:47.114+0000 7f47d6bcb640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-27T12:31:47.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:31:47.115+0000 7f47d6bcb640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-05-27T12:31:49.984 DEBUG:teuthology.orchestra.run.smithi055:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-05-27T12:31:50.015 DEBUG:teuthology.orchestra.run.smithi055:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-27T12:31:50.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:31:50.107+0000 7f0d2360d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-05-27T12:31:50.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:31:50.107+0000 7f0d2360d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-05-27T12:31:50.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:31:50.107+0000 7f0d2360d640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-27T12:31:50.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:31:50.107+0000 7f0d2360d640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-27T12:31:50.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:31:50.107+0000 7f0d2360d640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-27T12:31:50.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:31:50.108+0000 7f0d2360d640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-05-27T12:31:52.993 DEBUG:teuthology.orchestra.run.smithi055:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-05-27T12:31:53.023 DEBUG:teuthology.orchestra.run.smithi055:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-27T12:31:53.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:31:53.115+0000 7f0c91e0d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-05-27T12:31:53.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:31:53.115+0000 7f0c91e0d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-05-27T12:31:53.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:31:53.115+0000 7f0c91e0d640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-27T12:31:53.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:31:53.115+0000 7f0c91e0d640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-27T12:31:53.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:31:53.115+0000 7f0c91e0d640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-27T12:31:53.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:31:53.116+0000 7f0c91e0d640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-05-27T12:31:55.992 DEBUG:teuthology.orchestra.run.smithi055:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-05-27T12:31:56.023 DEBUG:teuthology.orchestra.run.smithi055:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-27T12:31:56.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:31:56.116+0000 7ff059133640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-05-27T12:31:56.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:31:56.116+0000 7ff059133640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-05-27T12:31:56.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:31:56.116+0000 7ff059133640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-27T12:31:56.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:31:56.116+0000 7ff059133640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-27T12:31:56.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:31:56.116+0000 7ff059133640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-27T12:31:56.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:31:56.117+0000 7ff059133640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-05-27T12:31:58.996 DEBUG:teuthology.orchestra.run.smithi055:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-05-27T12:31:59.026 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-05-27T12:31:59.057 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-27T12:31:59.057 INFO:tasks.ceph:role: osd.4 2024-05-27T12:31:59.057 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi072.front.sepia.ceph.com 2024-05-27T12:31:59.057 DEBUG:teuthology.orchestra.run.smithi072:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-05-27T12:31:59.134 INFO:teuthology.orchestra.run.smithi072.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-05-27T12:31:59.135 INFO:teuthology.orchestra.run.smithi072.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-27T12:31:59.135 INFO:teuthology.orchestra.run.smithi072.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-27T12:31:59.135 INFO:teuthology.orchestra.run.smithi072.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-27T12:31:59.135 INFO:teuthology.orchestra.run.smithi072.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-27T12:31:59.135 INFO:teuthology.orchestra.run.smithi072.stdout: = sunit=0 swidth=0 blks 2024-05-27T12:31:59.135 INFO:teuthology.orchestra.run.smithi072.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-27T12:31:59.135 INFO:teuthology.orchestra.run.smithi072.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-27T12:31:59.135 INFO:teuthology.orchestra.run.smithi072.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-27T12:31:59.135 INFO:teuthology.orchestra.run.smithi072.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-27T12:31:59.646 INFO:teuthology.orchestra.run.smithi072.stdout:Discarding blocks...Done. 2024-05-27T12:31:59.648 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi072.front.sepia.ceph.com -o noatime 2024-05-27T12:31:59.648 DEBUG:teuthology.orchestra.run.smithi072:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-05-27T12:31:59.761 DEBUG:teuthology.orchestra.run.smithi072:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-05-27T12:31:59.792 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-05-27T12:31:59.857 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-27T12:31:59.858 INFO:tasks.ceph:role: osd.5 2024-05-27T12:31:59.858 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi072.front.sepia.ceph.com 2024-05-27T12:31:59.858 DEBUG:teuthology.orchestra.run.smithi072:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-05-27T12:31:59.930 INFO:teuthology.orchestra.run.smithi072.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-05-27T12:31:59.930 INFO:teuthology.orchestra.run.smithi072.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-27T12:31:59.930 INFO:teuthology.orchestra.run.smithi072.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-27T12:31:59.930 INFO:teuthology.orchestra.run.smithi072.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-27T12:31:59.930 INFO:teuthology.orchestra.run.smithi072.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-27T12:31:59.931 INFO:teuthology.orchestra.run.smithi072.stdout: = sunit=0 swidth=0 blks 2024-05-27T12:31:59.931 INFO:teuthology.orchestra.run.smithi072.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-27T12:31:59.931 INFO:teuthology.orchestra.run.smithi072.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-27T12:31:59.931 INFO:teuthology.orchestra.run.smithi072.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-27T12:31:59.931 INFO:teuthology.orchestra.run.smithi072.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-27T12:32:00.393 INFO:teuthology.orchestra.run.smithi072.stdout:Discarding blocks...Done. 2024-05-27T12:32:00.395 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi072.front.sepia.ceph.com -o noatime 2024-05-27T12:32:00.395 DEBUG:teuthology.orchestra.run.smithi072:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-05-27T12:32:00.489 DEBUG:teuthology.orchestra.run.smithi072:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-05-27T12:32:00.518 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-05-27T12:32:00.584 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-27T12:32:00.584 INFO:tasks.ceph:role: osd.6 2024-05-27T12:32:00.584 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi072.front.sepia.ceph.com 2024-05-27T12:32:00.585 DEBUG:teuthology.orchestra.run.smithi072:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-05-27T12:32:00.656 INFO:teuthology.orchestra.run.smithi072.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-05-27T12:32:00.657 INFO:teuthology.orchestra.run.smithi072.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-27T12:32:00.657 INFO:teuthology.orchestra.run.smithi072.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-27T12:32:00.657 INFO:teuthology.orchestra.run.smithi072.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-27T12:32:00.657 INFO:teuthology.orchestra.run.smithi072.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-27T12:32:00.657 INFO:teuthology.orchestra.run.smithi072.stdout: = sunit=0 swidth=0 blks 2024-05-27T12:32:00.657 INFO:teuthology.orchestra.run.smithi072.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-27T12:32:00.657 INFO:teuthology.orchestra.run.smithi072.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-27T12:32:00.657 INFO:teuthology.orchestra.run.smithi072.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-27T12:32:00.657 INFO:teuthology.orchestra.run.smithi072.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-27T12:32:01.162 INFO:teuthology.orchestra.run.smithi072.stdout:Discarding blocks...Done. 2024-05-27T12:32:01.164 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi072.front.sepia.ceph.com -o noatime 2024-05-27T12:32:01.164 DEBUG:teuthology.orchestra.run.smithi072:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-05-27T12:32:01.290 DEBUG:teuthology.orchestra.run.smithi072:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-05-27T12:32:01.323 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-05-27T12:32:01.389 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-27T12:32:01.389 INFO:tasks.ceph:role: osd.7 2024-05-27T12:32:01.389 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi072.front.sepia.ceph.com 2024-05-27T12:32:01.389 DEBUG:teuthology.orchestra.run.smithi072:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-05-27T12:32:01.461 INFO:teuthology.orchestra.run.smithi072.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-05-27T12:32:01.462 INFO:teuthology.orchestra.run.smithi072.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-27T12:32:01.462 INFO:teuthology.orchestra.run.smithi072.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-27T12:32:01.462 INFO:teuthology.orchestra.run.smithi072.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-27T12:32:01.462 INFO:teuthology.orchestra.run.smithi072.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-27T12:32:01.462 INFO:teuthology.orchestra.run.smithi072.stdout: = sunit=0 swidth=0 blks 2024-05-27T12:32:01.462 INFO:teuthology.orchestra.run.smithi072.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-27T12:32:01.462 INFO:teuthology.orchestra.run.smithi072.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-27T12:32:01.462 INFO:teuthology.orchestra.run.smithi072.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-27T12:32:01.462 INFO:teuthology.orchestra.run.smithi072.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-27T12:32:01.965 INFO:teuthology.orchestra.run.smithi072.stdout:Discarding blocks...Done. 2024-05-27T12:32:01.967 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi072.front.sepia.ceph.com -o noatime 2024-05-27T12:32:01.967 DEBUG:teuthology.orchestra.run.smithi072:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-05-27T12:32:02.094 DEBUG:teuthology.orchestra.run.smithi072:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-05-27T12:32:02.124 DEBUG:teuthology.orchestra.run.smithi072:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-27T12:32:02.219 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:02.219+0000 7f502d841640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-05-27T12:32:02.219 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:02.219+0000 7f502d841640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-05-27T12:32:02.219 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:02.219+0000 7f502d841640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-27T12:32:02.220 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:02.219+0000 7f502d841640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-27T12:32:02.220 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:02.219+0000 7f502d841640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-27T12:32:02.220 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:02.220+0000 7f502d841640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-05-27T12:32:05.077 DEBUG:teuthology.orchestra.run.smithi072:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-05-27T12:32:05.105 DEBUG:teuthology.orchestra.run.smithi072:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-27T12:32:05.195 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:05.195+0000 7f1d6b40d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-05-27T12:32:05.196 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:05.196+0000 7f1d6b40d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-05-27T12:32:05.196 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:05.196+0000 7f1d6b40d640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-27T12:32:05.196 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:05.196+0000 7f1d6b40d640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-27T12:32:05.196 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:05.196+0000 7f1d6b40d640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-27T12:32:05.196 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:05.196+0000 7f1d6b40d640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-05-27T12:32:07.464 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T12:32:07.467 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T12:32:08.067 DEBUG:teuthology.orchestra.run.smithi072:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-05-27T12:32:08.094 DEBUG:teuthology.orchestra.run.smithi072:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-27T12:32:08.182 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:08.182+0000 7f5f16aee640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-05-27T12:32:08.182 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:08.182+0000 7f5f16aee640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-05-27T12:32:08.182 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:08.182+0000 7f5f16aee640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-27T12:32:08.182 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:08.182+0000 7f5f16aee640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-27T12:32:08.182 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:08.182+0000 7f5f16aee640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-27T12:32:08.182 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:08.183+0000 7f5f16aee640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-05-27T12:32:11.030 DEBUG:teuthology.orchestra.run.smithi072:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-05-27T12:32:11.058 DEBUG:teuthology.orchestra.run.smithi072:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-27T12:32:11.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:11.146+0000 7fcc9620d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-05-27T12:32:11.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:11.146+0000 7fcc9620d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-05-27T12:32:11.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:11.146+0000 7fcc9620d640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-27T12:32:11.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:11.146+0000 7fcc9620d640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-27T12:32:11.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:11.146+0000 7fcc9620d640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-27T12:32:11.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:11.146+0000 7fcc9620d640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-05-27T12:32:13.994 DEBUG:teuthology.orchestra.run.smithi072:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-05-27T12:32:14.025 INFO:tasks.ceph:Reading keys from all nodes... 2024-05-27T12:32:14.025 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-05-27T12:32:14.025 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-05-27T12:32:14.059 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-05-27T12:32:14.059 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-05-27T12:32:14.131 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-05-27T12:32:14.131 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-05-27T12:32:14.201 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-05-27T12:32:14.201 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-05-27T12:32:14.271 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-05-27T12:32:14.271 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-05-27T12:32:14.341 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-05-27T12:32:14.341 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-05-27T12:32:14.410 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-05-27T12:32:14.410 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-05-27T12:32:14.478 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-05-27T12:32:14.479 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-05-27T12:32:14.508 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-05-27T12:32:14.508 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-05-27T12:32:14.579 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-05-27T12:32:14.580 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-05-27T12:32:14.647 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-05-27T12:32:14.647 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-05-27T12:32:14.714 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-05-27T12:32:14.714 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-05-27T12:32:14.781 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-05-27T12:32:14.781 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-05-27T12:32:14.847 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-05-27T12:32:14.847 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-05-27T12:32:14.913 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-05-27T12:32:14.913 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-05-27T12:32:14.932 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-05-27T12:32:14.933 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-05-27T12:32:14.992 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-05-27T12:32:14.992 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-05-27T12:32:15.008 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-05-27T12:32:15.008 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-05-27T12:32:15.064 INFO:tasks.ceph:Adding keys to all mons... 2024-05-27T12:32:15.065 DEBUG:teuthology.orchestra.run.smithi055:> sudo tee -a /etc/ceph/ceph.keyring 2024-05-27T12:32:15.067 DEBUG:teuthology.orchestra.run.smithi072:> sudo tee -a /etc/ceph/ceph.keyring 2024-05-27T12:32:15.108 INFO:teuthology.orchestra.run.smithi055.stdout:[mgr.y] 2024-05-27T12:32:15.108 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQArfVRmSmXCNhAAKdJWtW4aY+SPuQ2nSJ1vWQ== 2024-05-27T12:32:15.108 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.a] 2024-05-27T12:32:15.108 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQAsfVRmmuYsAhAAhhu6/bL6pb53jKaMVlMEFg== 2024-05-27T12:32:15.108 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.c] 2024-05-27T12:32:15.108 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQAsfVRmCxVZCRAACN3XE9s+jqwww5gifWIdqw== 2024-05-27T12:32:15.108 INFO:teuthology.orchestra.run.smithi055.stdout:[osd.0] 2024-05-27T12:32:15.108 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQAzfVRmFFjjBhAApDXvZ6m3Zr++1/dXX4tpLQ== 2024-05-27T12:32:15.108 INFO:teuthology.orchestra.run.smithi055.stdout:[osd.1] 2024-05-27T12:32:15.108 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQA2fVRmqMGCBhAAYgt3tK17ik7/hp0piD6ztw== 2024-05-27T12:32:15.108 INFO:teuthology.orchestra.run.smithi055.stdout:[osd.2] 2024-05-27T12:32:15.109 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQA5fVRm/FnxBhAARLlQ54xir+qliKYDWY7nbg== 2024-05-27T12:32:15.109 INFO:teuthology.orchestra.run.smithi055.stdout:[osd.3] 2024-05-27T12:32:15.109 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQA8fVRmbcP9BhAAPE7oC6wdcqbK13HcpZINkg== 2024-05-27T12:32:15.109 INFO:teuthology.orchestra.run.smithi055.stdout:[mgr.x] 2024-05-27T12:32:15.109 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQArfVRmTs50OhAA8vBWPn6mEvL46NzZNyqu8w== 2024-05-27T12:32:15.109 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.b] 2024-05-27T12:32:15.109 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQAsfVRmD38jDhAA2IVtrkMz+IxwY6dzyXMpSg== 2024-05-27T12:32:15.109 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.d] 2024-05-27T12:32:15.109 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQAsfVRmCgMsFRAAM4AMNQSwfLsySOOEDjTfEg== 2024-05-27T12:32:15.109 INFO:teuthology.orchestra.run.smithi055.stdout:[osd.4] 2024-05-27T12:32:15.109 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQBCfVRmZD0sDRAAw2aNRb14iJwmHDrZIG8u1Q== 2024-05-27T12:32:15.109 INFO:teuthology.orchestra.run.smithi055.stdout:[osd.5] 2024-05-27T12:32:15.109 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQBFfVRmj4XACxAAKhItF0GvmQUQdf6/OGd3OA== 2024-05-27T12:32:15.109 INFO:teuthology.orchestra.run.smithi055.stdout:[osd.6] 2024-05-27T12:32:15.109 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQBIfVRmmH/zChAAkge2bDBqTBIuyQ+PNrnOAw== 2024-05-27T12:32:15.110 INFO:teuthology.orchestra.run.smithi055.stdout:[osd.7] 2024-05-27T12:32:15.110 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQBLfVRmfZLJCBAAwHAzXG7o/bNfhEegA+dsoQ== 2024-05-27T12:32:15.110 INFO:teuthology.orchestra.run.smithi055.stdout:[client.0] 2024-05-27T12:32:15.110 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQAsfVRmIz9dGRAAjAf3liTmQK1aXNskyzdRyQ== 2024-05-27T12:32:15.110 INFO:teuthology.orchestra.run.smithi055.stdout:[client.2] 2024-05-27T12:32:15.110 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQAsfVRm6f4RHxAAmfTdGbAPsF4KMgEv/JWzZQ== 2024-05-27T12:32:15.110 INFO:teuthology.orchestra.run.smithi055.stdout:[client.1] 2024-05-27T12:32:15.110 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQAsfVRmoipIIhAAyurpcSEPW1QVVZuf69hWNQ== 2024-05-27T12:32:15.110 INFO:teuthology.orchestra.run.smithi055.stdout:[client.3] 2024-05-27T12:32:15.110 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQAsfVRmCPbXJxAAtcAuYEQlV8GUMAzhL0rCWQ== 2024-05-27T12:32:15.128 INFO:teuthology.orchestra.run.smithi072.stdout:[mgr.y] 2024-05-27T12:32:15.128 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQArfVRmSmXCNhAAKdJWtW4aY+SPuQ2nSJ1vWQ== 2024-05-27T12:32:15.128 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.a] 2024-05-27T12:32:15.128 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQAsfVRmmuYsAhAAhhu6/bL6pb53jKaMVlMEFg== 2024-05-27T12:32:15.128 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.c] 2024-05-27T12:32:15.128 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQAsfVRmCxVZCRAACN3XE9s+jqwww5gifWIdqw== 2024-05-27T12:32:15.128 INFO:teuthology.orchestra.run.smithi072.stdout:[osd.0] 2024-05-27T12:32:15.128 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQAzfVRmFFjjBhAApDXvZ6m3Zr++1/dXX4tpLQ== 2024-05-27T12:32:15.129 INFO:teuthology.orchestra.run.smithi072.stdout:[osd.1] 2024-05-27T12:32:15.129 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQA2fVRmqMGCBhAAYgt3tK17ik7/hp0piD6ztw== 2024-05-27T12:32:15.129 INFO:teuthology.orchestra.run.smithi072.stdout:[osd.2] 2024-05-27T12:32:15.129 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQA5fVRm/FnxBhAARLlQ54xir+qliKYDWY7nbg== 2024-05-27T12:32:15.129 INFO:teuthology.orchestra.run.smithi072.stdout:[osd.3] 2024-05-27T12:32:15.129 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQA8fVRmbcP9BhAAPE7oC6wdcqbK13HcpZINkg== 2024-05-27T12:32:15.129 INFO:teuthology.orchestra.run.smithi072.stdout:[mgr.x] 2024-05-27T12:32:15.129 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQArfVRmTs50OhAA8vBWPn6mEvL46NzZNyqu8w== 2024-05-27T12:32:15.129 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.b] 2024-05-27T12:32:15.129 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQAsfVRmD38jDhAA2IVtrkMz+IxwY6dzyXMpSg== 2024-05-27T12:32:15.129 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.d] 2024-05-27T12:32:15.129 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQAsfVRmCgMsFRAAM4AMNQSwfLsySOOEDjTfEg== 2024-05-27T12:32:15.129 INFO:teuthology.orchestra.run.smithi072.stdout:[osd.4] 2024-05-27T12:32:15.129 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQBCfVRmZD0sDRAAw2aNRb14iJwmHDrZIG8u1Q== 2024-05-27T12:32:15.130 INFO:teuthology.orchestra.run.smithi072.stdout:[osd.5] 2024-05-27T12:32:15.130 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQBFfVRmj4XACxAAKhItF0GvmQUQdf6/OGd3OA== 2024-05-27T12:32:15.130 INFO:teuthology.orchestra.run.smithi072.stdout:[osd.6] 2024-05-27T12:32:15.130 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQBIfVRmmH/zChAAkge2bDBqTBIuyQ+PNrnOAw== 2024-05-27T12:32:15.130 INFO:teuthology.orchestra.run.smithi072.stdout:[osd.7] 2024-05-27T12:32:15.130 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQBLfVRmfZLJCBAAwHAzXG7o/bNfhEegA+dsoQ== 2024-05-27T12:32:15.130 INFO:teuthology.orchestra.run.smithi072.stdout:[client.0] 2024-05-27T12:32:15.130 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQAsfVRmIz9dGRAAjAf3liTmQK1aXNskyzdRyQ== 2024-05-27T12:32:15.130 INFO:teuthology.orchestra.run.smithi072.stdout:[client.2] 2024-05-27T12:32:15.130 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQAsfVRm6f4RHxAAmfTdGbAPsF4KMgEv/JWzZQ== 2024-05-27T12:32:15.130 INFO:teuthology.orchestra.run.smithi072.stdout:[client.1] 2024-05-27T12:32:15.130 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQAsfVRmoipIIhAAyurpcSEPW1QVVZuf69hWNQ== 2024-05-27T12:32:15.130 INFO:teuthology.orchestra.run.smithi072.stdout:[client.3] 2024-05-27T12:32:15.130 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQAsfVRmCPbXJxAAtcAuYEQlV8GUMAzhL0rCWQ== 2024-05-27T12:32:15.131 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-27T12:32:15.154 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-27T12:32:15.222 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-27T12:32:15.225 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-27T12:32:15.281 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-27T12:32:15.283 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-27T12:32:15.337 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-27T12:32:15.339 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-27T12:32:15.390 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-27T12:32:15.393 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-27T12:32:15.443 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-27T12:32:15.445 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-27T12:32:15.496 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-27T12:32:15.498 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-27T12:32:15.549 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-27T12:32:15.551 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-27T12:32:15.602 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-27T12:32:15.604 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-27T12:32:15.659 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-27T12:32:15.661 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-27T12:32:15.715 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-27T12:32:15.717 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-27T12:32:15.768 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-27T12:32:15.771 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-27T12:32:15.821 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-27T12:32:15.823 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-27T12:32:15.874 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-27T12:32:15.876 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-27T12:32:15.927 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-27T12:32:15.929 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-27T12:32:15.983 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-27T12:32:15.987 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-27T12:32:16.041 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-27T12:32:16.043 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-27T12:32:16.097 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-27T12:32:16.100 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-27T12:32:16.154 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-05-27T12:32:16.154 DEBUG:teuthology.orchestra.run.smithi055:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-05-27T12:32:16.179 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-27T12:32:16.291 DEBUG:teuthology.orchestra.run.smithi055:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-05-27T12:32:16.317 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-05-27T12:32:16.342 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-27T12:32:16.438 DEBUG:teuthology.orchestra.run.smithi072:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-05-27T12:32:16.462 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-05-27T12:32:16.527 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-27T12:32:16.623 DEBUG:teuthology.orchestra.run.smithi072:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-05-27T12:32:16.647 DEBUG:teuthology.orchestra.run.smithi055:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-05-27T12:32:16.650 DEBUG:teuthology.orchestra.run.smithi072:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-05-27T12:32:16.703 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-05-27T12:32:16.703 INFO:tasks.ceph.mon.a:Restarting daemon 2024-05-27T12:32:16.703 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-05-27T12:32:16.706 INFO:tasks.ceph.mon.a:Started 2024-05-27T12:32:16.706 INFO:tasks.ceph.mon.b:Restarting daemon 2024-05-27T12:32:16.706 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-05-27T12:32:16.745 INFO:tasks.ceph.mon.b:Started 2024-05-27T12:32:16.745 INFO:tasks.ceph.mon.c:Restarting daemon 2024-05-27T12:32:16.745 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-05-27T12:32:16.747 INFO:tasks.ceph.mon.c:Started 2024-05-27T12:32:16.747 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-05-27T12:32:16.747 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-05-27T12:32:16.747 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-05-27T12:32:16.750 INFO:tasks.ceph.mgr.y:Started 2024-05-27T12:32:16.750 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-05-27T12:32:16.750 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-05-27T12:32:16.752 INFO:tasks.ceph.mgr.x:Started 2024-05-27T12:32:16.752 INFO:tasks.ceph:Setting crush tunables to default 2024-05-27T12:32:16.752 DEBUG:teuthology.orchestra.run.smithi055:> sudo ceph --cluster ceph osd crush tunables default 2024-05-27T12:32:16.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:16.857+0000 7ffa10e85640 1 Processor -- start 2024-05-27T12:32:16.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:16.857+0000 7ffa10e85640 1 -- start start 2024-05-27T12:32:16.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:16.858+0000 7ffa10e85640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ffa0c15eb70 0x7ffa0c0d28b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:16.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:16.858+0000 7ffa10e85640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffa0c0d2df0 0x7ffa0c0b78e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:16.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:16.858+0000 7ffa10e85640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ffa0c0b7e20 0x7ffa0c0b9380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:16.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:16.858+0000 7ffa10e85640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7ffa0c0b8ef0 con 0x7ffa0c15eb70 2024-05-27T12:32:16.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:16.858+0000 7ffa10e85640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7ffa0c0b82e0 con 0x7ffa0c0b7e20 2024-05-27T12:32:16.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:16.858+0000 7ffa10e85640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7ffa0c0b85c0 con 0x7ffa0c0d2df0 2024-05-27T12:32:16.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:16.858+0000 7ffa0a59c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ffa0c15eb70 0x7ffa0c0d28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:16.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:16.858+0000 7ffa0a59c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ffa0c15eb70 0x7ffa0c0d28b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45576/0 (socket says 172.21.15.55:45576) 2024-05-27T12:32:16.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:16.858+0000 7ffa0a59c640 1 -- 172.21.15.55:0/280530334 learned_addr learned my addr 172.21.15.55:0/280530334 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:32:16.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:16.858+0000 7ffa0a59c640 1 -- 172.21.15.55:0/280530334 >> v2:172.21.15.55:3300/0 conn(0x7ffa0c15eb70 msgr2=0x7ffa0c0d28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-27T12:32:16.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:16.858+0000 7ffa0a59c640 1 -- 172.21.15.55:0/280530334 >> v2:172.21.15.55:3300/0 conn(0x7ffa0c15eb70 msgr2=0x7ffa0c0d28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-27T12:32:16.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:16.858+0000 7ffa0a59c640 1 --2- 172.21.15.55:0/280530334 >> v2:172.21.15.55:3300/0 conn(0x7ffa0c15eb70 0x7ffa0c0d28b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-27T12:32:16.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:16.858+0000 7ffa0a59c640 1 --2- 172.21.15.55:0/280530334 >> v2:172.21.15.55:3300/0 conn(0x7ffa0c15eb70 0x7ffa0c0d28b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-27T12:32:16.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:16.858+0000 7ffa0ad9d640 1 --2- 172.21.15.55:0/280530334 >> v2:172.21.15.72:3300/0 conn(0x7ffa0c0b7e20 0x7ffa0c0b9380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:16.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:16.858+0000 7ffa01d9b640 1 --2- 172.21.15.55:0/280530334 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffa0c0d2df0 0x7ffa0c0b78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:16.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:16.858+0000 7ffa0ad9d640 1 -- 172.21.15.55:0/280530334 >> v2:172.21.15.72:3300/0 conn(0x7ffa0c0b7e20 msgr2=0x7ffa0c0b9380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-05-27T12:32:16.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:16.858+0000 7ffa0ad9d640 1 -- 172.21.15.55:0/280530334 >> v2:172.21.15.72:3300/0 conn(0x7ffa0c0b7e20 msgr2=0x7ffa0c0b9380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-27T12:32:16.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:16.858+0000 7ffa0ad9d640 1 --2- 172.21.15.55:0/280530334 >> v2:172.21.15.72:3300/0 conn(0x7ffa0c0b7e20 0x7ffa0c0b9380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-27T12:32:16.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:16.858+0000 7ffa01d9b640 1 -- 172.21.15.55:0/280530334 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffa0c0d2df0 msgr2=0x7ffa0c0b78e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-27T12:32:16.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:16.858+0000 7ffa01d9b640 1 -- 172.21.15.55:0/280530334 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffa0c0d2df0 msgr2=0x7ffa0c0b78e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-27T12:32:16.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:16.858+0000 7ffa0ad9d640 1 --2- 172.21.15.55:0/280530334 >> v2:172.21.15.72:3300/0 conn(0x7ffa0c0b7e20 0x7ffa0c0b9380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-27T12:32:16.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:16.858+0000 7ffa01d9b640 1 --2- 172.21.15.55:0/280530334 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffa0c0d2df0 0x7ffa0c0b78e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-27T12:32:16.860 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:16.858+0000 7ffa01d9b640 1 --2- 172.21.15.55:0/280530334 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffa0c0d2df0 0x7ffa0c0b78e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-27T12:32:17.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:17.059+0000 7ffa0a59c640 1 --2- 172.21.15.55:0/280530334 >> v2:172.21.15.55:3300/0 conn(0x7ffa0c15eb70 0x7ffa0c0d28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:17.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:17.059+0000 7ffa01d9b640 1 --2- 172.21.15.55:0/280530334 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffa0c0d2df0 0x7ffa0c0b78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:17.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:17.059+0000 7ffa0ad9d640 1 --2- 172.21.15.55:0/280530334 >> v2:172.21.15.72:3300/0 conn(0x7ffa0c0b7e20 0x7ffa0c0b9380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:17.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:17.059+0000 7ffa0a59c640 1 -- 172.21.15.55:0/280530334 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffa0c0d2df0 msgr2=0x7ffa0c0b78e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:32:17.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:17.059+0000 7ffa0a59c640 1 --2- 172.21.15.55:0/280530334 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffa0c0d2df0 0x7ffa0c0b78e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:17.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:17.059+0000 7ffa0a59c640 1 -- 172.21.15.55:0/280530334 >> v2:172.21.15.72:3300/0 conn(0x7ffa0c0b7e20 msgr2=0x7ffa0c0b9380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:32:17.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:17.059+0000 7ffa0a59c640 1 --2- 172.21.15.55:0/280530334 >> v2:172.21.15.72:3300/0 conn(0x7ffa0c0b7e20 0x7ffa0c0b9380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:17.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:17.059+0000 7ffa0a59c640 1 -- 172.21.15.55:0/280530334 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa0c0b88a0 con 0x7ffa0c15eb70 2024-05-27T12:32:17.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:17.059+0000 7ffa0ad9d640 1 --2- 172.21.15.55:0/280530334 >> v2:172.21.15.72:3300/0 conn(0x7ffa0c0b7e20 0x7ffa0c0b9380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T12:32:17.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:17.060+0000 7ffa0a59c640 1 --2- 172.21.15.55:0/280530334 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffa0c15eb70 0x7ffa0c0d28b0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ffa0c08dbb0 tx=0x7ff9fc02a530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7d368733191c394 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:17.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:17.060+0000 7ffa09d9b640 1 -- 172.21.15.55:0/280530334 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9fc00f040 con 0x7ffa0c15eb70 2024-05-27T12:32:17.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:17.060+0000 7ffa09d9b640 1 -- 172.21.15.55:0/280530334 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9fc02f710 con 0x7ffa0c15eb70 2024-05-27T12:32:17.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:17.060+0000 7ffa09d9b640 1 -- 172.21.15.55:0/280530334 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9fc02fb00 con 0x7ffa0c15eb70 2024-05-27T12:32:17.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:17.060+0000 7ffa10e85640 1 -- 172.21.15.55:0/280530334 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffa0c15eb70 msgr2=0x7ffa0c0d28b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:17.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:17.060+0000 7ffa10e85640 1 --2- 172.21.15.55:0/280530334 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffa0c15eb70 0x7ffa0c0d28b0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ffa0c08dbb0 tx=0x7ff9fc02a530 comp rx=0 tx=0).stop 2024-05-27T12:32:17.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:17.061+0000 7ffa10e85640 1 -- 172.21.15.55:0/280530334 shutdown_connections 2024-05-27T12:32:17.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:17.061+0000 7ffa10e85640 1 --2- 172.21.15.55:0/280530334 >> v2:172.21.15.72:3300/0 conn(0x7ffa0c0b7e20 0x7ffa0c0b9380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:17.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:17.061+0000 7ffa10e85640 1 --2- 172.21.15.55:0/280530334 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffa0c0d2df0 0x7ffa0c0b78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:17.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:17.061+0000 7ffa10e85640 1 --2- 172.21.15.55:0/280530334 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffa0c15eb70 0x7ffa0c0d28b0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:17.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:17.061+0000 7ffa10e85640 1 -- 172.21.15.55:0/280530334 >> 172.21.15.55:0/280530334 conn(0x7ffa0c067a50 msgr2=0x7ffa0c067e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:17.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:17.061+0000 7ffa10e85640 1 -- 172.21.15.55:0/280530334 shutdown_connections 2024-05-27T12:32:17.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:17.061+0000 7ffa10e85640 1 -- 172.21.15.55:0/280530334 wait complete. 2024-05-27T12:32:17.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:17.062+0000 7ffa10e85640 1 Processor -- start 2024-05-27T12:32:17.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:17.062+0000 7ffa10e85640 1 -- start start 2024-05-27T12:32:17.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:17.063+0000 7ffa10e85640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa0c0b7e20 0x7ffa0c150420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:17.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:17.063+0000 7ffa10e85640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffa0c15eb70 0x7ffa0c152d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:17.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:17.063+0000 7ffa10e85640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffa0c1532b0 0x7ffa0c0cbc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:17.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:17.063+0000 7ffa10e85640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7ffa0c0ba540 con 0x7ffa0c1532b0 2024-05-27T12:32:17.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:17.063+0000 7ffa10e85640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7ffa0c15ef50 con 0x7ffa0c0b7e20 2024-05-27T12:32:17.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:17.063+0000 7ffa10e85640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7ffa0c0ba6c0 con 0x7ffa0c15eb70 2024-05-27T12:32:17.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:17.063+0000 7ffa0ad9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffa0c1532b0 0x7ffa0c0cbc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:17.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:17.063+0000 7ffa0a59c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa0c0b7e20 0x7ffa0c150420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:17.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:17.063+0000 7ffa0a59c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa0c0b7e20 0x7ffa0c150420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.55:50518/0 (socket says 172.21.15.55:50518) 2024-05-27T12:32:17.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:17.063+0000 7ffa01d9b640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffa0c15eb70 0x7ffa0c152d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:17.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:17.063+0000 7ffa0a59c640 1 -- 172.21.15.55:0/3547524799 learned_addr learned my addr 172.21.15.55:0/3547524799 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:32:17.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:17.063+0000 7ffa0ad9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffa0c1532b0 0x7ffa0c0cbc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45614/0 (socket says 172.21.15.55:45614) 2024-05-27T12:32:17.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:17.063+0000 7ffa0ad9d640 1 -- 172.21.15.55:0/3547524799 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffa0c15eb70 msgr2=0x7ffa0c152d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:17.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:17.063+0000 7ffa0ad9d640 1 --2- 172.21.15.55:0/3547524799 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffa0c15eb70 0x7ffa0c152d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:17.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:17.063+0000 7ffa0ad9d640 1 -- 172.21.15.55:0/3547524799 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa0c0b7e20 msgr2=0x7ffa0c150420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:17.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:17.063+0000 7ffa0ad9d640 1 --2- 172.21.15.55:0/3547524799 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa0c0b7e20 0x7ffa0c150420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:17.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:17.063+0000 7ffa0ad9d640 1 -- 172.21.15.55:0/3547524799 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa0c1548c0 con 0x7ffa0c1532b0 2024-05-27T12:32:17.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:17.063+0000 7ffa0a59c640 1 --2- 172.21.15.55:0/3547524799 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa0c0b7e20 0x7ffa0c150420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T12:32:17.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:17.064+0000 7ffa0ad9d640 1 --2- 172.21.15.55:0/3547524799 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffa0c1532b0 0x7ffa0c0cbc30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ffa0c0b63f0 tx=0x7ffa04007980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:17.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:17.064+0000 7ffa037fe640 1 -- 172.21.15.55:0/3547524799 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa04013780 con 0x7ffa0c1532b0 2024-05-27T12:32:17.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:17.064+0000 7ffa037fe640 1 -- 172.21.15.55:0/3547524799 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa04019070 con 0x7ffa0c1532b0 2024-05-27T12:32:17.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:17.064+0000 7ffa10e85640 1 -- 172.21.15.55:0/3547524799 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa0c153760 con 0x7ffa0c1532b0 2024-05-27T12:32:17.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:17.064+0000 7ffa037fe640 1 -- 172.21.15.55:0/3547524799 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa04013b20 con 0x7ffa0c1532b0 2024-05-27T12:32:17.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:17.064+0000 7ffa10e85640 1 -- 172.21.15.55:0/3547524799 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa0c15fc20 con 0x7ffa0c1532b0 2024-05-27T12:32:17.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:17.064+0000 7ffa037fe640 1 -- 172.21.15.55:0/3547524799 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ffa04013cc0 con 0x7ffa0c1532b0 2024-05-27T12:32:17.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:17.064+0000 7ffa037fe640 1 -- 172.21.15.55:0/3547524799 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7ffa04014620 con 0x7ffa0c1532b0 2024-05-27T12:32:17.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:17.065+0000 7ffa10e85640 1 -- 172.21.15.55:0/3547524799 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa0c075460 con 0x7ffa0c1532b0 2024-05-27T12:32:17.068 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:17.069+0000 7ffa037fe640 1 -- 172.21.15.55:0/3547524799 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7ffa04014870 con 0x7ffa0c1532b0 2024-05-27T12:32:17.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:17.136+0000 7ffa10e85640 1 -- 172.21.15.55:0/3547524799 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7ffa0c0d4850 con 0x7ffa0c1532b0 2024-05-27T12:32:17.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:17.142+0000 7ffa037fe640 1 -- 172.21.15.55:0/3547524799 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7ffa04009b30 con 0x7ffa0c1532b0 2024-05-27T12:32:17.141 INFO:teuthology.orchestra.run.smithi055.stderr:adjusted tunables profile to default 2024-05-27T12:32:17.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:17.143+0000 7ffa10e85640 1 -- 172.21.15.55:0/3547524799 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffa0c1532b0 msgr2=0x7ffa0c0cbc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:17.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:17.143+0000 7ffa10e85640 1 --2- 172.21.15.55:0/3547524799 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffa0c1532b0 0x7ffa0c0cbc30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ffa0c0b63f0 tx=0x7ffa04007980 comp rx=0 tx=0).stop 2024-05-27T12:32:17.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:17.143+0000 7ffa10e85640 1 -- 172.21.15.55:0/3547524799 shutdown_connections 2024-05-27T12:32:17.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:17.143+0000 7ffa10e85640 1 --2- 172.21.15.55:0/3547524799 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffa0c1532b0 0x7ffa0c0cbc30 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:17.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:17.143+0000 7ffa10e85640 1 --2- 172.21.15.55:0/3547524799 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffa0c15eb70 0x7ffa0c152d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:17.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:17.143+0000 7ffa10e85640 1 --2- 172.21.15.55:0/3547524799 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa0c0b7e20 0x7ffa0c150420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:17.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:17.143+0000 7ffa10e85640 1 -- 172.21.15.55:0/3547524799 >> 172.21.15.55:0/3547524799 conn(0x7ffa0c067a50 msgr2=0x7ffa0c0c8430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:17.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:17.143+0000 7ffa10e85640 1 -- 172.21.15.55:0/3547524799 shutdown_connections 2024-05-27T12:32:17.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:17.143+0000 7ffa10e85640 1 -- 172.21.15.55:0/3547524799 wait complete. 2024-05-27T12:32:17.145 INFO:tasks.ceph.mgr.x.smithi072.stderr:2024-05-27T12:32:17.146+0000 7f9268f09040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-27T12:32:17.154 INFO:tasks.ceph:check_enable_crimson: False 2024-05-27T12:32:17.154 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-05-27T12:32:17.154 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-05-27T12:32:17.154 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-05-27T12:32:17.158 INFO:tasks.ceph.mgr.y.smithi055.stderr:2024-05-27T12:32:17.159+0000 7fdab65be040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-27T12:32:17.180 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-05-27T12:32:17.180 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-05-27T12:32:17.246 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-05-27T12:32:17.246 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-05-27T12:32:17.312 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-05-27T12:32:17.312 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-05-27T12:32:17.314 INFO:tasks.ceph.mgr.x.smithi072.stderr:2024-05-27T12:32:17.315+0000 7f9268f09040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-27T12:32:17.332 INFO:tasks.ceph.mgr.y.smithi055.stderr:2024-05-27T12:32:17.333+0000 7fdab65be040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-27T12:32:17.357 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-05-27T12:32:17.357 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-05-27T12:32:17.366 INFO:tasks.ceph.mgr.x.smithi072.stderr:2024-05-27T12:32:17.368+0000 7f9268f09040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-27T12:32:17.382 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-05-27T12:32:17.383 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-05-27T12:32:17.388 INFO:tasks.ceph.mgr.y.smithi055.stderr:2024-05-27T12:32:17.389+0000 7fdab65be040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-27T12:32:17.447 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-05-27T12:32:17.447 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-05-27T12:32:17.512 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-05-27T12:32:17.512 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-05-27T12:32:17.577 DEBUG:teuthology.orchestra.run.smithi072:> sudo ceph --cluster ceph osd new e607b598-061b-4b6f-92ff-95c20b330599 0 2024-05-27T12:32:17.626 INFO:tasks.ceph.mgr.x.smithi072.stderr:2024-05-27T12:32:17.627+0000 7f9268f09040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-27T12:32:17.641 INFO:tasks.ceph.mgr.y.smithi055.stderr:2024-05-27T12:32:17.642+0000 7fdab65be040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-27T12:32:17.674 INFO:tasks.ceph.mgr.x.smithi072.stderr:2024-05-27T12:32:17.676+0000 7f9268f09040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-27T12:32:17.690 INFO:tasks.ceph.mgr.y.smithi055.stderr:2024-05-27T12:32:17.691+0000 7fdab65be040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-27T12:32:17.717 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:17.719+0000 7ffb63522640 1 Processor -- start 2024-05-27T12:32:17.717 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:17.719+0000 7ffb63522640 1 -- start start 2024-05-27T12:32:17.719 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:17.720+0000 7ffb63522640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ffb5c15b800 0x7ffb5c06f880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:17.719 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:17.720+0000 7ffb63522640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ffb5c0d1b20 0x7ffb5c0ce0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:17.719 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:17.720+0000 7ffb63522640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb5c0702b0 con 0x7ffb5c06fdc0 2024-05-27T12:32:17.720 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:17.720+0000 7ffb63522640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7ffb5c070590 con 0x7ffb5c0d1b20 2024-05-27T12:32:17.720 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:17.720+0000 7ffb63522640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7ffb5c070870 con 0x7ffb5c15b800 2024-05-27T12:32:17.720 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:17.720+0000 7ffb612be640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ffb5c15b800 0x7ffb5c06f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:17.720 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:17.720+0000 7ffb60abd640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7ffb5c06fdc0 0x7ffb5c0d1410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:47888/0 (socket says 172.21.15.72:47888) 2024-05-27T12:32:17.720 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:17.720+0000 7ffb60abd640 1 -- 172.21.15.72:0/3434687523 learned_addr learned my addr 172.21.15.72:0/3434687523 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-05-27T12:32:17.720 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:17.720+0000 7ffb612be640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ffb5c15b800 0x7ffb5c06f880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48900/0 (socket says 172.21.15.72:48900) 2024-05-27T12:32:17.720 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:17.720+0000 7ffb61abf640 1 --2- 172.21.15.72:0/3434687523 >> v2:172.21.15.55:3300/0 conn(0x7ffb5c0d1b20 0x7ffb5c0ce0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:17.720 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:17.720+0000 7ffb612be640 1 -- 172.21.15.72:0/3434687523 >> v2:172.21.15.55:3300/0 conn(0x7ffb5c0d1b20 msgr2=0x7ffb5c0ce0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:32:17.720 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:17.720+0000 7ffb612be640 1 --2- 172.21.15.72:0/3434687523 >> v2:172.21.15.55:3300/0 conn(0x7ffb5c0d1b20 0x7ffb5c0ce0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:17.720 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:17.720+0000 7ffb612be640 1 -- 172.21.15.72:0/3434687523 >> v1:172.21.15.72:6789/0 conn(0x7ffb5c06fdc0 legacy=0x7ffb5c0d1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:17.721 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:17.720+0000 7ffb612be640 1 -- 172.21.15.72:0/3434687523 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb5c070b50 con 0x7ffb5c15b800 2024-05-27T12:32:17.721 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:17.720+0000 7ffb53fff640 1 -- 172.21.15.72:0/3434687523 <== mon.1 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2022204995 0 0) 0x7ffb5c0702b0 con 0x7ffb5c06fdc0 2024-05-27T12:32:17.721 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:17.721+0000 7ffb612be640 1 --2- 172.21.15.72:0/3434687523 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffb5c15b800 0x7ffb5c06f880 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ffb5c073e00 tx=0x7ffb5802a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=23e47560481ab5dd server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:17.721 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:17.721+0000 7ffb53fff640 1 -- 172.21.15.72:0/3434687523 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb58037070 con 0x7ffb5c15b800 2024-05-27T12:32:17.721 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:17.721+0000 7ffb53fff640 1 -- 172.21.15.72:0/3434687523 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb58032440 con 0x7ffb5c15b800 2024-05-27T12:32:17.721 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:17.721+0000 7ffb53fff640 1 -- 172.21.15.72:0/3434687523 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb58032810 con 0x7ffb5c15b800 2024-05-27T12:32:17.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:17.721+0000 7ffb63522640 1 -- 172.21.15.72:0/3434687523 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffb5c15b800 msgr2=0x7ffb5c06f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:17.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:17.721+0000 7ffb63522640 1 --2- 172.21.15.72:0/3434687523 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffb5c15b800 0x7ffb5c06f880 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ffb5c073e00 tx=0x7ffb5802a1a0 comp rx=0 tx=0).stop 2024-05-27T12:32:17.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:17.722+0000 7ffb63522640 1 -- 172.21.15.72:0/3434687523 shutdown_connections 2024-05-27T12:32:17.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:17.722+0000 7ffb63522640 1 --2- 172.21.15.72:0/3434687523 >> v2:172.21.15.55:3300/0 conn(0x7ffb5c0d1b20 0x7ffb5c0ce0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:17.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:17.722+0000 7ffb63522640 1 --2- 172.21.15.72:0/3434687523 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffb5c15b800 0x7ffb5c06f880 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:17.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:17.722+0000 7ffb63522640 1 -- 172.21.15.72:0/3434687523 >> 172.21.15.72:0/3434687523 conn(0x7ffb5c0734b0 msgr2=0x7ffb5c09aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:17.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:17.722+0000 7ffb63522640 1 -- 172.21.15.72:0/3434687523 shutdown_connections 2024-05-27T12:32:17.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:17.722+0000 7ffb63522640 1 -- 172.21.15.72:0/3434687523 wait complete. 2024-05-27T12:32:17.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:17.724+0000 7ffb63522640 1 Processor -- start 2024-05-27T12:32:17.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:17.724+0000 7ffb63522640 1 -- start start 2024-05-27T12:32:17.725 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:17.725+0000 7ffb63522640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffb5c06fdc0 0x7ffb5c15d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:17.725 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:17.725+0000 7ffb63522640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffb5c0d1b20 0x7ffb5c155c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:17.725 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:17.725+0000 7ffb63522640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffb5c15b800 0x7ffb5c0ca2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:17.725 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:17.725+0000 7ffb63522640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7ffb5c0b0b50 con 0x7ffb5c06fdc0 2024-05-27T12:32:17.725 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:17.725+0000 7ffb63522640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7ffb5c0b09d0 con 0x7ffb5c0d1b20 2024-05-27T12:32:17.725 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:17.725+0000 7ffb63522640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7ffb5c0ce5f0 con 0x7ffb5c15b800 2024-05-27T12:32:17.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:17.725+0000 7ffb60abd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffb5c0d1b20 0x7ffb5c155c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:17.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:17.725+0000 7ffb60abd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffb5c0d1b20 0x7ffb5c155c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48910/0 (socket says 172.21.15.72:48910) 2024-05-27T12:32:17.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:17.725+0000 7ffb60abd640 1 -- 172.21.15.72:0/2734575122 learned_addr learned my addr 172.21.15.72:0/2734575122 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-27T12:32:17.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:17.725+0000 7ffb61abf640 1 --2- 172.21.15.72:0/2734575122 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffb5c15b800 0x7ffb5c0ca2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:17.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:17.725+0000 7ffb612be640 1 --2- 172.21.15.72:0/2734575122 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffb5c06fdc0 0x7ffb5c15d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:17.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:17.725+0000 7ffb60abd640 1 -- 172.21.15.72:0/2734575122 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffb5c15b800 msgr2=0x7ffb5c0ca2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:17.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:17.725+0000 7ffb60abd640 1 --2- 172.21.15.72:0/2734575122 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffb5c15b800 0x7ffb5c0ca2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:17.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:17.725+0000 7ffb60abd640 1 -- 172.21.15.72:0/2734575122 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffb5c06fdc0 msgr2=0x7ffb5c15d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:17.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:17.725+0000 7ffb60abd640 1 --2- 172.21.15.72:0/2734575122 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffb5c06fdc0 0x7ffb5c15d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:17.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:17.725+0000 7ffb60abd640 1 -- 172.21.15.72:0/2734575122 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb5c1561a0 con 0x7ffb5c0d1b20 2024-05-27T12:32:17.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:17.725+0000 7ffb60abd640 1 --2- 172.21.15.72:0/2734575122 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffb5c0d1b20 0x7ffb5c155c60 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ffb4c00c4e0 tx=0x7ffb4c00c9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:17.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:17.726+0000 7ffb51ffb640 1 -- 172.21.15.72:0/2734575122 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb4c018070 con 0x7ffb5c0d1b20 2024-05-27T12:32:17.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:17.726+0000 7ffb51ffb640 1 -- 172.21.15.72:0/2734575122 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb4c007500 con 0x7ffb5c0d1b20 2024-05-27T12:32:17.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:17.726+0000 7ffb51ffb640 1 -- 172.21.15.72:0/2734575122 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb4c004a20 con 0x7ffb5c0d1b20 2024-05-27T12:32:17.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:17.726+0000 7ffb63522640 1 -- 172.21.15.72:0/2734575122 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb5c159550 con 0x7ffb5c0d1b20 2024-05-27T12:32:17.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:17.726+0000 7ffb51ffb640 1 -- 172.21.15.72:0/2734575122 <== mon.1 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ffb4c01b070 con 0x7ffb5c0d1b20 2024-05-27T12:32:17.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:17.726+0000 7ffb63522640 1 -- 172.21.15.72:0/2734575122 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb5c15ca70 con 0x7ffb5c0d1b20 2024-05-27T12:32:17.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:17.726+0000 7ffb51ffb640 1 -- 172.21.15.72:0/2734575122 <== mon.1 v2:172.21.15.72:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7ffb4c01c6f0 con 0x7ffb5c0d1b20 2024-05-27T12:32:17.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:17.727+0000 7ffb63522640 1 -- 172.21.15.72:0/2734575122 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb5c075460 con 0x7ffb5c0d1b20 2024-05-27T12:32:17.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:17.729+0000 7ffb51ffb640 1 -- 172.21.15.72:0/2734575122 <== mon.1 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7ffb4c022020 con 0x7ffb5c0d1b20 2024-05-27T12:32:17.800 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:17.801+0000 7ffb63522640 1 -- 172.21.15.72:0/2734575122 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd new", "uuid": "e607b598-061b-4b6f-92ff-95c20b330599", "id": 0} v 0) -- 0x7ffb5c0b0e80 con 0x7ffb5c0d1b20 2024-05-27T12:32:17.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:17.805+0000 7ffb51ffb640 1 -- 172.21.15.72:0/2734575122 <== mon.1 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e607b598-061b-4b6f-92ff-95c20b330599", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7ffb4c01cd70 con 0x7ffb5c0d1b20 2024-05-27T12:32:17.803 INFO:teuthology.orchestra.run.smithi072.stdout:0 2024-05-27T12:32:17.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:17.805+0000 7ffb63522640 1 -- 172.21.15.72:0/2734575122 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffb5c0d1b20 msgr2=0x7ffb5c155c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:17.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:17.805+0000 7ffb63522640 1 --2- 172.21.15.72:0/2734575122 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffb5c0d1b20 0x7ffb5c155c60 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ffb4c00c4e0 tx=0x7ffb4c00c9a0 comp rx=0 tx=0).stop 2024-05-27T12:32:17.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:17.805+0000 7ffb63522640 1 -- 172.21.15.72:0/2734575122 shutdown_connections 2024-05-27T12:32:17.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:17.805+0000 7ffb63522640 1 --2- 172.21.15.72:0/2734575122 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffb5c15b800 0x7ffb5c0ca2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:17.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:17.805+0000 7ffb63522640 1 --2- 172.21.15.72:0/2734575122 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffb5c0d1b20 0x7ffb5c155c60 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:17.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:17.805+0000 7ffb63522640 1 --2- 172.21.15.72:0/2734575122 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffb5c06fdc0 0x7ffb5c15d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:17.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:17.805+0000 7ffb63522640 1 -- 172.21.15.72:0/2734575122 >> 172.21.15.72:0/2734575122 conn(0x7ffb5c0734b0 msgr2=0x7ffb5c0d1410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:17.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:17.806+0000 7ffb63522640 1 -- 172.21.15.72:0/2734575122 shutdown_connections 2024-05-27T12:32:17.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:17.806+0000 7ffb63522640 1 -- 172.21.15.72:0/2734575122 wait complete. 2024-05-27T12:32:17.815 DEBUG:teuthology.orchestra.run.smithi072:> sudo ceph --cluster ceph osd new ba2b5b1d-71a9-4ecc-9a48-55aa7fe54261 1 2024-05-27T12:32:17.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:17.957+0000 7f83d7b8e640 1 Processor -- start 2024-05-27T12:32:17.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:17.957+0000 7f83d7b8e640 1 -- start start 2024-05-27T12:32:17.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:17.958+0000 7f83d7b8e640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f83d015b800 0x7f83d006f880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:17.959 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:17.958+0000 7f83d7b8e640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83d00702b0 con 0x7f83d00d1b20 2024-05-27T12:32:17.959 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:17.958+0000 7f83d7b8e640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83d0070590 con 0x7f83d006fdc0 2024-05-27T12:32:17.959 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:17.958+0000 7f83d7b8e640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f83d0070870 con 0x7f83d015b800 2024-05-27T12:32:17.959 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:17.958+0000 7f83d592a640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f83d015b800 0x7f83d006f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:17.959 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:17.958+0000 7f83d5129640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f83d006fdc0 0x7f83d00d1410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:47890/0 (socket says 172.21.15.72:47890) 2024-05-27T12:32:17.959 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:17.958+0000 7f83d5129640 1 -- 172.21.15.72:0/3232530721 learned_addr learned my addr 172.21.15.72:0/3232530721 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-05-27T12:32:17.959 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:17.958+0000 7f83d4928640 1 -- 172.21.15.72:0/3232530721 <== mon.1 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3934445913 0 0) 0x7f83d0070590 con 0x7f83d006fdc0 2024-05-27T12:32:17.959 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:17.958+0000 7f83d4928640 1 -- 172.21.15.72:0/3232530721 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f83bc003520 con 0x7f83d006fdc0 2024-05-27T12:32:17.959 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:17.958+0000 7f83d592a640 1 -- 172.21.15.72:0/3232530721 >> v1:172.21.15.72:6789/0 conn(0x7f83d006fdc0 legacy=0x7f83d00d1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:17.959 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:17.958+0000 7f83d592a640 1 -- 172.21.15.72:0/3232530721 >> v1:172.21.15.55:6789/0 conn(0x7f83d00d1b20 legacy=0x7f83d00ce0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:17.959 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:17.958+0000 7f83d592a640 1 -- 172.21.15.72:0/3232530721 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83d0070b50 con 0x7f83d015b800 2024-05-27T12:32:17.959 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:17.959+0000 7f83d592a640 1 --2- 172.21.15.72:0/3232530721 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f83d015b800 0x7f83d006f880 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f83cc0097d0 tx=0x7f83cc02a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=931253c1642a9cd6 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:17.960 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:17.959+0000 7f83d4928640 1 -- 172.21.15.72:0/3232530721 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83cc037070 con 0x7f83d015b800 2024-05-27T12:32:17.960 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:17.959+0000 7f83d4928640 1 -- 172.21.15.72:0/3232530721 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83cc032440 con 0x7f83d015b800 2024-05-27T12:32:17.960 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:17.959+0000 7f83d4928640 1 -- 172.21.15.72:0/3232530721 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83cc032810 con 0x7f83d015b800 2024-05-27T12:32:17.960 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:17.960+0000 7f83d7b8e640 1 -- 172.21.15.72:0/3232530721 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f83d015b800 msgr2=0x7f83d006f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:17.960 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:17.960+0000 7f83d7b8e640 1 --2- 172.21.15.72:0/3232530721 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f83d015b800 0x7f83d006f880 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f83cc0097d0 tx=0x7f83cc02a210 comp rx=0 tx=0).stop 2024-05-27T12:32:17.960 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:17.960+0000 7f83d7b8e640 1 -- 172.21.15.72:0/3232530721 shutdown_connections 2024-05-27T12:32:17.960 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:17.960+0000 7f83d7b8e640 1 --2- 172.21.15.72:0/3232530721 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f83d015b800 0x7f83d006f880 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:17.960 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:17.960+0000 7f83d7b8e640 1 -- 172.21.15.72:0/3232530721 >> 172.21.15.72:0/3232530721 conn(0x7f83d00734b0 msgr2=0x7f83d009aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:17.960 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:17.960+0000 7f83d7b8e640 1 -- 172.21.15.72:0/3232530721 shutdown_connections 2024-05-27T12:32:17.960 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:17.960+0000 7f83d7b8e640 1 -- 172.21.15.72:0/3232530721 wait complete. 2024-05-27T12:32:17.962 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:17.961+0000 7f83d7b8e640 1 Processor -- start 2024-05-27T12:32:17.962 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:17.961+0000 7f83d7b8e640 1 -- start start 2024-05-27T12:32:17.963 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:17.962+0000 7f83d7b8e640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83d006fdc0 0x7f83d00cb540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:17.963 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:17.962+0000 7f83d7b8e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f83d00d1b20 0x7f83d00c7540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:17.963 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:17.962+0000 7f83d7b8e640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f83d015b800 0x7f83d00b18d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:17.963 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:17.962+0000 7f83d7b8e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f83d00b0b50 con 0x7f83d00d1b20 2024-05-27T12:32:17.963 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:17.962+0000 7f83d7b8e640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f83d00b09d0 con 0x7f83d006fdc0 2024-05-27T12:32:17.963 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:17.962+0000 7f83d7b8e640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f83d00af520 con 0x7f83d015b800 2024-05-27T12:32:17.963 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:17.962+0000 7f83d592a640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83d006fdc0 0x7f83d00cb540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:17.963 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:17.962+0000 7f83d592a640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83d006fdc0 0x7f83d00cb540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48922/0 (socket says 172.21.15.72:48922) 2024-05-27T12:32:17.963 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:17.962+0000 7f83d592a640 1 -- 172.21.15.72:0/1363414864 learned_addr learned my addr 172.21.15.72:0/1363414864 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-27T12:32:17.963 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:17.962+0000 7f83d612b640 1 --2- 172.21.15.72:0/1363414864 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f83d015b800 0x7f83d00b18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:17.963 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:17.962+0000 7f83d5129640 1 --2- 172.21.15.72:0/1363414864 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f83d00d1b20 0x7f83d00c7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:17.963 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:17.962+0000 7f83d592a640 1 -- 172.21.15.72:0/1363414864 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f83d015b800 msgr2=0x7f83d00b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:17.963 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:17.962+0000 7f83d592a640 1 --2- 172.21.15.72:0/1363414864 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f83d015b800 0x7f83d00b18d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:17.963 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:17.962+0000 7f83d592a640 1 -- 172.21.15.72:0/1363414864 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f83d00d1b20 msgr2=0x7f83d00c7540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:17.963 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:17.962+0000 7f83d592a640 1 --2- 172.21.15.72:0/1363414864 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f83d00d1b20 0x7f83d00c7540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:17.964 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:17.962+0000 7f83d592a640 1 -- 172.21.15.72:0/1363414864 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83d00c86d0 con 0x7f83d006fdc0 2024-05-27T12:32:17.964 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:17.962+0000 7f83d592a640 1 --2- 172.21.15.72:0/1363414864 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83d006fdc0 0x7f83d00cb540 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f83cc035040 tx=0x7f83cc0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:17.964 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:17.962+0000 7f83c67fc640 1 -- 172.21.15.72:0/1363414864 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83cc037050 con 0x7f83d006fdc0 2024-05-27T12:32:17.964 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:17.963+0000 7f83c67fc640 1 -- 172.21.15.72:0/1363414864 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83cc038040 con 0x7f83d006fdc0 2024-05-27T12:32:17.964 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:17.963+0000 7f83d7b8e640 1 -- 172.21.15.72:0/1363414864 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83d00b2040 con 0x7f83d006fdc0 2024-05-27T12:32:17.964 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:17.963+0000 7f83c67fc640 1 -- 172.21.15.72:0/1363414864 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83cc03cb70 con 0x7f83d006fdc0 2024-05-27T12:32:17.964 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:17.963+0000 7f83d7b8e640 1 -- 172.21.15.72:0/1363414864 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83d00c8c50 con 0x7f83d006fdc0 2024-05-27T12:32:17.964 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:17.963+0000 7f83c67fc640 1 -- 172.21.15.72:0/1363414864 <== mon.1 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f83cc03cd10 con 0x7f83d006fdc0 2024-05-27T12:32:17.964 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:17.963+0000 7f83c67fc640 1 -- 172.21.15.72:0/1363414864 <== mon.1 v2:172.21.15.72:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f83cc03e7c0 con 0x7f83d006fdc0 2024-05-27T12:32:17.964 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:17.963+0000 7f83d7b8e640 1 -- 172.21.15.72:0/1363414864 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83d0075460 con 0x7f83d006fdc0 2024-05-27T12:32:17.964 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:17.965+0000 7f83c67fc640 1 -- 172.21.15.72:0/1363414864 <== mon.1 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f83cc030de0 con 0x7f83d006fdc0 2024-05-27T12:32:18.038 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.039+0000 7f83d7b8e640 1 -- 172.21.15.72:0/1363414864 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd new", "uuid": "ba2b5b1d-71a9-4ecc-9a48-55aa7fe54261", "id": 1} v 0) -- 0x7f83d00cbb90 con 0x7f83d006fdc0 2024-05-27T12:32:18.041 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.042+0000 7f83c67fc640 1 -- 172.21.15.72:0/1363414864 <== mon.1 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ba2b5b1d-71a9-4ecc-9a48-55aa7fe54261", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f83cc03ea10 con 0x7f83d006fdc0 2024-05-27T12:32:18.041 INFO:teuthology.orchestra.run.smithi072.stdout:1 2024-05-27T12:32:18.042 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.043+0000 7f83d7b8e640 1 -- 172.21.15.72:0/1363414864 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83d006fdc0 msgr2=0x7f83d00cb540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:18.042 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.043+0000 7f83d7b8e640 1 --2- 172.21.15.72:0/1363414864 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83d006fdc0 0x7f83d00cb540 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f83cc035040 tx=0x7f83cc0046c0 comp rx=0 tx=0).stop 2024-05-27T12:32:18.042 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.043+0000 7f83d7b8e640 1 -- 172.21.15.72:0/1363414864 shutdown_connections 2024-05-27T12:32:18.042 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.043+0000 7f83d7b8e640 1 --2- 172.21.15.72:0/1363414864 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f83d015b800 0x7f83d00b18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:18.042 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.043+0000 7f83d7b8e640 1 --2- 172.21.15.72:0/1363414864 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f83d00d1b20 0x7f83d00c7540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:18.042 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.043+0000 7f83d7b8e640 1 --2- 172.21.15.72:0/1363414864 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83d006fdc0 0x7f83d00cb540 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:18.042 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.043+0000 7f83d7b8e640 1 -- 172.21.15.72:0/1363414864 >> 172.21.15.72:0/1363414864 conn(0x7f83d00734b0 msgr2=0x7f83d00b2840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:18.042 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.043+0000 7f83d7b8e640 1 -- 172.21.15.72:0/1363414864 shutdown_connections 2024-05-27T12:32:18.042 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.043+0000 7f83d7b8e640 1 -- 172.21.15.72:0/1363414864 wait complete. 2024-05-27T12:32:18.053 DEBUG:teuthology.orchestra.run.smithi072:> sudo ceph --cluster ceph osd new e6b81cc6-4ff1-45d0-87eb-9f04ccf986a3 2 2024-05-27T12:32:18.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.153+0000 7f1829eb9640 1 Processor -- start 2024-05-27T12:32:18.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.153+0000 7f1829eb9640 1 -- start start 2024-05-27T12:32:18.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.154+0000 7f1829eb9640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f18240b7030 0x7f18240d1f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:18.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.154+0000 7f1829eb9640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18240b4eb0 con 0x7f182415b6c0 2024-05-27T12:32:18.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.154+0000 7f1829eb9640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18240b5190 con 0x7f18240b22c0 2024-05-27T12:32:18.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.154+0000 7f1829eb9640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f18240b5470 con 0x7f18240b7030 2024-05-27T12:32:18.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.154+0000 7f1823fff640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f18240b7030 0x7f18240d1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:18.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.154+0000 7f1822ffd640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f18240b22c0 0x7f18240b6920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:47898/0 (socket says 172.21.15.72:47898) 2024-05-27T12:32:18.154 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.154+0000 7f1823fff640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f18240b7030 0x7f18240d1f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48924/0 (socket says 172.21.15.72:48924) 2024-05-27T12:32:18.154 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.154+0000 7f1822ffd640 1 -- 172.21.15.72:0/4024029385 learned_addr learned my addr 172.21.15.72:0/4024029385 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-05-27T12:32:18.154 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.154+0000 7f1823fff640 1 -- 172.21.15.72:0/4024029385 >> v1:172.21.15.72:6789/0 conn(0x7f18240b22c0 legacy=0x7f18240b6920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:18.154 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.154+0000 7f1823fff640 1 -- 172.21.15.72:0/4024029385 >> v1:172.21.15.55:6789/0 conn(0x7f182415b6c0 legacy=0x7f18240b46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:18.154 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.154+0000 7f1823fff640 1 -- 172.21.15.72:0/4024029385 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18240b5750 con 0x7f18240b7030 2024-05-27T12:32:18.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.155+0000 7f1823fff640 1 --2- 172.21.15.72:0/4024029385 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18240b7030 0x7f18240d1f60 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f181c009d90 tx=0x7f181c02a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb351adfaa1de681 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:18.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.155+0000 7f18227fc640 1 -- 172.21.15.72:0/4024029385 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f181c007740 con 0x7f18240b7030 2024-05-27T12:32:18.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.155+0000 7f18227fc640 1 -- 172.21.15.72:0/4024029385 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f181c0078e0 con 0x7f18240b7030 2024-05-27T12:32:18.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.155+0000 7f18227fc640 1 -- 172.21.15.72:0/4024029385 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f181c007cb0 con 0x7f18240b7030 2024-05-27T12:32:18.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.156+0000 7f1829eb9640 1 -- 172.21.15.72:0/4024029385 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18240b7030 msgr2=0x7f18240d1f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:18.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.156+0000 7f1829eb9640 1 --2- 172.21.15.72:0/4024029385 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18240b7030 0x7f18240d1f60 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f181c009d90 tx=0x7f181c02a6f0 comp rx=0 tx=0).stop 2024-05-27T12:32:18.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.156+0000 7f1829eb9640 1 -- 172.21.15.72:0/4024029385 shutdown_connections 2024-05-27T12:32:18.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.156+0000 7f1829eb9640 1 --2- 172.21.15.72:0/4024029385 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18240b7030 0x7f18240d1f60 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:18.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.156+0000 7f1829eb9640 1 -- 172.21.15.72:0/4024029385 >> 172.21.15.72:0/4024029385 conn(0x7f1824073440 msgr2=0x7f182409aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:18.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.156+0000 7f1829eb9640 1 -- 172.21.15.72:0/4024029385 shutdown_connections 2024-05-27T12:32:18.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.156+0000 7f1829eb9640 1 -- 172.21.15.72:0/4024029385 wait complete. 2024-05-27T12:32:18.158 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.157+0000 7f1829eb9640 1 Processor -- start 2024-05-27T12:32:18.158 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.157+0000 7f1829eb9640 1 -- start start 2024-05-27T12:32:18.158 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.158+0000 7f1829eb9640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18240b22c0 0x7f182414cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:18.158 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.158+0000 7f1829eb9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f18240b7030 0x7f182409d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:18.158 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.158+0000 7f1829eb9640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f182415b6c0 0x7f182409d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:18.158 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.158+0000 7f1829eb9640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f1824166270 con 0x7f18240b7030 2024-05-27T12:32:18.158 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.158+0000 7f1829eb9640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f182415baa0 con 0x7f18240b22c0 2024-05-27T12:32:18.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.158+0000 7f1829eb9640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f18241663f0 con 0x7f182415b6c0 2024-05-27T12:32:18.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.158+0000 7f18237fe640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18240b22c0 0x7f182414cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:18.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.158+0000 7f18237fe640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18240b22c0 0x7f182414cf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48938/0 (socket says 172.21.15.72:48938) 2024-05-27T12:32:18.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.158+0000 7f18237fe640 1 -- 172.21.15.72:0/1453379791 learned_addr learned my addr 172.21.15.72:0/1453379791 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-27T12:32:18.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.158+0000 7f1823fff640 1 --2- 172.21.15.72:0/1453379791 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f182415b6c0 0x7f182409d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:18.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.158+0000 7f1822ffd640 1 --2- 172.21.15.72:0/1453379791 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f18240b7030 0x7f182409d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:18.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.158+0000 7f18237fe640 1 -- 172.21.15.72:0/1453379791 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f182415b6c0 msgr2=0x7f182409d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:18.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.158+0000 7f18237fe640 1 --2- 172.21.15.72:0/1453379791 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f182415b6c0 0x7f182409d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:18.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.158+0000 7f18237fe640 1 -- 172.21.15.72:0/1453379791 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f18240b7030 msgr2=0x7f182409d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:18.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.158+0000 7f18237fe640 1 --2- 172.21.15.72:0/1453379791 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f18240b7030 0x7f182409d3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:18.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.158+0000 7f18237fe640 1 -- 172.21.15.72:0/1453379791 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f182409df40 con 0x7f18240b22c0 2024-05-27T12:32:18.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.158+0000 7f18237fe640 1 --2- 172.21.15.72:0/1453379791 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18240b22c0 0x7f182414cf90 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f181400c340 tx=0x7f181400c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:18.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.158+0000 7f180bfff640 1 -- 172.21.15.72:0/1453379791 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1814017070 con 0x7f18240b22c0 2024-05-27T12:32:18.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.159+0000 7f180bfff640 1 -- 172.21.15.72:0/1453379791 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18140052d0 con 0x7f18240b22c0 2024-05-27T12:32:18.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.159+0000 7f1829eb9640 1 -- 172.21.15.72:0/1453379791 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f182409e220 con 0x7f18240b22c0 2024-05-27T12:32:18.160 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.159+0000 7f180bfff640 1 -- 172.21.15.72:0/1453379791 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1814003850 con 0x7f18240b22c0 2024-05-27T12:32:18.160 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.159+0000 7f1829eb9640 1 -- 172.21.15.72:0/1453379791 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f182409e7e0 con 0x7f18240b22c0 2024-05-27T12:32:18.160 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.159+0000 7f180bfff640 1 -- 172.21.15.72:0/1453379791 <== mon.1 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f181401a070 con 0x7f18240b22c0 2024-05-27T12:32:18.160 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.159+0000 7f180bfff640 1 -- 172.21.15.72:0/1453379791 <== mon.1 v2:172.21.15.72:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f1814012420 con 0x7f18240b22c0 2024-05-27T12:32:18.160 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.160+0000 7f1829eb9640 1 -- 172.21.15.72:0/1453379791 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1824075460 con 0x7f18240b22c0 2024-05-27T12:32:18.160 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.162+0000 7f180bfff640 1 -- 172.21.15.72:0/1453379791 <== mon.1 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f1814021070 con 0x7f18240b22c0 2024-05-27T12:32:18.232 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.234+0000 7f1829eb9640 1 -- 172.21.15.72:0/1453379791 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd new", "uuid": "e6b81cc6-4ff1-45d0-87eb-9f04ccf986a3", "id": 2} v 0) -- 0x7f182409ae40 con 0x7f18240b22c0 2024-05-27T12:32:18.236 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.238+0000 7f180bfff640 1 -- 172.21.15.72:0/1453379791 <== mon.1 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e6b81cc6-4ff1-45d0-87eb-9f04ccf986a3", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f18140115f0 con 0x7f18240b22c0 2024-05-27T12:32:18.237 INFO:teuthology.orchestra.run.smithi072.stdout:2 2024-05-27T12:32:18.238 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.239+0000 7f1829eb9640 1 -- 172.21.15.72:0/1453379791 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18240b22c0 msgr2=0x7f182414cf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:18.238 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.239+0000 7f1829eb9640 1 --2- 172.21.15.72:0/1453379791 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18240b22c0 0x7f182414cf90 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f181400c340 tx=0x7f181400c800 comp rx=0 tx=0).stop 2024-05-27T12:32:18.238 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.239+0000 7f1829eb9640 1 -- 172.21.15.72:0/1453379791 shutdown_connections 2024-05-27T12:32:18.238 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.239+0000 7f1829eb9640 1 --2- 172.21.15.72:0/1453379791 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f182415b6c0 0x7f182409d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:18.238 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.239+0000 7f1829eb9640 1 --2- 172.21.15.72:0/1453379791 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f18240b7030 0x7f182409d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:18.238 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.239+0000 7f1829eb9640 1 --2- 172.21.15.72:0/1453379791 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18240b22c0 0x7f182414cf90 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:18.238 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.239+0000 7f1829eb9640 1 -- 172.21.15.72:0/1453379791 >> 172.21.15.72:0/1453379791 conn(0x7f1824073440 msgr2=0x7f18240704d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:18.238 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.239+0000 7f1829eb9640 1 -- 172.21.15.72:0/1453379791 shutdown_connections 2024-05-27T12:32:18.238 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.239+0000 7f1829eb9640 1 -- 172.21.15.72:0/1453379791 wait complete. 2024-05-27T12:32:18.248 DEBUG:teuthology.orchestra.run.smithi072:> sudo ceph --cluster ceph osd new b6a34b75-807d-4693-b1c3-903cb4c618d9 3 2024-05-27T12:32:18.349 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.350+0000 7f6dc2507640 1 Processor -- start 2024-05-27T12:32:18.349 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.350+0000 7f6dc2507640 1 -- start start 2024-05-27T12:32:18.351 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.351+0000 7f6dc2507640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6dbc15b6c0 0x7f6dbc0d1f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:18.351 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.351+0000 7f6dc2507640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6dbc0b7030 0x7f6dbc165260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:18.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.351+0000 7f6dc2507640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6dbc0b4eb0 con 0x7f6dbc0b46d0 2024-05-27T12:32:18.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.352+0000 7f6dc2507640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f6dbc0b5190 con 0x7f6dbc15b6c0 2024-05-27T12:32:18.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.352+0000 7f6dc2507640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f6dbc0b5470 con 0x7f6dbc0b7030 2024-05-27T12:32:18.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.352+0000 7f6dc0aa4640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6dbc0b7030 0x7f6dbc165260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:18.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.352+0000 7f6dbb7fe640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f6dbc0b46d0 0x7f6dbc0b6920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:47902/0 (socket says 172.21.15.72:47902) 2024-05-27T12:32:18.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.352+0000 7f6dbb7fe640 1 -- 172.21.15.72:0/3775718243 learned_addr learned my addr 172.21.15.72:0/3775718243 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-05-27T12:32:18.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.352+0000 7f6dbbfff640 1 --2- 172.21.15.72:0/3775718243 >> v2:172.21.15.55:3300/0 conn(0x7f6dbc15b6c0 0x7f6dbc0d1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:18.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.352+0000 7f6dbaffd640 1 -- 172.21.15.72:0/3775718243 <== mon.1 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2094110090 0 0) 0x7f6dbc0b4eb0 con 0x7f6dbc0b46d0 2024-05-27T12:32:18.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.352+0000 7f6dbaffd640 1 -- 172.21.15.72:0/3775718243 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6da4003520 con 0x7f6dbc0b46d0 2024-05-27T12:32:18.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.352+0000 7f6dc0aa4640 1 -- 172.21.15.72:0/3775718243 >> v2:172.21.15.55:3300/0 conn(0x7f6dbc15b6c0 msgr2=0x7f6dbc0d1f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:32:18.353 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.352+0000 7f6dc0aa4640 1 --2- 172.21.15.72:0/3775718243 >> v2:172.21.15.55:3300/0 conn(0x7f6dbc15b6c0 0x7f6dbc0d1f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:18.353 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.352+0000 7f6dc0aa4640 1 -- 172.21.15.72:0/3775718243 >> v1:172.21.15.72:6789/0 conn(0x7f6dbc0b46d0 legacy=0x7f6dbc0b6920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:18.353 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.352+0000 7f6dc0aa4640 1 -- 172.21.15.72:0/3775718243 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dbc0b5750 con 0x7f6dbc0b7030 2024-05-27T12:32:18.353 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.353+0000 7f6dc0aa4640 1 --2- 172.21.15.72:0/3775718243 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6dbc0b7030 0x7f6dbc165260 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc0cddd0 tx=0x7f6db402a5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4f43b3888e7216dc server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:18.353 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.353+0000 7f6dbaffd640 1 -- 172.21.15.72:0/3775718243 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6db4007740 con 0x7f6dbc0b7030 2024-05-27T12:32:18.353 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.353+0000 7f6dbaffd640 1 -- 172.21.15.72:0/3775718243 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6db40078e0 con 0x7f6dbc0b7030 2024-05-27T12:32:18.353 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.353+0000 7f6dbaffd640 1 -- 172.21.15.72:0/3775718243 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6db4007cb0 con 0x7f6dbc0b7030 2024-05-27T12:32:18.356 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.354+0000 7f6dc2507640 1 -- 172.21.15.72:0/3775718243 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6dbc0b7030 msgr2=0x7f6dbc165260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:18.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.354+0000 7f6dc2507640 1 --2- 172.21.15.72:0/3775718243 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6dbc0b7030 0x7f6dbc165260 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc0cddd0 tx=0x7f6db402a5f0 comp rx=0 tx=0).stop 2024-05-27T12:32:18.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.354+0000 7f6dc2507640 1 -- 172.21.15.72:0/3775718243 shutdown_connections 2024-05-27T12:32:18.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.354+0000 7f6dc2507640 1 --2- 172.21.15.72:0/3775718243 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6dbc0b7030 0x7f6dbc165260 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:18.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.354+0000 7f6dc2507640 1 --2- 172.21.15.72:0/3775718243 >> v2:172.21.15.55:3300/0 conn(0x7f6dbc15b6c0 0x7f6dbc0d1f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:18.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.354+0000 7f6dc2507640 1 -- 172.21.15.72:0/3775718243 >> 172.21.15.72:0/3775718243 conn(0x7f6dbc073440 msgr2=0x7f6dbc09aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:18.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.354+0000 7f6dc2507640 1 -- 172.21.15.72:0/3775718243 shutdown_connections 2024-05-27T12:32:18.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.354+0000 7f6dc2507640 1 -- 172.21.15.72:0/3775718243 wait complete. 2024-05-27T12:32:18.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.355+0000 7f6dc2507640 1 Processor -- start 2024-05-27T12:32:18.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.355+0000 7f6dc2507640 1 -- start start 2024-05-27T12:32:18.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.356+0000 7f6dc2507640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6dbc0b46d0 0x7f6dbc13f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:18.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.356+0000 7f6dc2507640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6dbc0b7030 0x7f6dbc142b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:18.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.356+0000 7f6dc2507640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6dbc15b6c0 0x7f6dbc153c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:18.359 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.356+0000 7f6dc2507640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f6dbc0b4b80 con 0x7f6dbc0b46d0 2024-05-27T12:32:18.359 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.356+0000 7f6dc2507640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f6dbc15baa0 con 0x7f6dbc15b6c0 2024-05-27T12:32:18.359 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.356+0000 7f6dc2507640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f6dbc0b22c0 con 0x7f6dbc0b7030 2024-05-27T12:32:18.359 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.356+0000 7f6dc0aa4640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6dbc15b6c0 0x7f6dbc153c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:18.359 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.356+0000 7f6dbb7fe640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6dbc0b7030 0x7f6dbc142b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:18.359 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.356+0000 7f6dc0aa4640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6dbc15b6c0 0x7f6dbc153c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48950/0 (socket says 172.21.15.72:48950) 2024-05-27T12:32:18.359 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.356+0000 7f6dc0aa4640 1 -- 172.21.15.72:0/2021222884 learned_addr learned my addr 172.21.15.72:0/2021222884 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-27T12:32:18.359 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.356+0000 7f6dbbfff640 1 --2- 172.21.15.72:0/2021222884 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6dbc0b46d0 0x7f6dbc13f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:18.359 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.356+0000 7f6dbb7fe640 1 -- 172.21.15.72:0/2021222884 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6dbc15b6c0 msgr2=0x7f6dbc153c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:18.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.356+0000 7f6dbb7fe640 1 --2- 172.21.15.72:0/2021222884 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6dbc15b6c0 0x7f6dbc153c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:18.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.356+0000 7f6dbb7fe640 1 -- 172.21.15.72:0/2021222884 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6dbc0b46d0 msgr2=0x7f6dbc13f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:18.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.356+0000 7f6dbb7fe640 1 --2- 172.21.15.72:0/2021222884 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6dbc0b46d0 0x7f6dbc13f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:18.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.356+0000 7f6dbb7fe640 1 -- 172.21.15.72:0/2021222884 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dbc1430a0 con 0x7f6dbc0b7030 2024-05-27T12:32:18.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.356+0000 7f6dbbfff640 1 --2- 172.21.15.72:0/2021222884 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6dbc0b46d0 0x7f6dbc13f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T12:32:18.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.356+0000 7f6dc0aa4640 1 --2- 172.21.15.72:0/2021222884 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6dbc15b6c0 0x7f6dbc153c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T12:32:18.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.356+0000 7f6dbb7fe640 1 --2- 172.21.15.72:0/2021222884 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6dbc0b7030 0x7f6dbc142b60 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f6db000c430 tx=0x7f6db000c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:18.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.357+0000 7f6db8ff9640 1 -- 172.21.15.72:0/2021222884 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6db0017070 con 0x7f6dbc0b7030 2024-05-27T12:32:18.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.357+0000 7f6db8ff9640 1 -- 172.21.15.72:0/2021222884 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6db0005ce0 con 0x7f6dbc0b7030 2024-05-27T12:32:18.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.357+0000 7f6db8ff9640 1 -- 172.21.15.72:0/2021222884 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6db00072f0 con 0x7f6dbc0b7030 2024-05-27T12:32:18.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.357+0000 7f6dc2507640 1 -- 172.21.15.72:0/2021222884 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6dbc1541b0 con 0x7f6dbc0b7030 2024-05-27T12:32:18.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.357+0000 7f6dc2507640 1 -- 172.21.15.72:0/2021222884 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f6dbc154710 con 0x7f6dbc0b7030 2024-05-27T12:32:18.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.357+0000 7f6db8ff9640 1 -- 172.21.15.72:0/2021222884 <== mon.2 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f6db001a070 con 0x7f6dbc0b7030 2024-05-27T12:32:18.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.357+0000 7f6db8ff9640 1 -- 172.21.15.72:0/2021222884 <== mon.2 v2:172.21.15.72:3301/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f6db0012890 con 0x7f6dbc0b7030 2024-05-27T12:32:18.361 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.358+0000 7f6dc2507640 1 -- 172.21.15.72:0/2021222884 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6dbc075460 con 0x7f6dbc0b7030 2024-05-27T12:32:18.361 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.360+0000 7f6db8ff9640 1 -- 172.21.15.72:0/2021222884 <== mon.2 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f6db0021070 con 0x7f6dbc0b7030 2024-05-27T12:32:18.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.432+0000 7f6dc2507640 1 -- 172.21.15.72:0/2021222884 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd new", "uuid": "b6a34b75-807d-4693-b1c3-903cb4c618d9", "id": 3} v 0) -- 0x7f6dbc0b4e70 con 0x7f6dbc0b7030 2024-05-27T12:32:18.435 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.436+0000 7f6db8ff9640 1 -- 172.21.15.72:0/2021222884 <== mon.2 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b6a34b75-807d-4693-b1c3-903cb4c618d9", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f6dbc1541b0 con 0x7f6dbc0b7030 2024-05-27T12:32:18.435 INFO:teuthology.orchestra.run.smithi072.stdout:3 2024-05-27T12:32:18.436 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.437+0000 7f6dc2507640 1 -- 172.21.15.72:0/2021222884 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6dbc0b7030 msgr2=0x7f6dbc142b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:18.436 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.437+0000 7f6dc2507640 1 --2- 172.21.15.72:0/2021222884 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6dbc0b7030 0x7f6dbc142b60 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f6db000c430 tx=0x7f6db000c8f0 comp rx=0 tx=0).stop 2024-05-27T12:32:18.436 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.437+0000 7f6dc2507640 1 -- 172.21.15.72:0/2021222884 shutdown_connections 2024-05-27T12:32:18.436 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.437+0000 7f6dc2507640 1 --2- 172.21.15.72:0/2021222884 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6dbc15b6c0 0x7f6dbc153c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:18.436 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.437+0000 7f6dc2507640 1 --2- 172.21.15.72:0/2021222884 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6dbc0b7030 0x7f6dbc142b60 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:18.437 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.437+0000 7f6dc2507640 1 --2- 172.21.15.72:0/2021222884 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6dbc0b46d0 0x7f6dbc13f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:18.437 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.437+0000 7f6dc2507640 1 -- 172.21.15.72:0/2021222884 >> 172.21.15.72:0/2021222884 conn(0x7f6dbc073440 msgr2=0x7f6dbc0d0620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:18.437 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.437+0000 7f6dc2507640 1 -- 172.21.15.72:0/2021222884 shutdown_connections 2024-05-27T12:32:18.437 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.437+0000 7f6dc2507640 1 -- 172.21.15.72:0/2021222884 wait complete. 2024-05-27T12:32:18.437 INFO:tasks.ceph.mgr.y.smithi055.stderr:2024-05-27T12:32:18.438+0000 7fdab65be040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-27T12:32:18.447 DEBUG:teuthology.orchestra.run.smithi072:> sudo ceph --cluster ceph osd new 272ec937-56b4-4f0a-b2e1-b0bc189c9d79 4 2024-05-27T12:32:18.487 INFO:tasks.ceph.mgr.x.smithi072.stderr:2024-05-27T12:32:18.489+0000 7f9268f09040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-27T12:32:18.528 INFO:tasks.ceph.mgr.y.smithi055.stderr:2024-05-27T12:32:18.529+0000 7fdab65be040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-27T12:32:18.547 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.548+0000 7f4986074640 1 Processor -- start 2024-05-27T12:32:18.547 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.549+0000 7f4986074640 1 -- start start 2024-05-27T12:32:18.548 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.549+0000 7f4986074640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f498009b140 0x7f4980167500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:18.548 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.549+0000 7f4986074640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49800af3a0 con 0x7f498015c7d0 2024-05-27T12:32:18.549 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.549+0000 7f4986074640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49800af680 con 0x7f498015cbb0 2024-05-27T12:32:18.549 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.549+0000 7f4986074640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f49800affb0 con 0x7f498009b140 2024-05-27T12:32:18.549 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.549+0000 7f497ffff640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f498009b140 0x7f4980167500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:18.549 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.549+0000 7f4977fff640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f498015cbb0 0x7f498009aa30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:47906/0 (socket says 172.21.15.72:47906) 2024-05-27T12:32:18.549 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.549+0000 7f4977fff640 1 -- 172.21.15.72:0/3888773978 learned_addr learned my addr 172.21.15.72:0/3888773978 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-05-27T12:32:18.549 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.550+0000 7f497ffff640 1 -- 172.21.15.72:0/3888773978 >> v1:172.21.15.72:6789/0 conn(0x7f498015cbb0 legacy=0x7f498009aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:18.549 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.550+0000 7f497effd640 1 -- 172.21.15.72:0/3888773978 <== mon.1 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1184788625 0 0) 0x7f49800af680 con 0x7f498015cbb0 2024-05-27T12:32:18.549 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.550+0000 7f497ffff640 1 -- 172.21.15.72:0/3888773978 >> v1:172.21.15.55:6789/0 conn(0x7f498015c7d0 legacy=0x7f49800d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:18.549 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.550+0000 7f497ffff640 1 -- 172.21.15.72:0/3888773978 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49800af960 con 0x7f498009b140 2024-05-27T12:32:18.550 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.550+0000 7f497ffff640 1 --2- 172.21.15.72:0/3888773978 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f498009b140 0x7f4980167500 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f4978009dc0 tx=0x7f497802a6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=59b298b951c874ba server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:18.550 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.551+0000 7f497effd640 1 -- 172.21.15.72:0/3888773978 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4978007740 con 0x7f498009b140 2024-05-27T12:32:18.550 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.551+0000 7f497effd640 1 -- 172.21.15.72:0/3888773978 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49780078e0 con 0x7f498009b140 2024-05-27T12:32:18.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.551+0000 7f497effd640 1 -- 172.21.15.72:0/3888773978 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4978007cb0 con 0x7f498009b140 2024-05-27T12:32:18.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.551+0000 7f4986074640 1 -- 172.21.15.72:0/3888773978 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f498009b140 msgr2=0x7f4980167500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:18.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.551+0000 7f4986074640 1 --2- 172.21.15.72:0/3888773978 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f498009b140 0x7f4980167500 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f4978009dc0 tx=0x7f497802a6d0 comp rx=0 tx=0).stop 2024-05-27T12:32:18.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.551+0000 7f4986074640 1 -- 172.21.15.72:0/3888773978 shutdown_connections 2024-05-27T12:32:18.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.551+0000 7f4986074640 1 --2- 172.21.15.72:0/3888773978 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f498009b140 0x7f4980167500 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:18.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.551+0000 7f4986074640 1 -- 172.21.15.72:0/3888773978 >> 172.21.15.72:0/3888773978 conn(0x7f49800d2650 msgr2=0x7f49800d2a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:18.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.551+0000 7f4986074640 1 -- 172.21.15.72:0/3888773978 shutdown_connections 2024-05-27T12:32:18.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.551+0000 7f4986074640 1 -- 172.21.15.72:0/3888773978 wait complete. 2024-05-27T12:32:18.554 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.552+0000 7f4986074640 1 Processor -- start 2024-05-27T12:32:18.554 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.553+0000 7f4986074640 1 -- start start 2024-05-27T12:32:18.554 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.553+0000 7f4986074640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f498009b140 0x7f498015fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:18.554 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.553+0000 7f4986074640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f498015c7d0 0x7f49800b7720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:18.554 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.553+0000 7f4986074640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f498015cbb0 0x7f49800b7c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:18.554 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.553+0000 7f4986074640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f49800d1220 con 0x7f498015cbb0 2024-05-27T12:32:18.554 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.553+0000 7f4986074640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f49800b3ed0 con 0x7f498015c7d0 2024-05-27T12:32:18.555 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.553+0000 7f4986074640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f49800d13a0 con 0x7f498009b140 2024-05-27T12:32:18.555 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.553+0000 7f4977fff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f498015c7d0 0x7f49800b7720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:18.555 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.553+0000 7f497f7fe640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f498009b140 0x7f498015fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:18.555 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.553+0000 7f497f7fe640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f498009b140 0x7f498015fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:41808/0 (socket says 172.21.15.72:41808) 2024-05-27T12:32:18.555 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.553+0000 7f4977fff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f498015c7d0 0x7f49800b7720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48956/0 (socket says 172.21.15.72:48956) 2024-05-27T12:32:18.555 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.553+0000 7f497f7fe640 1 -- 172.21.15.72:0/3318954188 learned_addr learned my addr 172.21.15.72:0/3318954188 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-27T12:32:18.555 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.553+0000 7f497ffff640 1 --2- 172.21.15.72:0/3318954188 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f498015cbb0 0x7f49800b7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:18.555 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.554+0000 7f497f7fe640 1 -- 172.21.15.72:0/3318954188 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f498015c7d0 msgr2=0x7f49800b7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:18.555 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.554+0000 7f497f7fe640 1 --2- 172.21.15.72:0/3318954188 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f498015c7d0 0x7f49800b7720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:18.555 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.554+0000 7f497f7fe640 1 -- 172.21.15.72:0/3318954188 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f498015cbb0 msgr2=0x7f49800b7c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:18.555 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.554+0000 7f497f7fe640 1 --2- 172.21.15.72:0/3318954188 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f498015cbb0 0x7f49800b7c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:18.555 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.554+0000 7f497f7fe640 1 -- 172.21.15.72:0/3318954188 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f498015ff50 con 0x7f498009b140 2024-05-27T12:32:18.555 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.554+0000 7f4977fff640 1 --2- 172.21.15.72:0/3318954188 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f498015c7d0 0x7f49800b7720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T12:32:18.555 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.554+0000 7f497f7fe640 1 --2- 172.21.15.72:0/3318954188 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f498009b140 0x7f498015fa10 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f497000c450 tx=0x7f497000c910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:18.556 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.554+0000 7f497cff9640 1 -- 172.21.15.72:0/3318954188 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49700052d0 con 0x7f498009b140 2024-05-27T12:32:18.556 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.554+0000 7f497cff9640 1 -- 172.21.15.72:0/3318954188 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4970005470 con 0x7f498009b140 2024-05-27T12:32:18.556 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.554+0000 7f497cff9640 1 -- 172.21.15.72:0/3318954188 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4970012870 con 0x7f498009b140 2024-05-27T12:32:18.556 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.554+0000 7f4986074640 1 -- 172.21.15.72:0/3318954188 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f498015da70 con 0x7f498009b140 2024-05-27T12:32:18.556 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.554+0000 7f4986074640 1 -- 172.21.15.72:0/3318954188 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f498015e030 con 0x7f498009b140 2024-05-27T12:32:18.556 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.554+0000 7f497cff9640 1 -- 172.21.15.72:0/3318954188 <== mon.2 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f4970012a10 con 0x7f498009b140 2024-05-27T12:32:18.556 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.554+0000 7f497cff9640 1 -- 172.21.15.72:0/3318954188 <== mon.2 v2:172.21.15.72:3301/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f497001b9b0 con 0x7f498009b140 2024-05-27T12:32:18.556 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.555+0000 7f4986074640 1 -- 172.21.15.72:0/3318954188 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4980075460 con 0x7f498009b140 2024-05-27T12:32:18.556 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.557+0000 7f497cff9640 1 -- 172.21.15.72:0/3318954188 <== mon.2 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f498015ff50 con 0x7f498009b140 2024-05-27T12:32:18.573 INFO:tasks.ceph.mgr.y.smithi055.stderr:2024-05-27T12:32:18.574+0000 7fdab65be040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-27T12:32:18.580 INFO:tasks.ceph.mgr.x.smithi072.stderr:2024-05-27T12:32:18.581+0000 7f9268f09040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-27T12:32:18.623 INFO:tasks.ceph.mgr.x.smithi072.stderr:2024-05-27T12:32:18.625+0000 7f9268f09040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-27T12:32:18.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.630+0000 7f4986074640 1 -- 172.21.15.72:0/3318954188 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd new", "uuid": "272ec937-56b4-4f0a-b2e1-b0bc189c9d79", "id": 4} v 0) -- 0x7f498015a2e0 con 0x7f498009b140 2024-05-27T12:32:18.631 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.633+0000 7f497cff9640 1 -- 172.21.15.72:0/3318954188 <== mon.2 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "272ec937-56b4-4f0a-b2e1-b0bc189c9d79", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f497001b4a0 con 0x7f498009b140 2024-05-27T12:32:18.631 INFO:teuthology.orchestra.run.smithi072.stdout:4 2024-05-27T12:32:18.633 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.634+0000 7f4986074640 1 -- 172.21.15.72:0/3318954188 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f498009b140 msgr2=0x7f498015fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:18.633 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.634+0000 7f4986074640 1 --2- 172.21.15.72:0/3318954188 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f498009b140 0x7f498015fa10 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f497000c450 tx=0x7f497000c910 comp rx=0 tx=0).stop 2024-05-27T12:32:18.633 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.634+0000 7f4986074640 1 -- 172.21.15.72:0/3318954188 shutdown_connections 2024-05-27T12:32:18.633 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.634+0000 7f4986074640 1 --2- 172.21.15.72:0/3318954188 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f498015cbb0 0x7f49800b7c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:18.633 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.634+0000 7f4986074640 1 --2- 172.21.15.72:0/3318954188 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f498015c7d0 0x7f49800b7720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:18.633 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.634+0000 7f4986074640 1 --2- 172.21.15.72:0/3318954188 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f498009b140 0x7f498015fa10 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:18.633 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.634+0000 7f4986074640 1 -- 172.21.15.72:0/3318954188 >> 172.21.15.72:0/3318954188 conn(0x7f49800d2650 msgr2=0x7f49800d2a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:18.633 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.634+0000 7f4986074640 1 -- 172.21.15.72:0/3318954188 shutdown_connections 2024-05-27T12:32:18.633 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.634+0000 7f4986074640 1 -- 172.21.15.72:0/3318954188 wait complete. 2024-05-27T12:32:18.643 DEBUG:teuthology.orchestra.run.smithi072:> sudo ceph --cluster ceph osd new 56439854-72a0-4ef4-81ff-184a3d924a5d 5 2024-05-27T12:32:18.746 INFO:tasks.ceph.mgr.y.smithi055.stderr:2024-05-27T12:32:18.747+0000 7fdab65be040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-27T12:32:18.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.784+0000 7fc9d1afd640 1 Processor -- start 2024-05-27T12:32:18.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.784+0000 7fc9d1afd640 1 -- start start 2024-05-27T12:32:18.785 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.785+0000 7fc9d1afd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc9cc0d1410 0x7fc9cc0d1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:18.785 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.785+0000 7fc9d1afd640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9cc0702b0 con 0x7fc9cc0ce0b0 2024-05-27T12:32:18.785 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.785+0000 7fc9d1afd640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9cc070590 con 0x7fc9cc15b800 2024-05-27T12:32:18.785 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.785+0000 7fc9d1afd640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7fc9cc070870 con 0x7fc9cc0d1410 2024-05-27T12:32:18.785 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.785+0000 7fc9cb7fe640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fc9cc15b800 0x7fc9cc06f880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:47916/0 (socket says 172.21.15.72:47916) 2024-05-27T12:32:18.785 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.785+0000 7fc9cb7fe640 1 -- 172.21.15.72:0/2467229592 learned_addr learned my addr 172.21.15.72:0/2467229592 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-05-27T12:32:18.785 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.786+0000 7fc9c2ffd640 1 --2- 172.21.15.72:0/2467229592 >> v2:172.21.15.55:3300/0 conn(0x7fc9cc0d1410 0x7fc9cc0d1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:18.785 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.786+0000 7fc9caffd640 1 -- 172.21.15.72:0/2467229592 <== mon.1 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2828260529 0 0) 0x7fc9cc070590 con 0x7fc9cc15b800 2024-05-27T12:32:18.785 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.786+0000 7fc9caffd640 1 -- 172.21.15.72:0/2467229592 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc9b8003520 con 0x7fc9cc15b800 2024-05-27T12:32:18.785 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.786+0000 7fc9caffd640 1 -- 172.21.15.72:0/2467229592 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2211947987 0 0) 0x7fc9cc0702b0 con 0x7fc9cc0ce0b0 2024-05-27T12:32:18.785 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.786+0000 7fc9caffd640 1 -- 172.21.15.72:0/2467229592 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc9cc070590 con 0x7fc9cc0ce0b0 2024-05-27T12:32:18.785 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.786+0000 7fc9c2ffd640 1 -- 172.21.15.72:0/2467229592 >> v1:172.21.15.72:6789/0 conn(0x7fc9cc15b800 legacy=0x7fc9cc06f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:18.785 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.786+0000 7fc9c2ffd640 1 -- 172.21.15.72:0/2467229592 >> v1:172.21.15.55:6789/0 conn(0x7fc9cc0ce0b0 legacy=0x7fc9cc0ce540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:18.786 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.786+0000 7fc9c2ffd640 1 -- 172.21.15.72:0/2467229592 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9cc070b50 con 0x7fc9cc0d1410 2024-05-27T12:32:18.787 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.787+0000 7fc9c2ffd640 1 --2- 172.21.15.72:0/2467229592 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9cc0d1410 0x7fc9cc0d1850 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc9b40097a0 tx=0x7fc9b402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=292e3cd69080070b server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:18.787 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.787+0000 7fc9caffd640 1 -- 172.21.15.72:0/2467229592 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9b4037070 con 0x7fc9cc0d1410 2024-05-27T12:32:18.787 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.787+0000 7fc9caffd640 1 -- 172.21.15.72:0/2467229592 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9b4032440 con 0x7fc9cc0d1410 2024-05-27T12:32:18.787 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.787+0000 7fc9caffd640 1 -- 172.21.15.72:0/2467229592 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9b4032810 con 0x7fc9cc0d1410 2024-05-27T12:32:18.787 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.787+0000 7fc9d1afd640 1 -- 172.21.15.72:0/2467229592 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9cc0d1410 msgr2=0x7fc9cc0d1850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:18.787 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.787+0000 7fc9d1afd640 1 --2- 172.21.15.72:0/2467229592 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9cc0d1410 0x7fc9cc0d1850 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc9b40097a0 tx=0x7fc9b402a230 comp rx=0 tx=0).stop 2024-05-27T12:32:18.787 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.787+0000 7fc9d1afd640 1 -- 172.21.15.72:0/2467229592 shutdown_connections 2024-05-27T12:32:18.787 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.787+0000 7fc9d1afd640 1 --2- 172.21.15.72:0/2467229592 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9cc0d1410 0x7fc9cc0d1850 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:18.787 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.787+0000 7fc9d1afd640 1 -- 172.21.15.72:0/2467229592 >> 172.21.15.72:0/2467229592 conn(0x7fc9cc0734b0 msgr2=0x7fc9cc09aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:18.787 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.787+0000 7fc9d1afd640 1 -- 172.21.15.72:0/2467229592 shutdown_connections 2024-05-27T12:32:18.787 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.787+0000 7fc9d1afd640 1 -- 172.21.15.72:0/2467229592 wait complete. 2024-05-27T12:32:18.789 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.789+0000 7fc9d1afd640 1 Processor -- start 2024-05-27T12:32:18.790 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.789+0000 7fc9d1afd640 1 -- start start 2024-05-27T12:32:18.790 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.789+0000 7fc9d1afd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc9cc0ce0b0 0x7fc9cc1f0f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:18.790 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.789+0000 7fc9d1afd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9cc0d1410 0x7fc9cc09e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:18.790 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.789+0000 7fc9d1afd640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc9cc15b800 0x7fc9cc09ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:18.790 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.790+0000 7fc9d1afd640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7fc9cc06ff90 con 0x7fc9cc0d1410 2024-05-27T12:32:18.790 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.790+0000 7fc9d1afd640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fc9cc0d1d90 con 0x7fc9cc0ce0b0 2024-05-27T12:32:18.790 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.790+0000 7fc9d1afd640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fc9cc0b09d0 con 0x7fc9cc15b800 2024-05-27T12:32:18.790 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.790+0000 7fc9cb7fe640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc9cc0ce0b0 0x7fc9cc1f0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:18.790 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.790+0000 7fc9cbfff640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc9cc15b800 0x7fc9cc09ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:18.790 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.790+0000 7fc9cb7fe640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc9cc0ce0b0 0x7fc9cc1f0f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48966/0 (socket says 172.21.15.72:48966) 2024-05-27T12:32:18.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.790+0000 7fc9cb7fe640 1 -- 172.21.15.72:0/2861848548 learned_addr learned my addr 172.21.15.72:0/2861848548 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-27T12:32:18.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.790+0000 7fc9cbfff640 1 --2- 172.21.15.72:0/2861848548 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc9cc15b800 0x7fc9cc09ee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:41818/0 (socket says 172.21.15.72:41818) 2024-05-27T12:32:18.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.790+0000 7fc9c2ffd640 1 --2- 172.21.15.72:0/2861848548 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9cc0d1410 0x7fc9cc09e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:18.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.790+0000 7fc9cb7fe640 1 -- 172.21.15.72:0/2861848548 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc9cc15b800 msgr2=0x7fc9cc09ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:18.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.790+0000 7fc9cb7fe640 1 --2- 172.21.15.72:0/2861848548 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc9cc15b800 0x7fc9cc09ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:18.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.790+0000 7fc9cb7fe640 1 -- 172.21.15.72:0/2861848548 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9cc0d1410 msgr2=0x7fc9cc09e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:18.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.790+0000 7fc9cb7fe640 1 --2- 172.21.15.72:0/2861848548 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9cc0d1410 0x7fc9cc09e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:18.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.790+0000 7fc9cb7fe640 1 -- 172.21.15.72:0/2861848548 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9cc0cb6e0 con 0x7fc9cc0ce0b0 2024-05-27T12:32:18.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.790+0000 7fc9c2ffd640 1 --2- 172.21.15.72:0/2861848548 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9cc0d1410 0x7fc9cc09e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T12:32:18.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.790+0000 7fc9cb7fe640 1 --2- 172.21.15.72:0/2861848548 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc9cc0ce0b0 0x7fc9cc1f0f00 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc00c410 tx=0x7fc9bc00c8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:18.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.790+0000 7fc9c8ff9640 1 -- 172.21.15.72:0/2861848548 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9bc017070 con 0x7fc9cc0ce0b0 2024-05-27T12:32:18.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.790+0000 7fc9c8ff9640 1 -- 172.21.15.72:0/2861848548 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9bc005ce0 con 0x7fc9cc0ce0b0 2024-05-27T12:32:18.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.790+0000 7fc9c8ff9640 1 -- 172.21.15.72:0/2861848548 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9bc0072f0 con 0x7fc9cc0ce0b0 2024-05-27T12:32:18.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.790+0000 7fc9d1afd640 1 -- 172.21.15.72:0/2861848548 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9cc0cb9c0 con 0x7fc9cc0ce0b0 2024-05-27T12:32:18.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.790+0000 7fc9d1afd640 1 -- 172.21.15.72:0/2861848548 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9cc0c8910 con 0x7fc9cc0ce0b0 2024-05-27T12:32:18.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.791+0000 7fc9c8ff9640 1 -- 172.21.15.72:0/2861848548 <== mon.1 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc9bc01a070 con 0x7fc9cc0ce0b0 2024-05-27T12:32:18.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.791+0000 7fc9c8ff9640 1 -- 172.21.15.72:0/2861848548 <== mon.1 v2:172.21.15.72:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7fc9bc012980 con 0x7fc9cc0ce0b0 2024-05-27T12:32:18.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.791+0000 7fc9d1afd640 1 -- 172.21.15.72:0/2861848548 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9cc075460 con 0x7fc9cc0ce0b0 2024-05-27T12:32:18.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.793+0000 7fc9c8ff9640 1 -- 172.21.15.72:0/2861848548 <== mon.1 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fc9bc021020 con 0x7fc9cc0ce0b0 2024-05-27T12:32:18.797 INFO:tasks.ceph.mgr.x.smithi072.stderr:2024-05-27T12:32:18.799+0000 7f9268f09040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-27T12:32:18.803 INFO:tasks.ceph.mgr.y.smithi055.stderr:2024-05-27T12:32:18.804+0000 7fdab65be040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-27T12:32:18.846 INFO:tasks.ceph.mgr.x.smithi072.stderr:2024-05-27T12:32:18.847+0000 7f9268f09040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-27T12:32:18.858 INFO:tasks.ceph.mgr.y.smithi055.stderr:2024-05-27T12:32:18.859+0000 7fdab65be040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-27T12:32:18.865 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.866+0000 7fc9d1afd640 1 -- 172.21.15.72:0/2861848548 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd new", "uuid": "56439854-72a0-4ef4-81ff-184a3d924a5d", "id": 5} v 0) -- 0x7fc9cc0b0e80 con 0x7fc9cc0ce0b0 2024-05-27T12:32:18.868 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.869+0000 7fc9c8ff9640 1 -- 172.21.15.72:0/2861848548 <== mon.1 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "56439854-72a0-4ef4-81ff-184a3d924a5d", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7fc9bc007650 con 0x7fc9cc0ce0b0 2024-05-27T12:32:18.868 INFO:teuthology.orchestra.run.smithi072.stdout:5 2024-05-27T12:32:18.869 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.870+0000 7fc9d1afd640 1 -- 172.21.15.72:0/2861848548 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc9cc0ce0b0 msgr2=0x7fc9cc1f0f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:18.869 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.870+0000 7fc9d1afd640 1 --2- 172.21.15.72:0/2861848548 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc9cc0ce0b0 0x7fc9cc1f0f00 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc00c410 tx=0x7fc9bc00c8d0 comp rx=0 tx=0).stop 2024-05-27T12:32:18.869 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.870+0000 7fc9d1afd640 1 -- 172.21.15.72:0/2861848548 shutdown_connections 2024-05-27T12:32:18.869 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.870+0000 7fc9d1afd640 1 --2- 172.21.15.72:0/2861848548 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc9cc15b800 0x7fc9cc09ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:18.870 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.870+0000 7fc9d1afd640 1 --2- 172.21.15.72:0/2861848548 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9cc0d1410 0x7fc9cc09e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:18.870 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.870+0000 7fc9d1afd640 1 --2- 172.21.15.72:0/2861848548 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc9cc0ce0b0 0x7fc9cc1f0f00 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:18.870 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.870+0000 7fc9d1afd640 1 -- 172.21.15.72:0/2861848548 >> 172.21.15.72:0/2861848548 conn(0x7fc9cc0734b0 msgr2=0x7fc9cc0cc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:18.870 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.870+0000 7fc9d1afd640 1 -- 172.21.15.72:0/2861848548 shutdown_connections 2024-05-27T12:32:18.870 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.871+0000 7fc9d1afd640 1 -- 172.21.15.72:0/2861848548 wait complete. 2024-05-27T12:32:18.879 DEBUG:teuthology.orchestra.run.smithi072:> sudo ceph --cluster ceph osd new e248e2be-3b6e-49cf-8c8a-1a4152827582 6 2024-05-27T12:32:18.902 INFO:tasks.ceph.mgr.x.smithi072.stderr:2024-05-27T12:32:18.903+0000 7f9268f09040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-27T12:32:18.976 INFO:tasks.ceph.mgr.y.smithi055.stderr:2024-05-27T12:32:18.977+0000 7fdab65be040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-27T12:32:18.979 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.980+0000 7fa8c1da2640 1 Processor -- start 2024-05-27T12:32:18.979 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.980+0000 7fa8c1da2640 1 -- start start 2024-05-27T12:32:18.980 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.981+0000 7fa8c1da2640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa8bc06c040 0x7fa8bc0b1b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:18.980 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.981+0000 7fa8c1da2640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8bc0b0d40 con 0x7fa8bc0b2bf0 2024-05-27T12:32:18.980 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.981+0000 7fa8c1da2640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8bc0b1020 con 0x7fa8bc15eaf0 2024-05-27T12:32:18.980 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.981+0000 7fa8c1da2640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fa8bc1635f0 con 0x7fa8bc06c040 2024-05-27T12:32:18.980 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.981+0000 7fa8bbfff640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa8bc06c040 0x7fa8bc0b1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:18.980 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.981+0000 7fa8bbfff640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa8bc06c040 0x7fa8bc0b1b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:41834/0 (socket says 172.21.15.72:41834) 2024-05-27T12:32:18.981 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.981+0000 7fa8bbfff640 1 -- 172.21.15.72:0/2978217217 learned_addr learned my addr 172.21.15.72:0/2978217217 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-27T12:32:18.981 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.981+0000 7fa8bb7fe640 1 --1- 172.21.15.72:0/2978217217 >> v1:172.21.15.72:6789/0 conn(0x7fa8bc15eaf0 0x7fa8bc0b24e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:47924/0 (socket says 172.21.15.72:47924) 2024-05-27T12:32:18.981 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.981+0000 7fa8baffd640 1 -- 172.21.15.72:0/2978217217 <== mon.1 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1187471603 0 0) 0x7fa8bc0b1020 con 0x7fa8bc15eaf0 2024-05-27T12:32:18.981 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.982+0000 7fa8bbfff640 1 -- 172.21.15.72:0/2978217217 >> v1:172.21.15.72:6789/0 conn(0x7fa8bc15eaf0 legacy=0x7fa8bc0b24e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:18.981 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.982+0000 7fa8bbfff640 1 -- 172.21.15.72:0/2978217217 >> v1:172.21.15.55:6789/0 conn(0x7fa8bc0b2bf0 legacy=0x7fa8bc06b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:18.981 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.982+0000 7fa8bbfff640 1 -- 172.21.15.72:0/2978217217 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8bc0b1300 con 0x7fa8bc06c040 2024-05-27T12:32:18.982 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.982+0000 7fa8bbfff640 1 --2- 172.21.15.72:0/2978217217 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa8bc06c040 0x7fa8bc0b1b00 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fa8b4009e80 tx=0x7fa8b402a730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e77d634a141150fa server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:18.982 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.982+0000 7fa8baffd640 1 -- 172.21.15.72:0/2978217217 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8b4036070 con 0x7fa8bc06c040 2024-05-27T12:32:18.982 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.982+0000 7fa8baffd640 1 -- 172.21.15.72:0/2978217217 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8b4031600 con 0x7fa8bc06c040 2024-05-27T12:32:18.982 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.982+0000 7fa8baffd640 1 -- 172.21.15.72:0/2978217217 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8b40319d0 con 0x7fa8bc06c040 2024-05-27T12:32:18.983 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.983+0000 7fa8c1da2640 1 -- 172.21.15.72:0/2978217217 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa8bc06c040 msgr2=0x7fa8bc0b1b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:18.983 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.983+0000 7fa8c1da2640 1 --2- 172.21.15.72:0/2978217217 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa8bc06c040 0x7fa8bc0b1b00 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fa8b4009e80 tx=0x7fa8b402a730 comp rx=0 tx=0).stop 2024-05-27T12:32:18.983 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.983+0000 7fa8c1da2640 1 -- 172.21.15.72:0/2978217217 shutdown_connections 2024-05-27T12:32:18.983 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.983+0000 7fa8c1da2640 1 --2- 172.21.15.72:0/2978217217 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa8bc06c040 0x7fa8bc0b1b00 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:18.983 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.983+0000 7fa8c1da2640 1 -- 172.21.15.72:0/2978217217 >> 172.21.15.72:0/2978217217 conn(0x7fa8bc0733d0 msgr2=0x7fa8bc09aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:18.983 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.983+0000 7fa8c1da2640 1 -- 172.21.15.72:0/2978217217 shutdown_connections 2024-05-27T12:32:18.983 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.983+0000 7fa8c1da2640 1 -- 172.21.15.72:0/2978217217 wait complete. 2024-05-27T12:32:18.985 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.984+0000 7fa8c1da2640 1 Processor -- start 2024-05-27T12:32:18.985 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.984+0000 7fa8c1da2640 1 -- start start 2024-05-27T12:32:18.985 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.985+0000 7fa8c1da2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8bc06c040 0x7fa8bc1507c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:18.986 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.985+0000 7fa8c1da2640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa8bc0b2bf0 0x7fa8bc160c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:18.986 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.985+0000 7fa8c1da2640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa8bc15eaf0 0x7fa8bc0b6680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:18.986 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.985+0000 7fa8c1da2640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7fa8bc15eed0 con 0x7fa8bc06c040 2024-05-27T12:32:18.986 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.985+0000 7fa8c1da2640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fa8bc0b0af0 con 0x7fa8bc0b2bf0 2024-05-27T12:32:18.986 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.985+0000 7fa8c1da2640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fa8bc1699f0 con 0x7fa8bc15eaf0 2024-05-27T12:32:18.986 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.985+0000 7fa8b3fff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa8bc0b2bf0 0x7fa8bc160c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:18.986 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.985+0000 7fa8bbfff640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa8bc15eaf0 0x7fa8bc0b6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:18.986 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.985+0000 7fa8b3fff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa8bc0b2bf0 0x7fa8bc160c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48976/0 (socket says 172.21.15.72:48976) 2024-05-27T12:32:18.986 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.985+0000 7fa8b3fff640 1 -- 172.21.15.72:0/3977807581 learned_addr learned my addr 172.21.15.72:0/3977807581 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-27T12:32:18.986 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.985+0000 7fa8bb7fe640 1 --2- 172.21.15.72:0/3977807581 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8bc06c040 0x7fa8bc1507c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:18.986 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.985+0000 7fa8b3fff640 1 -- 172.21.15.72:0/3977807581 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa8bc15eaf0 msgr2=0x7fa8bc0b6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:18.986 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.985+0000 7fa8b3fff640 1 --2- 172.21.15.72:0/3977807581 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa8bc15eaf0 0x7fa8bc0b6680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:18.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.985+0000 7fa8b3fff640 1 -- 172.21.15.72:0/3977807581 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8bc06c040 msgr2=0x7fa8bc1507c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:18.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.985+0000 7fa8b3fff640 1 --2- 172.21.15.72:0/3977807581 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8bc06c040 0x7fa8bc1507c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:18.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.985+0000 7fa8b3fff640 1 -- 172.21.15.72:0/3977807581 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8bc0b5be0 con 0x7fa8bc0b2bf0 2024-05-27T12:32:18.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.986+0000 7fa8b3fff640 1 --2- 172.21.15.72:0/3977807581 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa8bc0b2bf0 0x7fa8bc160c20 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fa8a400c750 tx=0x7fa8a400cc10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:18.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.986+0000 7fa8b8ff9640 1 -- 172.21.15.72:0/3977807581 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8a4017070 con 0x7fa8bc0b2bf0 2024-05-27T12:32:18.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.986+0000 7fa8b8ff9640 1 -- 172.21.15.72:0/3977807581 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8a4005270 con 0x7fa8bc0b2bf0 2024-05-27T12:32:18.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.986+0000 7fa8c1da2640 1 -- 172.21.15.72:0/3977807581 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8bc161d40 con 0x7fa8bc0b2bf0 2024-05-27T12:32:18.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.986+0000 7fa8b8ff9640 1 -- 172.21.15.72:0/3977807581 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8a400a640 con 0x7fa8bc0b2bf0 2024-05-27T12:32:18.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.986+0000 7fa8c1da2640 1 -- 172.21.15.72:0/3977807581 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8bc162020 con 0x7fa8bc0b2bf0 2024-05-27T12:32:18.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.986+0000 7fa8b8ff9640 1 -- 172.21.15.72:0/3977807581 <== mon.1 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa8a401a070 con 0x7fa8bc0b2bf0 2024-05-27T12:32:18.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.986+0000 7fa8b8ff9640 1 -- 172.21.15.72:0/3977807581 <== mon.1 v2:172.21.15.72:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7fa8a4003af0 con 0x7fa8bc0b2bf0 2024-05-27T12:32:18.988 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.987+0000 7fa8c1da2640 1 -- 172.21.15.72:0/3977807581 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8bc075460 con 0x7fa8bc0b2bf0 2024-05-27T12:32:18.989 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:18.989+0000 7fa8b8ff9640 1 -- 172.21.15.72:0/3977807581 <== mon.1 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fa8a4021020 con 0x7fa8bc0b2bf0 2024-05-27T12:32:19.021 INFO:tasks.ceph.mgr.x.smithi072.stderr:2024-05-27T12:32:19.022+0000 7f9268f09040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-27T12:32:19.063 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:19.063+0000 7fa8c1da2640 1 -- 172.21.15.72:0/3977807581 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd new", "uuid": "e248e2be-3b6e-49cf-8c8a-1a4152827582", "id": 6} v 0) -- 0x7fa8bc150d00 con 0x7fa8bc0b2bf0 2024-05-27T12:32:19.067 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:19.069+0000 7fa8b8ff9640 1 -- 172.21.15.72:0/3977807581 <== mon.1 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e248e2be-3b6e-49cf-8c8a-1a4152827582", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7fa8a400a880 con 0x7fa8bc0b2bf0 2024-05-27T12:32:19.068 INFO:teuthology.orchestra.run.smithi072.stdout:6 2024-05-27T12:32:19.069 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:19.070+0000 7fa8c1da2640 1 -- 172.21.15.72:0/3977807581 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa8bc0b2bf0 msgr2=0x7fa8bc160c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:19.069 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:19.070+0000 7fa8c1da2640 1 --2- 172.21.15.72:0/3977807581 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa8bc0b2bf0 0x7fa8bc160c20 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fa8a400c750 tx=0x7fa8a400cc10 comp rx=0 tx=0).stop 2024-05-27T12:32:19.069 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:19.070+0000 7fa8c1da2640 1 -- 172.21.15.72:0/3977807581 shutdown_connections 2024-05-27T12:32:19.069 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:19.070+0000 7fa8c1da2640 1 --2- 172.21.15.72:0/3977807581 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa8bc15eaf0 0x7fa8bc0b6680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:19.069 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:19.070+0000 7fa8c1da2640 1 --2- 172.21.15.72:0/3977807581 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa8bc0b2bf0 0x7fa8bc160c20 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:19.069 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:19.070+0000 7fa8c1da2640 1 --2- 172.21.15.72:0/3977807581 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8bc06c040 0x7fa8bc1507c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:19.069 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:19.070+0000 7fa8c1da2640 1 -- 172.21.15.72:0/3977807581 >> 172.21.15.72:0/3977807581 conn(0x7fa8bc0733d0 msgr2=0x7fa8bc15a5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:19.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:19.070+0000 7fa8c1da2640 1 -- 172.21.15.72:0/3977807581 shutdown_connections 2024-05-27T12:32:19.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:19.070+0000 7fa8c1da2640 1 -- 172.21.15.72:0/3977807581 wait complete. 2024-05-27T12:32:19.079 DEBUG:teuthology.orchestra.run.smithi072:> sudo ceph --cluster ceph osd new 505a62d3-322b-4629-b4fd-187a55563709 7 2024-05-27T12:32:19.230 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:19.228+0000 7fc5cee0b640 1 Processor -- start 2024-05-27T12:32:19.231 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:19.228+0000 7fc5cee0b640 1 -- start start 2024-05-27T12:32:19.231 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:19.228+0000 7fc5cee0b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc5c815eaf0 0x7fc5c80b1b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:19.231 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:19.228+0000 7fc5cee0b640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc5c806c040 0x7fc5c80b2930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:19.231 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:19.229+0000 7fc5cee0b640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5c80b0d40 con 0x7fc5c80b24e0 2024-05-27T12:32:19.231 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:19.229+0000 7fc5cee0b640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7fc5c81635f0 con 0x7fc5c815eaf0 2024-05-27T12:32:19.232 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:19.229+0000 7fc5cee0b640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fc5c80b2e70 con 0x7fc5c806c040 2024-05-27T12:32:19.232 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:19.229+0000 7fc5cd3a8640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc5c806c040 0x7fc5c80b2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:19.232 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:19.229+0000 7fc5cd3a8640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc5c806c040 0x7fc5c80b2930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:41838/0 (socket says 172.21.15.72:41838) 2024-05-27T12:32:19.232 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:19.229+0000 7fc5cd3a8640 1 -- 172.21.15.72:0/2141910954 learned_addr learned my addr 172.21.15.72:0/2141910954 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-27T12:32:19.232 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:19.229+0000 7fc5ccba7640 1 --2- 172.21.15.72:0/2141910954 >> v2:172.21.15.55:3300/0 conn(0x7fc5c815eaf0 0x7fc5c80b1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:19.233 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:19.229+0000 7fc5cd3a8640 1 -- 172.21.15.72:0/2141910954 >> v2:172.21.15.55:3300/0 conn(0x7fc5c815eaf0 msgr2=0x7fc5c80b1b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:32:19.233 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:19.229+0000 7fc5cd3a8640 1 --2- 172.21.15.72:0/2141910954 >> v2:172.21.15.55:3300/0 conn(0x7fc5c815eaf0 0x7fc5c80b1b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:19.233 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:19.229+0000 7fc5cd3a8640 1 -- 172.21.15.72:0/2141910954 >> v1:172.21.15.55:6789/0 conn(0x7fc5c80b24e0 legacy=0x7fc5c806b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:19.233 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:19.229+0000 7fc5cd3a8640 1 -- 172.21.15.72:0/2141910954 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5c80b1020 con 0x7fc5c806c040 2024-05-27T12:32:19.233 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:19.229+0000 7fc5ccba7640 1 --2- 172.21.15.72:0/2141910954 >> v2:172.21.15.55:3300/0 conn(0x7fc5c815eaf0 0x7fc5c80b1b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T12:32:19.233 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:19.230+0000 7fc5cd3a8640 1 --2- 172.21.15.72:0/2141910954 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc5c806c040 0x7fc5c80b2930 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc5c0009e50 tx=0x7fc5c002a7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1fb59219943febb2 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:19.234 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:19.230+0000 7fc5c77fe640 1 -- 172.21.15.72:0/2141910954 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5c0036070 con 0x7fc5c806c040 2024-05-27T12:32:19.234 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:19.230+0000 7fc5c77fe640 1 -- 172.21.15.72:0/2141910954 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5c0031600 con 0x7fc5c806c040 2024-05-27T12:32:19.234 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:19.230+0000 7fc5c77fe640 1 -- 172.21.15.72:0/2141910954 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5c00319d0 con 0x7fc5c806c040 2024-05-27T12:32:19.234 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:19.230+0000 7fc5cee0b640 1 -- 172.21.15.72:0/2141910954 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc5c806c040 msgr2=0x7fc5c80b2930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:19.234 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:19.230+0000 7fc5cee0b640 1 --2- 172.21.15.72:0/2141910954 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc5c806c040 0x7fc5c80b2930 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc5c0009e50 tx=0x7fc5c002a7a0 comp rx=0 tx=0).stop 2024-05-27T12:32:19.234 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:19.230+0000 7fc5cee0b640 1 -- 172.21.15.72:0/2141910954 shutdown_connections 2024-05-27T12:32:19.235 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:19.230+0000 7fc5cee0b640 1 --2- 172.21.15.72:0/2141910954 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc5c806c040 0x7fc5c80b2930 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:19.235 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:19.230+0000 7fc5cee0b640 1 --2- 172.21.15.72:0/2141910954 >> v2:172.21.15.55:3300/0 conn(0x7fc5c815eaf0 0x7fc5c80b1b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:19.235 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:19.230+0000 7fc5cee0b640 1 -- 172.21.15.72:0/2141910954 >> 172.21.15.72:0/2141910954 conn(0x7fc5c80733d0 msgr2=0x7fc5c809aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:19.235 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:19.230+0000 7fc5cee0b640 1 -- 172.21.15.72:0/2141910954 shutdown_connections 2024-05-27T12:32:19.235 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:19.230+0000 7fc5cee0b640 1 -- 172.21.15.72:0/2141910954 wait complete. 2024-05-27T12:32:19.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:19.232+0000 7fc5cee0b640 1 Processor -- start 2024-05-27T12:32:19.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:19.232+0000 7fc5cee0b640 1 -- start start 2024-05-27T12:32:19.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:19.234+0000 7fc5cee0b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc5c806c040 0x7fc5c8161cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:19.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:19.234+0000 7fc5cee0b640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc5c80b24e0 0x7fc5c80c7420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:19.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:19.234+0000 7fc5cee0b640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc5c815eaf0 0x7fc5c8150d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:19.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:19.234+0000 7fc5cee0b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7fc5c80b15e0 con 0x7fc5c806c040 2024-05-27T12:32:19.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:19.234+0000 7fc5cee0b640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fc5c80b0af0 con 0x7fc5c815eaf0 2024-05-27T12:32:19.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:19.234+0000 7fc5cee0b640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fc5c815eed0 con 0x7fc5c80b24e0 2024-05-27T12:32:19.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:19.234+0000 7fc5cd3a8640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc5c815eaf0 0x7fc5c8150d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:19.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:19.234+0000 7fc5c7fff640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc5c80b24e0 0x7fc5c80c7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:19.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:19.234+0000 7fc5c7fff640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc5c80b24e0 0x7fc5c80c7420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:41840/0 (socket says 172.21.15.72:41840) 2024-05-27T12:32:19.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:19.234+0000 7fc5cd3a8640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc5c815eaf0 0x7fc5c8150d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48990/0 (socket says 172.21.15.72:48990) 2024-05-27T12:32:19.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:19.234+0000 7fc5c7fff640 1 -- 172.21.15.72:0/426452564 learned_addr learned my addr 172.21.15.72:0/426452564 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-05-27T12:32:19.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:19.234+0000 7fc5ccba7640 1 --2- 172.21.15.72:0/426452564 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc5c806c040 0x7fc5c8161cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:19.241 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:19.234+0000 7fc5cd3a8640 1 -- 172.21.15.72:0/426452564 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc5c80b24e0 msgr2=0x7fc5c80c7420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:19.241 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:19.234+0000 7fc5cd3a8640 1 --2- 172.21.15.72:0/426452564 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc5c80b24e0 0x7fc5c80c7420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:19.241 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:19.234+0000 7fc5cd3a8640 1 -- 172.21.15.72:0/426452564 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc5c806c040 msgr2=0x7fc5c8161cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:19.241 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:19.234+0000 7fc5cd3a8640 1 --2- 172.21.15.72:0/426452564 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc5c806c040 0x7fc5c8161cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:19.241 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:19.234+0000 7fc5cd3a8640 1 -- 172.21.15.72:0/426452564 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5c80c7ac0 con 0x7fc5c815eaf0 2024-05-27T12:32:19.241 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:19.234+0000 7fc5cd3a8640 1 --2- 172.21.15.72:0/426452564 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc5c815eaf0 0x7fc5c8150d60 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc5c0030000 tx=0x7fc5c0004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:19.242 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:19.234+0000 7fc5c57fa640 1 -- 172.21.15.72:0/426452564 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5c0036050 con 0x7fc5c815eaf0 2024-05-27T12:32:19.242 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:19.234+0000 7fc5c57fa640 1 -- 172.21.15.72:0/426452564 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5c0042070 con 0x7fc5c815eaf0 2024-05-27T12:32:19.242 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:19.234+0000 7fc5c57fa640 1 -- 172.21.15.72:0/426452564 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5c0009510 con 0x7fc5c815eaf0 2024-05-27T12:32:19.242 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:19.235+0000 7fc5cee0b640 1 -- 172.21.15.72:0/426452564 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5c80c7da0 con 0x7fc5c815eaf0 2024-05-27T12:32:19.242 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:19.235+0000 7fc5cee0b640 1 -- 172.21.15.72:0/426452564 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5c8154b80 con 0x7fc5c815eaf0 2024-05-27T12:32:19.242 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:19.235+0000 7fc5c57fa640 1 -- 172.21.15.72:0/426452564 <== mon.1 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc5c0007bf0 con 0x7fc5c815eaf0 2024-05-27T12:32:19.243 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:19.235+0000 7fc5c57fa640 1 -- 172.21.15.72:0/426452564 <== mon.1 v2:172.21.15.72:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7fc5c0047af0 con 0x7fc5c815eaf0 2024-05-27T12:32:19.243 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:19.235+0000 7fc5cee0b640 1 -- 172.21.15.72:0/426452564 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5c8068a70 con 0x7fc5c815eaf0 2024-05-27T12:32:19.243 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:19.237+0000 7fc5c57fa640 1 -- 172.21.15.72:0/426452564 <== mon.1 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fc5c8068a70 con 0x7fc5c815eaf0 2024-05-27T12:32:19.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:19.308+0000 7fc5cee0b640 1 -- 172.21.15.72:0/426452564 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd new", "uuid": "505a62d3-322b-4629-b4fd-187a55563709", "id": 7} v 0) -- 0x7fc5c80c8410 con 0x7fc5c815eaf0 2024-05-27T12:32:19.315 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:19.317+0000 7fc5c57fa640 1 -- 172.21.15.72:0/426452564 <== mon.1 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "505a62d3-322b-4629-b4fd-187a55563709", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7fc5c80c8410 con 0x7fc5c815eaf0 2024-05-27T12:32:19.316 INFO:teuthology.orchestra.run.smithi072.stdout:7 2024-05-27T12:32:19.317 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:19.318+0000 7fc5cee0b640 1 -- 172.21.15.72:0/426452564 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc5c815eaf0 msgr2=0x7fc5c8150d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:19.317 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:19.318+0000 7fc5cee0b640 1 --2- 172.21.15.72:0/426452564 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc5c815eaf0 0x7fc5c8150d60 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc5c0030000 tx=0x7fc5c0004a40 comp rx=0 tx=0).stop 2024-05-27T12:32:19.317 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:19.318+0000 7fc5cee0b640 1 -- 172.21.15.72:0/426452564 shutdown_connections 2024-05-27T12:32:19.317 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:19.318+0000 7fc5cee0b640 1 --2- 172.21.15.72:0/426452564 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc5c815eaf0 0x7fc5c8150d60 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:19.317 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:19.318+0000 7fc5cee0b640 1 --2- 172.21.15.72:0/426452564 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc5c80b24e0 0x7fc5c80c7420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:19.317 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:19.318+0000 7fc5cee0b640 1 --2- 172.21.15.72:0/426452564 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc5c806c040 0x7fc5c8161cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:19.318 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:19.318+0000 7fc5cee0b640 1 -- 172.21.15.72:0/426452564 >> 172.21.15.72:0/426452564 conn(0x7fc5c80733d0 msgr2=0x7fc5c806f7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:19.318 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:19.318+0000 7fc5cee0b640 1 -- 172.21.15.72:0/426452564 shutdown_connections 2024-05-27T12:32:19.318 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:32:19.318+0000 7fc5cee0b640 1 -- 172.21.15.72:0/426452564 wait complete. 2024-05-27T12:32:19.327 INFO:tasks.ceph.osd.0:Restarting daemon 2024-05-27T12:32:19.327 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-05-27T12:32:19.330 INFO:tasks.ceph.osd.0:Started 2024-05-27T12:32:19.330 INFO:tasks.ceph.osd.1:Restarting daemon 2024-05-27T12:32:19.331 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-05-27T12:32:19.333 INFO:tasks.ceph.osd.1:Started 2024-05-27T12:32:19.333 INFO:tasks.ceph.osd.2:Restarting daemon 2024-05-27T12:32:19.334 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-05-27T12:32:19.337 INFO:tasks.ceph.osd.2:Started 2024-05-27T12:32:19.337 INFO:tasks.ceph.osd.3:Restarting daemon 2024-05-27T12:32:19.338 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-05-27T12:32:19.343 INFO:tasks.ceph.osd.3:Started 2024-05-27T12:32:19.345 INFO:tasks.ceph.osd.4:Restarting daemon 2024-05-27T12:32:19.346 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-05-27T12:32:19.349 INFO:tasks.ceph.osd.4:Started 2024-05-27T12:32:19.350 INFO:tasks.ceph.osd.5:Restarting daemon 2024-05-27T12:32:19.350 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-05-27T12:32:19.354 INFO:tasks.ceph.osd.5:Started 2024-05-27T12:32:19.354 INFO:tasks.ceph.osd.6:Restarting daemon 2024-05-27T12:32:19.354 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-05-27T12:32:19.357 INFO:tasks.ceph.osd.6:Started 2024-05-27T12:32:19.357 INFO:tasks.ceph.osd.7:Restarting daemon 2024-05-27T12:32:19.358 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-05-27T12:32:19.360 INFO:tasks.ceph.osd.7:Started 2024-05-27T12:32:19.360 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-27T12:32:19.409 INFO:tasks.ceph.mgr.y.smithi055.stderr:2024-05-27T12:32:19.410+0000 7fdab65be040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-27T12:32:19.428 INFO:tasks.ceph.mgr.x.smithi072.stderr:2024-05-27T12:32:19.429+0000 7f9268f09040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-27T12:32:19.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:19.491+0000 7faa2038e640 1 Processor -- start 2024-05-27T12:32:19.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:19.491+0000 7faa2038e640 1 -- start start 2024-05-27T12:32:19.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:19.492+0000 7faa2038e640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faa1815c840 0x7faa18070a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:19.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:19.492+0000 7faa2038e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7faa1806ee30 0x7faa1806c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:19.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:19.492+0000 7faa2038e640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa1815cc20 con 0x7faa180b0280 2024-05-27T12:32:19.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:19.492+0000 7faa2038e640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7faa180cd700 con 0x7faa1806ee30 2024-05-27T12:32:19.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:19.492+0000 7faa2038e640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7faa180710c0 con 0x7faa1815c840 2024-05-27T12:32:19.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:19.492+0000 7faa1e92b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7faa1806ee30 0x7faa1806c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:19.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:19.492+0000 7faa1d929640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7faa180b0280 0x7faa1806e720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:35626/0 (socket says 172.21.15.55:35626) 2024-05-27T12:32:19.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:19.492+0000 7faa1e92b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7faa1806ee30 0x7faa1806c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45642/0 (socket says 172.21.15.55:45642) 2024-05-27T12:32:19.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:19.492+0000 7faa1d929640 1 -- 172.21.15.55:0/55762542 learned_addr learned my addr 172.21.15.55:0/55762542 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-27T12:32:19.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:19.492+0000 7faa1e12a640 1 --2- 172.21.15.55:0/55762542 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faa1815c840 0x7faa18070a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:19.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:19.493+0000 7faa1e92b640 1 -- 172.21.15.55:0/55762542 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faa1815c840 msgr2=0x7faa18070a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:32:19.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:19.493+0000 7faa1e92b640 1 --2- 172.21.15.55:0/55762542 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faa1815c840 0x7faa18070a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:19.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:19.493+0000 7faa1e92b640 1 -- 172.21.15.55:0/55762542 >> v1:172.21.15.55:6789/0 conn(0x7faa180b0280 legacy=0x7faa1806e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:19.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:19.493+0000 7faa1e92b640 1 -- 172.21.15.55:0/55762542 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa18160f20 con 0x7faa1806ee30 2024-05-27T12:32:19.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:19.493+0000 7faa1d128640 1 -- 172.21.15.55:0/55762542 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2152567513 0 0) 0x7faa1815cc20 con 0x7faa180b0280 2024-05-27T12:32:19.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:19.493+0000 7faa1e92b640 1 --2- 172.21.15.55:0/55762542 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa1806ee30 0x7faa1806c130 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7faa10009dc0 tx=0x7faa1002a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35f04b298def835 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:19.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:19.493+0000 7faa1d128640 1 -- 172.21.15.55:0/55762542 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa10007740 con 0x7faa1806ee30 2024-05-27T12:32:19.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:19.493+0000 7faa1d128640 1 -- 172.21.15.55:0/55762542 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa100078e0 con 0x7faa1806ee30 2024-05-27T12:32:19.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:19.494+0000 7faa1d128640 1 -- 172.21.15.55:0/55762542 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa10007cb0 con 0x7faa1806ee30 2024-05-27T12:32:19.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:19.494+0000 7faa2038e640 1 -- 172.21.15.55:0/55762542 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa1806ee30 msgr2=0x7faa1806c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:19.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:19.494+0000 7faa2038e640 1 --2- 172.21.15.55:0/55762542 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa1806ee30 0x7faa1806c130 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7faa10009dc0 tx=0x7faa1002a560 comp rx=0 tx=0).stop 2024-05-27T12:32:19.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:19.494+0000 7faa2038e640 1 -- 172.21.15.55:0/55762542 shutdown_connections 2024-05-27T12:32:19.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:19.494+0000 7faa2038e640 1 --2- 172.21.15.55:0/55762542 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa1806ee30 0x7faa1806c130 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:19.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:19.494+0000 7faa2038e640 1 --2- 172.21.15.55:0/55762542 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faa1815c840 0x7faa18070a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:19.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:19.494+0000 7faa2038e640 1 -- 172.21.15.55:0/55762542 >> 172.21.15.55:0/55762542 conn(0x7faa180d10b0 msgr2=0x7faa180d14c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:19.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:19.494+0000 7faa2038e640 1 -- 172.21.15.55:0/55762542 shutdown_connections 2024-05-27T12:32:19.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:19.494+0000 7faa2038e640 1 -- 172.21.15.55:0/55762542 wait complete. 2024-05-27T12:32:19.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:19.496+0000 7faa2038e640 1 Processor -- start 2024-05-27T12:32:19.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:19.496+0000 7faa2038e640 1 -- start start 2024-05-27T12:32:19.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:19.497+0000 7faa2038e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa1806ee30 0x7faa181f62f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:19.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:19.497+0000 7faa2038e640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faa180b0280 0x7faa181f25c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:19.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:19.497+0000 7faa2038e640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faa1815c840 0x7faa1815e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:19.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:19.497+0000 7faa2038e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7faa1806f410 con 0x7faa1806ee30 2024-05-27T12:32:19.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:19.497+0000 7faa1e12a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa1806ee30 0x7faa181f62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:19.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:19.497+0000 7faa1e12a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa1806ee30 0x7faa181f62f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45646/0 (socket says 172.21.15.55:45646) 2024-05-27T12:32:19.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:19.497+0000 7faa1e12a640 1 -- 172.21.15.55:0/4205354636 learned_addr learned my addr 172.21.15.55:0/4205354636 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:32:19.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:19.497+0000 7faa2038e640 1 -- 172.21.15.55:0/4205354636 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7faa1806b930 con 0x7faa180b0280 2024-05-27T12:32:19.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:19.497+0000 7faa2038e640 1 -- 172.21.15.55:0/4205354636 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7faa1806f590 con 0x7faa1815c840 2024-05-27T12:32:19.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:19.497+0000 7faa1d929640 1 --2- 172.21.15.55:0/4205354636 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faa180b0280 0x7faa181f25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:19.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:19.497+0000 7faa1e92b640 1 --2- 172.21.15.55:0/4205354636 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faa1815c840 0x7faa1815e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:19.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:19.497+0000 7faa1e12a640 1 -- 172.21.15.55:0/4205354636 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faa1815c840 msgr2=0x7faa1815e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:19.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:19.497+0000 7faa1e12a640 1 --2- 172.21.15.55:0/4205354636 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faa1815c840 0x7faa1815e290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:19.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:19.497+0000 7faa1e12a640 1 -- 172.21.15.55:0/4205354636 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faa180b0280 msgr2=0x7faa181f25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:19.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:19.497+0000 7faa1e12a640 1 --2- 172.21.15.55:0/4205354636 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faa180b0280 0x7faa181f25c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:19.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:19.497+0000 7faa1e12a640 1 -- 172.21.15.55:0/4205354636 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa181f6b20 con 0x7faa1806ee30 2024-05-27T12:32:19.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:19.497+0000 7faa1d929640 1 --2- 172.21.15.55:0/4205354636 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faa180b0280 0x7faa181f25c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T12:32:19.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:19.498+0000 7faa1e12a640 1 --2- 172.21.15.55:0/4205354636 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa1806ee30 0x7faa181f62f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7faa1400e9b0 tx=0x7faa1400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:19.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:19.498+0000 7faa0affd640 1 -- 172.21.15.55:0/4205354636 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa14017070 con 0x7faa1806ee30 2024-05-27T12:32:19.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:19.498+0000 7faa0affd640 1 -- 172.21.15.55:0/4205354636 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa1400c9a0 con 0x7faa1806ee30 2024-05-27T12:32:19.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:19.498+0000 7faa0affd640 1 -- 172.21.15.55:0/4205354636 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa1400cd90 con 0x7faa1806ee30 2024-05-27T12:32:19.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:19.498+0000 7faa2038e640 1 -- 172.21.15.55:0/4205354636 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa181f6e00 con 0x7faa1806ee30 2024-05-27T12:32:19.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:19.498+0000 7faa2038e640 1 -- 172.21.15.55:0/4205354636 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa1809d930 con 0x7faa1806ee30 2024-05-27T12:32:19.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:19.498+0000 7faa0affd640 1 -- 172.21.15.55:0/4205354636 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7faa1401a070 con 0x7faa1806ee30 2024-05-27T12:32:19.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:19.498+0000 7faa0affd640 1 -- 172.21.15.55:0/4205354636 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7faa14006660 con 0x7faa1806ee30 2024-05-27T12:32:19.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:19.499+0000 7faa2038e640 1 -- 172.21.15.55:0/4205354636 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa181f6890 con 0x7faa1806ee30 2024-05-27T12:32:19.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:19.501+0000 7faa0affd640 1 -- 172.21.15.55:0/4205354636 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7faa14005990 con 0x7faa1806ee30 2024-05-27T12:32:19.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:19.563+0000 7faa2038e640 1 -- 172.21.15.55:0/4205354636 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7faa18075460 con 0x7faa1806ee30 2024-05-27T12:32:19.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:19.564+0000 7faa0affd640 1 -- 172.21.15.55:0/4205354636 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7faa14005b70 con 0x7faa1806ee30 2024-05-27T12:32:19.563 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-27T12:32:19.563 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":10,"fsid":"c3ff4e3b-8dae-4856-9593-e5cc66c59982","created":"2024-05-27T12:32:17.019097+0000","modified":"2024-05-27T12:32:19.309872+0000","last_up_change":"0.000000","last_in_change":"2024-05-27T12:32:19.309872+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"e607b598-061b-4b6f-92ff-95c20b330599","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"ba2b5b1d-71a9-4ecc-9a48-55aa7fe54261","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"e6b81cc6-4ff1-45d0-87eb-9f04ccf986a3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"b6a34b75-807d-4693-b1c3-903cb4c618d9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"272ec937-56b4-4f0a-b2e1-b0bc189c9d79","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"56439854-72a0-4ef4-81ff-184a3d924a5d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"e248e2be-3b6e-49cf-8c8a-1a4152827582","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"505a62d3-322b-4629-b4fd-187a55563709","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-27T12:32:19.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:19.565+0000 7faa2038e640 1 -- 172.21.15.55:0/4205354636 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa1806ee30 msgr2=0x7faa181f62f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:19.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:19.565+0000 7faa2038e640 1 --2- 172.21.15.55:0/4205354636 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa1806ee30 0x7faa181f62f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7faa1400e9b0 tx=0x7faa1400ee70 comp rx=0 tx=0).stop 2024-05-27T12:32:19.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:19.565+0000 7faa2038e640 1 -- 172.21.15.55:0/4205354636 shutdown_connections 2024-05-27T12:32:19.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:19.565+0000 7faa2038e640 1 --2- 172.21.15.55:0/4205354636 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faa1815c840 0x7faa1815e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:19.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:19.565+0000 7faa2038e640 1 --2- 172.21.15.55:0/4205354636 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faa180b0280 0x7faa181f25c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:19.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:19.565+0000 7faa2038e640 1 --2- 172.21.15.55:0/4205354636 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa1806ee30 0x7faa181f62f0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:19.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:19.565+0000 7faa2038e640 1 -- 172.21.15.55:0/4205354636 >> 172.21.15.55:0/4205354636 conn(0x7faa180d10b0 msgr2=0x7faa180ce630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:19.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:19.565+0000 7faa2038e640 1 -- 172.21.15.55:0/4205354636 shutdown_connections 2024-05-27T12:32:19.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:19.565+0000 7faa2038e640 1 -- 172.21.15.55:0/4205354636 wait complete. 2024-05-27T12:32:19.575 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-05-27T12:32:19.575 INFO:tasks.ceph:Waiting for OSDs to come up 2024-05-27T12:32:19.693 INFO:tasks.ceph.mgr.y.smithi055.stderr:2024-05-27T12:32:19.694+0000 7fdab65be040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-27T12:32:19.696 INFO:tasks.ceph.osd.0.smithi055.stderr:2024-05-27T12:32:19.697+0000 7fb3f7928640 -1 Falling back to public interface 2024-05-27T12:32:19.698 INFO:tasks.ceph.mgr.x.smithi072.stderr:2024-05-27T12:32:19.699+0000 7f9268f09040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-27T12:32:19.748 INFO:tasks.ceph.mgr.y.smithi055.stderr:2024-05-27T12:32:19.749+0000 7fdab65be040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-27T12:32:19.753 INFO:tasks.ceph.mgr.x.smithi072.stderr:2024-05-27T12:32:19.753+0000 7f9268f09040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-27T12:32:19.866 INFO:tasks.ceph.mgr.x.smithi072.stderr:2024-05-27T12:32:19.867+0000 7f9268f09040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-27T12:32:19.870 INFO:tasks.ceph.mgr.y.smithi055.stderr:2024-05-27T12:32:19.871+0000 7fdab65be040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-27T12:32:19.951 INFO:tasks.ceph.osd.2.smithi055.stderr:2024-05-27T12:32:19.952+0000 7f1a329d6640 -1 Falling back to public interface 2024-05-27T12:32:19.955 INFO:tasks.ceph.osd.5.smithi072.stderr:2024-05-27T12:32:19.956+0000 7f79b9214640 -1 Falling back to public interface 2024-05-27T12:32:19.955 INFO:tasks.ceph.osd.6.smithi072.stderr:2024-05-27T12:32:19.956+0000 7ffabb0e5640 -1 Falling back to public interface 2024-05-27T12:32:19.955 INFO:tasks.ceph.osd.6.smithi072.stderr:2024-05-27T12:32:19.956+0000 7ffaba094640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6800/0: (98) Address already in use 2024-05-27T12:32:19.956 INFO:tasks.ceph.osd.6.smithi072.stderr:2024-05-27T12:32:19.956+0000 7ffaba094640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6801/0: (98) Address already in use 2024-05-27T12:32:19.956 INFO:tasks.ceph.osd.3.smithi055.stderr:2024-05-27T12:32:19.956+0000 7fdd00e0e640 -1 Falling back to public interface 2024-05-27T12:32:19.958 INFO:tasks.ceph.osd.1.smithi055.stderr:2024-05-27T12:32:19.959+0000 7f33fdbaf640 -1 Falling back to public interface 2024-05-27T12:32:19.980 INFO:tasks.ceph.osd.7.smithi072.stderr:2024-05-27T12:32:19.981+0000 7f5ffae0d640 -1 Falling back to public interface 2024-05-27T12:32:19.980 INFO:tasks.ceph.osd.4.smithi072.stderr:2024-05-27T12:32:19.981+0000 7f2c7fa12640 -1 Falling back to public interface 2024-05-27T12:32:20.157 INFO:tasks.ceph.mgr.x.smithi072.stderr:2024-05-27T12:32:20.158+0000 7f9268f09040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-27T12:32:20.179 INFO:tasks.ceph.mgr.y.smithi055.stderr:2024-05-27T12:32:20.180+0000 7fdab65be040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-27T12:32:20.203 INFO:tasks.ceph.mgr.x.smithi072.stderr:2024-05-27T12:32:20.204+0000 7f9268f09040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-27T12:32:20.230 INFO:tasks.ceph.mgr.y.smithi055.stderr:2024-05-27T12:32:20.231+0000 7fdab65be040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-27T12:32:20.360 INFO:tasks.ceph.mgr.x.smithi072.stderr:2024-05-27T12:32:20.361+0000 7f9268f09040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-27T12:32:20.381 DEBUG:teuthology.orchestra.run.smithi055:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-27T12:32:20.393 INFO:tasks.ceph.mgr.y.smithi055.stderr:2024-05-27T12:32:20.394+0000 7fdab65be040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-27T12:32:20.476 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:20.477+0000 7f8d2c84e640 1 Processor -- start 2024-05-27T12:32:20.476 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:20.477+0000 7f8d2c84e640 1 -- start start 2024-05-27T12:32:20.478 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:20.478+0000 7f8d2c84e640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8d2815ce70 0x7f8d280cebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:20.478 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:20.478+0000 7f8d2c84e640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8d2806b860 0x7f8d2806bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:20.478 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:20.478+0000 7f8d2c84e640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d280d0730 con 0x7f8d281460c0 2024-05-27T12:32:20.478 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:20.478+0000 7f8d2c84e640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f8d2806c210 con 0x7f8d2815ce70 2024-05-27T12:32:20.478 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:20.478+0000 7f8d2c84e640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f8d280d0500 con 0x7f8d2806b860 2024-05-27T12:32:20.478 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:20.478+0000 7f8d2659c640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f8d281460c0 0x7f8d28071130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:35636/0 (socket says 172.21.15.55:35636) 2024-05-27T12:32:20.478 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:20.478+0000 7f8d2659c640 1 -- 172.21.15.55:0/207312430 learned_addr learned my addr 172.21.15.55:0/207312430 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-27T12:32:20.478 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:20.478+0000 7f8d25d9b640 1 --2- 172.21.15.55:0/207312430 >> v2:172.21.15.72:3300/0 conn(0x7f8d2815ce70 0x7f8d280cebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:20.478 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:20.478+0000 7f8d26d9d640 1 --2- 172.21.15.55:0/207312430 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8d2806b860 0x7f8d2806bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:20.478 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:20.478+0000 7f8d2559a640 1 -- 172.21.15.55:0/207312430 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4012072594 0 0) 0x7f8d280d0730 con 0x7f8d281460c0 2024-05-27T12:32:20.479 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:20.478+0000 7f8d2559a640 1 -- 172.21.15.55:0/207312430 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8d10003520 con 0x7f8d281460c0 2024-05-27T12:32:20.479 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:20.479+0000 7f8d26d9d640 1 -- 172.21.15.55:0/207312430 >> v2:172.21.15.72:3300/0 conn(0x7f8d2815ce70 msgr2=0x7f8d280cebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:32:20.479 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:20.479+0000 7f8d26d9d640 1 --2- 172.21.15.55:0/207312430 >> v2:172.21.15.72:3300/0 conn(0x7f8d2815ce70 0x7f8d280cebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:20.479 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:20.479+0000 7f8d26d9d640 1 -- 172.21.15.55:0/207312430 >> v1:172.21.15.55:6789/0 conn(0x7f8d281460c0 legacy=0x7f8d28071130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:20.479 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:20.479+0000 7f8d26d9d640 1 -- 172.21.15.55:0/207312430 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d280d0a10 con 0x7f8d2806b860 2024-05-27T12:32:20.479 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:20.479+0000 7f8d25d9b640 1 --2- 172.21.15.55:0/207312430 >> v2:172.21.15.72:3300/0 conn(0x7f8d2815ce70 0x7f8d280cebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T12:32:20.480 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:20.479+0000 7f8d26d9d640 1 --2- 172.21.15.55:0/207312430 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8d2806b860 0x7f8d2806bcd0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f8d20009d90 tx=0x7f8d2002a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f96d0deae7a918ea server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:20.480 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:20.479+0000 7f8d2559a640 1 -- 172.21.15.55:0/207312430 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d20031600 con 0x7f8d2806b860 2024-05-27T12:32:20.480 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:20.480+0000 7f8d2559a640 1 -- 172.21.15.55:0/207312430 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d200317a0 con 0x7f8d2806b860 2024-05-27T12:32:20.480 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:20.480+0000 7f8d2559a640 1 -- 172.21.15.55:0/207312430 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d20031b70 con 0x7f8d2806b860 2024-05-27T12:32:20.480 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:20.480+0000 7f8d2c84e640 1 -- 172.21.15.55:0/207312430 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8d2806b860 msgr2=0x7f8d2806bcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:20.480 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:20.480+0000 7f8d2c84e640 1 --2- 172.21.15.55:0/207312430 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8d2806b860 0x7f8d2806bcd0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f8d20009d90 tx=0x7f8d2002a5d0 comp rx=0 tx=0).stop 2024-05-27T12:32:20.480 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:20.480+0000 7f8d2c84e640 1 -- 172.21.15.55:0/207312430 shutdown_connections 2024-05-27T12:32:20.481 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:20.480+0000 7f8d2c84e640 1 --2- 172.21.15.55:0/207312430 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8d2806b860 0x7f8d2806bcd0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:20.481 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:20.480+0000 7f8d2c84e640 1 --2- 172.21.15.55:0/207312430 >> v2:172.21.15.72:3300/0 conn(0x7f8d2815ce70 0x7f8d280cebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:20.481 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:20.480+0000 7f8d2c84e640 1 -- 172.21.15.55:0/207312430 >> 172.21.15.55:0/207312430 conn(0x7f8d280b32e0 msgr2=0x7f8d280b36c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:20.481 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:20.480+0000 7f8d2c84e640 1 -- 172.21.15.55:0/207312430 shutdown_connections 2024-05-27T12:32:20.481 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:20.480+0000 7f8d2c84e640 1 -- 172.21.15.55:0/207312430 wait complete. 2024-05-27T12:32:20.483 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:20.482+0000 7f8d2c84e640 1 Processor -- start 2024-05-27T12:32:20.483 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:20.482+0000 7f8d2c84e640 1 -- start start 2024-05-27T12:32:20.483 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:20.482+0000 7f8d2c84e640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8d2806b860 0x7f8d2806f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:20.483 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:20.482+0000 7f8d2c84e640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8d281460c0 0x7f8d2813cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:20.484 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:20.482+0000 7f8d2c84e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8d2815ce70 0x7f8d2813d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:20.484 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:20.482+0000 7f8d2c84e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f8d280d0fd0 con 0x7f8d2815ce70 2024-05-27T12:32:20.484 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:20.482+0000 7f8d2c84e640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f8d280718f0 con 0x7f8d281460c0 2024-05-27T12:32:20.484 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:20.482+0000 7f8d2c84e640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f8d281464a0 con 0x7f8d2806b860 2024-05-27T12:32:20.484 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:20.482+0000 7f8d26d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8d2815ce70 0x7f8d2813d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:20.484 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:20.482+0000 7f8d26d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8d2815ce70 0x7f8d2813d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45652/0 (socket says 172.21.15.55:45652) 2024-05-27T12:32:20.484 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:20.482+0000 7f8d26d9d640 1 -- 172.21.15.55:0/1523811345 learned_addr learned my addr 172.21.15.55:0/1523811345 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:32:20.484 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:20.482+0000 7f8d25d9b640 1 --2- 172.21.15.55:0/1523811345 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8d281460c0 0x7f8d2813cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:20.484 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:20.482+0000 7f8d2659c640 1 --2- 172.21.15.55:0/1523811345 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8d2806b860 0x7f8d2806f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:20.484 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:20.483+0000 7f8d26d9d640 1 -- 172.21.15.55:0/1523811345 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8d2806b860 msgr2=0x7f8d2806f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:20.484 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:20.483+0000 7f8d26d9d640 1 --2- 172.21.15.55:0/1523811345 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8d2806b860 0x7f8d2806f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:20.484 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:20.483+0000 7f8d26d9d640 1 -- 172.21.15.55:0/1523811345 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8d281460c0 msgr2=0x7f8d2813cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:20.484 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:20.483+0000 7f8d26d9d640 1 --2- 172.21.15.55:0/1523811345 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8d281460c0 0x7f8d2813cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:20.484 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:20.483+0000 7f8d26d9d640 1 -- 172.21.15.55:0/1523811345 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d281423a0 con 0x7f8d2815ce70 2024-05-27T12:32:20.485 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:20.483+0000 7f8d25d9b640 1 --2- 172.21.15.55:0/1523811345 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8d281460c0 0x7f8d2813cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T12:32:20.485 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:20.483+0000 7f8d26d9d640 1 --2- 172.21.15.55:0/1523811345 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8d2815ce70 0x7f8d2813d060 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f8d20009eb0 tx=0x7f8d20004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:20.485 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:20.483+0000 7f8d16ffd640 1 -- 172.21.15.55:0/1523811345 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d20040070 con 0x7f8d2815ce70 2024-05-27T12:32:20.485 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:20.483+0000 7f8d16ffd640 1 -- 172.21.15.55:0/1523811345 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d2003c830 con 0x7f8d2815ce70 2024-05-27T12:32:20.485 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:20.483+0000 7f8d2c84e640 1 -- 172.21.15.55:0/1523811345 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d28142680 con 0x7f8d2815ce70 2024-05-27T12:32:20.485 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:20.483+0000 7f8d16ffd640 1 -- 172.21.15.55:0/1523811345 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d2003cbe0 con 0x7f8d2815ce70 2024-05-27T12:32:20.485 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:20.483+0000 7f8d2c84e640 1 -- 172.21.15.55:0/1523811345 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d28142c40 con 0x7f8d2815ce70 2024-05-27T12:32:20.485 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:20.483+0000 7f8d16ffd640 1 -- 172.21.15.55:0/1523811345 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8d20039040 con 0x7f8d2815ce70 2024-05-27T12:32:20.485 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:20.484+0000 7f8d16ffd640 1 -- 172.21.15.55:0/1523811345 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f8d20031730 con 0x7f8d2815ce70 2024-05-27T12:32:20.485 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:20.484+0000 7f8d2c84e640 1 -- 172.21.15.55:0/1523811345 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d2804fce0 con 0x7f8d2815ce70 2024-05-27T12:32:20.486 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:20.486+0000 7f8d16ffd640 1 -- 172.21.15.55:0/1523811345 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f8d2003cd80 con 0x7f8d2815ce70 2024-05-27T12:32:20.495 INFO:tasks.ceph.mgr.x.smithi072.stderr:2024-05-27T12:32:20.496+0000 7f9268f09040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-27T12:32:20.541 INFO:tasks.ceph.mgr.y.smithi055.stderr:2024-05-27T12:32:20.541+0000 7fdab65be040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-27T12:32:20.545 INFO:tasks.ceph.mgr.x.smithi072.stderr:2024-05-27T12:32:20.547+0000 7f9268f09040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-27T12:32:20.549 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:20.550+0000 7f8d2c84e640 1 -- 172.21.15.55:0/1523811345 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8d28075380 con 0x7f8d2815ce70 2024-05-27T12:32:20.550 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:20.551+0000 7f8d16ffd640 1 -- 172.21.15.55:0/1523811345 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f8d20045460 con 0x7f8d2815ce70 2024-05-27T12:32:20.550 INFO:teuthology.misc.health.smithi055.stdout: 2024-05-27T12:32:20.550 INFO:teuthology.misc.health.smithi055.stdout:{"epoch":10,"fsid":"c3ff4e3b-8dae-4856-9593-e5cc66c59982","created":"2024-05-27T12:32:17.019097+0000","modified":"2024-05-27T12:32:19.309872+0000","last_up_change":"0.000000","last_in_change":"2024-05-27T12:32:19.309872+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"e607b598-061b-4b6f-92ff-95c20b330599","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"ba2b5b1d-71a9-4ecc-9a48-55aa7fe54261","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"e6b81cc6-4ff1-45d0-87eb-9f04ccf986a3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"b6a34b75-807d-4693-b1c3-903cb4c618d9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"272ec937-56b4-4f0a-b2e1-b0bc189c9d79","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"56439854-72a0-4ef4-81ff-184a3d924a5d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"e248e2be-3b6e-49cf-8c8a-1a4152827582","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"505a62d3-322b-4629-b4fd-187a55563709","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-27T12:32:20.551 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:20.552+0000 7f8d2c84e640 1 -- 172.21.15.55:0/1523811345 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8d2815ce70 msgr2=0x7f8d2813d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:20.551 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:20.552+0000 7f8d2c84e640 1 --2- 172.21.15.55:0/1523811345 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8d2815ce70 0x7f8d2813d060 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f8d20009eb0 tx=0x7f8d20004a40 comp rx=0 tx=0).stop 2024-05-27T12:32:20.551 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:20.552+0000 7f8d2c84e640 1 -- 172.21.15.55:0/1523811345 shutdown_connections 2024-05-27T12:32:20.551 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:20.552+0000 7f8d2c84e640 1 --2- 172.21.15.55:0/1523811345 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8d2815ce70 0x7f8d2813d060 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:20.551 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:20.552+0000 7f8d2c84e640 1 --2- 172.21.15.55:0/1523811345 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8d281460c0 0x7f8d2813cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:20.551 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:20.552+0000 7f8d2c84e640 1 --2- 172.21.15.55:0/1523811345 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8d2806b860 0x7f8d2806f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:20.551 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:20.552+0000 7f8d2c84e640 1 -- 172.21.15.55:0/1523811345 >> 172.21.15.55:0/1523811345 conn(0x7f8d280b32e0 msgr2=0x7f8d280b2a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:20.551 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:20.552+0000 7f8d2c84e640 1 -- 172.21.15.55:0/1523811345 shutdown_connections 2024-05-27T12:32:20.552 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:20.552+0000 7f8d2c84e640 1 -- 172.21.15.55:0/1523811345 wait complete. 2024-05-27T12:32:20.560 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-05-27T12:32:20.593 INFO:tasks.ceph.mgr.y.smithi055.stderr:2024-05-27T12:32:20.594+0000 7fdab65be040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-27T12:32:20.614 INFO:tasks.ceph.mgr.x.smithi072.stderr:2024-05-27T12:32:20.615+0000 7f9268f09040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-27T12:32:20.658 INFO:tasks.ceph.mgr.x.smithi072.stderr:2024-05-27T12:32:20.659+0000 7f9268f09040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-27T12:32:20.666 INFO:tasks.ceph.mgr.y.smithi055.stderr:2024-05-27T12:32:20.667+0000 7fdab65be040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-27T12:32:20.714 INFO:tasks.ceph.mgr.y.smithi055.stderr:2024-05-27T12:32:20.714+0000 7fdab65be040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-27T12:32:21.134 INFO:tasks.ceph.mgr.x.smithi072.stderr:2024-05-27T12:32:21.135+0000 7f9268f09040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-27T12:32:21.215 INFO:tasks.ceph.mgr.y.smithi055.stderr:2024-05-27T12:32:21.216+0000 7fdab65be040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-27T12:32:21.247 INFO:tasks.ceph.mgr.x.smithi072.stderr:2024-05-27T12:32:21.249+0000 7f9268f09040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-27T12:32:21.340 INFO:tasks.ceph.mgr.y.smithi055.stderr:2024-05-27T12:32:21.341+0000 7fdab65be040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-27T12:32:22.264 INFO:tasks.ceph.mgr.x.smithi072.stderr:2024-05-27T12:32:22.265+0000 7f920a2fc640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-05-27T12:32:22.264 INFO:tasks.ceph.mgr.x.smithi072.stderr:2024-05-27T12:32:22.265+0000 7f920a2fc640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-05-27T12:32:23.201 INFO:tasks.ceph.osd.0.smithi055.stderr:2024-05-27T12:32:23.199+0000 7fb3f7928640 -1 osd.0 0 log_to_monitors true 2024-05-27T12:32:23.425 INFO:tasks.ceph.osd.6.smithi072.stderr:2024-05-27T12:32:23.426+0000 7ffabb0e5640 -1 osd.6 0 log_to_monitors true 2024-05-27T12:32:23.453 INFO:tasks.ceph.osd.5.smithi072.stderr:2024-05-27T12:32:23.455+0000 7f79b9214640 -1 osd.5 0 log_to_monitors true 2024-05-27T12:32:23.473 INFO:tasks.ceph.osd.1.smithi055.stderr:2024-05-27T12:32:23.474+0000 7f33fdbaf640 -1 osd.1 0 log_to_monitors true 2024-05-27T12:32:23.479 INFO:tasks.ceph.osd.2.smithi055.stderr:2024-05-27T12:32:23.480+0000 7f1a329d6640 -1 osd.2 0 log_to_monitors true 2024-05-27T12:32:23.481 INFO:tasks.ceph.osd.3.smithi055.stderr:2024-05-27T12:32:23.482+0000 7fdd00e0e640 -1 osd.3 0 log_to_monitors true 2024-05-27T12:32:23.500 INFO:tasks.ceph.osd.4.smithi072.stderr:2024-05-27T12:32:23.502+0000 7f2c7fa12640 -1 osd.4 0 log_to_monitors true 2024-05-27T12:32:23.503 INFO:tasks.ceph.osd.7.smithi072.stderr:2024-05-27T12:32:23.505+0000 7f5ffae0d640 -1 osd.7 0 log_to_monitors true 2024-05-27T12:32:25.271 INFO:tasks.ceph.osd.0.smithi055.stderr:2024-05-27T12:32:25.272+0000 7fb3f40d2640 -1 osd.0 0 waiting for initial osdmap 2024-05-27T12:32:25.452 INFO:tasks.ceph.osd.0.smithi055.stderr:2024-05-27T12:32:25.453+0000 7fb3eb6de640 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-27T12:32:27.105 INFO:tasks.ceph.osd.3.smithi055.stderr:2024-05-27T12:32:27.106+0000 7fdcfc704640 -1 osd.3 0 waiting for initial osdmap 2024-05-27T12:32:27.115 INFO:tasks.ceph.osd.3.smithi055.stderr:2024-05-27T12:32:27.116+0000 7fdcf4524640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-27T12:32:27.148 INFO:tasks.ceph.osd.2.smithi055.stderr:2024-05-27T12:32:27.148+0000 7f1a2e96c640 -1 osd.2 0 waiting for initial osdmap 2024-05-27T12:32:27.161 INFO:tasks.ceph.osd.2.smithi055.stderr:2024-05-27T12:32:27.162+0000 7f1a2678c640 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-27T12:32:27.166 INFO:tasks.ceph.osd.1.smithi055.stderr:2024-05-27T12:32:27.167+0000 7f33f9b45640 -1 osd.1 0 waiting for initial osdmap 2024-05-27T12:32:27.180 INFO:tasks.ceph.osd.1.smithi055.stderr:2024-05-27T12:32:27.181+0000 7f33f1965640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-27T12:32:27.303 INFO:tasks.ceph.osd.5.smithi072.stderr:2024-05-27T12:32:27.305+0000 7f79b4c59640 -1 osd.5 0 waiting for initial osdmap 2024-05-27T12:32:27.315 INFO:tasks.ceph.osd.5.smithi072.stderr:2024-05-27T12:32:27.317+0000 7f79aca79640 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-27T12:32:27.330 INFO:tasks.ceph.osd.6.smithi072.stderr:2024-05-27T12:32:27.332+0000 7ffab788f640 -1 osd.6 0 waiting for initial osdmap 2024-05-27T12:32:27.344 INFO:tasks.ceph.osd.6.smithi072.stderr:2024-05-27T12:32:27.346+0000 7ffaaee9b640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-27T12:32:27.350 INFO:tasks.ceph.osd.4.smithi072.stderr:2024-05-27T12:32:27.352+0000 7f2c7b451640 -1 osd.4 0 waiting for initial osdmap 2024-05-27T12:32:27.351 INFO:tasks.ceph.osd.7.smithi072.stderr:2024-05-27T12:32:27.352+0000 7f5ff669d640 -1 osd.7 0 waiting for initial osdmap 2024-05-27T12:32:27.366 DEBUG:teuthology.orchestra.run.smithi055:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-27T12:32:27.367 INFO:tasks.ceph.osd.7.smithi072.stderr:2024-05-27T12:32:27.368+0000 7f5fee4bd640 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-27T12:32:27.367 INFO:tasks.ceph.osd.4.smithi072.stderr:2024-05-27T12:32:27.369+0000 7f2c73271640 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-27T12:32:27.462 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:27.462+0000 7f9f63af6640 1 Processor -- start 2024-05-27T12:32:27.462 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:27.463+0000 7f9f63af6640 1 -- start start 2024-05-27T12:32:27.463 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:27.463+0000 7f9f63af6640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9f5c15ea30 0x7f9f5c0ba3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:27.463 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:27.463+0000 7f9f63af6640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9f5c0d1080 0x7f9f5c0cf5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:27.463 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:27.463+0000 7f9f63af6640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f5c0d18f0 con 0x7f9f5c0cfae0 2024-05-27T12:32:27.463 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:27.463+0000 7f9f63af6640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f9f5c0d2d40 con 0x7f9f5c15ea30 2024-05-27T12:32:27.463 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:27.463+0000 7f9f63af6640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f9f5c0d1bd0 con 0x7f9f5c0d1080 2024-05-27T12:32:27.463 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:27.464+0000 7f9f61091640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9f5c0d1080 0x7f9f5c0cf5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:27.463 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:27.464+0000 7f9f61892640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9f5c15ea30 0x7f9f5c0ba3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:27.463 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:27.464+0000 7f9f61892640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9f5c15ea30 0x7f9f5c0ba3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.55:47616/0 (socket says 172.21.15.55:47616) 2024-05-27T12:32:27.463 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:27.464+0000 7f9f62093640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f9f5c0cfae0 0x7f9f5c1625b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.55:43672/0 (socket says 172.21.15.55:43672) 2024-05-27T12:32:27.463 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:27.464+0000 7f9f61892640 1 -- 172.21.15.55:0/3326950092 learned_addr learned my addr 172.21.15.55:0/3326950092 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:32:27.464 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:27.464+0000 7f9f61091640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9f5c0d1080 0x7f9f5c0cf5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.55:56528/0 (socket says 172.21.15.55:56528) 2024-05-27T12:32:27.465 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:27.464+0000 7f9f61892640 1 -- 172.21.15.55:0/3326950092 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9f5c0d1080 msgr2=0x7f9f5c0cf5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:32:27.465 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:27.464+0000 7f9f61892640 1 --2- 172.21.15.55:0/3326950092 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9f5c0d1080 0x7f9f5c0cf5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:27.465 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:27.464+0000 7f9f61892640 1 -- 172.21.15.55:0/3326950092 >> v1:172.21.15.72:6789/0 conn(0x7f9f5c0cfae0 legacy=0x7f9f5c1625b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:27.465 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:27.464+0000 7f9f60890640 1 -- 172.21.15.55:0/3326950092 <== mon.1 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3380675226 0 0) 0x7f9f5c0d18f0 con 0x7f9f5c0cfae0 2024-05-27T12:32:27.466 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:27.464+0000 7f9f61892640 1 -- 172.21.15.55:0/3326950092 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f5c0d1eb0 con 0x7f9f5c15ea30 2024-05-27T12:32:27.466 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:27.464+0000 7f9f61091640 1 --2- 172.21.15.55:0/3326950092 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9f5c0d1080 0x7f9f5c0cf5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T12:32:27.466 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:27.465+0000 7f9f61892640 1 --2- 172.21.15.55:0/3326950092 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f5c15ea30 0x7f9f5c0ba3f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9f58009870 tx=0x7f9f5802a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5e12f4e5e4cde394 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:27.466 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:27.465+0000 7f9f60890640 1 -- 172.21.15.55:0/3326950092 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f58037070 con 0x7f9f5c15ea30 2024-05-27T12:32:27.466 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:27.465+0000 7f9f60890640 1 -- 172.21.15.55:0/3326950092 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f58032440 con 0x7f9f5c15ea30 2024-05-27T12:32:27.466 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:27.465+0000 7f9f60890640 1 -- 172.21.15.55:0/3326950092 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f58032810 con 0x7f9f5c15ea30 2024-05-27T12:32:27.466 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:27.465+0000 7f9f63af6640 1 -- 172.21.15.55:0/3326950092 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f5c15ea30 msgr2=0x7f9f5c0ba3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:27.466 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:27.465+0000 7f9f63af6640 1 --2- 172.21.15.55:0/3326950092 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f5c15ea30 0x7f9f5c0ba3f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9f58009870 tx=0x7f9f5802a270 comp rx=0 tx=0).stop 2024-05-27T12:32:27.466 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:27.466+0000 7f9f63af6640 1 -- 172.21.15.55:0/3326950092 shutdown_connections 2024-05-27T12:32:27.466 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:27.466+0000 7f9f63af6640 1 --2- 172.21.15.55:0/3326950092 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9f5c0d1080 0x7f9f5c0cf5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:27.466 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:27.466+0000 7f9f63af6640 1 --2- 172.21.15.55:0/3326950092 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f5c15ea30 0x7f9f5c0ba3f0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:27.466 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:27.466+0000 7f9f63af6640 1 -- 172.21.15.55:0/3326950092 >> 172.21.15.55:0/3326950092 conn(0x7f9f5c06cb50 msgr2=0x7f9f5c06cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:27.466 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:27.466+0000 7f9f63af6640 1 -- 172.21.15.55:0/3326950092 shutdown_connections 2024-05-27T12:32:27.467 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:27.466+0000 7f9f63af6640 1 -- 172.21.15.55:0/3326950092 wait complete. 2024-05-27T12:32:27.468 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:27.467+0000 7f9f63af6640 1 Processor -- start 2024-05-27T12:32:27.469 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:27.467+0000 7f9f63af6640 1 -- start start 2024-05-27T12:32:27.469 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:27.468+0000 7f9f63af6640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9f5c0cfae0 0x7f9f5c0c9940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:27.469 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:27.468+0000 7f9f63af6640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9f5c0d1080 0x7f9f5c0cdb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:27.469 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:27.468+0000 7f9f63af6640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f5c15ea30 0x7f9f5c0ce040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:27.469 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:27.468+0000 7f9f63af6640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f9f5c0d1680 con 0x7f9f5c0d1080 2024-05-27T12:32:27.469 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:27.468+0000 7f9f63af6640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f9f5c0d1500 con 0x7f9f5c15ea30 2024-05-27T12:32:27.469 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:27.468+0000 7f9f63af6640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f9f5c0d41e0 con 0x7f9f5c0cfae0 2024-05-27T12:32:27.469 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:27.468+0000 7f9f61091640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9f5c0d1080 0x7f9f5c0cdb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:27.469 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:27.468+0000 7f9f61091640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9f5c0d1080 0x7f9f5c0cdb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56982/0 (socket says 172.21.15.55:56982) 2024-05-27T12:32:27.469 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:27.468+0000 7f9f61091640 1 -- 172.21.15.55:0/2707685539 learned_addr learned my addr 172.21.15.55:0/2707685539 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:32:27.469 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:27.468+0000 7f9f61892640 1 --2- 172.21.15.55:0/2707685539 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9f5c0cfae0 0x7f9f5c0c9940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:27.469 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:27.468+0000 7f9f62093640 1 --2- 172.21.15.55:0/2707685539 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f5c15ea30 0x7f9f5c0ce040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:27.470 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:27.468+0000 7f9f61091640 1 -- 172.21.15.55:0/2707685539 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9f5c0cfae0 msgr2=0x7f9f5c0c9940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:27.470 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:27.468+0000 7f9f61091640 1 --2- 172.21.15.55:0/2707685539 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9f5c0cfae0 0x7f9f5c0c9940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:27.470 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:27.468+0000 7f9f61091640 1 -- 172.21.15.55:0/2707685539 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f5c15ea30 msgr2=0x7f9f5c0ce040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:27.470 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:27.468+0000 7f9f61091640 1 --2- 172.21.15.55:0/2707685539 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f5c15ea30 0x7f9f5c0ce040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:27.470 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:27.468+0000 7f9f61091640 1 -- 172.21.15.55:0/2707685539 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f5c0c88a0 con 0x7f9f5c0d1080 2024-05-27T12:32:27.470 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:27.468+0000 7f9f62093640 1 --2- 172.21.15.55:0/2707685539 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f5c15ea30 0x7f9f5c0ce040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T12:32:27.470 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:27.468+0000 7f9f61091640 1 --2- 172.21.15.55:0/2707685539 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9f5c0d1080 0x7f9f5c0cdb00 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f9f4c00ebe0 tx=0x7f9f4c00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:27.470 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:27.468+0000 7f9f527fc640 1 -- 172.21.15.55:0/2707685539 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f4c00cc30 con 0x7f9f5c0d1080 2024-05-27T12:32:27.470 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:27.468+0000 7f9f527fc640 1 -- 172.21.15.55:0/2707685539 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f4c00cdd0 con 0x7f9f5c0d1080 2024-05-27T12:32:27.470 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:27.468+0000 7f9f63af6640 1 -- 172.21.15.55:0/2707685539 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f5c0c8b80 con 0x7f9f5c0d1080 2024-05-27T12:32:27.470 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:27.468+0000 7f9f527fc640 1 -- 172.21.15.55:0/2707685539 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f4c005bb0 con 0x7f9f5c0d1080 2024-05-27T12:32:27.470 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:27.469+0000 7f9f63af6640 1 -- 172.21.15.55:0/2707685539 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f5c0c9140 con 0x7f9f5c0d1080 2024-05-27T12:32:27.471 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:27.469+0000 7f9f63af6640 1 -- 172.21.15.55:0/2707685539 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f5c04fce0 con 0x7f9f5c0d1080 2024-05-27T12:32:27.471 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:27.470+0000 7f9f527fc640 1 -- 172.21.15.55:0/2707685539 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 4) ==== 90984+0+0 (secure 0 0 0) 0x7f9f4c006030 con 0x7f9f5c0d1080 2024-05-27T12:32:27.471 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:27.470+0000 7f9f527fc640 1 --2- 172.21.15.55:0/2707685539 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f9f4006c860 0x7f9f4006ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:27.472 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:27.471+0000 7f9f527fc640 1 -- 172.21.15.55:0/2707685539 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2511+0+0 (secure 0 0 0) 0x7f9f4c08b3a0 con 0x7f9f5c0d1080 2024-05-27T12:32:27.472 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:27.471+0000 7f9f61892640 1 --2- 172.21.15.55:0/2707685539 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f9f4006c860 0x7f9f4006ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:27.472 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:27.471+0000 7f9f61892640 1 --2- 172.21.15.55:0/2707685539 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f9f4006c860 0x7f9f4006ed20 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f9f58034000 tx=0x7f9f5802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:27.474 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:27.475+0000 7f9f527fc640 1 -- 172.21.15.55:0/2707685539 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9f4c017020 con 0x7f9f5c0d1080 2024-05-27T12:32:27.664 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:27.665+0000 7f9f63af6640 1 -- 172.21.15.55:0/2707685539 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9f5c06bb10 con 0x7f9f5c0d1080 2024-05-27T12:32:27.665 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:27.666+0000 7f9f527fc640 1 -- 172.21.15.55:0/2707685539 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) ==== 74+0+7543 (secure 0 0 0) 0x7f9f4c05a490 con 0x7f9f5c0d1080 2024-05-27T12:32:27.665 INFO:teuthology.misc.health.smithi055.stdout: 2024-05-27T12:32:27.665 INFO:teuthology.misc.health.smithi055.stdout:{"epoch":14,"fsid":"c3ff4e3b-8dae-4856-9593-e5cc66c59982","created":"2024-05-27T12:32:17.019097+0000","modified":"2024-05-27T12:32:26.332149+0000","last_up_change":"2024-05-27T12:32:26.332149+0000","last_in_change":"2024-05-27T12:32:19.309872+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"e607b598-061b-4b6f-92ff-95c20b330599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":807572567},{"type":"v1","addr":"172.21.15.55:6801","nonce":807572567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":807572567},{"type":"v1","addr":"172.21.15.55:6803","nonce":807572567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":807572567},{"type":"v1","addr":"172.21.15.55:6807","nonce":807572567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":807572567},{"type":"v1","addr":"172.21.15.55:6805","nonce":807572567}]},"public_addr":"172.21.15.55:6801/807572567","cluster_addr":"172.21.15.55:6803/807572567","heartbeat_back_addr":"172.21.15.55:6807/807572567","heartbeat_front_addr":"172.21.15.55:6805/807572567","state":["exists","up"]},{"osd":1,"uuid":"ba2b5b1d-71a9-4ecc-9a48-55aa7fe54261","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"e6b81cc6-4ff1-45d0-87eb-9f04ccf986a3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"b6a34b75-807d-4693-b1c3-903cb4c618d9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"272ec937-56b4-4f0a-b2e1-b0bc189c9d79","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"56439854-72a0-4ef4-81ff-184a3d924a5d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"e248e2be-3b6e-49cf-8c8a-1a4152827582","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"505a62d3-322b-4629-b4fd-187a55563709","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-27T12:32:27.668 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:27.668+0000 7f9f63af6640 1 -- 172.21.15.55:0/2707685539 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f9f4006c860 msgr2=0x7f9f4006ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:27.668 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:27.668+0000 7f9f63af6640 1 --2- 172.21.15.55:0/2707685539 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f9f4006c860 0x7f9f4006ed20 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f9f58034000 tx=0x7f9f5802e000 comp rx=0 tx=0).stop 2024-05-27T12:32:27.668 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:27.668+0000 7f9f63af6640 1 -- 172.21.15.55:0/2707685539 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9f5c0d1080 msgr2=0x7f9f5c0cdb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:27.668 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:27.668+0000 7f9f63af6640 1 --2- 172.21.15.55:0/2707685539 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9f5c0d1080 0x7f9f5c0cdb00 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f9f4c00ebe0 tx=0x7f9f4c00c520 comp rx=0 tx=0).stop 2024-05-27T12:32:27.668 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:27.668+0000 7f9f63af6640 1 -- 172.21.15.55:0/2707685539 shutdown_connections 2024-05-27T12:32:27.668 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:27.668+0000 7f9f63af6640 1 --2- 172.21.15.55:0/2707685539 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f9f4006c860 0x7f9f4006ed20 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:27.668 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:27.668+0000 7f9f63af6640 1 --2- 172.21.15.55:0/2707685539 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f5c15ea30 0x7f9f5c0ce040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:27.668 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:27.668+0000 7f9f63af6640 1 --2- 172.21.15.55:0/2707685539 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9f5c0d1080 0x7f9f5c0cdb00 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:27.668 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:27.668+0000 7f9f63af6640 1 --2- 172.21.15.55:0/2707685539 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9f5c0cfae0 0x7f9f5c0c9940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:27.669 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:27.668+0000 7f9f63af6640 1 -- 172.21.15.55:0/2707685539 >> 172.21.15.55:0/2707685539 conn(0x7f9f5c06cb50 msgr2=0x7f9f5c159170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:27.669 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:27.668+0000 7f9f63af6640 1 -- 172.21.15.55:0/2707685539 shutdown_connections 2024-05-27T12:32:27.669 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:27.668+0000 7f9f63af6640 1 -- 172.21.15.55:0/2707685539 wait complete. 2024-05-27T12:32:27.677 DEBUG:teuthology.misc:1 of 8 OSDs are up 2024-05-27T12:32:34.485 DEBUG:teuthology.orchestra.run.smithi055:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-27T12:32:34.591 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:34.592+0000 7f3e216cf640 1 Processor -- start 2024-05-27T12:32:34.591 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:34.592+0000 7f3e216cf640 1 -- start start 2024-05-27T12:32:34.593 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:34.593+0000 7f3e216cf640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3e1c0ba3f0 0x7f3e1c0cf5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:34.593 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:34.593+0000 7f3e216cf640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3e1c0cfae0 0x7f3e1c0d31d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:34.593 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:34.593+0000 7f3e216cf640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e1c0d18f0 con 0x7f3e1c15ea30 2024-05-27T12:32:34.593 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:34.593+0000 7f3e216cf640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f3e1c0d2d40 con 0x7f3e1c0ba3f0 2024-05-27T12:32:34.593 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:34.593+0000 7f3e216cf640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f3e1c0d1bd0 con 0x7f3e1c0cfae0 2024-05-27T12:32:34.593 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:34.593+0000 7f3e1affd640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f3e1c15ea30 0x7f3e1c0d1080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:47904/0 (socket says 172.21.15.55:47904) 2024-05-27T12:32:34.593 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:34.593+0000 7f3e1affd640 1 -- 172.21.15.55:0/939898765 learned_addr learned my addr 172.21.15.55:0/939898765 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-27T12:32:34.593 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:34.593+0000 7f3e1a7fc640 1 --2- 172.21.15.55:0/939898765 >> v2:172.21.15.72:3300/0 conn(0x7f3e1c0ba3f0 0x7f3e1c0cf5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:34.593 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:34.593+0000 7f3e1b7fe640 1 --2- 172.21.15.55:0/939898765 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3e1c0cfae0 0x7f3e1c0d31d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:34.594 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:34.593+0000 7f3e19ffb640 1 -- 172.21.15.55:0/939898765 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 221388224 0 0) 0x7f3e1c0d18f0 con 0x7f3e1c15ea30 2024-05-27T12:32:34.594 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:34.593+0000 7f3e19ffb640 1 -- 172.21.15.55:0/939898765 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3e04003520 con 0x7f3e1c15ea30 2024-05-27T12:32:34.594 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:34.593+0000 7f3e1a7fc640 1 -- 172.21.15.55:0/939898765 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3e1c0cfae0 msgr2=0x7f3e1c0d31d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:32:34.594 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:34.593+0000 7f3e1a7fc640 1 --2- 172.21.15.55:0/939898765 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3e1c0cfae0 0x7f3e1c0d31d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:34.594 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:34.593+0000 7f3e1a7fc640 1 -- 172.21.15.55:0/939898765 >> v1:172.21.15.55:6789/0 conn(0x7f3e1c15ea30 legacy=0x7f3e1c0d1080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:34.594 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:34.594+0000 7f3e1a7fc640 1 -- 172.21.15.55:0/939898765 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e1c0d1eb0 con 0x7f3e1c0ba3f0 2024-05-27T12:32:34.595 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:34.594+0000 7f3e1a7fc640 1 --2- 172.21.15.55:0/939898765 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3e1c0ba3f0 0x7f3e1c0cf5a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3e10009790 tx=0x7f3e1002a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1dc3790ea1740b85 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:34.595 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:34.594+0000 7f3e19ffb640 1 -- 172.21.15.55:0/939898765 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e10037070 con 0x7f3e1c0ba3f0 2024-05-27T12:32:34.596 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:34.594+0000 7f3e19ffb640 1 -- 172.21.15.55:0/939898765 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e10032440 con 0x7f3e1c0ba3f0 2024-05-27T12:32:34.596 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:34.595+0000 7f3e19ffb640 1 -- 172.21.15.55:0/939898765 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e10032810 con 0x7f3e1c0ba3f0 2024-05-27T12:32:34.596 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:34.595+0000 7f3e216cf640 1 -- 172.21.15.55:0/939898765 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3e1c0ba3f0 msgr2=0x7f3e1c0cf5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:34.596 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:34.595+0000 7f3e216cf640 1 --2- 172.21.15.55:0/939898765 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3e1c0ba3f0 0x7f3e1c0cf5a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3e10009790 tx=0x7f3e1002a180 comp rx=0 tx=0).stop 2024-05-27T12:32:34.596 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:34.595+0000 7f3e216cf640 1 -- 172.21.15.55:0/939898765 shutdown_connections 2024-05-27T12:32:34.596 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:34.595+0000 7f3e216cf640 1 --2- 172.21.15.55:0/939898765 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3e1c0cfae0 0x7f3e1c0d31d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:34.596 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:34.595+0000 7f3e216cf640 1 --2- 172.21.15.55:0/939898765 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3e1c0ba3f0 0x7f3e1c0cf5a0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:34.596 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:34.595+0000 7f3e216cf640 1 -- 172.21.15.55:0/939898765 >> 172.21.15.55:0/939898765 conn(0x7f3e1c06cb50 msgr2=0x7f3e1c06cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:34.596 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:34.595+0000 7f3e216cf640 1 -- 172.21.15.55:0/939898765 shutdown_connections 2024-05-27T12:32:34.596 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:34.595+0000 7f3e216cf640 1 -- 172.21.15.55:0/939898765 wait complete. 2024-05-27T12:32:34.596 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:34.596+0000 7f3e216cf640 1 Processor -- start 2024-05-27T12:32:34.596 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:34.597+0000 7f3e216cf640 1 -- start start 2024-05-27T12:32:34.599 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:34.597+0000 7f3e216cf640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3e1c0ba3f0 0x7f3e1c152a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:34.599 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:34.597+0000 7f3e216cf640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3e1c0cfae0 0x7f3e1c15cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:34.599 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:34.597+0000 7f3e216cf640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3e1c15ea30 0x7f3e1c0cca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:34.599 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:34.597+0000 7f3e216cf640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f3e1c0d3890 con 0x7f3e1c15ea30 2024-05-27T12:32:34.599 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:34.597+0000 7f3e216cf640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f3e1c0d3710 con 0x7f3e1c0cfae0 2024-05-27T12:32:34.599 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:34.597+0000 7f3e216cf640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f3e1c0d3a10 con 0x7f3e1c0ba3f0 2024-05-27T12:32:34.599 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:34.597+0000 7f3e1b7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3e1c15ea30 0x7f3e1c0cca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:34.599 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:34.597+0000 7f3e1b7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3e1c15ea30 0x7f3e1c0cca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52082/0 (socket says 172.21.15.55:52082) 2024-05-27T12:32:34.599 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:34.597+0000 7f3e1b7fe640 1 -- 172.21.15.55:0/1341977320 learned_addr learned my addr 172.21.15.55:0/1341977320 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:32:34.599 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:34.598+0000 7f3e1a7fc640 1 --2- 172.21.15.55:0/1341977320 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3e1c0cfae0 0x7f3e1c15cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:34.600 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:34.598+0000 7f3e1affd640 1 --2- 172.21.15.55:0/1341977320 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3e1c0ba3f0 0x7f3e1c152a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:34.600 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:34.598+0000 7f3e1b7fe640 1 -- 172.21.15.55:0/1341977320 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3e1c0ba3f0 msgr2=0x7f3e1c152a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:34.600 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:34.598+0000 7f3e1b7fe640 1 --2- 172.21.15.55:0/1341977320 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3e1c0ba3f0 0x7f3e1c152a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:34.600 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:34.598+0000 7f3e1b7fe640 1 -- 172.21.15.55:0/1341977320 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3e1c0cfae0 msgr2=0x7f3e1c15cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:34.600 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:34.598+0000 7f3e1b7fe640 1 --2- 172.21.15.55:0/1341977320 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3e1c0cfae0 0x7f3e1c15cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:34.600 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:34.598+0000 7f3e1b7fe640 1 -- 172.21.15.55:0/1341977320 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e1c153ab0 con 0x7f3e1c15ea30 2024-05-27T12:32:34.600 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:34.598+0000 7f3e1a7fc640 1 --2- 172.21.15.55:0/1341977320 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3e1c0cfae0 0x7f3e1c15cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T12:32:34.600 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:34.598+0000 7f3e1b7fe640 1 --2- 172.21.15.55:0/1341977320 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3e1c15ea30 0x7f3e1c0cca20 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f3e1400e890 tx=0x7f3e1400ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:34.600 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:34.598+0000 7f3e037fe640 1 -- 172.21.15.55:0/1341977320 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e14017070 con 0x7f3e1c15ea30 2024-05-27T12:32:34.600 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:34.598+0000 7f3e037fe640 1 -- 172.21.15.55:0/1341977320 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e1400c8e0 con 0x7f3e1c15ea30 2024-05-27T12:32:34.601 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:34.598+0000 7f3e037fe640 1 -- 172.21.15.55:0/1341977320 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e1400ccd0 con 0x7f3e1c15ea30 2024-05-27T12:32:34.601 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:34.598+0000 7f3e216cf640 1 -- 172.21.15.55:0/1341977320 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e1c153d90 con 0x7f3e1c15ea30 2024-05-27T12:32:34.601 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:34.598+0000 7f3e216cf640 1 -- 172.21.15.55:0/1341977320 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e1c154350 con 0x7f3e1c15ea30 2024-05-27T12:32:34.601 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:34.599+0000 7f3e216cf640 1 -- 172.21.15.55:0/1341977320 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e1c04fce0 con 0x7f3e1c15ea30 2024-05-27T12:32:34.601 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:34.600+0000 7f3e037fe640 1 -- 172.21.15.55:0/1341977320 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3e1401a070 con 0x7f3e1c15ea30 2024-05-27T12:32:34.601 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:34.600+0000 7f3e037fe640 1 --2- 172.21.15.55:0/1341977320 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f3e0806c8f0 0x7f3e0806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:34.602 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:34.600+0000 7f3e037fe640 1 -- 172.21.15.55:0/1341977320 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7f3e1408ba60 con 0x7f3e1c15ea30 2024-05-27T12:32:34.602 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:34.601+0000 7f3e1affd640 1 --2- 172.21.15.55:0/1341977320 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f3e0806c8f0 0x7f3e0806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:34.602 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:34.601+0000 7f3e1affd640 1 --2- 172.21.15.55:0/1341977320 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f3e0806c8f0 0x7f3e0806edb0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c005c00 tx=0x7f3e0c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:34.604 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:34.605+0000 7f3e037fe640 1 -- 172.21.15.55:0/1341977320 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3e1405a270 con 0x7f3e1c15ea30 2024-05-27T12:32:34.790 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:34.791+0000 7f3e216cf640 1 -- 172.21.15.55:0/1341977320 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3e1c159ba0 con 0x7f3e1c15ea30 2024-05-27T12:32:34.791 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:34.792+0000 7f3e037fe640 1 -- 172.21.15.55:0/1341977320 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+12836 (secure 0 0 0) 0x7f3e14059b70 con 0x7f3e1c15ea30 2024-05-27T12:32:34.791 INFO:teuthology.misc.health.smithi055.stdout: 2024-05-27T12:32:34.791 INFO:teuthology.misc.health.smithi055.stdout:{"epoch":19,"fsid":"c3ff4e3b-8dae-4856-9593-e5cc66c59982","created":"2024-05-27T12:32:17.019097+0000","modified":"2024-05-27T12:32:32.154866+0000","last_up_change":"2024-05-27T12:32:28.109744+0000","last_in_change":"2024-05-27T12:32:19.309872+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-27T12:32:29.277895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e607b598-061b-4b6f-92ff-95c20b330599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":807572567},{"type":"v1","addr":"172.21.15.55:6801","nonce":807572567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":807572567},{"type":"v1","addr":"172.21.15.55:6803","nonce":807572567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":807572567},{"type":"v1","addr":"172.21.15.55:6807","nonce":807572567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":807572567},{"type":"v1","addr":"172.21.15.55:6805","nonce":807572567}]},"public_addr":"172.21.15.55:6801/807572567","cluster_addr":"172.21.15.55:6803/807572567","heartbeat_back_addr":"172.21.15.55:6807/807572567","heartbeat_front_addr":"172.21.15.55:6805/807572567","state":["exists","up"]},{"osd":1,"uuid":"ba2b5b1d-71a9-4ecc-9a48-55aa7fe54261","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":3426897300},{"type":"v1","addr":"172.21.15.55:6825","nonce":3426897300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":3426897300},{"type":"v1","addr":"172.21.15.55:6827","nonce":3426897300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":3426897300},{"type":"v1","addr":"172.21.15.55:6831","nonce":3426897300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":3426897300},{"type":"v1","addr":"172.21.15.55:6829","nonce":3426897300}]},"public_addr":"172.21.15.55:6825/3426897300","cluster_addr":"172.21.15.55:6827/3426897300","heartbeat_back_addr":"172.21.15.55:6831/3426897300","heartbeat_front_addr":"172.21.15.55:6829/3426897300","state":["exists","up"]},{"osd":2,"uuid":"e6b81cc6-4ff1-45d0-87eb-9f04ccf986a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3510271725},{"type":"v1","addr":"172.21.15.55:6809","nonce":3510271725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3510271725},{"type":"v1","addr":"172.21.15.55:6811","nonce":3510271725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3510271725},{"type":"v1","addr":"172.21.15.55:6815","nonce":3510271725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3510271725},{"type":"v1","addr":"172.21.15.55:6813","nonce":3510271725}]},"public_addr":"172.21.15.55:6809/3510271725","cluster_addr":"172.21.15.55:6811/3510271725","heartbeat_back_addr":"172.21.15.55:6815/3510271725","heartbeat_front_addr":"172.21.15.55:6813/3510271725","state":["exists","up"]},{"osd":3,"uuid":"b6a34b75-807d-4693-b1c3-903cb4c618d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":1066693520},{"type":"v1","addr":"172.21.15.55:6817","nonce":1066693520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":1066693520},{"type":"v1","addr":"172.21.15.55:6819","nonce":1066693520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":1066693520},{"type":"v1","addr":"172.21.15.55:6823","nonce":1066693520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":1066693520},{"type":"v1","addr":"172.21.15.55:6821","nonce":1066693520}]},"public_addr":"172.21.15.55:6817/1066693520","cluster_addr":"172.21.15.55:6819/1066693520","heartbeat_back_addr":"172.21.15.55:6823/1066693520","heartbeat_front_addr":"172.21.15.55:6821/1066693520","state":["exists","up"]},{"osd":4,"uuid":"272ec937-56b4-4f0a-b2e1-b0bc189c9d79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":4190771237},{"type":"v1","addr":"172.21.15.72:6820","nonce":4190771237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":4190771237},{"type":"v1","addr":"172.21.15.72:6824","nonce":4190771237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":4190771237},{"type":"v1","addr":"172.21.15.72:6831","nonce":4190771237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":4190771237},{"type":"v1","addr":"172.21.15.72:6828","nonce":4190771237}]},"public_addr":"172.21.15.72:6820/4190771237","cluster_addr":"172.21.15.72:6824/4190771237","heartbeat_back_addr":"172.21.15.72:6831/4190771237","heartbeat_front_addr":"172.21.15.72:6828/4190771237","state":["exists","up"]},{"osd":5,"uuid":"56439854-72a0-4ef4-81ff-184a3d924a5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":2421889184},{"type":"v1","addr":"172.21.15.72:6801","nonce":2421889184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6803","nonce":2421889184},{"type":"v1","addr":"172.21.15.72:6805","nonce":2421889184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":2421889184},{"type":"v1","addr":"172.21.15.72:6813","nonce":2421889184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6807","nonce":2421889184},{"type":"v1","addr":"172.21.15.72:6809","nonce":2421889184}]},"public_addr":"172.21.15.72:6801/2421889184","cluster_addr":"172.21.15.72:6805/2421889184","heartbeat_back_addr":"172.21.15.72:6813/2421889184","heartbeat_front_addr":"172.21.15.72:6809/2421889184","state":["exists","up"]},{"osd":6,"uuid":"e248e2be-3b6e-49cf-8c8a-1a4152827582","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3796994599},{"type":"v1","addr":"172.21.15.72:6804","nonce":3796994599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":3796994599},{"type":"v1","addr":"172.21.15.72:6808","nonce":3796994599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":3796994599},{"type":"v1","addr":"172.21.15.72:6815","nonce":3796994599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":3796994599},{"type":"v1","addr":"172.21.15.72:6812","nonce":3796994599}]},"public_addr":"172.21.15.72:6804/3796994599","cluster_addr":"172.21.15.72:6808/3796994599","heartbeat_back_addr":"172.21.15.72:6815/3796994599","heartbeat_front_addr":"172.21.15.72:6812/3796994599","state":["exists","up"]},{"osd":7,"uuid":"505a62d3-322b-4629-b4fd-187a55563709","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":3024877895},{"type":"v1","addr":"172.21.15.72:6817","nonce":3024877895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":3024877895},{"type":"v1","addr":"172.21.15.72:6821","nonce":3024877895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6827","nonce":3024877895},{"type":"v1","addr":"172.21.15.72:6829","nonce":3024877895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6823","nonce":3024877895},{"type":"v1","addr":"172.21.15.72:6825","nonce":3024877895}]},"public_addr":"172.21.15.72:6817/3024877895","cluster_addr":"172.21.15.72:6821/3024877895","heartbeat_back_addr":"172.21.15.72:6829/3024877895","heartbeat_front_addr":"172.21.15.72:6825/3024877895","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.241014+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.450799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.465018+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.507647+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.534763+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.495895+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.427110+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.547466+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-27T12:32:34.793 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:34.794+0000 7f3e216cf640 1 -- 172.21.15.55:0/1341977320 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f3e0806c8f0 msgr2=0x7f3e0806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:34.793 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:34.794+0000 7f3e216cf640 1 --2- 172.21.15.55:0/1341977320 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f3e0806c8f0 0x7f3e0806edb0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c005c00 tx=0x7f3e0c009040 comp rx=0 tx=0).stop 2024-05-27T12:32:34.793 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:34.794+0000 7f3e216cf640 1 -- 172.21.15.55:0/1341977320 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3e1c15ea30 msgr2=0x7f3e1c0cca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:34.793 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:34.794+0000 7f3e216cf640 1 --2- 172.21.15.55:0/1341977320 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3e1c15ea30 0x7f3e1c0cca20 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f3e1400e890 tx=0x7f3e1400ed50 comp rx=0 tx=0).stop 2024-05-27T12:32:34.793 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:34.794+0000 7f3e216cf640 1 -- 172.21.15.55:0/1341977320 shutdown_connections 2024-05-27T12:32:34.793 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:34.794+0000 7f3e216cf640 1 --2- 172.21.15.55:0/1341977320 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3e1c15ea30 0x7f3e1c0cca20 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:34.793 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:34.794+0000 7f3e216cf640 1 --2- 172.21.15.55:0/1341977320 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f3e0806c8f0 0x7f3e0806edb0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:34.794 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:34.794+0000 7f3e216cf640 1 --2- 172.21.15.55:0/1341977320 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3e1c0cfae0 0x7f3e1c15cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:34.794 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:34.794+0000 7f3e216cf640 1 --2- 172.21.15.55:0/1341977320 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3e1c0ba3f0 0x7f3e1c152a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:34.794 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:34.794+0000 7f3e216cf640 1 -- 172.21.15.55:0/1341977320 >> 172.21.15.55:0/1341977320 conn(0x7f3e1c06cb50 msgr2=0x7f3e1c15d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:34.794 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:34.794+0000 7f3e216cf640 1 -- 172.21.15.55:0/1341977320 shutdown_connections 2024-05-27T12:32:34.794 INFO:teuthology.misc.health.smithi055.stderr:2024-05-27T12:32:34.794+0000 7f3e216cf640 1 -- 172.21.15.55:0/1341977320 wait complete. 2024-05-27T12:32:34.803 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-05-27T12:32:34.803 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-05-27T12:32:34.803 INFO:tasks.ceph.mds.a:Restarting daemon 2024-05-27T12:32:34.804 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-05-27T12:32:34.806 INFO:tasks.ceph.mds.a:Started 2024-05-27T12:32:34.806 INFO:tasks.ceph.mds.c:Restarting daemon 2024-05-27T12:32:34.806 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-05-27T12:32:34.808 INFO:tasks.ceph.mds.c:Started 2024-05-27T12:32:34.808 INFO:tasks.ceph.mds.b:Restarting daemon 2024-05-27T12:32:34.808 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-05-27T12:32:34.811 INFO:tasks.ceph.mds.b:Started 2024-05-27T12:32:34.812 INFO:tasks.ceph.mds.d:Restarting daemon 2024-05-27T12:32:34.812 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-05-27T12:32:34.814 INFO:tasks.ceph.mds.d:Started 2024-05-27T12:32:34.814 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-05-27T12:32:34.814 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-27T12:32:34.886 INFO:tasks.ceph.mds.a.smithi055.stdout:starting mds.a at 2024-05-27T12:32:34.886 INFO:tasks.ceph.mds.c.smithi055.stdout:starting mds.c at 2024-05-27T12:32:34.897 INFO:tasks.ceph.mds.b.smithi072.stdout:starting mds.b at 2024-05-27T12:32:34.897 INFO:tasks.ceph.mds.d.smithi072.stdout:starting mds.d at 2024-05-27T12:32:34.898 INFO:tasks.ceph.mds.d.smithi072.stderr:2024-05-27T12:32:34.898+0000 7f9beb0b9640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2024-05-27T12:32:34.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:34.922+0000 7f08e5108640 1 Processor -- start 2024-05-27T12:32:34.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:34.922+0000 7f08e5108640 1 -- start start 2024-05-27T12:32:34.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:34.923+0000 7f08e5108640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f08e015c960 0x7f08e015f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:34.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:34.923+0000 7f08e5108640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f08e00ba310 0x7f08e0162e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:34.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:34.923+0000 7f08e5108640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08e01601b0 con 0x7f08e015c580 2024-05-27T12:32:34.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:34.923+0000 7f08e5108640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f08e015f910 con 0x7f08e015c960 2024-05-27T12:32:34.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:34.923+0000 7f08e5108640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f08e015fbf0 con 0x7f08e00ba310 2024-05-27T12:32:34.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:34.923+0000 7f08d7fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f08e015c960 0x7f08e015f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:34.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:34.923+0000 7f08d7fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f08e015c960 0x7f08e015f1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52118/0 (socket says 172.21.15.55:52118) 2024-05-27T12:32:34.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:34.923+0000 7f08d7fff640 1 -- 172.21.15.55:0/3575783141 learned_addr learned my addr 172.21.15.55:0/3575783141 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:32:34.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:34.923+0000 7f08ded9d640 1 --1- 172.21.15.55:0/3575783141 >> v1:172.21.15.55:6789/0 conn(0x7f08e015c580 0x7f08e00d2c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:47922/0 (socket says 172.21.15.55:47922) 2024-05-27T12:32:34.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:34.923+0000 7f08df59e640 1 --2- 172.21.15.55:0/3575783141 >> v2:172.21.15.72:3300/0 conn(0x7f08e00ba310 0x7f08e0162e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:34.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:34.923+0000 7f08d7fff640 1 -- 172.21.15.55:0/3575783141 >> v2:172.21.15.72:3300/0 conn(0x7f08e00ba310 msgr2=0x7f08e0162e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:32:34.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:34.923+0000 7f08d7fff640 1 --2- 172.21.15.55:0/3575783141 >> v2:172.21.15.72:3300/0 conn(0x7f08e00ba310 0x7f08e0162e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:34.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:34.923+0000 7f08d7fff640 1 -- 172.21.15.55:0/3575783141 >> v1:172.21.15.55:6789/0 conn(0x7f08e015c580 legacy=0x7f08e00d2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:34.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:34.923+0000 7f08de59c640 1 -- 172.21.15.55:0/3575783141 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2125436657 0 0) 0x7f08e01601b0 con 0x7f08e015c580 2024-05-27T12:32:34.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:34.923+0000 7f08d7fff640 1 -- 172.21.15.55:0/3575783141 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08e015fed0 con 0x7f08e015c960 2024-05-27T12:32:34.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:34.923+0000 7f08df59e640 1 --2- 172.21.15.55:0/3575783141 >> v2:172.21.15.72:3300/0 conn(0x7f08e00ba310 0x7f08e0162e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T12:32:34.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:34.924+0000 7f08d7fff640 1 --2- 172.21.15.55:0/3575783141 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f08e015c960 0x7f08e015f1e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f08c8009870 tx=0x7f08c802a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64a0b39ad25da99f server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:34.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:34.924+0000 7f08de59c640 1 -- 172.21.15.55:0/3575783141 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08c8037070 con 0x7f08e015c960 2024-05-27T12:32:34.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:34.924+0000 7f08de59c640 1 -- 172.21.15.55:0/3575783141 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08c8032440 con 0x7f08e015c960 2024-05-27T12:32:34.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:34.924+0000 7f08de59c640 1 -- 172.21.15.55:0/3575783141 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08c8032810 con 0x7f08e015c960 2024-05-27T12:32:34.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:34.925+0000 7f08e5108640 1 -- 172.21.15.55:0/3575783141 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f08e015c960 msgr2=0x7f08e015f1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:34.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:34.925+0000 7f08e5108640 1 --2- 172.21.15.55:0/3575783141 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f08e015c960 0x7f08e015f1e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f08c8009870 tx=0x7f08c802a2a0 comp rx=0 tx=0).stop 2024-05-27T12:32:34.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:34.925+0000 7f08e5108640 1 -- 172.21.15.55:0/3575783141 shutdown_connections 2024-05-27T12:32:34.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:34.925+0000 7f08e5108640 1 --2- 172.21.15.55:0/3575783141 >> v2:172.21.15.72:3300/0 conn(0x7f08e00ba310 0x7f08e0162e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:34.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:34.925+0000 7f08e5108640 1 --2- 172.21.15.55:0/3575783141 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f08e015c960 0x7f08e015f1e0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:34.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:34.925+0000 7f08e5108640 1 -- 172.21.15.55:0/3575783141 >> 172.21.15.55:0/3575783141 conn(0x7f08e0067a50 msgr2=0x7f08e0067e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:34.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:34.925+0000 7f08e5108640 1 -- 172.21.15.55:0/3575783141 shutdown_connections 2024-05-27T12:32:34.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:34.925+0000 7f08e5108640 1 -- 172.21.15.55:0/3575783141 wait complete. 2024-05-27T12:32:34.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:34.926+0000 7f08e5108640 1 Processor -- start 2024-05-27T12:32:34.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:34.926+0000 7f08e5108640 1 -- start start 2024-05-27T12:32:34.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:34.927+0000 7f08e5108640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f08e00ba310 0x7f08e00ca830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:34.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:34.927+0000 7f08e5108640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f08e015c580 0x7f08e0147b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:34.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:34.927+0000 7f08e5108640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f08e015c960 0x7f08e00b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:34.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:34.927+0000 7f08e5108640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f08e00d3310 con 0x7f08e015c960 2024-05-27T12:32:34.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:34.927+0000 7f08e5108640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f08e00ba780 con 0x7f08e015c580 2024-05-27T12:32:34.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:34.927+0000 7f08e5108640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f08e0163340 con 0x7f08e00ba310 2024-05-27T12:32:34.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:34.927+0000 7f08df59e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f08e015c960 0x7f08e00b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:34.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:34.927+0000 7f08df59e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f08e015c960 0x7f08e00b8aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52132/0 (socket says 172.21.15.55:52132) 2024-05-27T12:32:34.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:34.927+0000 7f08df59e640 1 -- 172.21.15.55:0/569486414 learned_addr learned my addr 172.21.15.55:0/569486414 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:32:34.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:34.927+0000 7f08d7fff640 1 --2- 172.21.15.55:0/569486414 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f08e015c580 0x7f08e0147b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:34.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:34.927+0000 7f08ded9d640 1 --2- 172.21.15.55:0/569486414 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f08e00ba310 0x7f08e00ca830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:34.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:34.927+0000 7f08df59e640 1 -- 172.21.15.55:0/569486414 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f08e00ba310 msgr2=0x7f08e00ca830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:34.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:34.927+0000 7f08df59e640 1 --2- 172.21.15.55:0/569486414 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f08e00ba310 0x7f08e00ca830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:34.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:34.927+0000 7f08df59e640 1 -- 172.21.15.55:0/569486414 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f08e015c580 msgr2=0x7f08e0147b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:34.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:34.927+0000 7f08df59e640 1 --2- 172.21.15.55:0/569486414 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f08e015c580 0x7f08e0147b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:34.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:34.927+0000 7f08df59e640 1 -- 172.21.15.55:0/569486414 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08e0148610 con 0x7f08e015c960 2024-05-27T12:32:34.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:34.928+0000 7f08df59e640 1 --2- 172.21.15.55:0/569486414 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f08e015c960 0x7f08e00b8aa0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f08d8009fa0 tx=0x7f08d800d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:34.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:34.928+0000 7f08d77fe640 1 -- 172.21.15.55:0/569486414 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08d801a070 con 0x7f08e015c960 2024-05-27T12:32:34.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:34.928+0000 7f08d77fe640 1 -- 172.21.15.55:0/569486414 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08d8003bb0 con 0x7f08e015c960 2024-05-27T12:32:34.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:34.928+0000 7f08e5108640 1 -- 172.21.15.55:0/569486414 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08e01488f0 con 0x7f08e015c960 2024-05-27T12:32:34.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:34.928+0000 7f08d77fe640 1 -- 172.21.15.55:0/569486414 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08d8004030 con 0x7f08e015c960 2024-05-27T12:32:34.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:34.928+0000 7f08e5108640 1 -- 172.21.15.55:0/569486414 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08e0159370 con 0x7f08e015c960 2024-05-27T12:32:34.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:34.929+0000 7f08e5108640 1 -- 172.21.15.55:0/569486414 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08e0148ac0 con 0x7f08e015c960 2024-05-27T12:32:34.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:34.929+0000 7f08d77fe640 1 -- 172.21.15.55:0/569486414 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f08d801d070 con 0x7f08e015c960 2024-05-27T12:32:34.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:34.930+0000 7f08d77fe640 1 --2- 172.21.15.55:0/569486414 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f08c006c8f0 0x7f08c006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:34.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:34.930+0000 7f08d77fe640 1 -- 172.21.15.55:0/569486414 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7f08d808ba90 con 0x7f08e015c960 2024-05-27T12:32:34.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:34.930+0000 7f08ded9d640 1 --2- 172.21.15.55:0/569486414 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f08c006c8f0 0x7f08c006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:34.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:34.930+0000 7f08ded9d640 1 --2- 172.21.15.55:0/569486414 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f08c006c8f0 0x7f08c006edb0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f08d0000f60 tx=0x7f08d0007d50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:34.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:34.934+0000 7f08d77fe640 1 -- 172.21.15.55:0/569486414 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f08d8010070 con 0x7f08e015c960 2024-05-27T12:32:35.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.120+0000 7f08e5108640 1 -- 172.21.15.55:0/569486414 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f08e0075460 con 0x7f08e015c960 2024-05-27T12:32:35.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.121+0000 7f08d77fe640 1 -- 172.21.15.55:0/569486414 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+12836 (secure 0 0 0) 0x7f08d8059bc0 con 0x7f08e015c960 2024-05-27T12:32:35.120 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-27T12:32:35.120 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":19,"fsid":"c3ff4e3b-8dae-4856-9593-e5cc66c59982","created":"2024-05-27T12:32:17.019097+0000","modified":"2024-05-27T12:32:32.154866+0000","last_up_change":"2024-05-27T12:32:28.109744+0000","last_in_change":"2024-05-27T12:32:19.309872+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-27T12:32:29.277895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e607b598-061b-4b6f-92ff-95c20b330599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":807572567},{"type":"v1","addr":"172.21.15.55:6801","nonce":807572567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":807572567},{"type":"v1","addr":"172.21.15.55:6803","nonce":807572567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":807572567},{"type":"v1","addr":"172.21.15.55:6807","nonce":807572567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":807572567},{"type":"v1","addr":"172.21.15.55:6805","nonce":807572567}]},"public_addr":"172.21.15.55:6801/807572567","cluster_addr":"172.21.15.55:6803/807572567","heartbeat_back_addr":"172.21.15.55:6807/807572567","heartbeat_front_addr":"172.21.15.55:6805/807572567","state":["exists","up"]},{"osd":1,"uuid":"ba2b5b1d-71a9-4ecc-9a48-55aa7fe54261","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":3426897300},{"type":"v1","addr":"172.21.15.55:6825","nonce":3426897300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":3426897300},{"type":"v1","addr":"172.21.15.55:6827","nonce":3426897300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":3426897300},{"type":"v1","addr":"172.21.15.55:6831","nonce":3426897300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":3426897300},{"type":"v1","addr":"172.21.15.55:6829","nonce":3426897300}]},"public_addr":"172.21.15.55:6825/3426897300","cluster_addr":"172.21.15.55:6827/3426897300","heartbeat_back_addr":"172.21.15.55:6831/3426897300","heartbeat_front_addr":"172.21.15.55:6829/3426897300","state":["exists","up"]},{"osd":2,"uuid":"e6b81cc6-4ff1-45d0-87eb-9f04ccf986a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3510271725},{"type":"v1","addr":"172.21.15.55:6809","nonce":3510271725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3510271725},{"type":"v1","addr":"172.21.15.55:6811","nonce":3510271725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3510271725},{"type":"v1","addr":"172.21.15.55:6815","nonce":3510271725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3510271725},{"type":"v1","addr":"172.21.15.55:6813","nonce":3510271725}]},"public_addr":"172.21.15.55:6809/3510271725","cluster_addr":"172.21.15.55:6811/3510271725","heartbeat_back_addr":"172.21.15.55:6815/3510271725","heartbeat_front_addr":"172.21.15.55:6813/3510271725","state":["exists","up"]},{"osd":3,"uuid":"b6a34b75-807d-4693-b1c3-903cb4c618d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":1066693520},{"type":"v1","addr":"172.21.15.55:6817","nonce":1066693520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":1066693520},{"type":"v1","addr":"172.21.15.55:6819","nonce":1066693520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":1066693520},{"type":"v1","addr":"172.21.15.55:6823","nonce":1066693520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":1066693520},{"type":"v1","addr":"172.21.15.55:6821","nonce":1066693520}]},"public_addr":"172.21.15.55:6817/1066693520","cluster_addr":"172.21.15.55:6819/1066693520","heartbeat_back_addr":"172.21.15.55:6823/1066693520","heartbeat_front_addr":"172.21.15.55:6821/1066693520","state":["exists","up"]},{"osd":4,"uuid":"272ec937-56b4-4f0a-b2e1-b0bc189c9d79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":4190771237},{"type":"v1","addr":"172.21.15.72:6820","nonce":4190771237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":4190771237},{"type":"v1","addr":"172.21.15.72:6824","nonce":4190771237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":4190771237},{"type":"v1","addr":"172.21.15.72:6831","nonce":4190771237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":4190771237},{"type":"v1","addr":"172.21.15.72:6828","nonce":4190771237}]},"public_addr":"172.21.15.72:6820/4190771237","cluster_addr":"172.21.15.72:6824/4190771237","heartbeat_back_addr":"172.21.15.72:6831/4190771237","heartbeat_front_addr":"172.21.15.72:6828/4190771237","state":["exists","up"]},{"osd":5,"uuid":"56439854-72a0-4ef4-81ff-184a3d924a5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":2421889184},{"type":"v1","addr":"172.21.15.72:6801","nonce":2421889184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6803","nonce":2421889184},{"type":"v1","addr":"172.21.15.72:6805","nonce":2421889184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":2421889184},{"type":"v1","addr":"172.21.15.72:6813","nonce":2421889184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6807","nonce":2421889184},{"type":"v1","addr":"172.21.15.72:6809","nonce":2421889184}]},"public_addr":"172.21.15.72:6801/2421889184","cluster_addr":"172.21.15.72:6805/2421889184","heartbeat_back_addr":"172.21.15.72:6813/2421889184","heartbeat_front_addr":"172.21.15.72:6809/2421889184","state":["exists","up"]},{"osd":6,"uuid":"e248e2be-3b6e-49cf-8c8a-1a4152827582","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3796994599},{"type":"v1","addr":"172.21.15.72:6804","nonce":3796994599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":3796994599},{"type":"v1","addr":"172.21.15.72:6808","nonce":3796994599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":3796994599},{"type":"v1","addr":"172.21.15.72:6815","nonce":3796994599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":3796994599},{"type":"v1","addr":"172.21.15.72:6812","nonce":3796994599}]},"public_addr":"172.21.15.72:6804/3796994599","cluster_addr":"172.21.15.72:6808/3796994599","heartbeat_back_addr":"172.21.15.72:6815/3796994599","heartbeat_front_addr":"172.21.15.72:6812/3796994599","state":["exists","up"]},{"osd":7,"uuid":"505a62d3-322b-4629-b4fd-187a55563709","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":3024877895},{"type":"v1","addr":"172.21.15.72:6817","nonce":3024877895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":3024877895},{"type":"v1","addr":"172.21.15.72:6821","nonce":3024877895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6827","nonce":3024877895},{"type":"v1","addr":"172.21.15.72:6829","nonce":3024877895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6823","nonce":3024877895},{"type":"v1","addr":"172.21.15.72:6825","nonce":3024877895}]},"public_addr":"172.21.15.72:6817/3024877895","cluster_addr":"172.21.15.72:6821/3024877895","heartbeat_back_addr":"172.21.15.72:6829/3024877895","heartbeat_front_addr":"172.21.15.72:6825/3024877895","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.241014+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.450799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.465018+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.507647+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.534763+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.495895+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.427110+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.547466+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-27T12:32:35.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.123+0000 7f08e5108640 1 -- 172.21.15.55:0/569486414 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f08c006c8f0 msgr2=0x7f08c006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:35.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.123+0000 7f08e5108640 1 --2- 172.21.15.55:0/569486414 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f08c006c8f0 0x7f08c006edb0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f08d0000f60 tx=0x7f08d0007d50 comp rx=0 tx=0).stop 2024-05-27T12:32:35.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.123+0000 7f08e5108640 1 -- 172.21.15.55:0/569486414 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f08e015c960 msgr2=0x7f08e00b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:35.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.123+0000 7f08e5108640 1 --2- 172.21.15.55:0/569486414 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f08e015c960 0x7f08e00b8aa0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f08d8009fa0 tx=0x7f08d800d560 comp rx=0 tx=0).stop 2024-05-27T12:32:35.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.123+0000 7f08e5108640 1 -- 172.21.15.55:0/569486414 shutdown_connections 2024-05-27T12:32:35.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.123+0000 7f08e5108640 1 --2- 172.21.15.55:0/569486414 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f08e015c960 0x7f08e00b8aa0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:35.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.123+0000 7f08e5108640 1 --2- 172.21.15.55:0/569486414 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f08c006c8f0 0x7f08c006edb0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:35.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.123+0000 7f08e5108640 1 --2- 172.21.15.55:0/569486414 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f08e015c580 0x7f08e0147b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:35.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.123+0000 7f08e5108640 1 --2- 172.21.15.55:0/569486414 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f08e00ba310 0x7f08e00ca830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:35.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.123+0000 7f08e5108640 1 -- 172.21.15.55:0/569486414 >> 172.21.15.55:0/569486414 conn(0x7f08e0067a50 msgr2=0x7f08e0067e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:35.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.123+0000 7f08e5108640 1 -- 172.21.15.55:0/569486414 shutdown_connections 2024-05-27T12:32:35.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.123+0000 7f08e5108640 1 -- 172.21.15.55:0/569486414 wait complete. 2024-05-27T12:32:35.134 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-27T12:32:29.277895+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-27T12:32:35.134 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-27T12:32:35.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.241+0000 7f283cc10640 1 Processor -- start 2024-05-27T12:32:35.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.241+0000 7f283cc10640 1 -- start start 2024-05-27T12:32:35.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.242+0000 7f283cc10640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f283815eb00 0x7f28380cfb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:35.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.242+0000 7f283cc10640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f28380d1f40 0x7f28380b78f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:35.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.242+0000 7f283cc10640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f283815eee0 con 0x7f28380d3e50 2024-05-27T12:32:35.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.242+0000 7f283cc10640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f28380d5700 con 0x7f28380d1f40 2024-05-27T12:32:35.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.242+0000 7f283cc10640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f28380d4660 con 0x7f283815eb00 2024-05-27T12:32:35.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.242+0000 7f2836d9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f28380d1f40 0x7f28380b78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:35.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.242+0000 7f2836d9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f28380d1f40 0x7f28380b78f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52148/0 (socket says 172.21.15.55:52148) 2024-05-27T12:32:35.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.242+0000 7f2835d9b640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f28380d3e50 0x7f28380d1830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:47926/0 (socket says 172.21.15.55:47926) 2024-05-27T12:32:35.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.242+0000 7f2836d9d640 1 -- 172.21.15.55:0/2992440561 learned_addr learned my addr 172.21.15.55:0/2992440561 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:32:35.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.243+0000 7f283659c640 1 --2- 172.21.15.55:0/2992440561 >> v2:172.21.15.72:3300/0 conn(0x7f283815eb00 0x7f28380cfb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:35.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.243+0000 7f2836d9d640 1 -- 172.21.15.55:0/2992440561 >> v2:172.21.15.72:3300/0 conn(0x7f283815eb00 msgr2=0x7f28380cfb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:32:35.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.243+0000 7f2836d9d640 1 --2- 172.21.15.55:0/2992440561 >> v2:172.21.15.72:3300/0 conn(0x7f283815eb00 0x7f28380cfb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:35.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.243+0000 7f2836d9d640 1 -- 172.21.15.55:0/2992440561 >> v1:172.21.15.55:6789/0 conn(0x7f28380d3e50 legacy=0x7f28380d1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:35.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.243+0000 7f283559a640 1 -- 172.21.15.55:0/2992440561 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3266111860 0 0) 0x7f283815eee0 con 0x7f28380d3e50 2024-05-27T12:32:35.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.243+0000 7f2836d9d640 1 -- 172.21.15.55:0/2992440561 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28380d4940 con 0x7f28380d1f40 2024-05-27T12:32:35.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.243+0000 7f2836d9d640 1 --2- 172.21.15.55:0/2992440561 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28380d1f40 0x7f28380b78f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f283806dcf0 tx=0x7f283002a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7f0d9284ac0f704 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:35.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.244+0000 7f283559a640 1 -- 172.21.15.55:0/2992440561 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2830037070 con 0x7f28380d1f40 2024-05-27T12:32:35.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.244+0000 7f283559a640 1 -- 172.21.15.55:0/2992440561 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f283002ae50 con 0x7f28380d1f40 2024-05-27T12:32:35.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.244+0000 7f283559a640 1 -- 172.21.15.55:0/2992440561 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2830032860 con 0x7f28380d1f40 2024-05-27T12:32:35.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.244+0000 7f283cc10640 1 -- 172.21.15.55:0/2992440561 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28380d1f40 msgr2=0x7f28380b78f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:35.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.244+0000 7f283cc10640 1 --2- 172.21.15.55:0/2992440561 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28380d1f40 0x7f28380b78f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f283806dcf0 tx=0x7f283002a300 comp rx=0 tx=0).stop 2024-05-27T12:32:35.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.244+0000 7f283cc10640 1 -- 172.21.15.55:0/2992440561 shutdown_connections 2024-05-27T12:32:35.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.244+0000 7f283cc10640 1 --2- 172.21.15.55:0/2992440561 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28380d1f40 0x7f28380b78f0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:35.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.244+0000 7f283cc10640 1 --2- 172.21.15.55:0/2992440561 >> v2:172.21.15.72:3300/0 conn(0x7f283815eb00 0x7f28380cfb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:35.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.244+0000 7f283cc10640 1 -- 172.21.15.55:0/2992440561 >> 172.21.15.55:0/2992440561 conn(0x7f2838067a50 msgr2=0x7f2838067e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:35.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.244+0000 7f283cc10640 1 -- 172.21.15.55:0/2992440561 shutdown_connections 2024-05-27T12:32:35.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.244+0000 7f283cc10640 1 -- 172.21.15.55:0/2992440561 wait complete. 2024-05-27T12:32:35.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.246+0000 7f283cc10640 1 Processor -- start 2024-05-27T12:32:35.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.246+0000 7f283cc10640 1 -- start start 2024-05-27T12:32:35.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.246+0000 7f283cc10640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f28380d1f40 0x7f28380cad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:35.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.246+0000 7f283cc10640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28380d3e50 0x7f28381f3b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:35.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.246+0000 7f283cc10640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f283815eb00 0x7f283814f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:35.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.246+0000 7f283cc10640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f28380d51e0 con 0x7f283815eb00 2024-05-27T12:32:35.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.246+0000 7f283cc10640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f28380d4f00 con 0x7f28380d3e50 2024-05-27T12:32:35.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.246+0000 7f283cc10640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f28380d42c0 con 0x7f28380d1f40 2024-05-27T12:32:35.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.246+0000 7f2836d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f283815eb00 0x7f283814f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:35.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.246+0000 7f2836d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f283815eb00 0x7f283814f1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52164/0 (socket says 172.21.15.55:52164) 2024-05-27T12:32:35.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.246+0000 7f2836d9d640 1 -- 172.21.15.55:0/1573419053 learned_addr learned my addr 172.21.15.55:0/1573419053 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:32:35.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.247+0000 7f2835d9b640 1 --2- 172.21.15.55:0/1573419053 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28380d3e50 0x7f28381f3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:35.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.247+0000 7f283659c640 1 --2- 172.21.15.55:0/1573419053 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f28380d1f40 0x7f28380cad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:35.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.247+0000 7f2836d9d640 1 -- 172.21.15.55:0/1573419053 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f28380d1f40 msgr2=0x7f28380cad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:35.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.247+0000 7f2836d9d640 1 --2- 172.21.15.55:0/1573419053 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f28380d1f40 0x7f28380cad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:35.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.247+0000 7f2836d9d640 1 -- 172.21.15.55:0/1573419053 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28380d3e50 msgr2=0x7f28381f3b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:35.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.247+0000 7f2836d9d640 1 --2- 172.21.15.55:0/1573419053 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28380d3e50 0x7f28381f3b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:35.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.247+0000 7f2836d9d640 1 -- 172.21.15.55:0/1573419053 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28381f4090 con 0x7f283815eb00 2024-05-27T12:32:35.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.247+0000 7f2836d9d640 1 --2- 172.21.15.55:0/1573419053 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f283815eb00 0x7f283814f1c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f28300090b0 tx=0x7f28300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:35.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.247+0000 7f282effd640 1 -- 172.21.15.55:0/1573419053 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2830041070 con 0x7f283815eb00 2024-05-27T12:32:35.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.247+0000 7f282effd640 1 -- 172.21.15.55:0/1573419053 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f283003c680 con 0x7f283815eb00 2024-05-27T12:32:35.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.247+0000 7f283cc10640 1 -- 172.21.15.55:0/1573419053 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28380c9cf0 con 0x7f283815eb00 2024-05-27T12:32:35.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.247+0000 7f282effd640 1 -- 172.21.15.55:0/1573419053 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2830037040 con 0x7f283815eb00 2024-05-27T12:32:35.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.247+0000 7f283cc10640 1 -- 172.21.15.55:0/1573419053 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28380ca2b0 con 0x7f283815eb00 2024-05-27T12:32:35.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.248+0000 7f283cc10640 1 -- 172.21.15.55:0/1573419053 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2838068a70 con 0x7f283815eb00 2024-05-27T12:32:35.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.249+0000 7f282effd640 1 -- 172.21.15.55:0/1573419053 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2830044070 con 0x7f283815eb00 2024-05-27T12:32:35.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.249+0000 7f282effd640 1 --2- 172.21.15.55:0/1573419053 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f281806c8f0 0x7f281806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:35.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.249+0000 7f282effd640 1 -- 172.21.15.55:0/1573419053 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7f28300ac440 con 0x7f283815eb00 2024-05-27T12:32:35.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.250+0000 7f283659c640 1 --2- 172.21.15.55:0/1573419053 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f281806c8f0 0x7f281806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:35.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.250+0000 7f283659c640 1 --2- 172.21.15.55:0/1573419053 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f281806c8f0 0x7f281806edb0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f28280099c0 tx=0x7f2828003990 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:35.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.253+0000 7f282effd640 1 -- 172.21.15.55:0/1573419053 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f28381f4090 con 0x7f283815eb00 2024-05-27T12:32:35.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.436+0000 7f283cc10640 1 -- 172.21.15.55:0/1573419053 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f283806bcc0 con 0x7f283815eb00 2024-05-27T12:32:35.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.436+0000 7f282effd640 1 -- 172.21.15.55:0/1573419053 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v19) ==== 93+0+10 (secure 0 0 0) 0x7f283007ace0 con 0x7f283815eb00 2024-05-27T12:32:35.436 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-05-27T12:32:35.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.438+0000 7f283cc10640 1 -- 172.21.15.55:0/1573419053 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f281806c8f0 msgr2=0x7f281806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:35.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.438+0000 7f283cc10640 1 --2- 172.21.15.55:0/1573419053 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f281806c8f0 0x7f281806edb0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f28280099c0 tx=0x7f2828003990 comp rx=0 tx=0).stop 2024-05-27T12:32:35.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.438+0000 7f283cc10640 1 -- 172.21.15.55:0/1573419053 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f283815eb00 msgr2=0x7f283814f1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:35.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.438+0000 7f283cc10640 1 --2- 172.21.15.55:0/1573419053 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f283815eb00 0x7f283814f1c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f28300090b0 tx=0x7f28300046c0 comp rx=0 tx=0).stop 2024-05-27T12:32:35.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.438+0000 7f283cc10640 1 -- 172.21.15.55:0/1573419053 shutdown_connections 2024-05-27T12:32:35.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.438+0000 7f283cc10640 1 --2- 172.21.15.55:0/1573419053 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f283815eb00 0x7f283814f1c0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:35.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.438+0000 7f283cc10640 1 --2- 172.21.15.55:0/1573419053 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f281806c8f0 0x7f281806edb0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:35.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.438+0000 7f283cc10640 1 --2- 172.21.15.55:0/1573419053 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28380d3e50 0x7f28381f3b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:35.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.438+0000 7f283cc10640 1 --2- 172.21.15.55:0/1573419053 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f28380d1f40 0x7f28380cad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:35.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.438+0000 7f283cc10640 1 -- 172.21.15.55:0/1573419053 >> 172.21.15.55:0/1573419053 conn(0x7f2838067a50 msgr2=0x7f28380b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:35.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.438+0000 7f283cc10640 1 -- 172.21.15.55:0/1573419053 shutdown_connections 2024-05-27T12:32:35.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.438+0000 7f283cc10640 1 -- 172.21.15.55:0/1573419053 wait complete. 2024-05-27T12:32:35.448 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-27T12:32:35.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.553+0000 7f521e908640 1 Processor -- start 2024-05-27T12:32:35.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.553+0000 7f521e908640 1 -- start start 2024-05-27T12:32:35.554 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.554+0000 7f521e908640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f52181620b0 0x7f52180b79c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:35.554 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.554+0000 7f521e908640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f52180cf8d0 0x7f521806ce80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:35.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.554+0000 7f521e908640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52180b39a0 con 0x7f52180cfd60 2024-05-27T12:32:35.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.554+0000 7f521e908640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f52180d56d0 con 0x7f52181620b0 2024-05-27T12:32:35.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.554+0000 7f521e908640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f52180b7f00 con 0x7f52180cf8d0 2024-05-27T12:32:35.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.554+0000 7f5217fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f52181620b0 0x7f52180b79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:35.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.554+0000 7f5217fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f52181620b0 0x7f52180b79c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52168/0 (socket says 172.21.15.55:52168) 2024-05-27T12:32:35.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.554+0000 7f5217fff640 1 -- 172.21.15.55:0/3290643377 learned_addr learned my addr 172.21.15.55:0/3290643377 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:32:35.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.554+0000 7f5217fff640 1 -- 172.21.15.55:0/3290643377 >> v2:172.21.15.72:3300/0 conn(0x7f52180cf8d0 msgr2=0x7f521806ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:32:35.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.554+0000 7f520ffff640 1 --2- 172.21.15.55:0/3290643377 >> v2:172.21.15.72:3300/0 conn(0x7f52180cf8d0 0x7f521806ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:35.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.554+0000 7f5217fff640 1 --2- 172.21.15.55:0/3290643377 >> v2:172.21.15.72:3300/0 conn(0x7f52180cf8d0 0x7f521806ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:35.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.554+0000 7f5217fff640 1 -- 172.21.15.55:0/3290643377 >> v1:172.21.15.72:6789/0 conn(0x7f52180cfd60 legacy=0x7f52180d3950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:32:35.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.554+0000 7f5217fff640 1 -- 172.21.15.55:0/3290643377 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52180b3c80 con 0x7f52181620b0 2024-05-27T12:32:35.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.554+0000 7f520ffff640 1 --2- 172.21.15.55:0/3290643377 >> v2:172.21.15.72:3300/0 conn(0x7f52180cf8d0 0x7f521806ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T12:32:35.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.555+0000 7f5217fff640 1 --2- 172.21.15.55:0/3290643377 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52181620b0 0x7f52180b79c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f521806cd10 tx=0x7f520802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dd732cf5f3590cd server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:35.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.555+0000 7f52177fe640 1 -- 172.21.15.55:0/3290643377 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5208037070 con 0x7f52181620b0 2024-05-27T12:32:35.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.555+0000 7f52177fe640 1 -- 172.21.15.55:0/3290643377 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5208032440 con 0x7f52181620b0 2024-05-27T12:32:35.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.555+0000 7f52177fe640 1 -- 172.21.15.55:0/3290643377 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5208032810 con 0x7f52181620b0 2024-05-27T12:32:35.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.556+0000 7f521e908640 1 -- 172.21.15.55:0/3290643377 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52181620b0 msgr2=0x7f52180b79c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:35.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.556+0000 7f521e908640 1 --2- 172.21.15.55:0/3290643377 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52181620b0 0x7f52180b79c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f521806cd10 tx=0x7f520802a1a0 comp rx=0 tx=0).stop 2024-05-27T12:32:35.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.556+0000 7f521e908640 1 -- 172.21.15.55:0/3290643377 shutdown_connections 2024-05-27T12:32:35.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.556+0000 7f521e908640 1 --2- 172.21.15.55:0/3290643377 >> v2:172.21.15.72:3300/0 conn(0x7f52180cf8d0 0x7f521806ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:35.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.556+0000 7f521e908640 1 --2- 172.21.15.55:0/3290643377 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52181620b0 0x7f52180b79c0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:35.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.556+0000 7f521e908640 1 -- 172.21.15.55:0/3290643377 >> 172.21.15.55:0/3290643377 conn(0x7f52180d1940 msgr2=0x7f52180d4890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:35.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.556+0000 7f521e908640 1 -- 172.21.15.55:0/3290643377 shutdown_connections 2024-05-27T12:32:35.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.556+0000 7f521e908640 1 -- 172.21.15.55:0/3290643377 wait complete. 2024-05-27T12:32:35.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.557+0000 7f521e908640 1 Processor -- start 2024-05-27T12:32:35.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.557+0000 7f521e908640 1 -- start start 2024-05-27T12:32:35.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.558+0000 7f521e908640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f52180cf8d0 0x7f5218154370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:35.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.558+0000 7f521e908640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f52180cfd60 0x7f52181f5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:35.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.558+0000 7f521e908640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52181620b0 0x7f52180d41b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:35.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.558+0000 7f521e908640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f52180d3430 con 0x7f52181620b0 2024-05-27T12:32:35.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.558+0000 7f521e908640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f52180d3150 con 0x7f52180cf8d0 2024-05-27T12:32:35.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.558+0000 7f521e908640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f52180b3650 con 0x7f52180cfd60 2024-05-27T12:32:35.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.558+0000 7f521cea5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52181620b0 0x7f52180d41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:35.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.558+0000 7f521cea5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52181620b0 0x7f52180d41b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52174/0 (socket says 172.21.15.55:52174) 2024-05-27T12:32:35.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.558+0000 7f521cea5640 1 -- 172.21.15.55:0/1231378418 learned_addr learned my addr 172.21.15.55:0/1231378418 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:32:35.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.558+0000 7f520ffff640 1 --2- 172.21.15.55:0/1231378418 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f52180cfd60 0x7f52181f5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:35.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.558+0000 7f5217fff640 1 --2- 172.21.15.55:0/1231378418 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f52180cf8d0 0x7f5218154370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:35.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.558+0000 7f521cea5640 1 -- 172.21.15.55:0/1231378418 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f52180cfd60 msgr2=0x7f52181f5230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:35.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.558+0000 7f521cea5640 1 --2- 172.21.15.55:0/1231378418 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f52180cfd60 0x7f52181f5230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:35.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.558+0000 7f521cea5640 1 -- 172.21.15.55:0/1231378418 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f52180cf8d0 msgr2=0x7f5218154370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:35.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.558+0000 7f521cea5640 1 --2- 172.21.15.55:0/1231378418 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f52180cf8d0 0x7f5218154370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:35.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.558+0000 7f521cea5640 1 -- 172.21.15.55:0/1231378418 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52180cde60 con 0x7f52181620b0 2024-05-27T12:32:35.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.559+0000 7f521cea5640 1 --2- 172.21.15.55:0/1231378418 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52181620b0 0x7f52180d41b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f521000c780 tx=0x7f521000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:35.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.559+0000 7f52157fa640 1 -- 172.21.15.55:0/1231378418 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5210004b60 con 0x7f52181620b0 2024-05-27T12:32:35.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.559+0000 7f52157fa640 1 -- 172.21.15.55:0/1231378418 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5210004d00 con 0x7f52181620b0 2024-05-27T12:32:35.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.559+0000 7f52157fa640 1 -- 172.21.15.55:0/1231378418 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f521000aa90 con 0x7f52181620b0 2024-05-27T12:32:35.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.559+0000 7f521e908640 1 -- 172.21.15.55:0/1231378418 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52180ce140 con 0x7f52181620b0 2024-05-27T12:32:35.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.559+0000 7f521e908640 1 -- 172.21.15.55:0/1231378418 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52180ce700 con 0x7f52181620b0 2024-05-27T12:32:35.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.560+0000 7f521e908640 1 -- 172.21.15.55:0/1231378418 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5218075460 con 0x7f52181620b0 2024-05-27T12:32:35.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.560+0000 7f52157fa640 1 -- 172.21.15.55:0/1231378418 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f521000ac30 con 0x7f52181620b0 2024-05-27T12:32:35.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.561+0000 7f52157fa640 1 --2- 172.21.15.55:0/1231378418 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f51f806c8f0 0x7f51f806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:35.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.561+0000 7f52157fa640 1 -- 172.21.15.55:0/1231378418 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7f521008ba60 con 0x7f52181620b0 2024-05-27T12:32:35.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.561+0000 7f5217fff640 1 --2- 172.21.15.55:0/1231378418 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f51f806c8f0 0x7f51f806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:35.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.562+0000 7f5217fff640 1 --2- 172.21.15.55:0/1231378418 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f51f806c8f0 0x7f51f806edb0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5208034000 tx=0x7f520802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:35.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.565+0000 7f52157fa640 1 -- 172.21.15.55:0/1231378418 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5210020070 con 0x7f52181620b0 2024-05-27T12:32:35.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.789+0000 7f521e908640 1 -- 172.21.15.55:0/1231378418 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f521806db20 con 0x7f52181620b0 2024-05-27T12:32:35.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.790+0000 7f52157fa640 1 -- 172.21.15.55:0/1231378418 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1392 (secure 0 0 0) 0x7f521005a270 con 0x7f52181620b0 2024-05-27T12:32:35.789 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-27T12:32:35.789 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/3311546358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":3311546358},{"type":"v1","addr":"172.21.15.55:6835","nonce":3311546358}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-05-27T12:32:35.789 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 2 2024-05-27T12:32:35.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.791+0000 7f521e908640 1 -- 172.21.15.55:0/1231378418 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f51f806c8f0 msgr2=0x7f51f806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:35.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.791+0000 7f521e908640 1 --2- 172.21.15.55:0/1231378418 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f51f806c8f0 0x7f51f806edb0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5208034000 tx=0x7f520802e000 comp rx=0 tx=0).stop 2024-05-27T12:32:35.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.791+0000 7f521e908640 1 -- 172.21.15.55:0/1231378418 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52181620b0 msgr2=0x7f52180d41b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:35.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.791+0000 7f521e908640 1 --2- 172.21.15.55:0/1231378418 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52181620b0 0x7f52180d41b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f521000c780 tx=0x7f521000cc40 comp rx=0 tx=0).stop 2024-05-27T12:32:35.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.791+0000 7f521e908640 1 -- 172.21.15.55:0/1231378418 shutdown_connections 2024-05-27T12:32:35.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.791+0000 7f521e908640 1 --2- 172.21.15.55:0/1231378418 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52181620b0 0x7f52180d41b0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:35.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.791+0000 7f521e908640 1 --2- 172.21.15.55:0/1231378418 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f52180cfd60 0x7f52181f5230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:35.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.791+0000 7f521e908640 1 --2- 172.21.15.55:0/1231378418 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f51f806c8f0 0x7f51f806edb0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:35.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.791+0000 7f521e908640 1 --2- 172.21.15.55:0/1231378418 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f52180cf8d0 0x7f5218154370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:35.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.791+0000 7f521e908640 1 -- 172.21.15.55:0/1231378418 >> 172.21.15.55:0/1231378418 conn(0x7f52180d1940 msgr2=0x7f52180d3850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:35.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.792+0000 7f521e908640 1 -- 172.21.15.55:0/1231378418 shutdown_connections 2024-05-27T12:32:35.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:35.792+0000 7f521e908640 1 -- 172.21.15.55:0/1231378418 wait complete. 2024-05-27T12:32:37.540 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T12:32:37.543 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T12:32:37.802 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-27T12:32:37.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:37.919+0000 7fb8eb605640 1 Processor -- start 2024-05-27T12:32:37.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:37.919+0000 7fb8eb605640 1 -- start start 2024-05-27T12:32:37.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:37.920+0000 7fb8eb605640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb8e415ec00 0x7fb8e40b3db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:37.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:37.920+0000 7fb8eb605640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8e41632f0 con 0x7fb8e40b6370 2024-05-27T12:32:37.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:37.920+0000 7fb8eb605640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8e41635d0 con 0x7fb8e40b3860 2024-05-27T12:32:37.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:37.920+0000 7fb8eb605640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fb8e40cf2e0 con 0x7fb8e415ec00 2024-05-27T12:32:37.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:37.920+0000 7fb8e9ba2640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fb8e40b6370 0x7fb8e40d2980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:47936/0 (socket says 172.21.15.55:47936) 2024-05-27T12:32:37.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:37.920+0000 7fb8e9ba2640 1 -- 172.21.15.55:0/3601744365 learned_addr learned my addr 172.21.15.55:0/3601744365 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-27T12:32:37.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:37.920+0000 7fb8e93a1640 1 --2- 172.21.15.55:0/3601744365 >> v2:172.21.15.72:3300/0 conn(0x7fb8e415ec00 0x7fb8e40b3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:37.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:37.920+0000 7fb8dbfff640 1 -- 172.21.15.55:0/3601744365 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3484584724 0 0) 0x7fb8e41632f0 con 0x7fb8e40b6370 2024-05-27T12:32:37.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:37.921+0000 7fb8dbfff640 1 -- 172.21.15.55:0/3601744365 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb8d0003520 con 0x7fb8e40b6370 2024-05-27T12:32:37.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:37.921+0000 7fb8e93a1640 1 -- 172.21.15.55:0/3601744365 >> v1:172.21.15.72:6789/0 conn(0x7fb8e40b3860 legacy=0x7fb8e40cfd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:37.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:37.921+0000 7fb8e93a1640 1 -- 172.21.15.55:0/3601744365 >> v1:172.21.15.55:6789/0 conn(0x7fb8e40b6370 legacy=0x7fb8e40d2980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:37.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:37.921+0000 7fb8e93a1640 1 -- 172.21.15.55:0/3601744365 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8e40cf530 con 0x7fb8e415ec00 2024-05-27T12:32:37.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:37.921+0000 7fb8e93a1640 1 --2- 172.21.15.55:0/3601744365 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8e415ec00 0x7fb8e40b3db0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb8e00097a0 tx=0x7fb8e002a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c80e1b810c3bc42 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:37.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:37.922+0000 7fb8dbfff640 1 -- 172.21.15.55:0/3601744365 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8e0037070 con 0x7fb8e415ec00 2024-05-27T12:32:37.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:37.922+0000 7fb8dbfff640 1 -- 172.21.15.55:0/3601744365 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8e0032440 con 0x7fb8e415ec00 2024-05-27T12:32:37.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:37.922+0000 7fb8dbfff640 1 -- 172.21.15.55:0/3601744365 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8e00327f0 con 0x7fb8e415ec00 2024-05-27T12:32:37.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:37.922+0000 7fb8eb605640 1 -- 172.21.15.55:0/3601744365 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8e415ec00 msgr2=0x7fb8e40b3db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:37.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:37.922+0000 7fb8eb605640 1 --2- 172.21.15.55:0/3601744365 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8e415ec00 0x7fb8e40b3db0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb8e00097a0 tx=0x7fb8e002a230 comp rx=0 tx=0).stop 2024-05-27T12:32:37.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:37.922+0000 7fb8eb605640 1 -- 172.21.15.55:0/3601744365 shutdown_connections 2024-05-27T12:32:37.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:37.922+0000 7fb8eb605640 1 --2- 172.21.15.55:0/3601744365 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8e415ec00 0x7fb8e40b3db0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:37.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:37.922+0000 7fb8eb605640 1 -- 172.21.15.55:0/3601744365 >> 172.21.15.55:0/3601744365 conn(0x7fb8e40d1370 msgr2=0x7fb8e40d1780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:37.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:37.922+0000 7fb8eb605640 1 -- 172.21.15.55:0/3601744365 shutdown_connections 2024-05-27T12:32:37.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:37.922+0000 7fb8eb605640 1 -- 172.21.15.55:0/3601744365 wait complete. 2024-05-27T12:32:37.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:37.924+0000 7fb8eb605640 1 Processor -- start 2024-05-27T12:32:37.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:37.924+0000 7fb8eb605640 1 -- start start 2024-05-27T12:32:37.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:37.924+0000 7fb8eb605640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8e40b3860 0x7fb8e4153070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:37.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:37.924+0000 7fb8eb605640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8e40b6370 0x7fb8e4161300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:37.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:37.924+0000 7fb8eb605640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb8e415ec00 0x7fb8e4161840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:37.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:37.924+0000 7fb8eb605640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7fb8e415efe0 con 0x7fb8e40b6370 2024-05-27T12:32:37.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:37.924+0000 7fb8eb605640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fb8e40b3530 con 0x7fb8e40b3860 2024-05-27T12:32:37.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:37.924+0000 7fb8eb605640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fb8e415f160 con 0x7fb8e415ec00 2024-05-27T12:32:37.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:37.925+0000 7fb8e8ba0640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8e40b6370 0x7fb8e4161300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:37.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:37.925+0000 7fb8e8ba0640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8e40b6370 0x7fb8e4161300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52190/0 (socket says 172.21.15.55:52190) 2024-05-27T12:32:37.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:37.925+0000 7fb8e8ba0640 1 -- 172.21.15.55:0/2770866386 learned_addr learned my addr 172.21.15.55:0/2770866386 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:32:37.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:37.925+0000 7fb8e93a1640 1 --2- 172.21.15.55:0/2770866386 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8e40b3860 0x7fb8e4153070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:37.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:37.925+0000 7fb8e9ba2640 1 --2- 172.21.15.55:0/2770866386 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb8e415ec00 0x7fb8e4161840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:37.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:37.925+0000 7fb8e8ba0640 1 -- 172.21.15.55:0/2770866386 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb8e415ec00 msgr2=0x7fb8e4161840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:37.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:37.925+0000 7fb8e8ba0640 1 --2- 172.21.15.55:0/2770866386 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb8e415ec00 0x7fb8e4161840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:37.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:37.925+0000 7fb8e8ba0640 1 -- 172.21.15.55:0/2770866386 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8e40b3860 msgr2=0x7fb8e4153070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:37.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:37.925+0000 7fb8e8ba0640 1 --2- 172.21.15.55:0/2770866386 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8e40b3860 0x7fb8e4153070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:37.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:37.925+0000 7fb8e8ba0640 1 -- 172.21.15.55:0/2770866386 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8e41535b0 con 0x7fb8e40b6370 2024-05-27T12:32:37.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:37.925+0000 7fb8e8ba0640 1 --2- 172.21.15.55:0/2770866386 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8e40b6370 0x7fb8e4161300 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb8d400c400 tx=0x7fb8d400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:37.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:37.925+0000 7fb8d9ffb640 1 -- 172.21.15.55:0/2770866386 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8d40052d0 con 0x7fb8e40b6370 2024-05-27T12:32:37.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:37.925+0000 7fb8d9ffb640 1 -- 172.21.15.55:0/2770866386 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8d4005490 con 0x7fb8e40b6370 2024-05-27T12:32:37.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:37.925+0000 7fb8eb605640 1 -- 172.21.15.55:0/2770866386 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8e41f8280 con 0x7fb8e40b6370 2024-05-27T12:32:37.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:37.925+0000 7fb8d9ffb640 1 -- 172.21.15.55:0/2770866386 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8d4007260 con 0x7fb8e40b6370 2024-05-27T12:32:37.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:37.926+0000 7fb8eb605640 1 -- 172.21.15.55:0/2770866386 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8e41f8840 con 0x7fb8e40b6370 2024-05-27T12:32:37.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:37.926+0000 7fb8eb605640 1 -- 172.21.15.55:0/2770866386 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8e406db20 con 0x7fb8e40b6370 2024-05-27T12:32:37.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:37.927+0000 7fb8d9ffb640 1 -- 172.21.15.55:0/2770866386 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb8d4007400 con 0x7fb8e40b6370 2024-05-27T12:32:37.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:37.927+0000 7fb8d9ffb640 1 --2- 172.21.15.55:0/2770866386 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fb8c806c8f0 0x7fb8c806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:37.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:37.927+0000 7fb8d9ffb640 1 -- 172.21.15.55:0/2770866386 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7fb8d408ad90 con 0x7fb8e40b6370 2024-05-27T12:32:37.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:37.928+0000 7fb8e93a1640 1 --2- 172.21.15.55:0/2770866386 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fb8c806c8f0 0x7fb8c806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:37.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:37.928+0000 7fb8e93a1640 1 --2- 172.21.15.55:0/2770866386 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fb8c806c8f0 0x7fb8c806edb0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb8e0034000 tx=0x7fb8e002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:37.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:37.932+0000 7fb8d9ffb640 1 -- 172.21.15.55:0/2770866386 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb8e406db20 con 0x7fb8e40b6370 2024-05-27T12:32:38.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.155+0000 7fb8eb605640 1 -- 172.21.15.55:0/2770866386 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb8e4075460 con 0x7fb8e40b6370 2024-05-27T12:32:38.155 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.156+0000 7fb8d9ffb640 1 -- 172.21.15.55:0/2770866386 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3855 (secure 0 0 0) 0x7fb8d4059510 con 0x7fb8e40b6370 2024-05-27T12:32:38.155 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-27T12:32:38.156 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/1501264038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":1501264038},{"type":"v1","addr":"172.21.15.55:6834","nonce":1501264038}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/3311546358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":3311546358},{"type":"v1","addr":"172.21.15.55:6835","nonce":3311546358}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4282,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/138819105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6835","nonce":138819105},{"type":"v1","addr":"172.21.15.72:6837","nonce":138819105}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4290,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6836/70510151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":70510151},{"type":"v1","addr":"172.21.15.72:6836","nonce":70510151}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-05-27T12:32:38.156 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 3 2024-05-27T12:32:38.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.158+0000 7fb8eb605640 1 -- 172.21.15.55:0/2770866386 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fb8c806c8f0 msgr2=0x7fb8c806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:38.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.158+0000 7fb8eb605640 1 --2- 172.21.15.55:0/2770866386 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fb8c806c8f0 0x7fb8c806edb0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb8e0034000 tx=0x7fb8e002e000 comp rx=0 tx=0).stop 2024-05-27T12:32:38.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.158+0000 7fb8eb605640 1 -- 172.21.15.55:0/2770866386 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8e40b6370 msgr2=0x7fb8e4161300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:38.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.158+0000 7fb8eb605640 1 --2- 172.21.15.55:0/2770866386 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8e40b6370 0x7fb8e4161300 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb8d400c400 tx=0x7fb8d400c8c0 comp rx=0 tx=0).stop 2024-05-27T12:32:38.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.158+0000 7fb8eb605640 1 -- 172.21.15.55:0/2770866386 shutdown_connections 2024-05-27T12:32:38.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.158+0000 7fb8eb605640 1 --2- 172.21.15.55:0/2770866386 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb8e415ec00 0x7fb8e4161840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:38.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.158+0000 7fb8eb605640 1 --2- 172.21.15.55:0/2770866386 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8e40b6370 0x7fb8e4161300 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:38.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.158+0000 7fb8eb605640 1 --2- 172.21.15.55:0/2770866386 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fb8c806c8f0 0x7fb8c806edb0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:38.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.158+0000 7fb8eb605640 1 --2- 172.21.15.55:0/2770866386 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8e40b3860 0x7fb8e4153070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:38.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.158+0000 7fb8eb605640 1 -- 172.21.15.55:0/2770866386 >> 172.21.15.55:0/2770866386 conn(0x7fb8e40d1370 msgr2=0x7fb8e40b9da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:38.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.158+0000 7fb8eb605640 1 -- 172.21.15.55:0/2770866386 shutdown_connections 2024-05-27T12:32:38.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.158+0000 7fb8eb605640 1 -- 172.21.15.55:0/2770866386 wait complete. 2024-05-27T12:32:38.169 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-27T12:32:38.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.274+0000 7f301bc42640 1 Processor -- start 2024-05-27T12:32:38.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.275+0000 7f301bc42640 1 -- start start 2024-05-27T12:32:38.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.275+0000 7f301bc42640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f30140d0560 0x7f30140d09a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:38.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.275+0000 7f301bc42640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f30140cdbb0 0x7f30140ce040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:38.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.275+0000 7f301bc42640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30140cd410 con 0x7f301409aa30 2024-05-27T12:32:38.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.275+0000 7f301bc42640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f30140d1020 con 0x7f30140cdbb0 2024-05-27T12:32:38.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.275+0000 7f301bc42640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f30140d1300 con 0x7f30140d0560 2024-05-27T12:32:38.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.276+0000 7f30199de640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f301409aa30 0x7f301409ae10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:47948/0 (socket says 172.21.15.55:47948) 2024-05-27T12:32:38.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.276+0000 7f30199de640 1 -- 172.21.15.55:0/2423634498 learned_addr learned my addr 172.21.15.55:0/2423634498 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-27T12:32:38.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.276+0000 7f301a1df640 1 --2- 172.21.15.55:0/2423634498 >> v2:172.21.15.72:3300/0 conn(0x7f30140cdbb0 0x7f30140ce040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:38.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.276+0000 7f30191dd640 1 --2- 172.21.15.55:0/2423634498 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f30140d0560 0x7f30140d09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:38.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.276+0000 7f30189dc640 1 -- 172.21.15.55:0/2423634498 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2076213466 0 0) 0x7f3010001110 con 0x7f301409aa30 2024-05-27T12:32:38.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.276+0000 7f30189dc640 1 -- 172.21.15.55:0/2423634498 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3000003520 con 0x7f301409aa30 2024-05-27T12:32:38.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.276+0000 7f30191dd640 1 -- 172.21.15.55:0/2423634498 >> v2:172.21.15.72:3300/0 conn(0x7f30140cdbb0 msgr2=0x7f30140ce040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:32:38.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.276+0000 7f30191dd640 1 --2- 172.21.15.55:0/2423634498 >> v2:172.21.15.72:3300/0 conn(0x7f30140cdbb0 0x7f30140ce040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:38.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.276+0000 7f30191dd640 1 -- 172.21.15.55:0/2423634498 >> v1:172.21.15.55:6789/0 conn(0x7f301409aa30 legacy=0x7f301409ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:38.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.276+0000 7f30191dd640 1 -- 172.21.15.55:0/2423634498 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30140d15e0 con 0x7f30140d0560 2024-05-27T12:32:38.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.276+0000 7f301a1df640 1 --2- 172.21.15.55:0/2423634498 >> v2:172.21.15.72:3300/0 conn(0x7f30140cdbb0 0x7f30140ce040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T12:32:38.277 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.277+0000 7f30191dd640 1 --2- 172.21.15.55:0/2423634498 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f30140d0560 0x7f30140d09a0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f30040097a0 tx=0x7f300402e590 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cdfb339b16089fa server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:38.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.277+0000 7f30189dc640 1 -- 172.21.15.55:0/2423634498 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f300403a070 con 0x7f30140d0560 2024-05-27T12:32:38.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.277+0000 7f30189dc640 1 -- 172.21.15.55:0/2423634498 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3004033710 con 0x7f30140d0560 2024-05-27T12:32:38.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.277+0000 7f30189dc640 1 -- 172.21.15.55:0/2423634498 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3004033ac0 con 0x7f30140d0560 2024-05-27T12:32:38.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.278+0000 7f301bc42640 1 -- 172.21.15.55:0/2423634498 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f30140d0560 msgr2=0x7f30140d09a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:38.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.278+0000 7f301bc42640 1 --2- 172.21.15.55:0/2423634498 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f30140d0560 0x7f30140d09a0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f30040097a0 tx=0x7f300402e590 comp rx=0 tx=0).stop 2024-05-27T12:32:38.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.278+0000 7f301bc42640 1 -- 172.21.15.55:0/2423634498 shutdown_connections 2024-05-27T12:32:38.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.278+0000 7f301bc42640 1 --2- 172.21.15.55:0/2423634498 >> v2:172.21.15.72:3300/0 conn(0x7f30140cdbb0 0x7f30140ce040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:38.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.278+0000 7f301bc42640 1 --2- 172.21.15.55:0/2423634498 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f30140d0560 0x7f30140d09a0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:38.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.278+0000 7f301bc42640 1 -- 172.21.15.55:0/2423634498 >> 172.21.15.55:0/2423634498 conn(0x7f30140d2660 msgr2=0x7f30140d2a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:38.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.278+0000 7f301bc42640 1 -- 172.21.15.55:0/2423634498 shutdown_connections 2024-05-27T12:32:38.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.278+0000 7f301bc42640 1 -- 172.21.15.55:0/2423634498 wait complete. 2024-05-27T12:32:38.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.279+0000 7f301bc42640 1 Processor -- start 2024-05-27T12:32:38.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.279+0000 7f301bc42640 1 -- start start 2024-05-27T12:32:38.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.280+0000 7f301bc42640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f301409aa30 0x7f30140b50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:38.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.280+0000 7f301bc42640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f30140cdbb0 0x7f301415b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:38.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.280+0000 7f301bc42640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30140d0560 0x7f30141f0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:38.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.280+0000 7f301bc42640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f301415cd30 con 0x7f30140d0560 2024-05-27T12:32:38.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.280+0000 7f301bc42640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f301415d340 con 0x7f301409aa30 2024-05-27T12:32:38.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.280+0000 7f301bc42640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f301415ceb0 con 0x7f30140cdbb0 2024-05-27T12:32:38.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.280+0000 7f301a1df640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30140d0560 0x7f30141f0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:38.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.280+0000 7f301a1df640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30140d0560 0x7f30141f0bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52202/0 (socket says 172.21.15.55:52202) 2024-05-27T12:32:38.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.280+0000 7f301a1df640 1 -- 172.21.15.55:0/3076547510 learned_addr learned my addr 172.21.15.55:0/3076547510 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:32:38.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.280+0000 7f30199de640 1 --2- 172.21.15.55:0/3076547510 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f301409aa30 0x7f30140b50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:38.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.280+0000 7f30191dd640 1 --2- 172.21.15.55:0/3076547510 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f30140cdbb0 0x7f301415b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:38.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.280+0000 7f301a1df640 1 -- 172.21.15.55:0/3076547510 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f30140cdbb0 msgr2=0x7f301415b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:38.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.280+0000 7f301a1df640 1 --2- 172.21.15.55:0/3076547510 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f30140cdbb0 0x7f301415b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:38.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.280+0000 7f301a1df640 1 -- 172.21.15.55:0/3076547510 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f301409aa30 msgr2=0x7f30140b50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:38.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.280+0000 7f301a1df640 1 --2- 172.21.15.55:0/3076547510 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f301409aa30 0x7f30140b50d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:38.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.280+0000 7f301a1df640 1 -- 172.21.15.55:0/3076547510 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30140c7690 con 0x7f30140d0560 2024-05-27T12:32:38.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.280+0000 7f301a1df640 1 --2- 172.21.15.55:0/3076547510 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30140d0560 0x7f30141f0bb0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f300c00efc0 tx=0x7f300c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:38.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.280+0000 7f300a7fc640 1 -- 172.21.15.55:0/3076547510 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f300c018030 con 0x7f30140d0560 2024-05-27T12:32:38.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.280+0000 7f300a7fc640 1 -- 172.21.15.55:0/3076547510 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f300c00cdf0 con 0x7f30140d0560 2024-05-27T12:32:38.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.280+0000 7f301bc42640 1 -- 172.21.15.55:0/3076547510 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30140c7970 con 0x7f30140d0560 2024-05-27T12:32:38.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.280+0000 7f300a7fc640 1 -- 172.21.15.55:0/3076547510 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f300c003bb0 con 0x7f30140d0560 2024-05-27T12:32:38.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.280+0000 7f301bc42640 1 -- 172.21.15.55:0/3076547510 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30140c7f30 con 0x7f30140d0560 2024-05-27T12:32:38.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.281+0000 7f301bc42640 1 -- 172.21.15.55:0/3076547510 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3014075460 con 0x7f30140d0560 2024-05-27T12:32:38.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.282+0000 7f300a7fc640 1 -- 172.21.15.55:0/3076547510 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f300c01b070 con 0x7f30140d0560 2024-05-27T12:32:38.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.282+0000 7f300a7fc640 1 --2- 172.21.15.55:0/3076547510 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f2ff806c8f0 0x7f2ff806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:38.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.282+0000 7f300a7fc640 1 -- 172.21.15.55:0/3076547510 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7f300c08c040 con 0x7f30140d0560 2024-05-27T12:32:38.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.283+0000 7f30199de640 1 --2- 172.21.15.55:0/3076547510 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f2ff806c8f0 0x7f2ff806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:38.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.283+0000 7f30199de640 1 --2- 172.21.15.55:0/3076547510 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f2ff806c8f0 0x7f2ff806edb0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3010005880 tx=0x7f3010009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:38.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.286+0000 7f300a7fc640 1 -- 172.21.15.55:0/3076547510 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f300c010040 con 0x7f30140d0560 2024-05-27T12:32:38.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.472+0000 7f301bc42640 1 -- 172.21.15.55:0/3076547510 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f30140d32c0 con 0x7f30140d0560 2024-05-27T12:32:38.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.473+0000 7f300a7fc640 1 -- 172.21.15.55:0/3076547510 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+12836 (secure 0 0 0) 0x7f300c05a200 con 0x7f30140d0560 2024-05-27T12:32:38.473 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-27T12:32:38.473 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":19,"fsid":"c3ff4e3b-8dae-4856-9593-e5cc66c59982","created":"2024-05-27T12:32:17.019097+0000","modified":"2024-05-27T12:32:32.154866+0000","last_up_change":"2024-05-27T12:32:28.109744+0000","last_in_change":"2024-05-27T12:32:19.309872+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-27T12:32:29.277895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e607b598-061b-4b6f-92ff-95c20b330599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":807572567},{"type":"v1","addr":"172.21.15.55:6801","nonce":807572567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":807572567},{"type":"v1","addr":"172.21.15.55:6803","nonce":807572567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":807572567},{"type":"v1","addr":"172.21.15.55:6807","nonce":807572567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":807572567},{"type":"v1","addr":"172.21.15.55:6805","nonce":807572567}]},"public_addr":"172.21.15.55:6801/807572567","cluster_addr":"172.21.15.55:6803/807572567","heartbeat_back_addr":"172.21.15.55:6807/807572567","heartbeat_front_addr":"172.21.15.55:6805/807572567","state":["exists","up"]},{"osd":1,"uuid":"ba2b5b1d-71a9-4ecc-9a48-55aa7fe54261","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":3426897300},{"type":"v1","addr":"172.21.15.55:6825","nonce":3426897300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":3426897300},{"type":"v1","addr":"172.21.15.55:6827","nonce":3426897300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":3426897300},{"type":"v1","addr":"172.21.15.55:6831","nonce":3426897300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":3426897300},{"type":"v1","addr":"172.21.15.55:6829","nonce":3426897300}]},"public_addr":"172.21.15.55:6825/3426897300","cluster_addr":"172.21.15.55:6827/3426897300","heartbeat_back_addr":"172.21.15.55:6831/3426897300","heartbeat_front_addr":"172.21.15.55:6829/3426897300","state":["exists","up"]},{"osd":2,"uuid":"e6b81cc6-4ff1-45d0-87eb-9f04ccf986a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3510271725},{"type":"v1","addr":"172.21.15.55:6809","nonce":3510271725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3510271725},{"type":"v1","addr":"172.21.15.55:6811","nonce":3510271725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3510271725},{"type":"v1","addr":"172.21.15.55:6815","nonce":3510271725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3510271725},{"type":"v1","addr":"172.21.15.55:6813","nonce":3510271725}]},"public_addr":"172.21.15.55:6809/3510271725","cluster_addr":"172.21.15.55:6811/3510271725","heartbeat_back_addr":"172.21.15.55:6815/3510271725","heartbeat_front_addr":"172.21.15.55:6813/3510271725","state":["exists","up"]},{"osd":3,"uuid":"b6a34b75-807d-4693-b1c3-903cb4c618d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":1066693520},{"type":"v1","addr":"172.21.15.55:6817","nonce":1066693520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":1066693520},{"type":"v1","addr":"172.21.15.55:6819","nonce":1066693520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":1066693520},{"type":"v1","addr":"172.21.15.55:6823","nonce":1066693520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":1066693520},{"type":"v1","addr":"172.21.15.55:6821","nonce":1066693520}]},"public_addr":"172.21.15.55:6817/1066693520","cluster_addr":"172.21.15.55:6819/1066693520","heartbeat_back_addr":"172.21.15.55:6823/1066693520","heartbeat_front_addr":"172.21.15.55:6821/1066693520","state":["exists","up"]},{"osd":4,"uuid":"272ec937-56b4-4f0a-b2e1-b0bc189c9d79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":4190771237},{"type":"v1","addr":"172.21.15.72:6820","nonce":4190771237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":4190771237},{"type":"v1","addr":"172.21.15.72:6824","nonce":4190771237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":4190771237},{"type":"v1","addr":"172.21.15.72:6831","nonce":4190771237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":4190771237},{"type":"v1","addr":"172.21.15.72:6828","nonce":4190771237}]},"public_addr":"172.21.15.72:6820/4190771237","cluster_addr":"172.21.15.72:6824/4190771237","heartbeat_back_addr":"172.21.15.72:6831/4190771237","heartbeat_front_addr":"172.21.15.72:6828/4190771237","state":["exists","up"]},{"osd":5,"uuid":"56439854-72a0-4ef4-81ff-184a3d924a5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":2421889184},{"type":"v1","addr":"172.21.15.72:6801","nonce":2421889184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6803","nonce":2421889184},{"type":"v1","addr":"172.21.15.72:6805","nonce":2421889184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":2421889184},{"type":"v1","addr":"172.21.15.72:6813","nonce":2421889184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6807","nonce":2421889184},{"type":"v1","addr":"172.21.15.72:6809","nonce":2421889184}]},"public_addr":"172.21.15.72:6801/2421889184","cluster_addr":"172.21.15.72:6805/2421889184","heartbeat_back_addr":"172.21.15.72:6813/2421889184","heartbeat_front_addr":"172.21.15.72:6809/2421889184","state":["exists","up"]},{"osd":6,"uuid":"e248e2be-3b6e-49cf-8c8a-1a4152827582","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3796994599},{"type":"v1","addr":"172.21.15.72:6804","nonce":3796994599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":3796994599},{"type":"v1","addr":"172.21.15.72:6808","nonce":3796994599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":3796994599},{"type":"v1","addr":"172.21.15.72:6815","nonce":3796994599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":3796994599},{"type":"v1","addr":"172.21.15.72:6812","nonce":3796994599}]},"public_addr":"172.21.15.72:6804/3796994599","cluster_addr":"172.21.15.72:6808/3796994599","heartbeat_back_addr":"172.21.15.72:6815/3796994599","heartbeat_front_addr":"172.21.15.72:6812/3796994599","state":["exists","up"]},{"osd":7,"uuid":"505a62d3-322b-4629-b4fd-187a55563709","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":3024877895},{"type":"v1","addr":"172.21.15.72:6817","nonce":3024877895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":3024877895},{"type":"v1","addr":"172.21.15.72:6821","nonce":3024877895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6827","nonce":3024877895},{"type":"v1","addr":"172.21.15.72:6829","nonce":3024877895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6823","nonce":3024877895},{"type":"v1","addr":"172.21.15.72:6825","nonce":3024877895}]},"public_addr":"172.21.15.72:6817/3024877895","cluster_addr":"172.21.15.72:6821/3024877895","heartbeat_back_addr":"172.21.15.72:6829/3024877895","heartbeat_front_addr":"172.21.15.72:6825/3024877895","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.241014+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.450799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.465018+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.507647+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.534763+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.495895+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.427110+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.547466+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-27T12:32:38.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.475+0000 7f301bc42640 1 -- 172.21.15.55:0/3076547510 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f2ff806c8f0 msgr2=0x7f2ff806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:38.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.475+0000 7f301bc42640 1 --2- 172.21.15.55:0/3076547510 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f2ff806c8f0 0x7f2ff806edb0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3010005880 tx=0x7f3010009040 comp rx=0 tx=0).stop 2024-05-27T12:32:38.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.475+0000 7f301bc42640 1 -- 172.21.15.55:0/3076547510 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30140d0560 msgr2=0x7f30141f0bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:38.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.475+0000 7f301bc42640 1 --2- 172.21.15.55:0/3076547510 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30140d0560 0x7f30141f0bb0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f300c00efc0 tx=0x7f300c00c490 comp rx=0 tx=0).stop 2024-05-27T12:32:38.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.475+0000 7f301bc42640 1 -- 172.21.15.55:0/3076547510 shutdown_connections 2024-05-27T12:32:38.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.475+0000 7f301bc42640 1 --2- 172.21.15.55:0/3076547510 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30140d0560 0x7f30141f0bb0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:38.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.475+0000 7f301bc42640 1 --2- 172.21.15.55:0/3076547510 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f30140cdbb0 0x7f301415b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:38.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.475+0000 7f301bc42640 1 --2- 172.21.15.55:0/3076547510 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f2ff806c8f0 0x7f2ff806edb0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:38.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.475+0000 7f301bc42640 1 --2- 172.21.15.55:0/3076547510 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f301409aa30 0x7f30140b50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:38.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.475+0000 7f301bc42640 1 -- 172.21.15.55:0/3076547510 >> 172.21.15.55:0/3076547510 conn(0x7f30140d2660 msgr2=0x7f301406ca40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:38.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.475+0000 7f301bc42640 1 -- 172.21.15.55:0/3076547510 shutdown_connections 2024-05-27T12:32:38.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.475+0000 7f301bc42640 1 -- 172.21.15.55:0/3076547510 wait complete. 2024-05-27T12:32:38.485 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-27T12:32:29.277895+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-27T12:32:38.486 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-27T12:32:38.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.594+0000 7f1735a8a640 1 Processor -- start 2024-05-27T12:32:38.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.594+0000 7f1735a8a640 1 -- start start 2024-05-27T12:32:38.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.595+0000 7f1735a8a640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f173015eb00 0x7f17300cfb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:38.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.595+0000 7f1735a8a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f17300d3e50 0x7f17300d1830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:38.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.595+0000 7f1735a8a640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f17300d1d70 0x7f17300d2910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:38.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.595+0000 7f1735a8a640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f17300d5700 con 0x7f17300d3e50 2024-05-27T12:32:38.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.595+0000 7f1735a8a640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f17300d2180 con 0x7f173015eb00 2024-05-27T12:32:38.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.595+0000 7f1735a8a640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f173015eee0 con 0x7f17300d1d70 2024-05-27T12:32:38.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.595+0000 7f172effd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f17300d3e50 0x7f17300d1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:38.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.595+0000 7f172effd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f17300d3e50 0x7f17300d1830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52208/0 (socket says 172.21.15.55:52208) 2024-05-27T12:32:38.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.595+0000 7f172effd640 1 -- 172.21.15.55:0/4006615994 learned_addr learned my addr 172.21.15.55:0/4006615994 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:32:38.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.595+0000 7f172f7fe640 1 --2- 172.21.15.55:0/4006615994 >> v2:172.21.15.72:3300/0 conn(0x7f173015eb00 0x7f17300cfb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:38.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.595+0000 7f172ffff640 1 --2- 172.21.15.55:0/4006615994 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f17300d1d70 0x7f17300d2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:38.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.595+0000 7f172effd640 1 -- 172.21.15.55:0/4006615994 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f17300d1d70 msgr2=0x7f17300d2910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:32:38.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.595+0000 7f172effd640 1 --2- 172.21.15.55:0/4006615994 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f17300d1d70 0x7f17300d2910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:38.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.595+0000 7f172effd640 1 -- 172.21.15.55:0/4006615994 >> v2:172.21.15.72:3300/0 conn(0x7f173015eb00 msgr2=0x7f17300cfb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:32:38.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.595+0000 7f172effd640 1 --2- 172.21.15.55:0/4006615994 >> v2:172.21.15.72:3300/0 conn(0x7f173015eb00 0x7f17300cfb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:38.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.595+0000 7f172effd640 1 -- 172.21.15.55:0/4006615994 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17300d4660 con 0x7f17300d3e50 2024-05-27T12:32:38.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.596+0000 7f172effd640 1 --2- 172.21.15.55:0/4006615994 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f17300d3e50 0x7f17300d1830 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f173006dcf0 tx=0x7f171802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dee9b44a06e45d6 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:38.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.596+0000 7f172e7fc640 1 -- 172.21.15.55:0/4006615994 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1718037070 con 0x7f17300d3e50 2024-05-27T12:32:38.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.596+0000 7f172e7fc640 1 -- 172.21.15.55:0/4006615994 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1718032440 con 0x7f17300d3e50 2024-05-27T12:32:38.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.596+0000 7f172e7fc640 1 -- 172.21.15.55:0/4006615994 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1718032810 con 0x7f17300d3e50 2024-05-27T12:32:38.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.597+0000 7f1735a8a640 1 -- 172.21.15.55:0/4006615994 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f17300d3e50 msgr2=0x7f17300d1830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:38.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.597+0000 7f1735a8a640 1 --2- 172.21.15.55:0/4006615994 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f17300d3e50 0x7f17300d1830 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f173006dcf0 tx=0x7f171802a270 comp rx=0 tx=0).stop 2024-05-27T12:32:38.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.597+0000 7f1735a8a640 1 -- 172.21.15.55:0/4006615994 shutdown_connections 2024-05-27T12:32:38.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.597+0000 7f1735a8a640 1 --2- 172.21.15.55:0/4006615994 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f17300d1d70 0x7f17300d2910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:38.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.597+0000 7f1735a8a640 1 --2- 172.21.15.55:0/4006615994 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f17300d3e50 0x7f17300d1830 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:38.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.597+0000 7f1735a8a640 1 --2- 172.21.15.55:0/4006615994 >> v2:172.21.15.72:3300/0 conn(0x7f173015eb00 0x7f17300cfb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:38.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.597+0000 7f1735a8a640 1 -- 172.21.15.55:0/4006615994 >> 172.21.15.55:0/4006615994 conn(0x7f1730067a50 msgr2=0x7f1730067e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:38.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.597+0000 7f1735a8a640 1 -- 172.21.15.55:0/4006615994 shutdown_connections 2024-05-27T12:32:38.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.597+0000 7f1735a8a640 1 -- 172.21.15.55:0/4006615994 wait complete. 2024-05-27T12:32:38.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.598+0000 7f1735a8a640 1 Processor -- start 2024-05-27T12:32:38.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.598+0000 7f1735a8a640 1 -- start start 2024-05-27T12:32:38.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.599+0000 7f1735a8a640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f17300d1d70 0x7f17301f51d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:38.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.599+0000 7f1735a8a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f17300d3e50 0x7f17300b2c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:38.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.599+0000 7f1735a8a640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f173015eb00 0x7f17300ca620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:38.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.599+0000 7f1735a8a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f17300d4f00 con 0x7f17300d3e50 2024-05-27T12:32:38.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.599+0000 7f1735a8a640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f17300d4c20 con 0x7f17300d1d70 2024-05-27T12:32:38.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.599+0000 7f1735a8a640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f17300d51e0 con 0x7f173015eb00 2024-05-27T12:32:38.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.599+0000 7f172effd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f17300d3e50 0x7f17300b2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:38.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.599+0000 7f172effd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f17300d3e50 0x7f17300b2c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52210/0 (socket says 172.21.15.55:52210) 2024-05-27T12:32:38.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.599+0000 7f172effd640 1 -- 172.21.15.55:0/3750547489 learned_addr learned my addr 172.21.15.55:0/3750547489 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:32:38.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.599+0000 7f172f7fe640 1 --2- 172.21.15.55:0/3750547489 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f17300d1d70 0x7f17301f51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:38.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.599+0000 7f172ffff640 1 --2- 172.21.15.55:0/3750547489 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f173015eb00 0x7f17300ca620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:38.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.599+0000 7f172effd640 1 -- 172.21.15.55:0/3750547489 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f173015eb00 msgr2=0x7f17300ca620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:38.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.599+0000 7f172effd640 1 --2- 172.21.15.55:0/3750547489 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f173015eb00 0x7f17300ca620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:38.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.599+0000 7f172effd640 1 -- 172.21.15.55:0/3750547489 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f17300d1d70 msgr2=0x7f17301f51d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:38.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.599+0000 7f172effd640 1 --2- 172.21.15.55:0/3750547489 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f17300d1d70 0x7f17301f51d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:38.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.599+0000 7f172effd640 1 -- 172.21.15.55:0/3750547489 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17300c9ad0 con 0x7f17300d3e50 2024-05-27T12:32:38.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.600+0000 7f172effd640 1 --2- 172.21.15.55:0/3750547489 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f17300d3e50 0x7f17300b2c60 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f171802a2b0 tx=0x7f17180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:38.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.600+0000 7f1727fff640 1 -- 172.21.15.55:0/3750547489 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1718041020 con 0x7f17300d3e50 2024-05-27T12:32:38.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.600+0000 7f1727fff640 1 -- 172.21.15.55:0/3750547489 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17180306c0 con 0x7f17300d3e50 2024-05-27T12:32:38.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.600+0000 7f1727fff640 1 -- 172.21.15.55:0/3750547489 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1718037040 con 0x7f17300d3e50 2024-05-27T12:32:38.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.600+0000 7f1735a8a640 1 -- 172.21.15.55:0/3750547489 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f173015f150 con 0x7f17300d3e50 2024-05-27T12:32:38.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.600+0000 7f1735a8a640 1 -- 172.21.15.55:0/3750547489 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f173015f9f0 con 0x7f17300d3e50 2024-05-27T12:32:38.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.601+0000 7f1735a8a640 1 -- 172.21.15.55:0/3750547489 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f173015f540 con 0x7f17300d3e50 2024-05-27T12:32:38.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.601+0000 7f1727fff640 1 -- 172.21.15.55:0/3750547489 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1718044020 con 0x7f17300d3e50 2024-05-27T12:32:38.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.602+0000 7f1727fff640 1 --2- 172.21.15.55:0/3750547489 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f171006c920 0x7f171006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:38.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.602+0000 7f1727fff640 1 -- 172.21.15.55:0/3750547489 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7f17180abf70 con 0x7f17300d3e50 2024-05-27T12:32:38.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.602+0000 7f172f7fe640 1 --2- 172.21.15.55:0/3750547489 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f171006c920 0x7f171006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:38.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.602+0000 7f172f7fe640 1 --2- 172.21.15.55:0/3750547489 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f171006c920 0x7f171006ede0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1720006fd0 tx=0x7f1720008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:38.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.606+0000 7f1727fff640 1 -- 172.21.15.55:0/3750547489 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f171804b030 con 0x7f17300d3e50 2024-05-27T12:32:38.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.796+0000 7f1735a8a640 1 -- 172.21.15.55:0/3750547489 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f1730068a70 con 0x7f17300d3e50 2024-05-27T12:32:38.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.796+0000 7f1727fff640 1 -- 172.21.15.55:0/3750547489 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v19) ==== 93+0+10 (secure 0 0 0) 0x7f171807a780 con 0x7f17300d3e50 2024-05-27T12:32:38.796 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-05-27T12:32:38.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.798+0000 7f1735a8a640 1 -- 172.21.15.55:0/3750547489 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f171006c920 msgr2=0x7f171006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:38.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.798+0000 7f1735a8a640 1 --2- 172.21.15.55:0/3750547489 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f171006c920 0x7f171006ede0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1720006fd0 tx=0x7f1720008040 comp rx=0 tx=0).stop 2024-05-27T12:32:38.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.798+0000 7f1735a8a640 1 -- 172.21.15.55:0/3750547489 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f17300d3e50 msgr2=0x7f17300b2c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:38.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.798+0000 7f1735a8a640 1 --2- 172.21.15.55:0/3750547489 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f17300d3e50 0x7f17300b2c60 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f171802a2b0 tx=0x7f17180046c0 comp rx=0 tx=0).stop 2024-05-27T12:32:38.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.798+0000 7f1735a8a640 1 -- 172.21.15.55:0/3750547489 shutdown_connections 2024-05-27T12:32:38.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.798+0000 7f1735a8a640 1 --2- 172.21.15.55:0/3750547489 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f173015eb00 0x7f17300ca620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:38.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.798+0000 7f1735a8a640 1 --2- 172.21.15.55:0/3750547489 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f17300d3e50 0x7f17300b2c60 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:38.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.798+0000 7f1735a8a640 1 --2- 172.21.15.55:0/3750547489 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f171006c920 0x7f171006ede0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:38.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.798+0000 7f1735a8a640 1 --2- 172.21.15.55:0/3750547489 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f17300d1d70 0x7f17301f51d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:38.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.798+0000 7f1735a8a640 1 -- 172.21.15.55:0/3750547489 >> 172.21.15.55:0/3750547489 conn(0x7f1730067a50 msgr2=0x7f17300b78f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:38.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.798+0000 7f1735a8a640 1 -- 172.21.15.55:0/3750547489 shutdown_connections 2024-05-27T12:32:38.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.798+0000 7f1735a8a640 1 -- 172.21.15.55:0/3750547489 wait complete. 2024-05-27T12:32:38.809 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-27T12:32:38.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.913+0000 7fa998576640 1 Processor -- start 2024-05-27T12:32:38.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.913+0000 7fa998576640 1 -- start start 2024-05-27T12:32:38.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.914+0000 7fa998576640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa9901620b0 0x7fa9900b79c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:38.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.914+0000 7fa998576640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa9900cf8d0 0x7fa99006ce80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:38.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.914+0000 7fa998576640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa9900cfd30 0x7fa99006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:38.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.914+0000 7fa998576640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7fa9900d56d0 con 0x7fa9900cfd30 2024-05-27T12:32:38.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.914+0000 7fa998576640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fa9900b7f00 con 0x7fa9901620b0 2024-05-27T12:32:38.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.914+0000 7fa998576640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fa9900b39a0 con 0x7fa9900cf8d0 2024-05-27T12:32:38.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.914+0000 7fa996b13640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa9900cfd30 0x7fa99006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:38.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.914+0000 7fa996b13640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa9900cfd30 0x7fa99006d3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52222/0 (socket says 172.21.15.55:52222) 2024-05-27T12:32:38.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.914+0000 7fa996b13640 1 -- 172.21.15.55:0/3579357078 learned_addr learned my addr 172.21.15.55:0/3579357078 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:32:38.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.914+0000 7fa996312640 1 --2- 172.21.15.55:0/3579357078 >> v2:172.21.15.72:3300/0 conn(0x7fa9901620b0 0x7fa9900b79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:38.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.914+0000 7fa995b11640 1 --2- 172.21.15.55:0/3579357078 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa9900cf8d0 0x7fa99006ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:38.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.914+0000 7fa996b13640 1 -- 172.21.15.55:0/3579357078 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa9900cf8d0 msgr2=0x7fa99006ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:32:38.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.914+0000 7fa996b13640 1 --2- 172.21.15.55:0/3579357078 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa9900cf8d0 0x7fa99006ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:38.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.914+0000 7fa996b13640 1 -- 172.21.15.55:0/3579357078 >> v2:172.21.15.72:3300/0 conn(0x7fa9901620b0 msgr2=0x7fa9900b79c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:32:38.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.914+0000 7fa996b13640 1 --2- 172.21.15.55:0/3579357078 >> v2:172.21.15.72:3300/0 conn(0x7fa9901620b0 0x7fa9900b79c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:38.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.914+0000 7fa996b13640 1 -- 172.21.15.55:0/3579357078 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9900b3c80 con 0x7fa9900cfd30 2024-05-27T12:32:38.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.914+0000 7fa996312640 1 --2- 172.21.15.55:0/3579357078 >> v2:172.21.15.72:3300/0 conn(0x7fa9901620b0 0x7fa9900b79c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T12:32:38.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.915+0000 7fa996b13640 1 --2- 172.21.15.55:0/3579357078 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9900cfd30 0x7fa99006d3c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa99006e000 tx=0x7fa98802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d7124d2088dd335 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:38.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.915+0000 7fa995310640 1 -- 172.21.15.55:0/3579357078 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa988036070 con 0x7fa9900cfd30 2024-05-27T12:32:38.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.915+0000 7fa995310640 1 -- 172.21.15.55:0/3579357078 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa988031600 con 0x7fa9900cfd30 2024-05-27T12:32:38.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.915+0000 7fa995310640 1 -- 172.21.15.55:0/3579357078 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9880319d0 con 0x7fa9900cfd30 2024-05-27T12:32:38.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.916+0000 7fa998576640 1 -- 172.21.15.55:0/3579357078 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9900cfd30 msgr2=0x7fa99006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:38.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.916+0000 7fa998576640 1 --2- 172.21.15.55:0/3579357078 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9900cfd30 0x7fa99006d3c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa99006e000 tx=0x7fa98802a6a0 comp rx=0 tx=0).stop 2024-05-27T12:32:38.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.916+0000 7fa998576640 1 -- 172.21.15.55:0/3579357078 shutdown_connections 2024-05-27T12:32:38.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.916+0000 7fa998576640 1 --2- 172.21.15.55:0/3579357078 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9900cfd30 0x7fa99006d3c0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:38.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.916+0000 7fa998576640 1 --2- 172.21.15.55:0/3579357078 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa9900cf8d0 0x7fa99006ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:38.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.916+0000 7fa998576640 1 --2- 172.21.15.55:0/3579357078 >> v2:172.21.15.72:3300/0 conn(0x7fa9901620b0 0x7fa9900b79c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:38.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.916+0000 7fa998576640 1 -- 172.21.15.55:0/3579357078 >> 172.21.15.55:0/3579357078 conn(0x7fa9900d1940 msgr2=0x7fa9900d4890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:38.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.916+0000 7fa998576640 1 -- 172.21.15.55:0/3579357078 shutdown_connections 2024-05-27T12:32:38.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.916+0000 7fa998576640 1 -- 172.21.15.55:0/3579357078 wait complete. 2024-05-27T12:32:38.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.917+0000 7fa998576640 1 Processor -- start 2024-05-27T12:32:38.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.917+0000 7fa998576640 1 -- start start 2024-05-27T12:32:38.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.918+0000 7fa998576640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa9900cf8d0 0x7fa9900b86f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:38.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.918+0000 7fa998576640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9900cfd30 0x7fa99015d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:38.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.918+0000 7fa998576640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa9901620b0 0x7fa99014a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:38.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.918+0000 7fa998576640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7fa9900d3430 con 0x7fa9900cfd30 2024-05-27T12:32:38.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.918+0000 7fa998576640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fa9900d3150 con 0x7fa9900cf8d0 2024-05-27T12:32:38.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.918+0000 7fa998576640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fa9900b3650 con 0x7fa9901620b0 2024-05-27T12:32:38.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.918+0000 7fa995b11640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9900cfd30 0x7fa99015d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:38.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.918+0000 7fa995b11640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9900cfd30 0x7fa99015d4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52226/0 (socket says 172.21.15.55:52226) 2024-05-27T12:32:38.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.918+0000 7fa995b11640 1 -- 172.21.15.55:0/3949615099 learned_addr learned my addr 172.21.15.55:0/3949615099 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:32:38.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.918+0000 7fa996312640 1 --2- 172.21.15.55:0/3949615099 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa9900cf8d0 0x7fa9900b86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:38.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.918+0000 7fa996b13640 1 --2- 172.21.15.55:0/3949615099 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa9901620b0 0x7fa99014a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:38.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.918+0000 7fa995b11640 1 -- 172.21.15.55:0/3949615099 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa9901620b0 msgr2=0x7fa99014a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:38.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.918+0000 7fa995b11640 1 --2- 172.21.15.55:0/3949615099 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa9901620b0 0x7fa99014a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:38.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.918+0000 7fa995b11640 1 -- 172.21.15.55:0/3949615099 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa9900cf8d0 msgr2=0x7fa9900b86f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:38.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.918+0000 7fa995b11640 1 --2- 172.21.15.55:0/3949615099 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa9900cf8d0 0x7fa9900b86f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:38.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.918+0000 7fa995b11640 1 -- 172.21.15.55:0/3949615099 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9900b8df0 con 0x7fa9900cfd30 2024-05-27T12:32:38.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.918+0000 7fa996312640 1 --2- 172.21.15.55:0/3949615099 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa9900cf8d0 0x7fa9900b86f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T12:32:38.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.918+0000 7fa996b13640 1 --2- 172.21.15.55:0/3949615099 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa9901620b0 0x7fa99014a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T12:32:38.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.918+0000 7fa995b11640 1 --2- 172.21.15.55:0/3949615099 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9900cfd30 0x7fa99015d4c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa98000d830 tx=0x7fa98000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:38.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.918+0000 7fa986ffd640 1 -- 172.21.15.55:0/3949615099 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa980018030 con 0x7fa9900cfd30 2024-05-27T12:32:38.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.918+0000 7fa986ffd640 1 -- 172.21.15.55:0/3949615099 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa98000be10 con 0x7fa9900cfd30 2024-05-27T12:32:38.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.918+0000 7fa998576640 1 -- 172.21.15.55:0/3949615099 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9900b90d0 con 0x7fa9900cfd30 2024-05-27T12:32:38.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.918+0000 7fa986ffd640 1 -- 172.21.15.55:0/3949615099 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9800098b0 con 0x7fa9900cfd30 2024-05-27T12:32:38.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.919+0000 7fa998576640 1 -- 172.21.15.55:0/3949615099 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9900b9690 con 0x7fa9900cfd30 2024-05-27T12:32:38.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.919+0000 7fa998576640 1 -- 172.21.15.55:0/3949615099 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa990075460 con 0x7fa9900cfd30 2024-05-27T12:32:38.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.920+0000 7fa986ffd640 1 -- 172.21.15.55:0/3949615099 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa98001b070 con 0x7fa9900cfd30 2024-05-27T12:32:38.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.921+0000 7fa986ffd640 1 --2- 172.21.15.55:0/3949615099 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fa97406c8f0 0x7fa97406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:38.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.921+0000 7fa986ffd640 1 -- 172.21.15.55:0/3949615099 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7fa98008ba00 con 0x7fa9900cfd30 2024-05-27T12:32:38.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.921+0000 7fa996312640 1 --2- 172.21.15.55:0/3949615099 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fa97406c8f0 0x7fa97406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:38.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.922+0000 7fa996312640 1 --2- 172.21.15.55:0/3949615099 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fa97406c8f0 0x7fa97406edb0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa98c006fd0 tx=0x7fa98c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:38.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:38.925+0000 7fa986ffd640 1 -- 172.21.15.55:0/3949615099 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa98005a180 con 0x7fa9900cfd30 2024-05-27T12:32:39.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:39.115+0000 7fa998576640 1 -- 172.21.15.55:0/3949615099 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fa99006db20 con 0x7fa9900cfd30 2024-05-27T12:32:39.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:39.115+0000 7fa986ffd640 1 -- 172.21.15.55:0/3949615099 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v19) ==== 84+0+65 (secure 0 0 0) 0x7fa980059a80 con 0x7fa9900cfd30 2024-05-27T12:32:39.114 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-27T12:32:39.114 INFO:teuthology.orchestra.run.smithi055.stdout:[ 2024-05-27T12:32:39.115 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-05-27T12:32:39.115 INFO:teuthology.orchestra.run.smithi055.stdout: "poolnum": 1, 2024-05-27T12:32:39.115 INFO:teuthology.orchestra.run.smithi055.stdout: "poolname": ".mgr" 2024-05-27T12:32:39.115 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-05-27T12:32:39.115 INFO:teuthology.orchestra.run.smithi055.stdout:] 2024-05-27T12:32:39.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:39.117+0000 7fa998576640 1 -- 172.21.15.55:0/3949615099 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fa97406c8f0 msgr2=0x7fa97406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:39.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:39.117+0000 7fa998576640 1 --2- 172.21.15.55:0/3949615099 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fa97406c8f0 0x7fa97406edb0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa98c006fd0 tx=0x7fa98c008040 comp rx=0 tx=0).stop 2024-05-27T12:32:39.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:39.117+0000 7fa998576640 1 -- 172.21.15.55:0/3949615099 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9900cfd30 msgr2=0x7fa99015d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:39.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:39.117+0000 7fa998576640 1 --2- 172.21.15.55:0/3949615099 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9900cfd30 0x7fa99015d4c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa98000d830 tx=0x7fa98000dcf0 comp rx=0 tx=0).stop 2024-05-27T12:32:39.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:39.117+0000 7fa998576640 1 -- 172.21.15.55:0/3949615099 shutdown_connections 2024-05-27T12:32:39.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:39.117+0000 7fa998576640 1 --2- 172.21.15.55:0/3949615099 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa9901620b0 0x7fa99014a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:39.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:39.117+0000 7fa998576640 1 --2- 172.21.15.55:0/3949615099 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9900cfd30 0x7fa99015d4c0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:39.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:39.117+0000 7fa998576640 1 --2- 172.21.15.55:0/3949615099 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fa97406c8f0 0x7fa97406edb0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:39.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:39.117+0000 7fa998576640 1 --2- 172.21.15.55:0/3949615099 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa9900cf8d0 0x7fa9900b86f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:39.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:39.117+0000 7fa998576640 1 -- 172.21.15.55:0/3949615099 >> 172.21.15.55:0/3949615099 conn(0x7fa9900d1940 msgr2=0x7fa99015f8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:39.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:39.117+0000 7fa998576640 1 -- 172.21.15.55:0/3949615099 shutdown_connections 2024-05-27T12:32:39.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:39.117+0000 7fa998576640 1 -- 172.21.15.55:0/3949615099 wait complete. 2024-05-27T12:32:39.127 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-27T12:32:39.127 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-27T12:32:39.235 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:39.236+0000 7fc9acd68640 1 Processor -- start 2024-05-27T12:32:39.235 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:39.236+0000 7fc9acd68640 1 -- start start 2024-05-27T12:32:39.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:39.237+0000 7fc9acd68640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc9a815eb00 0x7fc9a80cfb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:39.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:39.237+0000 7fc9acd68640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc9a80d1f40 0x7fc9a80b78f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:39.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:39.237+0000 7fc9acd68640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9a815eee0 con 0x7fc9a80d3e50 2024-05-27T12:32:39.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:39.237+0000 7fc9acd68640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7fc9a80d5700 con 0x7fc9a815eb00 2024-05-27T12:32:39.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:39.237+0000 7fc9acd68640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fc9a80d4660 con 0x7fc9a80d1f40 2024-05-27T12:32:39.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:39.237+0000 7fc9a659c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc9a815eb00 0x7fc9a80cfb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:39.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:39.237+0000 7fc9a5d9b640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fc9a80d3e50 0x7fc9a80d1830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:47952/0 (socket says 172.21.15.55:47952) 2024-05-27T12:32:39.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:39.237+0000 7fc9a659c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc9a815eb00 0x7fc9a80cfb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52238/0 (socket says 172.21.15.55:52238) 2024-05-27T12:32:39.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:39.237+0000 7fc9a5d9b640 1 -- 172.21.15.55:0/2162455741 learned_addr learned my addr 172.21.15.55:0/2162455741 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-27T12:32:39.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:39.237+0000 7fc9a6d9d640 1 --2- 172.21.15.55:0/2162455741 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc9a80d1f40 0x7fc9a80b78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:39.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:39.237+0000 7fc9a659c640 1 -- 172.21.15.55:0/2162455741 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc9a80d1f40 msgr2=0x7fc9a80b78f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:32:39.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:39.237+0000 7fc9a659c640 1 --2- 172.21.15.55:0/2162455741 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc9a80d1f40 0x7fc9a80b78f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:39.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:39.237+0000 7fc9a659c640 1 -- 172.21.15.55:0/2162455741 >> v1:172.21.15.55:6789/0 conn(0x7fc9a80d3e50 legacy=0x7fc9a80d1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:39.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:39.238+0000 7fc9a659c640 1 -- 172.21.15.55:0/2162455741 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9a80d4940 con 0x7fc9a815eb00 2024-05-27T12:32:39.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:39.238+0000 7fc9a559a640 1 -- 172.21.15.55:0/2162455741 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1579940769 0 0) 0x7fc9a815eee0 con 0x7fc9a80d3e50 2024-05-27T12:32:39.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:39.238+0000 7fc9a659c640 1 --2- 172.21.15.55:0/2162455741 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9a815eb00 0x7fc9a80cfb40 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc9a0009d90 tx=0x7fc9a002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3dd7b1a14074d53 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:39.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:39.238+0000 7fc9a559a640 1 -- 172.21.15.55:0/2162455741 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9a0007740 con 0x7fc9a815eb00 2024-05-27T12:32:39.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:39.238+0000 7fc9a559a640 1 -- 172.21.15.55:0/2162455741 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9a00078e0 con 0x7fc9a815eb00 2024-05-27T12:32:39.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:39.238+0000 7fc9a559a640 1 -- 172.21.15.55:0/2162455741 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9a0007cb0 con 0x7fc9a815eb00 2024-05-27T12:32:39.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:39.239+0000 7fc9acd68640 1 -- 172.21.15.55:0/2162455741 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9a815eb00 msgr2=0x7fc9a80cfb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:39.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:39.239+0000 7fc9acd68640 1 --2- 172.21.15.55:0/2162455741 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9a815eb00 0x7fc9a80cfb40 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc9a0009d90 tx=0x7fc9a002a6f0 comp rx=0 tx=0).stop 2024-05-27T12:32:39.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:39.239+0000 7fc9acd68640 1 -- 172.21.15.55:0/2162455741 shutdown_connections 2024-05-27T12:32:39.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:39.239+0000 7fc9acd68640 1 --2- 172.21.15.55:0/2162455741 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc9a80d1f40 0x7fc9a80b78f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:39.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:39.239+0000 7fc9acd68640 1 --2- 172.21.15.55:0/2162455741 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9a815eb00 0x7fc9a80cfb40 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:39.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:39.239+0000 7fc9acd68640 1 -- 172.21.15.55:0/2162455741 >> 172.21.15.55:0/2162455741 conn(0x7fc9a8067a50 msgr2=0x7fc9a8067e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:39.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:39.239+0000 7fc9acd68640 1 -- 172.21.15.55:0/2162455741 shutdown_connections 2024-05-27T12:32:39.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:39.239+0000 7fc9acd68640 1 -- 172.21.15.55:0/2162455741 wait complete. 2024-05-27T12:32:39.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:39.240+0000 7fc9acd68640 1 Processor -- start 2024-05-27T12:32:39.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:39.240+0000 7fc9acd68640 1 -- start start 2024-05-27T12:32:39.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:39.241+0000 7fc9acd68640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc9a80d1f40 0x7fc9a80c85c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:39.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:39.241+0000 7fc9acd68640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc9a80d3e50 0x7fc9a8153e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:39.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:39.241+0000 7fc9acd68640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9a815eb00 0x7fc9a81614d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:39.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:39.241+0000 7fc9acd68640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7fc9a80d51e0 con 0x7fc9a815eb00 2024-05-27T12:32:39.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:39.241+0000 7fc9acd68640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fc9a80d4f00 con 0x7fc9a80d1f40 2024-05-27T12:32:39.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:39.241+0000 7fc9acd68640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fc9a80d42c0 con 0x7fc9a80d3e50 2024-05-27T12:32:39.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:39.241+0000 7fc9a6d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9a815eb00 0x7fc9a81614d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:39.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:39.241+0000 7fc9a6d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9a815eb00 0x7fc9a81614d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52240/0 (socket says 172.21.15.55:52240) 2024-05-27T12:32:39.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:39.241+0000 7fc9a6d9d640 1 -- 172.21.15.55:0/3482288770 learned_addr learned my addr 172.21.15.55:0/3482288770 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:32:39.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:39.241+0000 7fc9a659c640 1 --2- 172.21.15.55:0/3482288770 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc9a80d1f40 0x7fc9a80c85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:39.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:39.242+0000 7fc9a5d9b640 1 --2- 172.21.15.55:0/3482288770 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc9a80d3e50 0x7fc9a8153e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:39.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:39.242+0000 7fc9a6d9d640 1 -- 172.21.15.55:0/3482288770 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc9a80d3e50 msgr2=0x7fc9a8153e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:39.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:39.242+0000 7fc9a6d9d640 1 --2- 172.21.15.55:0/3482288770 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc9a80d3e50 0x7fc9a8153e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:39.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:39.242+0000 7fc9a6d9d640 1 -- 172.21.15.55:0/3482288770 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc9a80d1f40 msgr2=0x7fc9a80c85c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:39.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:39.242+0000 7fc9a6d9d640 1 --2- 172.21.15.55:0/3482288770 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc9a80d1f40 0x7fc9a80c85c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:39.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:39.242+0000 7fc9a6d9d640 1 -- 172.21.15.55:0/3482288770 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9a8161a10 con 0x7fc9a815eb00 2024-05-27T12:32:39.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:39.242+0000 7fc9a659c640 1 --2- 172.21.15.55:0/3482288770 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc9a80d1f40 0x7fc9a80c85c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T12:32:39.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:39.242+0000 7fc9a6d9d640 1 --2- 172.21.15.55:0/3482288770 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9a815eb00 0x7fc9a81614d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc99800d600 tx=0x7fc99800dac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:39.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:39.242+0000 7fc99effd640 1 -- 172.21.15.55:0/3482288770 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9980125f0 con 0x7fc9a815eb00 2024-05-27T12:32:39.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:39.242+0000 7fc99effd640 1 -- 172.21.15.55:0/3482288770 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc998019070 con 0x7fc9a815eb00 2024-05-27T12:32:39.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:39.242+0000 7fc9acd68640 1 -- 172.21.15.55:0/3482288770 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9a8161f90 con 0x7fc9a815eb00 2024-05-27T12:32:39.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:39.242+0000 7fc99effd640 1 -- 172.21.15.55:0/3482288770 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9980129f0 con 0x7fc9a815eb00 2024-05-27T12:32:39.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:39.242+0000 7fc9acd68640 1 -- 172.21.15.55:0/3482288770 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9a80cbc70 con 0x7fc9a815eb00 2024-05-27T12:32:39.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:39.243+0000 7fc9acd68640 1 -- 172.21.15.55:0/3482288770 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9a8068a70 con 0x7fc9a815eb00 2024-05-27T12:32:39.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:39.243+0000 7fc99effd640 1 -- 172.21.15.55:0/3482288770 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc998012b90 con 0x7fc9a815eb00 2024-05-27T12:32:39.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:39.244+0000 7fc99effd640 1 --2- 172.21.15.55:0/3482288770 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fc98806c8f0 0x7fc98806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:39.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:39.244+0000 7fc99effd640 1 -- 172.21.15.55:0/3482288770 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7fc99808bbe0 con 0x7fc9a815eb00 2024-05-27T12:32:39.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:39.244+0000 7fc9a659c640 1 --2- 172.21.15.55:0/3482288770 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fc98806c8f0 0x7fc98806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:39.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:39.245+0000 7fc9a659c640 1 --2- 172.21.15.55:0/3482288770 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fc98806c8f0 0x7fc98806edb0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc9a0034000 tx=0x7fc9a002f000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:39.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:39.248+0000 7fc99effd640 1 -- 172.21.15.55:0/3482288770 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc99805a370 con 0x7fc9a815eb00 2024-05-27T12:32:39.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:39.438+0000 7fc9acd68640 1 -- 172.21.15.55:0/3482288770 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fc9a80cf740 con 0x7fc9a815eb00 2024-05-27T12:32:40.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:40.332+0000 7fc99effd640 1 -- 172.21.15.55:0/3482288770 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v20) ==== 138+0+0 (secure 0 0 0) 0x7fc998060070 con 0x7fc9a815eb00 2024-05-27T12:32:40.332 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_metadata' created 2024-05-27T12:32:40.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:40.335+0000 7fc9acd68640 1 -- 172.21.15.55:0/3482288770 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fc98806c8f0 msgr2=0x7fc98806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:40.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:40.335+0000 7fc9acd68640 1 --2- 172.21.15.55:0/3482288770 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fc98806c8f0 0x7fc98806edb0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc9a0034000 tx=0x7fc9a002f000 comp rx=0 tx=0).stop 2024-05-27T12:32:40.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:40.335+0000 7fc9acd68640 1 -- 172.21.15.55:0/3482288770 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9a815eb00 msgr2=0x7fc9a81614d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:40.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:40.335+0000 7fc9acd68640 1 --2- 172.21.15.55:0/3482288770 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9a815eb00 0x7fc9a81614d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc99800d600 tx=0x7fc99800dac0 comp rx=0 tx=0).stop 2024-05-27T12:32:40.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:40.335+0000 7fc9acd68640 1 -- 172.21.15.55:0/3482288770 shutdown_connections 2024-05-27T12:32:40.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:40.335+0000 7fc9acd68640 1 --2- 172.21.15.55:0/3482288770 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9a815eb00 0x7fc9a81614d0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:40.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:40.335+0000 7fc9acd68640 1 --2- 172.21.15.55:0/3482288770 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc9a80d3e50 0x7fc9a8153e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:40.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:40.335+0000 7fc9acd68640 1 --2- 172.21.15.55:0/3482288770 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fc98806c8f0 0x7fc98806edb0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:40.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:40.335+0000 7fc9acd68640 1 --2- 172.21.15.55:0/3482288770 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc9a80d1f40 0x7fc9a80c85c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:40.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:40.336+0000 7fc9acd68640 1 -- 172.21.15.55:0/3482288770 >> 172.21.15.55:0/3482288770 conn(0x7fc9a8067a50 msgr2=0x7fc9a80d1830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:40.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:40.336+0000 7fc9acd68640 1 -- 172.21.15.55:0/3482288770 shutdown_connections 2024-05-27T12:32:40.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:40.336+0000 7fc9acd68640 1 -- 172.21.15.55:0/3482288770 wait complete. 2024-05-27T12:32:40.353 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-05-27T12:32:40.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:40.470+0000 7f62f9fad640 1 Processor -- start 2024-05-27T12:32:40.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:40.470+0000 7f62f9fad640 1 -- start start 2024-05-27T12:32:40.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:40.471+0000 7f62f9fad640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f62f406d000 0x7f62f4161d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:40.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:40.471+0000 7f62f9fad640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f62f40cb5f0 0x7f62f4162290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:40.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:40.471+0000 7f62f9fad640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f62f40cf9b0 0x7f62f40d25b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:40.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:40.471+0000 7f62f9fad640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f62f40cff20 con 0x7f62f406d000 2024-05-27T12:32:40.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:40.471+0000 7f62f9fad640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f62f40d41e0 con 0x7f62f40cb5f0 2024-05-27T12:32:40.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:40.471+0000 7f62f9fad640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f62f40d44c0 con 0x7f62f40cf9b0 2024-05-27T12:32:40.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:40.471+0000 7f62f37fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f62f406d000 0x7f62f4161d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:40.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:40.471+0000 7f62f37fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f62f406d000 0x7f62f4161d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52256/0 (socket says 172.21.15.55:52256) 2024-05-27T12:32:40.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:40.471+0000 7f62f37fe640 1 -- 172.21.15.55:0/1625298193 learned_addr learned my addr 172.21.15.55:0/1625298193 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:32:40.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:40.471+0000 7f62f3fff640 1 --2- 172.21.15.55:0/1625298193 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f62f40cf9b0 0x7f62f40d25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:40.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:40.471+0000 7f62f2ffd640 1 --2- 172.21.15.55:0/1625298193 >> v2:172.21.15.72:3300/0 conn(0x7f62f40cb5f0 0x7f62f4162290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:40.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:40.472+0000 7f62f37fe640 1 -- 172.21.15.55:0/1625298193 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f62f40cf9b0 msgr2=0x7f62f40d25b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:32:40.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:40.472+0000 7f62f37fe640 1 --2- 172.21.15.55:0/1625298193 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f62f40cf9b0 0x7f62f40d25b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:40.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:40.472+0000 7f62f37fe640 1 -- 172.21.15.55:0/1625298193 >> v2:172.21.15.72:3300/0 conn(0x7f62f40cb5f0 msgr2=0x7f62f4162290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:32:40.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:40.472+0000 7f62f37fe640 1 --2- 172.21.15.55:0/1625298193 >> v2:172.21.15.72:3300/0 conn(0x7f62f40cb5f0 0x7f62f4162290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:40.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:40.472+0000 7f62f37fe640 1 -- 172.21.15.55:0/1625298193 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62f40d47a0 con 0x7f62f406d000 2024-05-27T12:32:40.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:40.472+0000 7f62f2ffd640 1 --2- 172.21.15.55:0/1625298193 >> v2:172.21.15.72:3300/0 conn(0x7f62f40cb5f0 0x7f62f4162290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T12:32:40.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:40.472+0000 7f62f37fe640 1 --2- 172.21.15.55:0/1625298193 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62f406d000 0x7f62f4161d50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f62f40d2510 tx=0x7f62e402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f911cdfa1bac3d9 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:40.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:40.473+0000 7f62f27fc640 1 -- 172.21.15.55:0/1625298193 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62e4037070 con 0x7f62f406d000 2024-05-27T12:32:40.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:40.473+0000 7f62f27fc640 1 -- 172.21.15.55:0/1625298193 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62e4032440 con 0x7f62f406d000 2024-05-27T12:32:40.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:40.473+0000 7f62f27fc640 1 -- 172.21.15.55:0/1625298193 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62e4032810 con 0x7f62f406d000 2024-05-27T12:32:40.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:40.473+0000 7f62f9fad640 1 -- 172.21.15.55:0/1625298193 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62f406d000 msgr2=0x7f62f4161d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:40.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:40.473+0000 7f62f9fad640 1 --2- 172.21.15.55:0/1625298193 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62f406d000 0x7f62f4161d50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f62f40d2510 tx=0x7f62e402a1e0 comp rx=0 tx=0).stop 2024-05-27T12:32:40.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:40.473+0000 7f62f9fad640 1 -- 172.21.15.55:0/1625298193 shutdown_connections 2024-05-27T12:32:40.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:40.473+0000 7f62f9fad640 1 --2- 172.21.15.55:0/1625298193 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f62f40cf9b0 0x7f62f40d25b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:40.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:40.473+0000 7f62f9fad640 1 --2- 172.21.15.55:0/1625298193 >> v2:172.21.15.72:3300/0 conn(0x7f62f40cb5f0 0x7f62f4162290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:40.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:40.473+0000 7f62f9fad640 1 --2- 172.21.15.55:0/1625298193 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62f406d000 0x7f62f4161d50 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:40.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:40.473+0000 7f62f9fad640 1 -- 172.21.15.55:0/1625298193 >> 172.21.15.55:0/1625298193 conn(0x7f62f40d1a90 msgr2=0x7f62f40d49e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:40.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:40.473+0000 7f62f9fad640 1 -- 172.21.15.55:0/1625298193 shutdown_connections 2024-05-27T12:32:40.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:40.473+0000 7f62f9fad640 1 -- 172.21.15.55:0/1625298193 wait complete. 2024-05-27T12:32:40.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:40.474+0000 7f62f9fad640 1 Processor -- start 2024-05-27T12:32:40.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:40.475+0000 7f62f9fad640 1 -- start start 2024-05-27T12:32:40.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:40.475+0000 7f62f9fad640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f62f406d000 0x7f62f41f3d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:40.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:40.475+0000 7f62f9fad640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62f40cb5f0 0x7f62f40ac120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:40.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:40.475+0000 7f62f9fad640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f62f40cf9b0 0x7f62f40ac660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:40.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:40.475+0000 7f62f9fad640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f62f406d3e0 con 0x7f62f40cb5f0 2024-05-27T12:32:40.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:40.475+0000 7f62f9fad640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f62f40d5990 con 0x7f62f40cf9b0 2024-05-27T12:32:40.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:40.475+0000 7f62f9fad640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f62f406d560 con 0x7f62f406d000 2024-05-27T12:32:40.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:40.475+0000 7f62f2ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62f40cb5f0 0x7f62f40ac120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:40.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:40.475+0000 7f62f2ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62f40cb5f0 0x7f62f40ac120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52262/0 (socket says 172.21.15.55:52262) 2024-05-27T12:32:40.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:40.475+0000 7f62f2ffd640 1 -- 172.21.15.55:0/1112298463 learned_addr learned my addr 172.21.15.55:0/1112298463 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:32:40.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:40.476+0000 7f62f3fff640 1 --2- 172.21.15.55:0/1112298463 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f62f40cf9b0 0x7f62f40ac660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:40.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:40.476+0000 7f62f37fe640 1 --2- 172.21.15.55:0/1112298463 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f62f406d000 0x7f62f41f3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:40.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:40.476+0000 7f62f2ffd640 1 -- 172.21.15.55:0/1112298463 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f62f406d000 msgr2=0x7f62f41f3d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:40.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:40.476+0000 7f62f2ffd640 1 --2- 172.21.15.55:0/1112298463 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f62f406d000 0x7f62f41f3d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:40.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:40.476+0000 7f62f2ffd640 1 -- 172.21.15.55:0/1112298463 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f62f40cf9b0 msgr2=0x7f62f40ac660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:40.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:40.476+0000 7f62f2ffd640 1 --2- 172.21.15.55:0/1112298463 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f62f40cf9b0 0x7f62f40ac660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:40.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:40.476+0000 7f62f2ffd640 1 -- 172.21.15.55:0/1112298463 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62f415dd40 con 0x7f62f40cb5f0 2024-05-27T12:32:40.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:40.476+0000 7f62f3fff640 1 --2- 172.21.15.55:0/1112298463 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f62f40cf9b0 0x7f62f40ac660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T12:32:40.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:40.476+0000 7f62f2ffd640 1 --2- 172.21.15.55:0/1112298463 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62f40cb5f0 0x7f62f40ac120 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f62e800e810 tx=0x7f62e800ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:40.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:40.476+0000 7f62dbfff640 1 -- 172.21.15.55:0/1112298463 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62e800f040 con 0x7f62f40cb5f0 2024-05-27T12:32:40.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:40.476+0000 7f62dbfff640 1 -- 172.21.15.55:0/1112298463 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62e8004030 con 0x7f62f40cb5f0 2024-05-27T12:32:40.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:40.476+0000 7f62dbfff640 1 -- 172.21.15.55:0/1112298463 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62e8004400 con 0x7f62f40cb5f0 2024-05-27T12:32:40.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:40.476+0000 7f62f9fad640 1 -- 172.21.15.55:0/1112298463 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62f415e020 con 0x7f62f40cb5f0 2024-05-27T12:32:40.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:40.476+0000 7f62f9fad640 1 -- 172.21.15.55:0/1112298463 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62f415e5e0 con 0x7f62f40cb5f0 2024-05-27T12:32:40.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:40.477+0000 7f62f9fad640 1 -- 172.21.15.55:0/1112298463 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62f4068b50 con 0x7f62f40cb5f0 2024-05-27T12:32:40.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:40.478+0000 7f62dbfff640 1 -- 172.21.15.55:0/1112298463 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f62e800c6d0 con 0x7f62f40cb5f0 2024-05-27T12:32:40.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:40.478+0000 7f62dbfff640 1 --2- 172.21.15.55:0/1112298463 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f62e006c8f0 0x7f62e006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:40.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:40.478+0000 7f62dbfff640 1 -- 172.21.15.55:0/1112298463 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5227+0+0 (secure 0 0 0) 0x7f62e808b670 con 0x7f62f40cb5f0 2024-05-27T12:32:40.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:40.478+0000 7f62f37fe640 1 --2- 172.21.15.55:0/1112298463 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f62e006c8f0 0x7f62e006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:40.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:40.479+0000 7f62f37fe640 1 --2- 172.21.15.55:0/1112298463 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f62e006c8f0 0x7f62e006edb0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f62e4034000 tx=0x7f62e402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:40.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:40.483+0000 7f62dbfff640 1 -- 172.21.15.55:0/1112298463 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f62e8017020 con 0x7f62f40cb5f0 2024-05-27T12:32:40.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:40.668+0000 7f62f9fad640 1 -- 172.21.15.55:0/1112298463 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f62f40cbc50 con 0x7f62f40cb5f0 2024-05-27T12:32:41.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:41.343+0000 7f62dbfff640 1 -- 172.21.15.55:0/1112298463 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v21) ==== 170+0+0 (secure 0 0 0) 0x7f62e8059c80 con 0x7f62f40cb5f0 2024-05-27T12:32:41.348 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_data' created 2024-05-27T12:32:41.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:41.346+0000 7f62f9fad640 1 -- 172.21.15.55:0/1112298463 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f62e006c8f0 msgr2=0x7f62e006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:41.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:41.346+0000 7f62f9fad640 1 --2- 172.21.15.55:0/1112298463 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f62e006c8f0 0x7f62e006edb0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f62e4034000 tx=0x7f62e402e000 comp rx=0 tx=0).stop 2024-05-27T12:32:41.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:41.346+0000 7f62f9fad640 1 -- 172.21.15.55:0/1112298463 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62f40cb5f0 msgr2=0x7f62f40ac120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:41.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:41.346+0000 7f62f9fad640 1 --2- 172.21.15.55:0/1112298463 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62f40cb5f0 0x7f62f40ac120 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f62e800e810 tx=0x7f62e800ecd0 comp rx=0 tx=0).stop 2024-05-27T12:32:41.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:41.346+0000 7f62f9fad640 1 -- 172.21.15.55:0/1112298463 shutdown_connections 2024-05-27T12:32:41.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:41.346+0000 7f62f9fad640 1 --2- 172.21.15.55:0/1112298463 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f62e006c8f0 0x7f62e006edb0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:41.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:41.346+0000 7f62f9fad640 1 --2- 172.21.15.55:0/1112298463 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f62f40cf9b0 0x7f62f40ac660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:41.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:41.346+0000 7f62f9fad640 1 --2- 172.21.15.55:0/1112298463 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62f40cb5f0 0x7f62f40ac120 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:41.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:41.346+0000 7f62f9fad640 1 --2- 172.21.15.55:0/1112298463 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f62f406d000 0x7f62f41f3d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:41.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:41.346+0000 7f62f9fad640 1 -- 172.21.15.55:0/1112298463 >> 172.21.15.55:0/1112298463 conn(0x7f62f40d1a90 msgr2=0x7f62f40cd180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:41.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:41.346+0000 7f62f9fad640 1 -- 172.21.15.55:0/1112298463 shutdown_connections 2024-05-27T12:32:41.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:41.346+0000 7f62f9fad640 1 -- 172.21.15.55:0/1112298463 wait complete. 2024-05-27T12:32:41.375 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-27T12:32:41.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:41.486+0000 7fe1a237d640 1 Processor -- start 2024-05-27T12:32:41.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:41.486+0000 7fe1a237d640 1 -- start start 2024-05-27T12:32:41.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:41.487+0000 7fe1a237d640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe19c0cfb40 0x7fe19c0d1830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:41.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:41.487+0000 7fe1a237d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe19c0d1d70 0x7fe19c0b78f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:41.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:41.487+0000 7fe1a237d640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe19c15eee0 con 0x7fe19c15eb00 2024-05-27T12:32:41.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:41.487+0000 7fe1a237d640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7fe19c0d5700 con 0x7fe19c0d1d70 2024-05-27T12:32:41.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:41.487+0000 7fe1a237d640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fe19c0d21a0 con 0x7fe19c0cfb40 2024-05-27T12:32:41.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:41.487+0000 7fe19bfff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fe19c15eb00 0x7fe19c0d3e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:47962/0 (socket says 172.21.15.55:47962) 2024-05-27T12:32:41.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:41.487+0000 7fe19bfff640 1 -- 172.21.15.55:0/3734955192 learned_addr learned my addr 172.21.15.55:0/3734955192 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-27T12:32:41.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:41.487+0000 7fe1a091a640 1 --2- 172.21.15.55:0/3734955192 >> v2:172.21.15.55:3300/0 conn(0x7fe19c0d1d70 0x7fe19c0b78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:41.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:41.488+0000 7fe19b7fe640 1 --2- 172.21.15.55:0/3734955192 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe19c0cfb40 0x7fe19c0d1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:41.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:41.488+0000 7fe1a091a640 1 -- 172.21.15.55:0/3734955192 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe19c0cfb40 msgr2=0x7fe19c0d1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:32:41.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:41.488+0000 7fe1a091a640 1 --2- 172.21.15.55:0/3734955192 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe19c0cfb40 0x7fe19c0d1830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:41.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:41.488+0000 7fe1a091a640 1 -- 172.21.15.55:0/3734955192 >> v1:172.21.15.55:6789/0 conn(0x7fe19c15eb00 legacy=0x7fe19c0d3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:41.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:41.488+0000 7fe19affd640 1 -- 172.21.15.55:0/3734955192 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1867604602 0 0) 0x7fe19c15eee0 con 0x7fe19c15eb00 2024-05-27T12:32:41.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:41.488+0000 7fe1a091a640 1 -- 172.21.15.55:0/3734955192 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe19c0d4660 con 0x7fe19c0d1d70 2024-05-27T12:32:41.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:41.488+0000 7fe19b7fe640 1 --2- 172.21.15.55:0/3734955192 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe19c0cfb40 0x7fe19c0d1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T12:32:41.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:41.489+0000 7fe1a091a640 1 --2- 172.21.15.55:0/3734955192 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe19c0d1d70 0x7fe19c0b78f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe194009dc0 tx=0x7fe19402a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8c34840766f4291 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:41.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:41.489+0000 7fe19affd640 1 -- 172.21.15.55:0/3734955192 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe194007740 con 0x7fe19c0d1d70 2024-05-27T12:32:41.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:41.489+0000 7fe19affd640 1 -- 172.21.15.55:0/3734955192 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1940078e0 con 0x7fe19c0d1d70 2024-05-27T12:32:41.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:41.489+0000 7fe19affd640 1 -- 172.21.15.55:0/3734955192 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe194007cb0 con 0x7fe19c0d1d70 2024-05-27T12:32:41.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:41.489+0000 7fe1a237d640 1 -- 172.21.15.55:0/3734955192 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe19c0d1d70 msgr2=0x7fe19c0b78f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:41.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:41.489+0000 7fe1a237d640 1 --2- 172.21.15.55:0/3734955192 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe19c0d1d70 0x7fe19c0b78f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe194009dc0 tx=0x7fe19402a710 comp rx=0 tx=0).stop 2024-05-27T12:32:41.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:41.489+0000 7fe1a237d640 1 -- 172.21.15.55:0/3734955192 shutdown_connections 2024-05-27T12:32:41.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:41.489+0000 7fe1a237d640 1 --2- 172.21.15.55:0/3734955192 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe19c0cfb40 0x7fe19c0d1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:41.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:41.489+0000 7fe1a237d640 1 --2- 172.21.15.55:0/3734955192 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe19c0d1d70 0x7fe19c0b78f0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:41.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:41.489+0000 7fe1a237d640 1 -- 172.21.15.55:0/3734955192 >> 172.21.15.55:0/3734955192 conn(0x7fe19c067a50 msgr2=0x7fe19c067e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:41.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:41.489+0000 7fe1a237d640 1 -- 172.21.15.55:0/3734955192 shutdown_connections 2024-05-27T12:32:41.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:41.489+0000 7fe1a237d640 1 -- 172.21.15.55:0/3734955192 wait complete. 2024-05-27T12:32:41.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:41.490+0000 7fe1a237d640 1 Processor -- start 2024-05-27T12:32:41.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:41.491+0000 7fe1a237d640 1 -- start start 2024-05-27T12:32:41.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:41.491+0000 7fe1a237d640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe19c0cfb40 0x7fe19c0cdb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:41.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:41.491+0000 7fe1a237d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe19c0d1d70 0x7fe19c15f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:41.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:41.491+0000 7fe1a237d640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe19c15eb00 0x7fe19c15f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:41.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:41.491+0000 7fe1a237d640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7fe19c0d4f00 con 0x7fe19c0d1d70 2024-05-27T12:32:41.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:41.491+0000 7fe1a237d640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fe19c0d4c20 con 0x7fe19c0cfb40 2024-05-27T12:32:41.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:41.491+0000 7fe1a237d640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fe19c0d51e0 con 0x7fe19c15eb00 2024-05-27T12:32:41.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:41.492+0000 7fe19b7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe19c0d1d70 0x7fe19c15f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:41.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:41.492+0000 7fe19b7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe19c0d1d70 0x7fe19c15f0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52288/0 (socket says 172.21.15.55:52288) 2024-05-27T12:32:41.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:41.492+0000 7fe19b7fe640 1 -- 172.21.15.55:0/1410247538 learned_addr learned my addr 172.21.15.55:0/1410247538 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:32:41.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:41.492+0000 7fe19bfff640 1 --2- 172.21.15.55:0/1410247538 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe19c0cfb40 0x7fe19c0cdb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:41.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:41.492+0000 7fe1a091a640 1 --2- 172.21.15.55:0/1410247538 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe19c15eb00 0x7fe19c15f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:41.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:41.492+0000 7fe19b7fe640 1 -- 172.21.15.55:0/1410247538 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe19c15eb00 msgr2=0x7fe19c15f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:41.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:41.492+0000 7fe19b7fe640 1 --2- 172.21.15.55:0/1410247538 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe19c15eb00 0x7fe19c15f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:41.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:41.492+0000 7fe19b7fe640 1 -- 172.21.15.55:0/1410247538 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe19c0cfb40 msgr2=0x7fe19c0cdb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:41.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:41.492+0000 7fe19b7fe640 1 --2- 172.21.15.55:0/1410247538 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe19c0cfb40 0x7fe19c0cdb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:41.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:41.492+0000 7fe19b7fe640 1 -- 172.21.15.55:0/1410247538 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe19c0ccb20 con 0x7fe19c0d1d70 2024-05-27T12:32:41.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:41.492+0000 7fe19bfff640 1 --2- 172.21.15.55:0/1410247538 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe19c0cfb40 0x7fe19c0cdb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T12:32:41.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:41.492+0000 7fe19b7fe640 1 --2- 172.21.15.55:0/1410247538 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe19c0d1d70 0x7fe19c15f0d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe18400e7e0 tx=0x7fe18400eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:41.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:41.492+0000 7fe198ff9640 1 -- 172.21.15.55:0/1410247538 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe18400f040 con 0x7fe19c0d1d70 2024-05-27T12:32:41.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:41.492+0000 7fe198ff9640 1 -- 172.21.15.55:0/1410247538 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe184004030 con 0x7fe19c0d1d70 2024-05-27T12:32:41.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:41.492+0000 7fe1a237d640 1 -- 172.21.15.55:0/1410247538 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe19c0ccdc0 con 0x7fe19c0d1d70 2024-05-27T12:32:41.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:41.492+0000 7fe198ff9640 1 -- 172.21.15.55:0/1410247538 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe184004400 con 0x7fe19c0d1d70 2024-05-27T12:32:41.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:41.492+0000 7fe1a237d640 1 -- 172.21.15.55:0/1410247538 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe19c0cd380 con 0x7fe19c0d1d70 2024-05-27T12:32:41.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:41.493+0000 7fe1a237d640 1 -- 172.21.15.55:0/1410247538 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe19c068a70 con 0x7fe19c0d1d70 2024-05-27T12:32:41.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:41.494+0000 7fe198ff9640 1 -- 172.21.15.55:0/1410247538 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe18400c6d0 con 0x7fe19c0d1d70 2024-05-27T12:32:41.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:41.494+0000 7fe198ff9640 1 --2- 172.21.15.55:0/1410247538 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fe17c06c8f0 0x7fe17c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:41.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:41.494+0000 7fe198ff9640 1 -- 172.21.15.55:0/1410247538 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5609+0+0 (secure 0 0 0) 0x7fe18408b880 con 0x7fe19c0d1d70 2024-05-27T12:32:41.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:41.495+0000 7fe19bfff640 1 --2- 172.21.15.55:0/1410247538 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fe17c06c8f0 0x7fe17c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:41.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:41.495+0000 7fe19bfff640 1 --2- 172.21.15.55:0/1410247538 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fe17c06c8f0 0x7fe17c06edb0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe18c000f60 tx=0x7fe18c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:41.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:41.499+0000 7fe198ff9640 1 -- 172.21.15.55:0/1410247538 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe184017020 con 0x7fe19c0d1d70 2024-05-27T12:32:41.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:41.725+0000 7fe1a237d640 1 -- 172.21.15.55:0/1410247538 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fe19c0b3700 con 0x7fe19c0d1d70 2024-05-27T12:32:42.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.348+0000 7fe198ff9640 1 -- 172.21.15.55:0/1410247538 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7fe184059d10 con 0x7fe19c0d1d70 2024-05-27T12:32:42.348 INFO:teuthology.orchestra.run.smithi055.stderr:new fs with metadata pool 2 and data pool 3 2024-05-27T12:32:42.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.351+0000 7fe1a237d640 1 -- 172.21.15.55:0/1410247538 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fe17c06c8f0 msgr2=0x7fe17c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:42.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.351+0000 7fe1a237d640 1 --2- 172.21.15.55:0/1410247538 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fe17c06c8f0 0x7fe17c06edb0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe18c000f60 tx=0x7fe18c009040 comp rx=0 tx=0).stop 2024-05-27T12:32:42.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.351+0000 7fe1a237d640 1 -- 172.21.15.55:0/1410247538 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe19c0d1d70 msgr2=0x7fe19c15f0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:42.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.351+0000 7fe1a237d640 1 --2- 172.21.15.55:0/1410247538 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe19c0d1d70 0x7fe19c15f0d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe18400e7e0 tx=0x7fe18400eca0 comp rx=0 tx=0).stop 2024-05-27T12:32:42.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.351+0000 7fe1a237d640 1 -- 172.21.15.55:0/1410247538 shutdown_connections 2024-05-27T12:32:42.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.351+0000 7fe1a237d640 1 --2- 172.21.15.55:0/1410247538 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe19c15eb00 0x7fe19c15f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:42.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.351+0000 7fe1a237d640 1 --2- 172.21.15.55:0/1410247538 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe19c0d1d70 0x7fe19c15f0d0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:42.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.351+0000 7fe1a237d640 1 --2- 172.21.15.55:0/1410247538 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fe17c06c8f0 0x7fe17c06edb0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:42.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.351+0000 7fe1a237d640 1 --2- 172.21.15.55:0/1410247538 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe19c0cfb40 0x7fe19c0cdb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:42.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.351+0000 7fe1a237d640 1 -- 172.21.15.55:0/1410247538 >> 172.21.15.55:0/1410247538 conn(0x7fe19c067a50 msgr2=0x7fe19c0d2910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:42.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.351+0000 7fe1a237d640 1 -- 172.21.15.55:0/1410247538 shutdown_connections 2024-05-27T12:32:42.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.351+0000 7fe1a237d640 1 -- 172.21.15.55:0/1410247538 wait complete. 2024-05-27T12:32:42.375 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-27T12:32:42.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.484+0000 7feba7cc2640 1 Processor -- start 2024-05-27T12:32:42.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.484+0000 7feba7cc2640 1 -- start start 2024-05-27T12:32:42.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.485+0000 7feba7cc2640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7feba00d0560 0x7feba00d09d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:42.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.485+0000 7feba7cc2640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feba00cd410 con 0x7feba009aa30 2024-05-27T12:32:42.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.485+0000 7feba7cc2640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feba00d1020 con 0x7feba00cdbb0 2024-05-27T12:32:42.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.485+0000 7feba7cc2640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7feba00d1300 con 0x7feba00d0560 2024-05-27T12:32:42.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.485+0000 7feba525d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7feba00d0560 0x7feba00d09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:42.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.485+0000 7feba5a5e640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7feba009aa30 0x7feba009ae10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:47970/0 (socket says 172.21.15.55:47970) 2024-05-27T12:32:42.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.485+0000 7feba525d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7feba00d0560 0x7feba00d09d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52294/0 (socket says 172.21.15.55:52294) 2024-05-27T12:32:42.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.485+0000 7feba5a5e640 1 -- 172.21.15.55:0/2213615794 learned_addr learned my addr 172.21.15.55:0/2213615794 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-27T12:32:42.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.486+0000 7feba525d640 1 -- 172.21.15.55:0/2213615794 >> v1:172.21.15.72:6789/0 conn(0x7feba00cdbb0 legacy=0x7feba00ce000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:42.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.486+0000 7feba525d640 1 -- 172.21.15.55:0/2213615794 >> v1:172.21.15.55:6789/0 conn(0x7feba009aa30 legacy=0x7feba009ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:42.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.486+0000 7feba525d640 1 -- 172.21.15.55:0/2213615794 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feba00d15e0 con 0x7feba00d0560 2024-05-27T12:32:42.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.486+0000 7feba525d640 1 --2- 172.21.15.55:0/2213615794 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feba00d0560 0x7feba00d09d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7feb940097a0 tx=0x7feb9402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0951785f625731e server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:42.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.487+0000 7feba4a5c640 1 -- 172.21.15.55:0/2213615794 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb94037070 con 0x7feba00d0560 2024-05-27T12:32:42.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.487+0000 7feba4a5c640 1 -- 172.21.15.55:0/2213615794 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb94032440 con 0x7feba00d0560 2024-05-27T12:32:42.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.487+0000 7feba4a5c640 1 -- 172.21.15.55:0/2213615794 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb94032810 con 0x7feba00d0560 2024-05-27T12:32:42.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.487+0000 7feba7cc2640 1 -- 172.21.15.55:0/2213615794 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feba00d0560 msgr2=0x7feba00d09d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:42.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.487+0000 7feba7cc2640 1 --2- 172.21.15.55:0/2213615794 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feba00d0560 0x7feba00d09d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7feb940097a0 tx=0x7feb9402a230 comp rx=0 tx=0).stop 2024-05-27T12:32:42.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.487+0000 7feba7cc2640 1 -- 172.21.15.55:0/2213615794 shutdown_connections 2024-05-27T12:32:42.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.487+0000 7feba7cc2640 1 --2- 172.21.15.55:0/2213615794 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feba00d0560 0x7feba00d09d0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:42.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.487+0000 7feba7cc2640 1 -- 172.21.15.55:0/2213615794 >> 172.21.15.55:0/2213615794 conn(0x7feba00d2660 msgr2=0x7feba00d2a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:42.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.487+0000 7feba7cc2640 1 -- 172.21.15.55:0/2213615794 shutdown_connections 2024-05-27T12:32:42.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.487+0000 7feba7cc2640 1 -- 172.21.15.55:0/2213615794 wait complete. 2024-05-27T12:32:42.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.488+0000 7feba7cc2640 1 Processor -- start 2024-05-27T12:32:42.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.488+0000 7feba7cc2640 1 -- start start 2024-05-27T12:32:42.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.489+0000 7feba7cc2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feba009aa30 0x7feba00b6da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:42.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.489+0000 7feba7cc2640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feba00cdbb0 0x7feba01f3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:42.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.489+0000 7feba7cc2640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feba00d0560 0x7feba015bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:42.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.489+0000 7feba7cc2640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7feba015cd30 con 0x7feba009aa30 2024-05-27T12:32:42.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.489+0000 7feba7cc2640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7feba015d340 con 0x7feba00cdbb0 2024-05-27T12:32:42.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.489+0000 7feba7cc2640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7feba015ceb0 con 0x7feba00d0560 2024-05-27T12:32:42.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.489+0000 7feba5a5e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feba009aa30 0x7feba00b6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:42.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.489+0000 7feba5a5e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feba009aa30 0x7feba00b6da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52304/0 (socket says 172.21.15.55:52304) 2024-05-27T12:32:42.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.489+0000 7feba5a5e640 1 -- 172.21.15.55:0/3619220945 learned_addr learned my addr 172.21.15.55:0/3619220945 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:32:42.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.489+0000 7feba525d640 1 --2- 172.21.15.55:0/3619220945 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feba00cdbb0 0x7feba01f3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:42.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.489+0000 7feba625f640 1 --2- 172.21.15.55:0/3619220945 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feba00d0560 0x7feba015bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:42.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.490+0000 7feba5a5e640 1 -- 172.21.15.55:0/3619220945 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feba00d0560 msgr2=0x7feba015bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:42.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.490+0000 7feba5a5e640 1 --2- 172.21.15.55:0/3619220945 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feba00d0560 0x7feba015bd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:42.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.490+0000 7feba5a5e640 1 -- 172.21.15.55:0/3619220945 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feba00cdbb0 msgr2=0x7feba01f3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:42.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.490+0000 7feba5a5e640 1 --2- 172.21.15.55:0/3619220945 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feba00cdbb0 0x7feba01f3990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:42.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.490+0000 7feba5a5e640 1 -- 172.21.15.55:0/3619220945 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feba00c6880 con 0x7feba009aa30 2024-05-27T12:32:42.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.490+0000 7feba525d640 1 --2- 172.21.15.55:0/3619220945 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feba00cdbb0 0x7feba01f3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T12:32:42.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.490+0000 7feba625f640 1 --2- 172.21.15.55:0/3619220945 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feba00d0560 0x7feba015bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T12:32:42.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.490+0000 7feba5a5e640 1 --2- 172.21.15.55:0/3619220945 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feba009aa30 0x7feba00b6da0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7feb9000cbc0 tx=0x7feb9000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:42.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.490+0000 7feb9e7fc640 1 -- 172.21.15.55:0/3619220945 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb90017070 con 0x7feba009aa30 2024-05-27T12:32:42.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.490+0000 7feb9e7fc640 1 -- 172.21.15.55:0/3619220945 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb9000aca0 con 0x7feba009aa30 2024-05-27T12:32:42.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.490+0000 7feba7cc2640 1 -- 172.21.15.55:0/3619220945 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feba01f3ed0 con 0x7feba009aa30 2024-05-27T12:32:42.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.490+0000 7feb9e7fc640 1 -- 172.21.15.55:0/3619220945 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb90012600 con 0x7feba009aa30 2024-05-27T12:32:42.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.490+0000 7feba7cc2640 1 -- 172.21.15.55:0/3619220945 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feba00b62c0 con 0x7feba009aa30 2024-05-27T12:32:42.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.491+0000 7feba7cc2640 1 -- 172.21.15.55:0/3619220945 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feba009b2a0 con 0x7feba009aa30 2024-05-27T12:32:42.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.491+0000 7feb9e7fc640 1 -- 172.21.15.55:0/3619220945 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7feb9001a070 con 0x7feba009aa30 2024-05-27T12:32:42.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.492+0000 7feb9e7fc640 1 --2- 172.21.15.55:0/3619220945 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7feb8c06c8f0 0x7feb8c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:42.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.492+0000 7feb9e7fc640 1 -- 172.21.15.55:0/3619220945 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7feb9008b800 con 0x7feba009aa30 2024-05-27T12:32:42.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.492+0000 7feba525d640 1 --2- 172.21.15.55:0/3619220945 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7feb8c06c8f0 0x7feb8c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:42.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.493+0000 7feba525d640 1 --2- 172.21.15.55:0/3619220945 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7feb8c06c8f0 0x7feb8c06edb0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7feb94034000 tx=0x7feb9402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:42.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.497+0000 7feb9e7fc640 1 -- 172.21.15.55:0/3619220945 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7feba01f3ed0 con 0x7feba009aa30 2024-05-27T12:32:42.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.681+0000 7feba7cc2640 1 -- 172.21.15.55:0/3619220945 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7feba00d32c0 con 0x7feba009aa30 2024-05-27T12:32:42.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.682+0000 7feb9e7fc640 1 -- 172.21.15.55:0/3619220945 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16570 (secure 0 0 0) 0x7feba00c6880 con 0x7feba009aa30 2024-05-27T12:32:42.683 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-27T12:32:42.683 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":22,"fsid":"c3ff4e3b-8dae-4856-9593-e5cc66c59982","created":"2024-05-27T12:32:17.019097+0000","modified":"2024-05-27T12:32:41.727387+0000","last_up_change":"2024-05-27T12:32:28.109744+0000","last_in_change":"2024-05-27T12:32:19.309872+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-27T12:32:29.277895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-27T12:32:39.442745+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-27T12:32:40.672118+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e607b598-061b-4b6f-92ff-95c20b330599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":807572567},{"type":"v1","addr":"172.21.15.55:6801","nonce":807572567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":807572567},{"type":"v1","addr":"172.21.15.55:6803","nonce":807572567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":807572567},{"type":"v1","addr":"172.21.15.55:6807","nonce":807572567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":807572567},{"type":"v1","addr":"172.21.15.55:6805","nonce":807572567}]},"public_addr":"172.21.15.55:6801/807572567","cluster_addr":"172.21.15.55:6803/807572567","heartbeat_back_addr":"172.21.15.55:6807/807572567","heartbeat_front_addr":"172.21.15.55:6805/807572567","state":["exists","up"]},{"osd":1,"uuid":"ba2b5b1d-71a9-4ecc-9a48-55aa7fe54261","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":3426897300},{"type":"v1","addr":"172.21.15.55:6825","nonce":3426897300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":3426897300},{"type":"v1","addr":"172.21.15.55:6827","nonce":3426897300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":3426897300},{"type":"v1","addr":"172.21.15.55:6831","nonce":3426897300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":3426897300},{"type":"v1","addr":"172.21.15.55:6829","nonce":3426897300}]},"public_addr":"172.21.15.55:6825/3426897300","cluster_addr":"172.21.15.55:6827/3426897300","heartbeat_back_addr":"172.21.15.55:6831/3426897300","heartbeat_front_addr":"172.21.15.55:6829/3426897300","state":["exists","up"]},{"osd":2,"uuid":"e6b81cc6-4ff1-45d0-87eb-9f04ccf986a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3510271725},{"type":"v1","addr":"172.21.15.55:6809","nonce":3510271725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3510271725},{"type":"v1","addr":"172.21.15.55:6811","nonce":3510271725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3510271725},{"type":"v1","addr":"172.21.15.55:6815","nonce":3510271725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3510271725},{"type":"v1","addr":"172.21.15.55:6813","nonce":3510271725}]},"public_addr":"172.21.15.55:6809/3510271725","cluster_addr":"172.21.15.55:6811/3510271725","heartbeat_back_addr":"172.21.15.55:6815/3510271725","heartbeat_front_addr":"172.21.15.55:6813/3510271725","state":["exists","up"]},{"osd":3,"uuid":"b6a34b75-807d-4693-b1c3-903cb4c618d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":1066693520},{"type":"v1","addr":"172.21.15.55:6817","nonce":1066693520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":1066693520},{"type":"v1","addr":"172.21.15.55:6819","nonce":1066693520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":1066693520},{"type":"v1","addr":"172.21.15.55:6823","nonce":1066693520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":1066693520},{"type":"v1","addr":"172.21.15.55:6821","nonce":1066693520}]},"public_addr":"172.21.15.55:6817/1066693520","cluster_addr":"172.21.15.55:6819/1066693520","heartbeat_back_addr":"172.21.15.55:6823/1066693520","heartbeat_front_addr":"172.21.15.55:6821/1066693520","state":["exists","up"]},{"osd":4,"uuid":"272ec937-56b4-4f0a-b2e1-b0bc189c9d79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":4190771237},{"type":"v1","addr":"172.21.15.72:6820","nonce":4190771237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":4190771237},{"type":"v1","addr":"172.21.15.72:6824","nonce":4190771237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":4190771237},{"type":"v1","addr":"172.21.15.72:6831","nonce":4190771237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":4190771237},{"type":"v1","addr":"172.21.15.72:6828","nonce":4190771237}]},"public_addr":"172.21.15.72:6820/4190771237","cluster_addr":"172.21.15.72:6824/4190771237","heartbeat_back_addr":"172.21.15.72:6831/4190771237","heartbeat_front_addr":"172.21.15.72:6828/4190771237","state":["exists","up"]},{"osd":5,"uuid":"56439854-72a0-4ef4-81ff-184a3d924a5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":2421889184},{"type":"v1","addr":"172.21.15.72:6801","nonce":2421889184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6803","nonce":2421889184},{"type":"v1","addr":"172.21.15.72:6805","nonce":2421889184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":2421889184},{"type":"v1","addr":"172.21.15.72:6813","nonce":2421889184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6807","nonce":2421889184},{"type":"v1","addr":"172.21.15.72:6809","nonce":2421889184}]},"public_addr":"172.21.15.72:6801/2421889184","cluster_addr":"172.21.15.72:6805/2421889184","heartbeat_back_addr":"172.21.15.72:6813/2421889184","heartbeat_front_addr":"172.21.15.72:6809/2421889184","state":["exists","up"]},{"osd":6,"uuid":"e248e2be-3b6e-49cf-8c8a-1a4152827582","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3796994599},{"type":"v1","addr":"172.21.15.72:6804","nonce":3796994599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":3796994599},{"type":"v1","addr":"172.21.15.72:6808","nonce":3796994599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":3796994599},{"type":"v1","addr":"172.21.15.72:6815","nonce":3796994599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":3796994599},{"type":"v1","addr":"172.21.15.72:6812","nonce":3796994599}]},"public_addr":"172.21.15.72:6804/3796994599","cluster_addr":"172.21.15.72:6808/3796994599","heartbeat_back_addr":"172.21.15.72:6815/3796994599","heartbeat_front_addr":"172.21.15.72:6812/3796994599","state":["exists","up"]},{"osd":7,"uuid":"505a62d3-322b-4629-b4fd-187a55563709","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":3024877895},{"type":"v1","addr":"172.21.15.72:6817","nonce":3024877895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":3024877895},{"type":"v1","addr":"172.21.15.72:6821","nonce":3024877895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6827","nonce":3024877895},{"type":"v1","addr":"172.21.15.72:6829","nonce":3024877895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6823","nonce":3024877895},{"type":"v1","addr":"172.21.15.72:6825","nonce":3024877895}]},"public_addr":"172.21.15.72:6817/3024877895","cluster_addr":"172.21.15.72:6821/3024877895","heartbeat_back_addr":"172.21.15.72:6829/3024877895","heartbeat_front_addr":"172.21.15.72:6825/3024877895","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.241014+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.450799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.465018+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.507647+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.534763+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.495895+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.427110+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.547466+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-27T12:32:42.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.684+0000 7feba7cc2640 1 -- 172.21.15.55:0/3619220945 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7feb8c06c8f0 msgr2=0x7feb8c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:42.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.684+0000 7feba7cc2640 1 --2- 172.21.15.55:0/3619220945 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7feb8c06c8f0 0x7feb8c06edb0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7feb94034000 tx=0x7feb9402e000 comp rx=0 tx=0).stop 2024-05-27T12:32:42.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.684+0000 7feba7cc2640 1 -- 172.21.15.55:0/3619220945 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feba009aa30 msgr2=0x7feba00b6da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:42.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.684+0000 7feba7cc2640 1 --2- 172.21.15.55:0/3619220945 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feba009aa30 0x7feba00b6da0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7feb9000cbc0 tx=0x7feb9000a060 comp rx=0 tx=0).stop 2024-05-27T12:32:42.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.684+0000 7feba7cc2640 1 -- 172.21.15.55:0/3619220945 shutdown_connections 2024-05-27T12:32:42.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.684+0000 7feba7cc2640 1 --2- 172.21.15.55:0/3619220945 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feba00d0560 0x7feba015bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:42.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.684+0000 7feba7cc2640 1 --2- 172.21.15.55:0/3619220945 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7feb8c06c8f0 0x7feb8c06edb0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:42.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.684+0000 7feba7cc2640 1 --2- 172.21.15.55:0/3619220945 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feba00cdbb0 0x7feba01f3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:42.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.684+0000 7feba7cc2640 1 --2- 172.21.15.55:0/3619220945 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feba009aa30 0x7feba00b6da0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:42.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.684+0000 7feba7cc2640 1 -- 172.21.15.55:0/3619220945 >> 172.21.15.55:0/3619220945 conn(0x7feba00d2660 msgr2=0x7feba015a320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:42.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.684+0000 7feba7cc2640 1 -- 172.21.15.55:0/3619220945 shutdown_connections 2024-05-27T12:32:42.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.684+0000 7feba7cc2640 1 -- 172.21.15.55:0/3619220945 wait complete. 2024-05-27T12:32:42.696 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-27T12:32:42.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.798+0000 7fac34a64640 1 Processor -- start 2024-05-27T12:32:42.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.798+0000 7fac34a64640 1 -- start start 2024-05-27T12:32:42.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.799+0000 7fac34a64640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fac301620b0 0x7fac300b79c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:42.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.799+0000 7fac34a64640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fac300cf8d0 0x7fac3006ce80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:42.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.799+0000 7fac34a64640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac300b39a0 con 0x7fac300cfd30 2024-05-27T12:32:42.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.799+0000 7fac34a64640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7fac300d56d0 con 0x7fac301620b0 2024-05-27T12:32:42.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.799+0000 7fac34a64640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fac300b7f00 con 0x7fac300cf8d0 2024-05-27T12:32:42.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.799+0000 7fac2e59c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fac301620b0 0x7fac300b79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:42.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.799+0000 7fac2e59c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fac301620b0 0x7fac300b79c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55162/0 (socket says 172.21.15.55:55162) 2024-05-27T12:32:42.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.799+0000 7fac2e59c640 1 -- 172.21.15.55:0/3682413242 learned_addr learned my addr 172.21.15.55:0/3682413242 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:32:42.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.799+0000 7fac2dd9b640 1 --2- 172.21.15.55:0/3682413242 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fac300cf8d0 0x7fac3006ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:42.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.799+0000 7fac2e59c640 1 -- 172.21.15.55:0/3682413242 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fac300cf8d0 msgr2=0x7fac3006ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:32:42.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.799+0000 7fac2e59c640 1 --2- 172.21.15.55:0/3682413242 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fac300cf8d0 0x7fac3006ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:42.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.800+0000 7fac2e59c640 1 -- 172.21.15.55:0/3682413242 >> v1:172.21.15.72:6789/0 conn(0x7fac300cfd30 legacy=0x7fac300d3950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:42.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.800+0000 7fac2e59c640 1 -- 172.21.15.55:0/3682413242 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac300b3c80 con 0x7fac301620b0 2024-05-27T12:32:42.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.800+0000 7fac2e59c640 1 --2- 172.21.15.55:0/3682413242 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac301620b0 0x7fac300b79c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fac20009870 tx=0x7fac2002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2df4821fe744afb0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:42.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.800+0000 7fac2d59a640 1 -- 172.21.15.55:0/3682413242 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac20037070 con 0x7fac301620b0 2024-05-27T12:32:42.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.800+0000 7fac2d59a640 1 -- 172.21.15.55:0/3682413242 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac20032440 con 0x7fac301620b0 2024-05-27T12:32:42.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.800+0000 7fac2d59a640 1 -- 172.21.15.55:0/3682413242 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac20032810 con 0x7fac301620b0 2024-05-27T12:32:42.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.801+0000 7fac34a64640 1 -- 172.21.15.55:0/3682413242 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac301620b0 msgr2=0x7fac300b79c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:42.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.801+0000 7fac34a64640 1 --2- 172.21.15.55:0/3682413242 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac301620b0 0x7fac300b79c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fac20009870 tx=0x7fac2002a270 comp rx=0 tx=0).stop 2024-05-27T12:32:42.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.801+0000 7fac34a64640 1 -- 172.21.15.55:0/3682413242 shutdown_connections 2024-05-27T12:32:42.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.801+0000 7fac34a64640 1 --2- 172.21.15.55:0/3682413242 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fac300cf8d0 0x7fac3006ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:42.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.801+0000 7fac34a64640 1 --2- 172.21.15.55:0/3682413242 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac301620b0 0x7fac300b79c0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:42.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.801+0000 7fac34a64640 1 -- 172.21.15.55:0/3682413242 >> 172.21.15.55:0/3682413242 conn(0x7fac300d1940 msgr2=0x7fac300d4890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:42.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.801+0000 7fac34a64640 1 -- 172.21.15.55:0/3682413242 shutdown_connections 2024-05-27T12:32:42.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.801+0000 7fac34a64640 1 -- 172.21.15.55:0/3682413242 wait complete. 2024-05-27T12:32:42.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.802+0000 7fac34a64640 1 Processor -- start 2024-05-27T12:32:42.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.802+0000 7fac34a64640 1 -- start start 2024-05-27T12:32:42.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.803+0000 7fac34a64640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fac300cf8d0 0x7fac301f5be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:42.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.803+0000 7fac34a64640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fac300cfd30 0x7fac30153a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:42.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.803+0000 7fac34a64640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac301620b0 0x7fac300c9e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:42.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.803+0000 7fac34a64640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7fac300d3430 con 0x7fac301620b0 2024-05-27T12:32:42.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.803+0000 7fac34a64640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fac300d3150 con 0x7fac300cf8d0 2024-05-27T12:32:42.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.803+0000 7fac34a64640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fac300b3650 con 0x7fac300cfd30 2024-05-27T12:32:42.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.803+0000 7fac2ed9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac301620b0 0x7fac300c9e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:42.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.803+0000 7fac2e59c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fac300cf8d0 0x7fac301f5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:42.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.803+0000 7fac2ed9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac301620b0 0x7fac300c9e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55178/0 (socket says 172.21.15.55:55178) 2024-05-27T12:32:42.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.803+0000 7fac2ed9d640 1 -- 172.21.15.55:0/2382424802 learned_addr learned my addr 172.21.15.55:0/2382424802 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:32:42.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.803+0000 7fac2dd9b640 1 --2- 172.21.15.55:0/2382424802 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fac300cfd30 0x7fac30153a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:42.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.804+0000 7fac2ed9d640 1 -- 172.21.15.55:0/2382424802 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fac300cfd30 msgr2=0x7fac30153a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:42.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.804+0000 7fac2ed9d640 1 --2- 172.21.15.55:0/2382424802 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fac300cfd30 0x7fac30153a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:42.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.804+0000 7fac2ed9d640 1 -- 172.21.15.55:0/2382424802 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fac300cf8d0 msgr2=0x7fac301f5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:42.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.804+0000 7fac2ed9d640 1 --2- 172.21.15.55:0/2382424802 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fac300cf8d0 0x7fac301f5be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:42.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.804+0000 7fac2ed9d640 1 -- 172.21.15.55:0/2382424802 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac30157a00 con 0x7fac301620b0 2024-05-27T12:32:42.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.804+0000 7fac2ed9d640 1 --2- 172.21.15.55:0/2382424802 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac301620b0 0x7fac300c9e40 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fac2800c7d0 tx=0x7fac2800cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:42.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.804+0000 7fac1effd640 1 -- 172.21.15.55:0/2382424802 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac28003b70 con 0x7fac301620b0 2024-05-27T12:32:42.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.804+0000 7fac1effd640 1 -- 172.21.15.55:0/2382424802 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac28003d30 con 0x7fac301620b0 2024-05-27T12:32:42.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.804+0000 7fac34a64640 1 -- 172.21.15.55:0/2382424802 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac301f6120 con 0x7fac301620b0 2024-05-27T12:32:42.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.804+0000 7fac1effd640 1 -- 172.21.15.55:0/2382424802 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac2800aa90 con 0x7fac301620b0 2024-05-27T12:32:42.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.804+0000 7fac34a64640 1 -- 172.21.15.55:0/2382424802 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac300cc100 con 0x7fac301620b0 2024-05-27T12:32:42.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.805+0000 7fac34a64640 1 -- 172.21.15.55:0/2382424802 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac300d0200 con 0x7fac301620b0 2024-05-27T12:32:42.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.805+0000 7fac1effd640 1 -- 172.21.15.55:0/2382424802 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fac2800ac30 con 0x7fac301620b0 2024-05-27T12:32:42.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.806+0000 7fac1effd640 1 --2- 172.21.15.55:0/2382424802 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fac1006c8f0 0x7fac1006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:42.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.806+0000 7fac1effd640 1 -- 172.21.15.55:0/2382424802 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fac2808b950 con 0x7fac301620b0 2024-05-27T12:32:42.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.806+0000 7fac2e59c640 1 --2- 172.21.15.55:0/2382424802 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fac1006c8f0 0x7fac1006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:42.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.806+0000 7fac2e59c640 1 --2- 172.21.15.55:0/2382424802 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fac1006c8f0 0x7fac1006edb0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fac20034000 tx=0x7fac2002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:42.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.810+0000 7fac1effd640 1 -- 172.21.15.55:0/2382424802 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fac300d0200 con 0x7fac301620b0 2024-05-27T12:32:42.994 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.994+0000 7fac34a64640 1 -- 172.21.15.55:0/2382424802 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fac30162490 con 0x7fac301620b0 2024-05-27T12:32:42.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.995+0000 7fac1effd640 1 -- 172.21.15.55:0/2382424802 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16570 (secure 0 0 0) 0x7fac30162490 con 0x7fac301620b0 2024-05-27T12:32:42.996 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-27T12:32:42.996 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":22,"fsid":"c3ff4e3b-8dae-4856-9593-e5cc66c59982","created":"2024-05-27T12:32:17.019097+0000","modified":"2024-05-27T12:32:41.727387+0000","last_up_change":"2024-05-27T12:32:28.109744+0000","last_in_change":"2024-05-27T12:32:19.309872+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-27T12:32:29.277895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-27T12:32:39.442745+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-27T12:32:40.672118+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e607b598-061b-4b6f-92ff-95c20b330599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":807572567},{"type":"v1","addr":"172.21.15.55:6801","nonce":807572567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":807572567},{"type":"v1","addr":"172.21.15.55:6803","nonce":807572567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":807572567},{"type":"v1","addr":"172.21.15.55:6807","nonce":807572567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":807572567},{"type":"v1","addr":"172.21.15.55:6805","nonce":807572567}]},"public_addr":"172.21.15.55:6801/807572567","cluster_addr":"172.21.15.55:6803/807572567","heartbeat_back_addr":"172.21.15.55:6807/807572567","heartbeat_front_addr":"172.21.15.55:6805/807572567","state":["exists","up"]},{"osd":1,"uuid":"ba2b5b1d-71a9-4ecc-9a48-55aa7fe54261","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":3426897300},{"type":"v1","addr":"172.21.15.55:6825","nonce":3426897300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":3426897300},{"type":"v1","addr":"172.21.15.55:6827","nonce":3426897300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":3426897300},{"type":"v1","addr":"172.21.15.55:6831","nonce":3426897300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":3426897300},{"type":"v1","addr":"172.21.15.55:6829","nonce":3426897300}]},"public_addr":"172.21.15.55:6825/3426897300","cluster_addr":"172.21.15.55:6827/3426897300","heartbeat_back_addr":"172.21.15.55:6831/3426897300","heartbeat_front_addr":"172.21.15.55:6829/3426897300","state":["exists","up"]},{"osd":2,"uuid":"e6b81cc6-4ff1-45d0-87eb-9f04ccf986a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3510271725},{"type":"v1","addr":"172.21.15.55:6809","nonce":3510271725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3510271725},{"type":"v1","addr":"172.21.15.55:6811","nonce":3510271725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3510271725},{"type":"v1","addr":"172.21.15.55:6815","nonce":3510271725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3510271725},{"type":"v1","addr":"172.21.15.55:6813","nonce":3510271725}]},"public_addr":"172.21.15.55:6809/3510271725","cluster_addr":"172.21.15.55:6811/3510271725","heartbeat_back_addr":"172.21.15.55:6815/3510271725","heartbeat_front_addr":"172.21.15.55:6813/3510271725","state":["exists","up"]},{"osd":3,"uuid":"b6a34b75-807d-4693-b1c3-903cb4c618d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":1066693520},{"type":"v1","addr":"172.21.15.55:6817","nonce":1066693520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":1066693520},{"type":"v1","addr":"172.21.15.55:6819","nonce":1066693520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":1066693520},{"type":"v1","addr":"172.21.15.55:6823","nonce":1066693520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":1066693520},{"type":"v1","addr":"172.21.15.55:6821","nonce":1066693520}]},"public_addr":"172.21.15.55:6817/1066693520","cluster_addr":"172.21.15.55:6819/1066693520","heartbeat_back_addr":"172.21.15.55:6823/1066693520","heartbeat_front_addr":"172.21.15.55:6821/1066693520","state":["exists","up"]},{"osd":4,"uuid":"272ec937-56b4-4f0a-b2e1-b0bc189c9d79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":4190771237},{"type":"v1","addr":"172.21.15.72:6820","nonce":4190771237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":4190771237},{"type":"v1","addr":"172.21.15.72:6824","nonce":4190771237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":4190771237},{"type":"v1","addr":"172.21.15.72:6831","nonce":4190771237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":4190771237},{"type":"v1","addr":"172.21.15.72:6828","nonce":4190771237}]},"public_addr":"172.21.15.72:6820/4190771237","cluster_addr":"172.21.15.72:6824/4190771237","heartbeat_back_addr":"172.21.15.72:6831/4190771237","heartbeat_front_addr":"172.21.15.72:6828/4190771237","state":["exists","up"]},{"osd":5,"uuid":"56439854-72a0-4ef4-81ff-184a3d924a5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":2421889184},{"type":"v1","addr":"172.21.15.72:6801","nonce":2421889184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6803","nonce":2421889184},{"type":"v1","addr":"172.21.15.72:6805","nonce":2421889184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":2421889184},{"type":"v1","addr":"172.21.15.72:6813","nonce":2421889184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6807","nonce":2421889184},{"type":"v1","addr":"172.21.15.72:6809","nonce":2421889184}]},"public_addr":"172.21.15.72:6801/2421889184","cluster_addr":"172.21.15.72:6805/2421889184","heartbeat_back_addr":"172.21.15.72:6813/2421889184","heartbeat_front_addr":"172.21.15.72:6809/2421889184","state":["exists","up"]},{"osd":6,"uuid":"e248e2be-3b6e-49cf-8c8a-1a4152827582","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3796994599},{"type":"v1","addr":"172.21.15.72:6804","nonce":3796994599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":3796994599},{"type":"v1","addr":"172.21.15.72:6808","nonce":3796994599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":3796994599},{"type":"v1","addr":"172.21.15.72:6815","nonce":3796994599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":3796994599},{"type":"v1","addr":"172.21.15.72:6812","nonce":3796994599}]},"public_addr":"172.21.15.72:6804/3796994599","cluster_addr":"172.21.15.72:6808/3796994599","heartbeat_back_addr":"172.21.15.72:6815/3796994599","heartbeat_front_addr":"172.21.15.72:6812/3796994599","state":["exists","up"]},{"osd":7,"uuid":"505a62d3-322b-4629-b4fd-187a55563709","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":3024877895},{"type":"v1","addr":"172.21.15.72:6817","nonce":3024877895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":3024877895},{"type":"v1","addr":"172.21.15.72:6821","nonce":3024877895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6827","nonce":3024877895},{"type":"v1","addr":"172.21.15.72:6829","nonce":3024877895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6823","nonce":3024877895},{"type":"v1","addr":"172.21.15.72:6825","nonce":3024877895}]},"public_addr":"172.21.15.72:6817/3024877895","cluster_addr":"172.21.15.72:6821/3024877895","heartbeat_back_addr":"172.21.15.72:6829/3024877895","heartbeat_front_addr":"172.21.15.72:6825/3024877895","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.241014+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.450799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.465018+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.507647+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.534763+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.495895+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.427110+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.547466+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-27T12:32:42.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.997+0000 7fac34a64640 1 -- 172.21.15.55:0/2382424802 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fac1006c8f0 msgr2=0x7fac1006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:42.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.997+0000 7fac34a64640 1 --2- 172.21.15.55:0/2382424802 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fac1006c8f0 0x7fac1006edb0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fac20034000 tx=0x7fac2002e000 comp rx=0 tx=0).stop 2024-05-27T12:32:42.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.997+0000 7fac34a64640 1 -- 172.21.15.55:0/2382424802 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac301620b0 msgr2=0x7fac300c9e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:42.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.997+0000 7fac34a64640 1 --2- 172.21.15.55:0/2382424802 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac301620b0 0x7fac300c9e40 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fac2800c7d0 tx=0x7fac2800cc90 comp rx=0 tx=0).stop 2024-05-27T12:32:42.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.997+0000 7fac34a64640 1 -- 172.21.15.55:0/2382424802 shutdown_connections 2024-05-27T12:32:42.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.997+0000 7fac34a64640 1 --2- 172.21.15.55:0/2382424802 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac301620b0 0x7fac300c9e40 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:42.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.997+0000 7fac34a64640 1 --2- 172.21.15.55:0/2382424802 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fac300cfd30 0x7fac30153a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:42.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.997+0000 7fac34a64640 1 --2- 172.21.15.55:0/2382424802 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fac1006c8f0 0x7fac1006edb0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:42.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.997+0000 7fac34a64640 1 --2- 172.21.15.55:0/2382424802 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fac300cf8d0 0x7fac301f5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:42.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.997+0000 7fac34a64640 1 -- 172.21.15.55:0/2382424802 >> 172.21.15.55:0/2382424802 conn(0x7fac300d1940 msgr2=0x7fac3006ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:42.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.998+0000 7fac34a64640 1 -- 172.21.15.55:0/2382424802 shutdown_connections 2024-05-27T12:32:42.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:42.998+0000 7fac34a64640 1 -- 172.21.15.55:0/2382424802 wait complete. 2024-05-27T12:32:43.009 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-05-27T12:32:43.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.115+0000 7fbec89e5640 1 Processor -- start 2024-05-27T12:32:43.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.115+0000 7fbec89e5640 1 -- start start 2024-05-27T12:32:43.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.116+0000 7fbec89e5640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbec4072570 0x7fbec40b3f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:43.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.116+0000 7fbec89e5640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbec40b4be0 con 0x7fbec415bdc0 2024-05-27T12:32:43.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.116+0000 7fbec89e5640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbec40b4ea0 con 0x7fbec40b4450 2024-05-27T12:32:43.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.116+0000 7fbec89e5640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fbec406e1d0 con 0x7fbec4072570 2024-05-27T12:32:43.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.116+0000 7fbec259c640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fbec415bdc0 0x7fbec4071e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:60308/0 (socket says 172.21.15.55:60308) 2024-05-27T12:32:43.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.116+0000 7fbec259c640 1 -- 172.21.15.55:0/1447939044 learned_addr learned my addr 172.21.15.55:0/1447939044 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-27T12:32:43.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.116+0000 7fbec1d9b640 1 -- 172.21.15.55:0/1447939044 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2383104931 0 0) 0x7fbec40b4be0 con 0x7fbec415bdc0 2024-05-27T12:32:43.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.116+0000 7fbeb9d9b640 1 --2- 172.21.15.55:0/1447939044 >> v2:172.21.15.72:3300/0 conn(0x7fbec4072570 0x7fbec40b3f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:43.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.116+0000 7fbec1d9b640 1 -- 172.21.15.55:0/1447939044 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbeb0005730 con 0x7fbec415bdc0 2024-05-27T12:32:43.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.116+0000 7fbec1d9b640 1 -- 172.21.15.55:0/1447939044 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1832588702 0 0) 0x7fbeb0005730 con 0x7fbec415bdc0 2024-05-27T12:32:43.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.116+0000 7fbec1d9b640 1 -- 172.21.15.55:0/1447939044 >> v2:172.21.15.72:3300/0 conn(0x7fbec4072570 msgr2=0x7fbec40b3f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:32:43.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.116+0000 7fbec1d9b640 1 --2- 172.21.15.55:0/1447939044 >> v2:172.21.15.72:3300/0 conn(0x7fbec4072570 0x7fbec40b3f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:43.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.116+0000 7fbec1d9b640 1 -- 172.21.15.55:0/1447939044 >> v1:172.21.15.72:6789/0 conn(0x7fbec40b4450 legacy=0x7fbec406e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:43.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.116+0000 7fbec1d9b640 1 -- 172.21.15.55:0/1447939044 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbec40b5180 con 0x7fbec415bdc0 2024-05-27T12:32:43.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.116+0000 7fbec1d9b640 1 -- 172.21.15.55:0/1447939044 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 793017739 0 0) 0x7fbeb4001670 con 0x7fbec415bdc0 2024-05-27T12:32:43.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.116+0000 7fbec1d9b640 1 -- 172.21.15.55:0/1447939044 >> v1:172.21.15.55:6789/0 conn(0x7fbec415bdc0 legacy=0x7fbec4071e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:43.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.116+0000 7fbec1d9b640 1 --2- 172.21.15.55:0/1447939044 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbeb0005bc0 0x7fbeb0005fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:43.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.116+0000 7fbec1d9b640 1 --2- 172.21.15.55:0/1447939044 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbeb0006a10 0x7fbeb0006e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:43.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.116+0000 7fbec1d9b640 1 --2- 172.21.15.55:0/1447939044 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbeb0007420 0x7fbeb000dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:43.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.117+0000 7fbec1d9b640 1 -- 172.21.15.55:0/1447939044 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7fbec406e1d0 con 0x7fbeb0006a10 2024-05-27T12:32:43.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.117+0000 7fbec1d9b640 1 -- 172.21.15.55:0/1447939044 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fbeb000e350 con 0x7fbeb0007420 2024-05-27T12:32:43.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.117+0000 7fbec1d9b640 1 -- 172.21.15.55:0/1447939044 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fbeb000e550 con 0x7fbeb0005bc0 2024-05-27T12:32:43.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.117+0000 7fbeb9d9b640 1 --2- 172.21.15.55:0/1447939044 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbeb0006a10 0x7fbeb0006e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:43.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.117+0000 7fbec259c640 1 --2- 172.21.15.55:0/1447939044 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbeb0005bc0 0x7fbeb0005fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:43.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.117+0000 7fbec2d9d640 1 --2- 172.21.15.55:0/1447939044 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbeb0007420 0x7fbeb000dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:43.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.117+0000 7fbeb9d9b640 1 -- 172.21.15.55:0/1447939044 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbeb0005bc0 msgr2=0x7fbeb0005fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:32:43.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.117+0000 7fbeb9d9b640 1 --2- 172.21.15.55:0/1447939044 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbeb0005bc0 0x7fbeb0005fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:43.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.117+0000 7fbeb9d9b640 1 -- 172.21.15.55:0/1447939044 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbeb0007420 msgr2=0x7fbeb000dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:32:43.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.117+0000 7fbeb9d9b640 1 --2- 172.21.15.55:0/1447939044 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbeb0007420 0x7fbeb000dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:43.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.117+0000 7fbeb9d9b640 1 -- 172.21.15.55:0/1447939044 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbeb0005730 con 0x7fbeb0006a10 2024-05-27T12:32:43.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.117+0000 7fbec2d9d640 1 -- 172.21.15.55:0/1447939044 reap_dead start 2024-05-27T12:32:43.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.118+0000 7fbeb9d9b640 1 --2- 172.21.15.55:0/1447939044 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbeb0006a10 0x7fbeb0006e90 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fbeac006070 tx=0x7fbeb0007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af0250dfc610c175 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:43.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.118+0000 7fbec1d9b640 1 -- 172.21.15.55:0/1447939044 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbeac038070 con 0x7fbeb0006a10 2024-05-27T12:32:43.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.118+0000 7fbec1d9b640 1 -- 172.21.15.55:0/1447939044 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbeac033410 con 0x7fbeb0006a10 2024-05-27T12:32:43.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.118+0000 7fbec1d9b640 1 -- 172.21.15.55:0/1447939044 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbeac005be0 con 0x7fbeb0006a10 2024-05-27T12:32:43.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.118+0000 7fbec89e5640 1 -- 172.21.15.55:0/1447939044 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbeb0006a10 msgr2=0x7fbeb0006e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:43.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.118+0000 7fbec89e5640 1 --2- 172.21.15.55:0/1447939044 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbeb0006a10 0x7fbeb0006e90 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fbeac006070 tx=0x7fbeb0007a40 comp rx=0 tx=0).stop 2024-05-27T12:32:43.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.118+0000 7fbec89e5640 1 -- 172.21.15.55:0/1447939044 shutdown_connections 2024-05-27T12:32:43.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.118+0000 7fbec89e5640 1 --2- 172.21.15.55:0/1447939044 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbeb0006a10 0x7fbeb0006e90 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:43.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.118+0000 7fbec89e5640 1 -- 172.21.15.55:0/1447939044 >> 172.21.15.55:0/1447939044 conn(0x7fbec40b2240 msgr2=0x7fbec40b2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:43.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.118+0000 7fbec89e5640 1 -- 172.21.15.55:0/1447939044 shutdown_connections 2024-05-27T12:32:43.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.118+0000 7fbec89e5640 1 -- 172.21.15.55:0/1447939044 wait complete. 2024-05-27T12:32:43.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.120+0000 7fbec89e5640 1 Processor -- start 2024-05-27T12:32:43.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.120+0000 7fbec89e5640 1 -- start start 2024-05-27T12:32:43.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.121+0000 7fbec89e5640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbeb0006a10 0x7fbec4147ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:43.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.121+0000 7fbec89e5640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbec4157310 0x7fbec4156430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:43.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.121+0000 7fbec89e5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbec4158890 0x7fbec4158d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:43.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.121+0000 7fbec89e5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7fbec415c1a0 con 0x7fbec4158890 2024-05-27T12:32:43.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.121+0000 7fbec89e5640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fbec40b4880 con 0x7fbeb0006a10 2024-05-27T12:32:43.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.121+0000 7fbec89e5640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fbec415c320 con 0x7fbec4157310 2024-05-27T12:32:43.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.121+0000 7fbec2d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbec4158890 0x7fbec4158d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:43.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.121+0000 7fbec2d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbec4158890 0x7fbec4158d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55204/0 (socket says 172.21.15.55:55204) 2024-05-27T12:32:43.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.121+0000 7fbec2d9d640 1 -- 172.21.15.55:0/1130239034 learned_addr learned my addr 172.21.15.55:0/1130239034 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:32:43.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.121+0000 7fbec259c640 1 --2- 172.21.15.55:0/1130239034 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbeb0006a10 0x7fbec4147ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:43.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.121+0000 7fbeb9d9b640 1 --2- 172.21.15.55:0/1130239034 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbec4157310 0x7fbec4156430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:43.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.121+0000 7fbec2d9d640 1 -- 172.21.15.55:0/1130239034 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbec4157310 msgr2=0x7fbec4156430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:43.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.121+0000 7fbec2d9d640 1 --2- 172.21.15.55:0/1130239034 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbec4157310 0x7fbec4156430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:43.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.121+0000 7fbec2d9d640 1 -- 172.21.15.55:0/1130239034 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbeb0006a10 msgr2=0x7fbec4147ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:43.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.121+0000 7fbec2d9d640 1 --2- 172.21.15.55:0/1130239034 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbeb0006a10 0x7fbec4147ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:43.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.121+0000 7fbec2d9d640 1 -- 172.21.15.55:0/1130239034 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbec4148430 con 0x7fbec4158890 2024-05-27T12:32:43.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.121+0000 7fbeb9d9b640 1 --2- 172.21.15.55:0/1130239034 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbec4157310 0x7fbec4156430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T12:32:43.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.121+0000 7fbec2d9d640 1 --2- 172.21.15.55:0/1130239034 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbec4158890 0x7fbec4158d40 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fbec406c9c0 tx=0x7fbebc00fd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:43.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.121+0000 7fbebb7fe640 1 -- 172.21.15.55:0/1130239034 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbebc01a070 con 0x7fbec4158890 2024-05-27T12:32:43.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.121+0000 7fbebb7fe640 1 -- 172.21.15.55:0/1130239034 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbebc006e20 con 0x7fbec4158890 2024-05-27T12:32:43.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.121+0000 7fbec89e5640 1 -- 172.21.15.55:0/1130239034 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbec41577f0 con 0x7fbec4158890 2024-05-27T12:32:43.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.121+0000 7fbebb7fe640 1 -- 172.21.15.55:0/1130239034 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbebc003b90 con 0x7fbec4158890 2024-05-27T12:32:43.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.121+0000 7fbec89e5640 1 -- 172.21.15.55:0/1130239034 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbec4157db0 con 0x7fbec4158890 2024-05-27T12:32:43.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.122+0000 7fbec89e5640 1 -- 172.21.15.55:0/1130239034 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbec4068a70 con 0x7fbec4158890 2024-05-27T12:32:43.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.123+0000 7fbebb7fe640 1 -- 172.21.15.55:0/1130239034 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbebc005110 con 0x7fbec4158890 2024-05-27T12:32:43.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.123+0000 7fbebb7fe640 1 --2- 172.21.15.55:0/1130239034 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fbea406c920 0x7fbea406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:43.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.123+0000 7fbebb7fe640 1 -- 172.21.15.55:0/1130239034 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fbebc08b2f0 con 0x7fbec4158890 2024-05-27T12:32:43.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.124+0000 7fbec259c640 1 --2- 172.21.15.55:0/1130239034 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fbea406c920 0x7fbea406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:43.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.124+0000 7fbec259c640 1 --2- 172.21.15.55:0/1130239034 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fbea406c920 0x7fbea406ede0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fbec4050f50 tx=0x7fbeb40078f0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:43.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.127+0000 7fbebb7fe640 1 -- 172.21.15.55:0/1130239034 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fbec4148430 con 0x7fbec4158890 2024-05-27T12:32:43.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.354+0000 7fbec89e5640 1 -- 172.21.15.55:0/1130239034 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fbec40730c0 con 0x7fbec4158890 2024-05-27T12:32:43.365 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.365+0000 7fbebb7fe640 1 -- 172.21.15.55:0/1130239034 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v5) ==== 118+0+0 (secure 0 0 0) 0x7fbebc059160 con 0x7fbec4158890 2024-05-27T12:32:43.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.367+0000 7fbec89e5640 1 -- 172.21.15.55:0/1130239034 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fbea406c920 msgr2=0x7fbea406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:43.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.367+0000 7fbec89e5640 1 --2- 172.21.15.55:0/1130239034 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fbea406c920 0x7fbea406ede0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fbec4050f50 tx=0x7fbeb40078f0 comp rx=0 tx=0).stop 2024-05-27T12:32:43.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.367+0000 7fbec89e5640 1 -- 172.21.15.55:0/1130239034 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbec4158890 msgr2=0x7fbec4158d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:43.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.367+0000 7fbec89e5640 1 --2- 172.21.15.55:0/1130239034 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbec4158890 0x7fbec4158d40 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fbec406c9c0 tx=0x7fbebc00fd40 comp rx=0 tx=0).stop 2024-05-27T12:32:43.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.367+0000 7fbec89e5640 1 -- 172.21.15.55:0/1130239034 shutdown_connections 2024-05-27T12:32:43.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.367+0000 7fbec89e5640 1 --2- 172.21.15.55:0/1130239034 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbec4158890 0x7fbec4158d40 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:43.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.367+0000 7fbec89e5640 1 --2- 172.21.15.55:0/1130239034 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbec4157310 0x7fbec4156430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:43.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.367+0000 7fbec89e5640 1 --2- 172.21.15.55:0/1130239034 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fbea406c920 0x7fbea406ede0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:43.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.367+0000 7fbec89e5640 1 --2- 172.21.15.55:0/1130239034 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbeb0006a10 0x7fbec4147ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:43.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.367+0000 7fbec89e5640 1 -- 172.21.15.55:0/1130239034 >> 172.21.15.55:0/1130239034 conn(0x7fbec40b2240 msgr2=0x7fbec4154e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:43.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.367+0000 7fbec89e5640 1 -- 172.21.15.55:0/1130239034 shutdown_connections 2024-05-27T12:32:43.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.367+0000 7fbec89e5640 1 -- 172.21.15.55:0/1130239034 wait complete. 2024-05-27T12:32:43.379 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-05-27T12:32:43.379 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-05-27T12:32:43.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.485+0000 7f8a248cb640 1 Processor -- start 2024-05-27T12:32:43.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.485+0000 7f8a248cb640 1 -- start start 2024-05-27T12:32:43.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.486+0000 7f8a248cb640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8a2009b980 0x7f8a200d1390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:43.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.486+0000 7f8a248cb640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8a2009aa30 0x7f8a2009aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:43.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.486+0000 7f8a248cb640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a2006cb70 con 0x7f8a2015eb60 2024-05-27T12:32:43.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.486+0000 7f8a248cb640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f8a2009b3e0 con 0x7f8a2009b980 2024-05-27T12:32:43.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.486+0000 7f8a248cb640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f8a200d1cc0 con 0x7f8a2009aa30 2024-05-27T12:32:43.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.486+0000 7f8a1dd9b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8a2009b980 0x7f8a200d1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:43.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.486+0000 7f8a1dd9b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8a2009b980 0x7f8a200d1390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55214/0 (socket says 172.21.15.55:55214) 2024-05-27T12:32:43.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.486+0000 7f8a1dd9b640 1 -- 172.21.15.55:0/1330750928 learned_addr learned my addr 172.21.15.55:0/1330750928 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:32:43.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.486+0000 7f8a1ed9d640 1 --2- 172.21.15.55:0/1330750928 >> v2:172.21.15.72:3300/0 conn(0x7f8a2009aa30 0x7f8a2009aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:43.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.487+0000 7f8a1dd9b640 1 -- 172.21.15.55:0/1330750928 >> v2:172.21.15.72:3300/0 conn(0x7f8a2009aa30 msgr2=0x7f8a2009aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:32:43.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.487+0000 7f8a1dd9b640 1 --2- 172.21.15.55:0/1330750928 >> v2:172.21.15.72:3300/0 conn(0x7f8a2009aa30 0x7f8a2009aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:43.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.487+0000 7f8a1dd9b640 1 -- 172.21.15.55:0/1330750928 >> v1:172.21.15.72:6789/0 conn(0x7f8a2015eb60 legacy=0x7f8a2006d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:43.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.487+0000 7f8a1dd9b640 1 -- 172.21.15.55:0/1330750928 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a2006ce50 con 0x7f8a2009b980 2024-05-27T12:32:43.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.487+0000 7f8a1dd9b640 1 --2- 172.21.15.55:0/1330750928 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a2009b980 0x7f8a200d1390 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8a200b4dc0 tx=0x7f8a1402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f342ac55ef799e85 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:43.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.487+0000 7f8a1d59a640 1 -- 172.21.15.55:0/1330750928 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a14037070 con 0x7f8a2009b980 2024-05-27T12:32:43.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.487+0000 7f8a1d59a640 1 -- 172.21.15.55:0/1330750928 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a14032440 con 0x7f8a2009b980 2024-05-27T12:32:43.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.487+0000 7f8a1d59a640 1 -- 172.21.15.55:0/1330750928 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a14032810 con 0x7f8a2009b980 2024-05-27T12:32:43.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.488+0000 7f8a248cb640 1 -- 172.21.15.55:0/1330750928 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a2009b980 msgr2=0x7f8a200d1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:43.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.488+0000 7f8a248cb640 1 --2- 172.21.15.55:0/1330750928 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a2009b980 0x7f8a200d1390 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8a200b4dc0 tx=0x7f8a1402a180 comp rx=0 tx=0).stop 2024-05-27T12:32:43.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.488+0000 7f8a248cb640 1 -- 172.21.15.55:0/1330750928 shutdown_connections 2024-05-27T12:32:43.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.488+0000 7f8a248cb640 1 --2- 172.21.15.55:0/1330750928 >> v2:172.21.15.72:3300/0 conn(0x7f8a2009aa30 0x7f8a2009aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:43.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.488+0000 7f8a248cb640 1 --2- 172.21.15.55:0/1330750928 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a2009b980 0x7f8a200d1390 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:43.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.488+0000 7f8a248cb640 1 -- 172.21.15.55:0/1330750928 >> 172.21.15.55:0/1330750928 conn(0x7f8a200b4160 msgr2=0x7f8a200b4570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:43.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.488+0000 7f8a248cb640 1 -- 172.21.15.55:0/1330750928 shutdown_connections 2024-05-27T12:32:43.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.488+0000 7f8a248cb640 1 -- 172.21.15.55:0/1330750928 wait complete. 2024-05-27T12:32:43.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.489+0000 7f8a248cb640 1 Processor -- start 2024-05-27T12:32:43.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.489+0000 7f8a248cb640 1 -- start start 2024-05-27T12:32:43.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.490+0000 7f8a248cb640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a2009aa30 0x7f8a200cbfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:43.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.490+0000 7f8a248cb640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a2009b980 0x7f8a201f8280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:43.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.490+0000 7f8a248cb640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8a2015eb60 0x7f8a200710a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:43.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.490+0000 7f8a248cb640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f8a200d18d0 con 0x7f8a2009aa30 2024-05-27T12:32:43.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.490+0000 7f8a248cb640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f8a2006d410 con 0x7f8a2009b980 2024-05-27T12:32:43.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.490+0000 7f8a248cb640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f8a200d1a50 con 0x7f8a2015eb60 2024-05-27T12:32:43.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.490+0000 7f8a1e59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a2009aa30 0x7f8a200cbfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:43.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.490+0000 7f8a1e59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a2009aa30 0x7f8a200cbfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55222/0 (socket says 172.21.15.55:55222) 2024-05-27T12:32:43.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.490+0000 7f8a1e59c640 1 -- 172.21.15.55:0/1998028081 learned_addr learned my addr 172.21.15.55:0/1998028081 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:32:43.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.490+0000 7f8a1dd9b640 1 --2- 172.21.15.55:0/1998028081 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a2009b980 0x7f8a201f8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:43.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.490+0000 7f8a1ed9d640 1 --2- 172.21.15.55:0/1998028081 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8a2015eb60 0x7f8a200710a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:43.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.491+0000 7f8a1e59c640 1 -- 172.21.15.55:0/1998028081 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8a2015eb60 msgr2=0x7f8a200710a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:43.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.491+0000 7f8a1e59c640 1 --2- 172.21.15.55:0/1998028081 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8a2015eb60 0x7f8a200710a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:43.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.491+0000 7f8a1e59c640 1 -- 172.21.15.55:0/1998028081 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a2009b980 msgr2=0x7f8a201f8280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:43.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.491+0000 7f8a1e59c640 1 --2- 172.21.15.55:0/1998028081 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a2009b980 0x7f8a201f8280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:43.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.491+0000 7f8a1e59c640 1 -- 172.21.15.55:0/1998028081 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a201f5410 con 0x7f8a2009aa30 2024-05-27T12:32:43.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.491+0000 7f8a1e59c640 1 --2- 172.21.15.55:0/1998028081 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a2009aa30 0x7f8a200cbfd0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8a1000c3c0 tx=0x7f8a1000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:43.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.491+0000 7f8a0effd640 1 -- 172.21.15.55:0/1998028081 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a100052d0 con 0x7f8a2009aa30 2024-05-27T12:32:43.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.491+0000 7f8a0effd640 1 -- 172.21.15.55:0/1998028081 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a10005490 con 0x7f8a2009aa30 2024-05-27T12:32:43.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.491+0000 7f8a248cb640 1 -- 172.21.15.55:0/1998028081 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a200cb4f0 con 0x7f8a2009aa30 2024-05-27T12:32:43.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.491+0000 7f8a0effd640 1 -- 172.21.15.55:0/1998028081 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a10007260 con 0x7f8a2009aa30 2024-05-27T12:32:43.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.491+0000 7f8a248cb640 1 -- 172.21.15.55:0/1998028081 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a200cbab0 con 0x7f8a2009aa30 2024-05-27T12:32:43.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.492+0000 7f8a248cb640 1 -- 172.21.15.55:0/1998028081 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a20068a70 con 0x7f8a2009aa30 2024-05-27T12:32:43.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.492+0000 7f8a0effd640 1 -- 172.21.15.55:0/1998028081 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8a10007400 con 0x7f8a2009aa30 2024-05-27T12:32:43.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.493+0000 7f8a0effd640 1 --2- 172.21.15.55:0/1998028081 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f8a0006c8f0 0x7f8a0006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:43.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.493+0000 7f8a0effd640 1 -- 172.21.15.55:0/1998028081 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f8a1008afa0 con 0x7f8a2009aa30 2024-05-27T12:32:43.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.493+0000 7f8a1dd9b640 1 --2- 172.21.15.55:0/1998028081 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f8a0006c8f0 0x7f8a0006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:43.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.494+0000 7f8a1dd9b640 1 --2- 172.21.15.55:0/1998028081 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f8a0006c8f0 0x7f8a0006edb0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8a14034000 tx=0x7f8a1402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:43.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.497+0000 7f8a0effd640 1 -- 172.21.15.55:0/1998028081 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8a10058d80 con 0x7f8a2009aa30 2024-05-27T12:32:43.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:43.720+0000 7f8a248cb640 1 -- 172.21.15.55:0/1998028081 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f8a2006e160 con 0x7f8a2009aa30 2024-05-27T12:32:44.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.367+0000 7f8a0effd640 1 -- 172.21.15.55:0/1998028081 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v6) ==== 122+0+0 (secure 0 0 0) 0x7f8a1005d080 con 0x7f8a2009aa30 2024-05-27T12:32:44.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.369+0000 7f8a248cb640 1 -- 172.21.15.55:0/1998028081 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f8a0006c8f0 msgr2=0x7f8a0006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:44.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.369+0000 7f8a248cb640 1 --2- 172.21.15.55:0/1998028081 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f8a0006c8f0 0x7f8a0006edb0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8a14034000 tx=0x7f8a1402e000 comp rx=0 tx=0).stop 2024-05-27T12:32:44.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.369+0000 7f8a248cb640 1 -- 172.21.15.55:0/1998028081 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a2009aa30 msgr2=0x7f8a200cbfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:44.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.369+0000 7f8a248cb640 1 --2- 172.21.15.55:0/1998028081 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a2009aa30 0x7f8a200cbfd0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8a1000c3c0 tx=0x7f8a1000c880 comp rx=0 tx=0).stop 2024-05-27T12:32:44.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.369+0000 7f8a248cb640 1 -- 172.21.15.55:0/1998028081 shutdown_connections 2024-05-27T12:32:44.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.369+0000 7f8a248cb640 1 --2- 172.21.15.55:0/1998028081 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8a2015eb60 0x7f8a200710a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:44.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.369+0000 7f8a248cb640 1 --2- 172.21.15.55:0/1998028081 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f8a0006c8f0 0x7f8a0006edb0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:44.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.369+0000 7f8a248cb640 1 --2- 172.21.15.55:0/1998028081 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a2009b980 0x7f8a201f8280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:44.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.369+0000 7f8a248cb640 1 --2- 172.21.15.55:0/1998028081 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a2009aa30 0x7f8a200cbfd0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:44.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.369+0000 7f8a248cb640 1 -- 172.21.15.55:0/1998028081 >> 172.21.15.55:0/1998028081 conn(0x7f8a200b4160 msgr2=0x7f8a2015d920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:44.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.369+0000 7f8a248cb640 1 -- 172.21.15.55:0/1998028081 shutdown_connections 2024-05-27T12:32:44.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.369+0000 7f8a248cb640 1 -- 172.21.15.55:0/1998028081 wait complete. 2024-05-27T12:32:44.383 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-05-27T12:32:44.383 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-27T12:32:44.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.492+0000 7f81a3be1640 1 Processor -- start 2024-05-27T12:32:44.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.492+0000 7f81a3be1640 1 -- start start 2024-05-27T12:32:44.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.493+0000 7f81a3be1640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f819c144bb0 0x7f819c0cd180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:44.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.493+0000 7f81a3be1640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f819c0cd6c0 0x7f819c071f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:44.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.493+0000 7f81a3be1640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f819c0ce200 con 0x7f819c072460 2024-05-27T12:32:44.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.493+0000 7f81a3be1640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f819c144f90 con 0x7f819c144bb0 2024-05-27T12:32:44.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.493+0000 7f81a3be1640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f819c0cdc40 con 0x7f819c0cd6c0 2024-05-27T12:32:44.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.493+0000 7f81a197d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f819c144bb0 0x7f819c0cd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:44.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.493+0000 7f81a217e640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f819c072460 0x7f819c15f210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:60322/0 (socket says 172.21.15.55:60322) 2024-05-27T12:32:44.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.493+0000 7f81a217e640 1 -- 172.21.15.55:0/3544767183 learned_addr learned my addr 172.21.15.55:0/3544767183 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-27T12:32:44.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.493+0000 7f81a117c640 1 --2- 172.21.15.55:0/3544767183 >> v2:172.21.15.72:3300/0 conn(0x7f819c0cd6c0 0x7f819c071f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:44.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.494+0000 7f81a197d640 1 -- 172.21.15.55:0/3544767183 >> v2:172.21.15.72:3300/0 conn(0x7f819c0cd6c0 msgr2=0x7f819c071f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:32:44.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.494+0000 7f81a197d640 1 --2- 172.21.15.55:0/3544767183 >> v2:172.21.15.72:3300/0 conn(0x7f819c0cd6c0 0x7f819c071f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:44.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.494+0000 7f81a197d640 1 -- 172.21.15.55:0/3544767183 >> v1:172.21.15.55:6789/0 conn(0x7f819c072460 legacy=0x7f819c15f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:44.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.494+0000 7f81a197d640 1 -- 172.21.15.55:0/3544767183 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f819c0cdf20 con 0x7f819c144bb0 2024-05-27T12:32:44.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.494+0000 7f81a117c640 1 --2- 172.21.15.55:0/3544767183 >> v2:172.21.15.72:3300/0 conn(0x7f819c0cd6c0 0x7f819c071f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T12:32:44.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.494+0000 7f81a197d640 1 --2- 172.21.15.55:0/3544767183 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f819c144bb0 0x7f819c0cd180 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f819c0700a0 tx=0x7f819802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2b1550845c966fa server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:44.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.494+0000 7f81a097b640 1 -- 172.21.15.55:0/3544767183 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8198037070 con 0x7f819c144bb0 2024-05-27T12:32:44.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.494+0000 7f81a097b640 1 -- 172.21.15.55:0/3544767183 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8198032440 con 0x7f819c144bb0 2024-05-27T12:32:44.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.494+0000 7f81a097b640 1 -- 172.21.15.55:0/3544767183 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8198032810 con 0x7f819c144bb0 2024-05-27T12:32:44.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.495+0000 7f81a3be1640 1 -- 172.21.15.55:0/3544767183 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f819c144bb0 msgr2=0x7f819c0cd180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:44.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.495+0000 7f81a3be1640 1 --2- 172.21.15.55:0/3544767183 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f819c144bb0 0x7f819c0cd180 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f819c0700a0 tx=0x7f819802a1a0 comp rx=0 tx=0).stop 2024-05-27T12:32:44.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.495+0000 7f81a3be1640 1 -- 172.21.15.55:0/3544767183 shutdown_connections 2024-05-27T12:32:44.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.495+0000 7f81a3be1640 1 --2- 172.21.15.55:0/3544767183 >> v2:172.21.15.72:3300/0 conn(0x7f819c0cd6c0 0x7f819c071f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:44.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.495+0000 7f81a3be1640 1 --2- 172.21.15.55:0/3544767183 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f819c144bb0 0x7f819c0cd180 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:44.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.495+0000 7f81a3be1640 1 -- 172.21.15.55:0/3544767183 >> 172.21.15.55:0/3544767183 conn(0x7f819c0b3830 msgr2=0x7f819c0b3c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:44.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.495+0000 7f81a3be1640 1 -- 172.21.15.55:0/3544767183 shutdown_connections 2024-05-27T12:32:44.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.495+0000 7f81a3be1640 1 -- 172.21.15.55:0/3544767183 wait complete. 2024-05-27T12:32:44.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.496+0000 7f81a3be1640 1 Processor -- start 2024-05-27T12:32:44.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.496+0000 7f81a3be1640 1 -- start start 2024-05-27T12:32:44.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.497+0000 7f81a3be1640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f819c072460 0x7f819c0cf610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:44.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.497+0000 7f81a3be1640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f819c0cd6c0 0x7f819c15beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:44.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.497+0000 7f81a3be1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f819c144bb0 0x7f819c15c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:44.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.497+0000 7f81a3be1640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f819c145330 con 0x7f819c144bb0 2024-05-27T12:32:44.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.497+0000 7f81a3be1640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f819c0ceb20 con 0x7f819c0cd6c0 2024-05-27T12:32:44.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.497+0000 7f81a3be1640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f819c0d0050 con 0x7f819c072460 2024-05-27T12:32:44.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.497+0000 7f81a217e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f819c144bb0 0x7f819c15c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:44.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.497+0000 7f81a217e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f819c144bb0 0x7f819c15c3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55248/0 (socket says 172.21.15.55:55248) 2024-05-27T12:32:44.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.497+0000 7f81a217e640 1 -- 172.21.15.55:0/178274393 learned_addr learned my addr 172.21.15.55:0/178274393 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:32:44.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.497+0000 7f81a117c640 1 --2- 172.21.15.55:0/178274393 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f819c0cd6c0 0x7f819c15beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:44.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.497+0000 7f81a197d640 1 --2- 172.21.15.55:0/178274393 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f819c072460 0x7f819c0cf610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:44.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.498+0000 7f81a217e640 1 -- 172.21.15.55:0/178274393 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f819c072460 msgr2=0x7f819c0cf610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:44.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.498+0000 7f81a217e640 1 --2- 172.21.15.55:0/178274393 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f819c072460 0x7f819c0cf610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:44.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.498+0000 7f81a217e640 1 -- 172.21.15.55:0/178274393 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f819c0cd6c0 msgr2=0x7f819c15beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:44.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.498+0000 7f81a217e640 1 --2- 172.21.15.55:0/178274393 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f819c0cd6c0 0x7f819c15beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:44.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.498+0000 7f81a217e640 1 -- 172.21.15.55:0/178274393 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f819c0cfb50 con 0x7f819c144bb0 2024-05-27T12:32:44.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.498+0000 7f81a217e640 1 --2- 172.21.15.55:0/178274393 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f819c144bb0 0x7f819c15c3f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f819400cbc0 tx=0x7f819400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:44.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.498+0000 7f81927fc640 1 -- 172.21.15.55:0/178274393 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8194017070 con 0x7f819c144bb0 2024-05-27T12:32:44.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.498+0000 7f81927fc640 1 -- 172.21.15.55:0/178274393 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f819400ad40 con 0x7f819c144bb0 2024-05-27T12:32:44.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.498+0000 7f81a3be1640 1 -- 172.21.15.55:0/178274393 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f819c1589e0 con 0x7f819c144bb0 2024-05-27T12:32:44.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.498+0000 7f81927fc640 1 -- 172.21.15.55:0/178274393 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8194012600 con 0x7f819c144bb0 2024-05-27T12:32:44.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.498+0000 7f81a3be1640 1 -- 172.21.15.55:0/178274393 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f819c158fa0 con 0x7f819c144bb0 2024-05-27T12:32:44.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.499+0000 7f81a3be1640 1 -- 172.21.15.55:0/178274393 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f819c075460 con 0x7f819c144bb0 2024-05-27T12:32:44.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.499+0000 7f81927fc640 1 -- 172.21.15.55:0/178274393 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f819401a070 con 0x7f819c144bb0 2024-05-27T12:32:44.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.500+0000 7f81927fc640 1 --2- 172.21.15.55:0/178274393 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f818006c8f0 0x7f818006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:44.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.500+0000 7f81927fc640 1 -- 172.21.15.55:0/178274393 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f819408b750 con 0x7f819c144bb0 2024-05-27T12:32:44.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.500+0000 7f81a197d640 1 --2- 172.21.15.55:0/178274393 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f818006c8f0 0x7f818006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:44.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.501+0000 7f81a197d640 1 --2- 172.21.15.55:0/178274393 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f818006c8f0 0x7f818006edb0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8198034000 tx=0x7f819802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:44.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.504+0000 7f81927fc640 1 -- 172.21.15.55:0/178274393 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f81940595c0 con 0x7f819c144bb0 2024-05-27T12:32:44.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.729+0000 7f81a3be1640 1 -- 172.21.15.55:0/178274393 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f819c15d3d0 con 0x7f819c144bb0 2024-05-27T12:32:44.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.729+0000 7f81927fc640 1 -- 172.21.15.55:0/178274393 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5166 (secure 0 0 0) 0x7f819405d8c0 con 0x7f819c144bb0 2024-05-27T12:32:44.730 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-27T12:32:44.730 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/1501264038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":1501264038},{"type":"v1","addr":"172.21.15.55:6834","nonce":1501264038}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/3311546358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":3311546358},{"type":"v1","addr":"172.21.15.55:6835","nonce":3311546358}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4282,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/138819105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6835","nonce":138819105},{"type":"v1","addr":"172.21.15.72:6837","nonce":138819105}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-27T12:32:41.727353+0000","modified":"2024-05-27T12:32:43.723059+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.72:6836/70510151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":70510151},{"type":"v1","addr":"172.21.15.72:6836","nonce":70510151}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4290,"qdb_cluster":[4290]},"id":1}]} 2024-05-27T12:32:44.730 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 6 2024-05-27T12:32:44.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.731+0000 7f81a3be1640 1 -- 172.21.15.55:0/178274393 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f818006c8f0 msgr2=0x7f818006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:44.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.731+0000 7f81a3be1640 1 --2- 172.21.15.55:0/178274393 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f818006c8f0 0x7f818006edb0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8198034000 tx=0x7f819802e000 comp rx=0 tx=0).stop 2024-05-27T12:32:44.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.731+0000 7f81a3be1640 1 -- 172.21.15.55:0/178274393 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f819c144bb0 msgr2=0x7f819c15c3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:44.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.731+0000 7f81a3be1640 1 --2- 172.21.15.55:0/178274393 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f819c144bb0 0x7f819c15c3f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f819400cbc0 tx=0x7f819400a430 comp rx=0 tx=0).stop 2024-05-27T12:32:44.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.731+0000 7f81a3be1640 1 -- 172.21.15.55:0/178274393 shutdown_connections 2024-05-27T12:32:44.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.731+0000 7f81a3be1640 1 --2- 172.21.15.55:0/178274393 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f819c144bb0 0x7f819c15c3f0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:44.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.731+0000 7f81a3be1640 1 --2- 172.21.15.55:0/178274393 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f818006c8f0 0x7f818006edb0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:44.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.731+0000 7f81a3be1640 1 --2- 172.21.15.55:0/178274393 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f819c0cd6c0 0x7f819c15beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:44.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.731+0000 7f81a3be1640 1 --2- 172.21.15.55:0/178274393 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f819c072460 0x7f819c0cf610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:44.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.731+0000 7f81a3be1640 1 -- 172.21.15.55:0/178274393 >> 172.21.15.55:0/178274393 conn(0x7f819c0b3830 msgr2=0x7f819c160670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:44.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.732+0000 7f81a3be1640 1 -- 172.21.15.55:0/178274393 shutdown_connections 2024-05-27T12:32:44.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.732+0000 7f81a3be1640 1 -- 172.21.15.55:0/178274393 wait complete. 2024-05-27T12:32:44.743 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-27T12:32:44.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.846+0000 7f388224e640 1 Processor -- start 2024-05-27T12:32:44.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.846+0000 7f388224e640 1 -- start start 2024-05-27T12:32:44.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.847+0000 7f388224e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f387c0cf400 0x7f387c0cf840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:44.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.847+0000 7f388224e640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f387c0c5710 0x7f387c0c5b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:44.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.847+0000 7f388224e640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f387c06f450 con 0x7f387c15a250 2024-05-27T12:32:44.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.847+0000 7f388224e640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f387c160f70 con 0x7f387c0cf400 2024-05-27T12:32:44.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.847+0000 7f388224e640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f387c0cfd80 con 0x7f387c0c5710 2024-05-27T12:32:44.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.847+0000 7f387affd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f387c0cf400 0x7f387c0cf840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:44.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.847+0000 7f387affd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f387c0cf400 0x7f387c0cf840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55252/0 (socket says 172.21.15.55:55252) 2024-05-27T12:32:44.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.847+0000 7f387affd640 1 -- 172.21.15.55:0/3383642789 learned_addr learned my addr 172.21.15.55:0/3383642789 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:32:44.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.847+0000 7f387bfff640 1 --2- 172.21.15.55:0/3383642789 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f387c0c5710 0x7f387c0c5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:44.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.847+0000 7f387affd640 1 -- 172.21.15.55:0/3383642789 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f387c0c5710 msgr2=0x7f387c0c5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:32:44.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.847+0000 7f387affd640 1 --2- 172.21.15.55:0/3383642789 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f387c0c5710 0x7f387c0c5b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:44.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.847+0000 7f387affd640 1 -- 172.21.15.55:0/3383642789 >> v1:172.21.15.72:6789/0 conn(0x7f387c15a250 legacy=0x7f387c06ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:32:44.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.847+0000 7f387affd640 1 -- 172.21.15.55:0/3383642789 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f387c160360 con 0x7f387c0cf400 2024-05-27T12:32:44.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.847+0000 7f387bfff640 1 --2- 172.21.15.55:0/3383642789 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f387c0c5710 0x7f387c0c5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T12:32:44.850 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.848+0000 7f387affd640 1 --2- 172.21.15.55:0/3383642789 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f387c0cf400 0x7f387c0cf840 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f387c0b2ad0 tx=0x7f387002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9a74436c244a886 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:44.850 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.848+0000 7f387a7fc640 1 -- 172.21.15.55:0/3383642789 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3870037070 con 0x7f387c0cf400 2024-05-27T12:32:44.850 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.848+0000 7f387a7fc640 1 -- 172.21.15.55:0/3383642789 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3870032440 con 0x7f387c0cf400 2024-05-27T12:32:44.850 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.848+0000 7f387a7fc640 1 -- 172.21.15.55:0/3383642789 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3870032810 con 0x7f387c0cf400 2024-05-27T12:32:44.850 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.848+0000 7f388224e640 1 -- 172.21.15.55:0/3383642789 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f387c0cf400 msgr2=0x7f387c0cf840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:44.850 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.849+0000 7f388224e640 1 --2- 172.21.15.55:0/3383642789 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f387c0cf400 0x7f387c0cf840 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f387c0b2ad0 tx=0x7f387002a1e0 comp rx=0 tx=0).stop 2024-05-27T12:32:44.850 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.849+0000 7f388224e640 1 -- 172.21.15.55:0/3383642789 shutdown_connections 2024-05-27T12:32:44.850 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.849+0000 7f388224e640 1 --2- 172.21.15.55:0/3383642789 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f387c0c5710 0x7f387c0c5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:44.850 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.849+0000 7f388224e640 1 --2- 172.21.15.55:0/3383642789 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f387c0cf400 0x7f387c0cf840 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:44.850 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.849+0000 7f388224e640 1 -- 172.21.15.55:0/3383642789 >> 172.21.15.55:0/3383642789 conn(0x7f387c0b3830 msgr2=0x7f387c0b3c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:44.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.849+0000 7f388224e640 1 -- 172.21.15.55:0/3383642789 shutdown_connections 2024-05-27T12:32:44.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.849+0000 7f388224e640 1 -- 172.21.15.55:0/3383642789 wait complete. 2024-05-27T12:32:44.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.850+0000 7f388224e640 1 Processor -- start 2024-05-27T12:32:44.853 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.850+0000 7f388224e640 1 -- start start 2024-05-27T12:32:44.853 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.851+0000 7f388224e640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f387c0c5710 0x7f387c1461c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:44.853 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.851+0000 7f388224e640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f387c0cf400 0x7f387c1e6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:44.853 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.851+0000 7f388224e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f387c15a250 0x7f387c0cde30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:44.853 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.851+0000 7f388224e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f387c160c00 con 0x7f387c15a250 2024-05-27T12:32:44.853 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.851+0000 7f388224e640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f387c160920 con 0x7f387c0c5710 2024-05-27T12:32:44.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.851+0000 7f388224e640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f387c15a630 con 0x7f387c0cf400 2024-05-27T12:32:44.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.851+0000 7f387bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f387c15a250 0x7f387c0cde30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:44.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.851+0000 7f387bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f387c15a250 0x7f387c0cde30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55268/0 (socket says 172.21.15.55:55268) 2024-05-27T12:32:44.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.851+0000 7f387bfff640 1 -- 172.21.15.55:0/764003263 learned_addr learned my addr 172.21.15.55:0/764003263 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:32:44.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.851+0000 7f387b7fe640 1 --2- 172.21.15.55:0/764003263 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f387c0c5710 0x7f387c1461c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:44.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.851+0000 7f387affd640 1 --2- 172.21.15.55:0/764003263 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f387c0cf400 0x7f387c1e6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:44.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.851+0000 7f387bfff640 1 -- 172.21.15.55:0/764003263 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f387c0cf400 msgr2=0x7f387c1e6ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:44.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.851+0000 7f387bfff640 1 --2- 172.21.15.55:0/764003263 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f387c0cf400 0x7f387c1e6ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:44.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.851+0000 7f387bfff640 1 -- 172.21.15.55:0/764003263 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f387c0c5710 msgr2=0x7f387c1461c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:44.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.851+0000 7f387bfff640 1 --2- 172.21.15.55:0/764003263 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f387c0c5710 0x7f387c1461c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:44.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.851+0000 7f387bfff640 1 -- 172.21.15.55:0/764003263 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f387c156670 con 0x7f387c15a250 2024-05-27T12:32:44.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.851+0000 7f387affd640 1 --2- 172.21.15.55:0/764003263 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f387c0cf400 0x7f387c1e6ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T12:32:44.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.851+0000 7f387bfff640 1 --2- 172.21.15.55:0/764003263 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f387c15a250 0x7f387c0cde30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f387400cf20 tx=0x7f387400a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:44.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.852+0000 7f3863fff640 1 -- 172.21.15.55:0/764003263 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f387401a070 con 0x7f387c15a250 2024-05-27T12:32:44.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.852+0000 7f3863fff640 1 -- 172.21.15.55:0/764003263 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f387400d840 con 0x7f387c15a250 2024-05-27T12:32:44.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.852+0000 7f388224e640 1 -- 172.21.15.55:0/764003263 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f387c156950 con 0x7f387c15a250 2024-05-27T12:32:44.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.852+0000 7f3863fff640 1 -- 172.21.15.55:0/764003263 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f387400dc30 con 0x7f387c15a250 2024-05-27T12:32:44.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.852+0000 7f388224e640 1 -- 172.21.15.55:0/764003263 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f387c156f10 con 0x7f387c15a250 2024-05-27T12:32:44.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.853+0000 7f388224e640 1 -- 172.21.15.55:0/764003263 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f387c075460 con 0x7f387c15a250 2024-05-27T12:32:44.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.853+0000 7f3863fff640 1 -- 172.21.15.55:0/764003263 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f387401d070 con 0x7f387c15a250 2024-05-27T12:32:44.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.854+0000 7f3863fff640 1 --2- 172.21.15.55:0/764003263 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f386806c8f0 0x7f386806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:44.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.854+0000 7f3863fff640 1 -- 172.21.15.55:0/764003263 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f387408c350 con 0x7f387c15a250 2024-05-27T12:32:44.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.854+0000 7f387b7fe640 1 --2- 172.21.15.55:0/764003263 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f386806c8f0 0x7f386806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:44.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.854+0000 7f387b7fe640 1 --2- 172.21.15.55:0/764003263 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f386806c8f0 0x7f386806edb0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f387c0b6550 tx=0x7f386c009060 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:44.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:44.858+0000 7f3863fff640 1 -- 172.21.15.55:0/764003263 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f387405a1f0 con 0x7f387c15a250 2024-05-27T12:32:45.044 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.044+0000 7f388224e640 1 -- 172.21.15.55:0/764003263 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f387c06e1c0 con 0x7f387c15a250 2024-05-27T12:32:45.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.045+0000 7f3863fff640 1 -- 172.21.15.55:0/764003263 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16557 (secure 0 0 0) 0x7f387405e4f0 con 0x7f387c15a250 2024-05-27T12:32:45.045 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-27T12:32:45.045 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":23,"fsid":"c3ff4e3b-8dae-4856-9593-e5cc66c59982","created":"2024-05-27T12:32:17.019097+0000","modified":"2024-05-27T12:32:43.361598+0000","last_up_change":"2024-05-27T12:32:28.109744+0000","last_in_change":"2024-05-27T12:32:19.309872+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-27T12:32:29.277895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-27T12:32:39.442745+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-27T12:32:40.672118+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e607b598-061b-4b6f-92ff-95c20b330599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":807572567},{"type":"v1","addr":"172.21.15.55:6801","nonce":807572567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":807572567},{"type":"v1","addr":"172.21.15.55:6803","nonce":807572567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":807572567},{"type":"v1","addr":"172.21.15.55:6807","nonce":807572567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":807572567},{"type":"v1","addr":"172.21.15.55:6805","nonce":807572567}]},"public_addr":"172.21.15.55:6801/807572567","cluster_addr":"172.21.15.55:6803/807572567","heartbeat_back_addr":"172.21.15.55:6807/807572567","heartbeat_front_addr":"172.21.15.55:6805/807572567","state":["exists","up"]},{"osd":1,"uuid":"ba2b5b1d-71a9-4ecc-9a48-55aa7fe54261","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":3426897300},{"type":"v1","addr":"172.21.15.55:6825","nonce":3426897300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":3426897300},{"type":"v1","addr":"172.21.15.55:6827","nonce":3426897300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":3426897300},{"type":"v1","addr":"172.21.15.55:6831","nonce":3426897300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":3426897300},{"type":"v1","addr":"172.21.15.55:6829","nonce":3426897300}]},"public_addr":"172.21.15.55:6825/3426897300","cluster_addr":"172.21.15.55:6827/3426897300","heartbeat_back_addr":"172.21.15.55:6831/3426897300","heartbeat_front_addr":"172.21.15.55:6829/3426897300","state":["exists","up"]},{"osd":2,"uuid":"e6b81cc6-4ff1-45d0-87eb-9f04ccf986a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3510271725},{"type":"v1","addr":"172.21.15.55:6809","nonce":3510271725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3510271725},{"type":"v1","addr":"172.21.15.55:6811","nonce":3510271725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3510271725},{"type":"v1","addr":"172.21.15.55:6815","nonce":3510271725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3510271725},{"type":"v1","addr":"172.21.15.55:6813","nonce":3510271725}]},"public_addr":"172.21.15.55:6809/3510271725","cluster_addr":"172.21.15.55:6811/3510271725","heartbeat_back_addr":"172.21.15.55:6815/3510271725","heartbeat_front_addr":"172.21.15.55:6813/3510271725","state":["exists","up"]},{"osd":3,"uuid":"b6a34b75-807d-4693-b1c3-903cb4c618d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":1066693520},{"type":"v1","addr":"172.21.15.55:6817","nonce":1066693520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":1066693520},{"type":"v1","addr":"172.21.15.55:6819","nonce":1066693520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":1066693520},{"type":"v1","addr":"172.21.15.55:6823","nonce":1066693520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":1066693520},{"type":"v1","addr":"172.21.15.55:6821","nonce":1066693520}]},"public_addr":"172.21.15.55:6817/1066693520","cluster_addr":"172.21.15.55:6819/1066693520","heartbeat_back_addr":"172.21.15.55:6823/1066693520","heartbeat_front_addr":"172.21.15.55:6821/1066693520","state":["exists","up"]},{"osd":4,"uuid":"272ec937-56b4-4f0a-b2e1-b0bc189c9d79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":4190771237},{"type":"v1","addr":"172.21.15.72:6820","nonce":4190771237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":4190771237},{"type":"v1","addr":"172.21.15.72:6824","nonce":4190771237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":4190771237},{"type":"v1","addr":"172.21.15.72:6831","nonce":4190771237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":4190771237},{"type":"v1","addr":"172.21.15.72:6828","nonce":4190771237}]},"public_addr":"172.21.15.72:6820/4190771237","cluster_addr":"172.21.15.72:6824/4190771237","heartbeat_back_addr":"172.21.15.72:6831/4190771237","heartbeat_front_addr":"172.21.15.72:6828/4190771237","state":["exists","up"]},{"osd":5,"uuid":"56439854-72a0-4ef4-81ff-184a3d924a5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":2421889184},{"type":"v1","addr":"172.21.15.72:6801","nonce":2421889184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6803","nonce":2421889184},{"type":"v1","addr":"172.21.15.72:6805","nonce":2421889184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":2421889184},{"type":"v1","addr":"172.21.15.72:6813","nonce":2421889184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6807","nonce":2421889184},{"type":"v1","addr":"172.21.15.72:6809","nonce":2421889184}]},"public_addr":"172.21.15.72:6801/2421889184","cluster_addr":"172.21.15.72:6805/2421889184","heartbeat_back_addr":"172.21.15.72:6813/2421889184","heartbeat_front_addr":"172.21.15.72:6809/2421889184","state":["exists","up"]},{"osd":6,"uuid":"e248e2be-3b6e-49cf-8c8a-1a4152827582","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3796994599},{"type":"v1","addr":"172.21.15.72:6804","nonce":3796994599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":3796994599},{"type":"v1","addr":"172.21.15.72:6808","nonce":3796994599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":3796994599},{"type":"v1","addr":"172.21.15.72:6815","nonce":3796994599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":3796994599},{"type":"v1","addr":"172.21.15.72:6812","nonce":3796994599}]},"public_addr":"172.21.15.72:6804/3796994599","cluster_addr":"172.21.15.72:6808/3796994599","heartbeat_back_addr":"172.21.15.72:6815/3796994599","heartbeat_front_addr":"172.21.15.72:6812/3796994599","state":["exists","up"]},{"osd":7,"uuid":"505a62d3-322b-4629-b4fd-187a55563709","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":3024877895},{"type":"v1","addr":"172.21.15.72:6817","nonce":3024877895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":3024877895},{"type":"v1","addr":"172.21.15.72:6821","nonce":3024877895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6827","nonce":3024877895},{"type":"v1","addr":"172.21.15.72:6829","nonce":3024877895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6823","nonce":3024877895},{"type":"v1","addr":"172.21.15.72:6825","nonce":3024877895}]},"public_addr":"172.21.15.72:6817/3024877895","cluster_addr":"172.21.15.72:6821/3024877895","heartbeat_back_addr":"172.21.15.72:6829/3024877895","heartbeat_front_addr":"172.21.15.72:6825/3024877895","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.241014+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.450799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.465018+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.507647+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.534763+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.495895+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.427110+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.547466+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-27T12:32:45.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.047+0000 7f388224e640 1 -- 172.21.15.55:0/764003263 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f386806c8f0 msgr2=0x7f386806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:45.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.047+0000 7f388224e640 1 --2- 172.21.15.55:0/764003263 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f386806c8f0 0x7f386806edb0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f387c0b6550 tx=0x7f386c009060 comp rx=0 tx=0).stop 2024-05-27T12:32:45.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.047+0000 7f388224e640 1 -- 172.21.15.55:0/764003263 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f387c15a250 msgr2=0x7f387c0cde30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:45.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.047+0000 7f388224e640 1 --2- 172.21.15.55:0/764003263 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f387c15a250 0x7f387c0cde30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f387400cf20 tx=0x7f387400a7d0 comp rx=0 tx=0).stop 2024-05-27T12:32:45.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.047+0000 7f388224e640 1 -- 172.21.15.55:0/764003263 shutdown_connections 2024-05-27T12:32:45.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.047+0000 7f388224e640 1 --2- 172.21.15.55:0/764003263 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f387c15a250 0x7f387c0cde30 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:45.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.047+0000 7f388224e640 1 --2- 172.21.15.55:0/764003263 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f387c0cf400 0x7f387c1e6ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:45.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.047+0000 7f388224e640 1 --2- 172.21.15.55:0/764003263 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f386806c8f0 0x7f386806edb0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:45.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.047+0000 7f388224e640 1 --2- 172.21.15.55:0/764003263 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f387c0c5710 0x7f387c1461c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:45.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.047+0000 7f388224e640 1 -- 172.21.15.55:0/764003263 >> 172.21.15.55:0/764003263 conn(0x7f387c0b3830 msgr2=0x7f387c15cd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:45.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.047+0000 7f388224e640 1 -- 172.21.15.55:0/764003263 shutdown_connections 2024-05-27T12:32:45.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.047+0000 7f388224e640 1 -- 172.21.15.55:0/764003263 wait complete. 2024-05-27T12:32:45.058 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-05-27T12:32:45.059 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-27T12:32:45.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.163+0000 7f39bdf7d640 1 Processor -- start 2024-05-27T12:32:45.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.163+0000 7f39bdf7d640 1 -- start start 2024-05-27T12:32:45.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.164+0000 7f39bdf7d640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f39b815a250 0x7f39b806ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:45.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.164+0000 7f39bdf7d640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39b8160360 con 0x7f39b80cfb10 2024-05-27T12:32:45.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.164+0000 7f39bdf7d640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39b8160640 con 0x7f39b806f280 2024-05-27T12:32:45.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.164+0000 7f39bdf7d640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f39b8160f70 con 0x7f39b815a250 2024-05-27T12:32:45.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.164+0000 7f39b7fff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f39b80cfb10 0x7f39b80c5710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:60336/0 (socket says 172.21.15.55:60336) 2024-05-27T12:32:45.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.164+0000 7f39b7fff640 1 -- 172.21.15.55:0/2511761344 learned_addr learned my addr 172.21.15.55:0/2511761344 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-27T12:32:45.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.164+0000 7f39b77fe640 1 --2- 172.21.15.55:0/2511761344 >> v2:172.21.15.72:3300/0 conn(0x7f39b815a250 0x7f39b806ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:45.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.164+0000 7f39b67fc640 1 -- 172.21.15.55:0/2511761344 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 676336710 0 0) 0x7f39b8160360 con 0x7f39b80cfb10 2024-05-27T12:32:45.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.164+0000 7f39b67fc640 1 -- 172.21.15.55:0/2511761344 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f39a0003520 con 0x7f39b80cfb10 2024-05-27T12:32:45.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.164+0000 7f39b67fc640 1 -- 172.21.15.55:0/2511761344 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1997422374 0 0) 0x7f39a0003520 con 0x7f39b80cfb10 2024-05-27T12:32:45.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.164+0000 7f39b67fc640 1 -- 172.21.15.55:0/2511761344 >> v2:172.21.15.72:3300/0 conn(0x7f39b815a250 msgr2=0x7f39b806ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:32:45.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.164+0000 7f39b67fc640 1 --2- 172.21.15.55:0/2511761344 >> v2:172.21.15.72:3300/0 conn(0x7f39b815a250 0x7f39b806ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:45.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.164+0000 7f39b67fc640 1 -- 172.21.15.55:0/2511761344 >> v1:172.21.15.72:6789/0 conn(0x7f39b806f280 legacy=0x7f39b80cf400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:45.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.164+0000 7f39b67fc640 1 -- 172.21.15.55:0/2511761344 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39b8160920 con 0x7f39b80cfb10 2024-05-27T12:32:45.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.164+0000 7f39b67fc640 1 -- 172.21.15.55:0/2511761344 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 793017739 0 0) 0x7f39b00019f0 con 0x7f39b80cfb10 2024-05-27T12:32:45.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.164+0000 7f39b67fc640 1 -- 172.21.15.55:0/2511761344 >> v1:172.21.15.55:6789/0 conn(0x7f39b80cfb10 legacy=0x7f39b80c5710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:45.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.164+0000 7f39b67fc640 1 --2- 172.21.15.55:0/2511761344 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f39a0003a90 0x7f39a0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:45.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.164+0000 7f39b67fc640 1 --2- 172.21.15.55:0/2511761344 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f39a0004800 0x7f39a0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:45.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.164+0000 7f39b67fc640 1 --2- 172.21.15.55:0/2511761344 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f39a00051c0 0x7f39a000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:45.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.164+0000 7f39b67fc640 1 -- 172.21.15.55:0/2511761344 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f39a000c090 con 0x7f39a00051c0 2024-05-27T12:32:45.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.164+0000 7f39b67fc640 1 -- 172.21.15.55:0/2511761344 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f39a000c240 con 0x7f39a0003a90 2024-05-27T12:32:45.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.164+0000 7f39b67fc640 1 -- 172.21.15.55:0/2511761344 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f39a000c440 con 0x7f39a0004800 2024-05-27T12:32:45.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.164+0000 7f39b7fff640 1 --2- 172.21.15.55:0/2511761344 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f39a00051c0 0x7f39a000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:45.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.164+0000 7f39b77fe640 1 --2- 172.21.15.55:0/2511761344 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f39a0003a90 0x7f39a0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:45.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.165+0000 7f39b6ffd640 1 --2- 172.21.15.55:0/2511761344 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f39a0004800 0x7f39a0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:45.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.165+0000 7f39b7fff640 1 -- 172.21.15.55:0/2511761344 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f39a0004800 msgr2=0x7f39a0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:32:45.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.165+0000 7f39b7fff640 1 --2- 172.21.15.55:0/2511761344 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f39a0004800 0x7f39a0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:45.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.165+0000 7f39b7fff640 1 -- 172.21.15.55:0/2511761344 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f39a0003a90 msgr2=0x7f39a0003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:32:45.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.165+0000 7f39b7fff640 1 --2- 172.21.15.55:0/2511761344 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f39a0003a90 0x7f39a0003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:45.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.165+0000 7f39b7fff640 1 -- 172.21.15.55:0/2511761344 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39a0003520 con 0x7f39a00051c0 2024-05-27T12:32:45.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.165+0000 7f39b7fff640 1 -- 172.21.15.55:0/2511761344 reap_dead start 2024-05-27T12:32:45.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.165+0000 7f39b7fff640 1 --2- 172.21.15.55:0/2511761344 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f39a00051c0 0x7f39a000b9c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f39b000a850 tx=0x7f39a0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16ecf7dce356160d server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:45.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.166+0000 7f39b67fc640 1 -- 172.21.15.55:0/2511761344 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39b000a4a0 con 0x7f39a00051c0 2024-05-27T12:32:45.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.166+0000 7f39b67fc640 1 -- 172.21.15.55:0/2511761344 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39b002f070 con 0x7f39a00051c0 2024-05-27T12:32:45.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.166+0000 7f39b67fc640 1 -- 172.21.15.55:0/2511761344 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39b002bcb0 con 0x7f39a00051c0 2024-05-27T12:32:45.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.166+0000 7f39bdf7d640 1 -- 172.21.15.55:0/2511761344 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f39a00051c0 msgr2=0x7f39a000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:45.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.166+0000 7f39bdf7d640 1 --2- 172.21.15.55:0/2511761344 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f39a00051c0 0x7f39a000b9c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f39b000a850 tx=0x7f39a0005830 comp rx=0 tx=0).stop 2024-05-27T12:32:45.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.166+0000 7f39bdf7d640 1 -- 172.21.15.55:0/2511761344 shutdown_connections 2024-05-27T12:32:45.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.166+0000 7f39bdf7d640 1 --2- 172.21.15.55:0/2511761344 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f39a00051c0 0x7f39a000b9c0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:45.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.166+0000 7f39bdf7d640 1 -- 172.21.15.55:0/2511761344 >> 172.21.15.55:0/2511761344 conn(0x7f39b80b3830 msgr2=0x7f39b80b3c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:45.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.166+0000 7f39bdf7d640 1 -- 172.21.15.55:0/2511761344 shutdown_connections 2024-05-27T12:32:45.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.166+0000 7f39bdf7d640 1 -- 172.21.15.55:0/2511761344 wait complete. 2024-05-27T12:32:45.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.167+0000 7f39bdf7d640 1 Processor -- start 2024-05-27T12:32:45.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.168+0000 7f39bdf7d640 1 -- start start 2024-05-27T12:32:45.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.168+0000 7f39bdf7d640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f39a00051c0 0x7f39b81f1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:45.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.168+0000 7f39bdf7d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f39b80c9f60 0x7f39b8159430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:45.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.168+0000 7f39bdf7d640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f39b80ca3e0 0x7f39b80c6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:45.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.168+0000 7f39bdf7d640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f39b806e7f0 con 0x7f39b80c9f60 2024-05-27T12:32:45.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.168+0000 7f39bdf7d640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f39b815a630 con 0x7f39a00051c0 2024-05-27T12:32:45.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.168+0000 7f39bdf7d640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f39b806e970 con 0x7f39b80ca3e0 2024-05-27T12:32:45.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.168+0000 7f39b6ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f39b80c9f60 0x7f39b8159430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:45.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.168+0000 7f39b6ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f39b80c9f60 0x7f39b8159430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55276/0 (socket says 172.21.15.55:55276) 2024-05-27T12:32:45.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.168+0000 7f39b6ffd640 1 -- 172.21.15.55:0/3051826882 learned_addr learned my addr 172.21.15.55:0/3051826882 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:32:45.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.169+0000 7f39b77fe640 1 --2- 172.21.15.55:0/3051826882 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f39a00051c0 0x7f39b81f1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:45.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.169+0000 7f39b7fff640 1 --2- 172.21.15.55:0/3051826882 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f39b80ca3e0 0x7f39b80c6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:45.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.169+0000 7f39b6ffd640 1 -- 172.21.15.55:0/3051826882 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f39b80ca3e0 msgr2=0x7f39b80c6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:45.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.169+0000 7f39b6ffd640 1 --2- 172.21.15.55:0/3051826882 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f39b80ca3e0 0x7f39b80c6120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:45.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.169+0000 7f39b6ffd640 1 -- 172.21.15.55:0/3051826882 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f39a00051c0 msgr2=0x7f39b81f1bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:45.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.169+0000 7f39b6ffd640 1 --2- 172.21.15.55:0/3051826882 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f39a00051c0 0x7f39b81f1bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:45.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.169+0000 7f39b6ffd640 1 -- 172.21.15.55:0/3051826882 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39b8156950 con 0x7f39b80c9f60 2024-05-27T12:32:45.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.169+0000 7f39b77fe640 1 --2- 172.21.15.55:0/3051826882 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f39a00051c0 0x7f39b81f1bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T12:32:45.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.169+0000 7f39b6ffd640 1 --2- 172.21.15.55:0/3051826882 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f39b80c9f60 0x7f39b8159430 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f39ac00f7c0 tx=0x7f39ac00fc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:45.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.169+0000 7f399ffff640 1 -- 172.21.15.55:0/3051826882 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39ac00fe70 con 0x7f39b80c9f60 2024-05-27T12:32:45.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.169+0000 7f399ffff640 1 -- 172.21.15.55:0/3051826882 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39ac018070 con 0x7f39b80c9f60 2024-05-27T12:32:45.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.169+0000 7f39bdf7d640 1 -- 172.21.15.55:0/3051826882 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39b8156c30 con 0x7f39b80c9f60 2024-05-27T12:32:45.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.169+0000 7f399ffff640 1 -- 172.21.15.55:0/3051826882 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39ac00d730 con 0x7f39b80c9f60 2024-05-27T12:32:45.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.169+0000 7f39bdf7d640 1 -- 172.21.15.55:0/3051826882 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39b81571f0 con 0x7f39b80c9f60 2024-05-27T12:32:45.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.170+0000 7f39bdf7d640 1 -- 172.21.15.55:0/3051826882 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39b8075460 con 0x7f39b80c9f60 2024-05-27T12:32:45.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.171+0000 7f399ffff640 1 -- 172.21.15.55:0/3051826882 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f39ac00d8d0 con 0x7f39b80c9f60 2024-05-27T12:32:45.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.171+0000 7f399ffff640 1 --2- 172.21.15.55:0/3051826882 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f39a406c8f0 0x7f39a406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:45.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.171+0000 7f399ffff640 1 -- 172.21.15.55:0/3051826882 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f39ac08ba80 con 0x7f39b80c9f60 2024-05-27T12:32:45.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.171+0000 7f39b77fe640 1 --2- 172.21.15.55:0/3051826882 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f39a406c8f0 0x7f39a406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:45.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.172+0000 7f39b77fe640 1 --2- 172.21.15.55:0/3051826882 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f39a406c8f0 0x7f39a406edb0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f39a8009a40 tx=0x7f39a8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:45.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.175+0000 7f399ffff640 1 -- 172.21.15.55:0/3051826882 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f39ac01a310 con 0x7f39b80c9f60 2024-05-27T12:32:45.357 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.357+0000 7f39bdf7d640 1 -- 172.21.15.55:0/3051826882 --> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f39b806e1c0 con 0x7f39a406c8f0 2024-05-27T12:32:45.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.364+0000 7f399ffff640 1 -- 172.21.15.55:0/3051826882 <== mgr.4105 v2:172.21.15.72:6832/3152720583 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251063 (secure 0 0 0) 0x7f39b806e1c0 con 0x7f39a406c8f0 2024-05-27T12:32:45.367 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-27T12:32:45.369 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2024-05-27T12:32:45.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.367+0000 7f39bdf7d640 1 -- 172.21.15.55:0/3051826882 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f39a406c8f0 msgr2=0x7f39a406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:45.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.367+0000 7f39bdf7d640 1 --2- 172.21.15.55:0/3051826882 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f39a406c8f0 0x7f39a406edb0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f39a8009a40 tx=0x7f39a8008040 comp rx=0 tx=0).stop 2024-05-27T12:32:45.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.367+0000 7f39bdf7d640 1 -- 172.21.15.55:0/3051826882 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f39b80c9f60 msgr2=0x7f39b8159430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:45.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.367+0000 7f39bdf7d640 1 --2- 172.21.15.55:0/3051826882 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f39b80c9f60 0x7f39b8159430 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f39ac00f7c0 tx=0x7f39ac00fc80 comp rx=0 tx=0).stop 2024-05-27T12:32:45.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.367+0000 7f39bdf7d640 1 -- 172.21.15.55:0/3051826882 shutdown_connections 2024-05-27T12:32:45.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.367+0000 7f39bdf7d640 1 --2- 172.21.15.55:0/3051826882 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f39b80ca3e0 0x7f39b80c6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:45.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.367+0000 7f39bdf7d640 1 --2- 172.21.15.55:0/3051826882 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f39b80c9f60 0x7f39b8159430 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:45.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.367+0000 7f39bdf7d640 1 --2- 172.21.15.55:0/3051826882 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f39a406c8f0 0x7f39a406edb0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:45.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.367+0000 7f39bdf7d640 1 --2- 172.21.15.55:0/3051826882 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f39a00051c0 0x7f39b81f1bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:45.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.367+0000 7f39bdf7d640 1 -- 172.21.15.55:0/3051826882 >> 172.21.15.55:0/3051826882 conn(0x7f39b80b3830 msgr2=0x7f39b80b4890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:45.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.367+0000 7f39bdf7d640 1 -- 172.21.15.55:0/3051826882 shutdown_connections 2024-05-27T12:32:45.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.367+0000 7f39bdf7d640 1 -- 172.21.15.55:0/3051826882 wait complete. 2024-05-27T12:32:45.378 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-05-27T12:32:45.263246+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592162,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":196,"num_write_kb":2422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":149,"ondisk_log_size":149,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":84,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235728,"kb_used_data":2928,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738992,"statfs":{"total":773094113280,"available":772852727808,"internally_reserved":0,"allocated":2998272,"data_stored":1775383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1794,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.925680"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.374797+0000","last_change":"2024-05-27T12:32:42.368378+0000","last_active":"2024-05-27T12:32:42.374797+0000","last_peered":"2024-05-27T12:32:42.374797+0000","last_clean":"2024-05-27T12:32:42.374797+0000","last_became_active":"2024-05-27T12:32:42.367689+0000","last_became_peered":"2024-05-27T12:32:42.367689+0000","last_unstale":"2024-05-27T12:32:42.374797+0000","last_undegraded":"2024-05-27T12:32:42.374797+0000","last_fullsized":"2024-05-27T12:32:42.374797+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:23:59.137419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.381869+0000","last_change":"2024-05-27T12:32:42.380372+0000","last_active":"2024-05-27T12:32:42.381869+0000","last_peered":"2024-05-27T12:32:42.381869+0000","last_clean":"2024-05-27T12:32:42.381869+0000","last_became_active":"2024-05-27T12:32:42.379503+0000","last_became_peered":"2024-05-27T12:32:42.379503+0000","last_unstale":"2024-05-27T12:32:42.381869+0000","last_undegraded":"2024-05-27T12:32:42.381869+0000","last_fullsized":"2024-05-27T12:32:42.381869+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:08:37.481605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-27T12:32:41.357767+0000","last_change":"2024-05-27T12:32:41.357767+0000","last_active":"2024-05-27T12:32:41.333908+0000","last_peered":"2024-05-27T12:32:41.333908+0000","last_clean":"2024-05-27T12:32:41.333908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T12:32:41.357767+0000","last_undegraded":"2024-05-27T12:32:41.357767+0000","last_fullsized":"2024-05-27T12:32:41.357767+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.389251+0000","last_change":"2024-05-27T12:32:42.384566+0000","last_active":"2024-05-27T12:32:42.389251+0000","last_peered":"2024-05-27T12:32:42.389251+0000","last_clean":"2024-05-27T12:32:42.389251+0000","last_became_active":"2024-05-27T12:32:42.384269+0000","last_became_peered":"2024-05-27T12:32:42.384269+0000","last_unstale":"2024-05-27T12:32:42.389251+0000","last_undegraded":"2024-05-27T12:32:42.389251+0000","last_fullsized":"2024-05-27T12:32:42.389251+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:08:37.481605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.374093+0000","last_change":"2024-05-27T12:32:42.367164+0000","last_active":"2024-05-27T12:32:42.374093+0000","last_peered":"2024-05-27T12:32:42.374093+0000","last_clean":"2024-05-27T12:32:42.374093+0000","last_became_active":"2024-05-27T12:32:42.366882+0000","last_became_peered":"2024-05-27T12:32:42.366882+0000","last_unstale":"2024-05-27T12:32:42.374093+0000","last_undegraded":"2024-05-27T12:32:42.374093+0000","last_fullsized":"2024-05-27T12:32:42.374093+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:04:04.818266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.389344+0000","last_change":"2024-05-27T12:32:42.385413+0000","last_active":"2024-05-27T12:32:42.389344+0000","last_peered":"2024-05-27T12:32:42.389344+0000","last_clean":"2024-05-27T12:32:42.389344+0000","last_became_active":"2024-05-27T12:32:42.385163+0000","last_became_peered":"2024-05-27T12:32:42.385163+0000","last_unstale":"2024-05-27T12:32:42.389344+0000","last_undegraded":"2024-05-27T12:32:42.389344+0000","last_fullsized":"2024-05-27T12:32:42.389344+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:23:59.137419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.380885+0000","last_change":"2024-05-27T12:32:42.376081+0000","last_active":"2024-05-27T12:32:42.380885+0000","last_peered":"2024-05-27T12:32:42.380885+0000","last_clean":"2024-05-27T12:32:42.380885+0000","last_became_active":"2024-05-27T12:32:42.375689+0000","last_became_peered":"2024-05-27T12:32:42.375689+0000","last_unstale":"2024-05-27T12:32:42.380885+0000","last_undegraded":"2024-05-27T12:32:42.380885+0000","last_fullsized":"2024-05-27T12:32:42.380885+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:45:06.261408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.386869+0000","last_change":"2024-05-27T12:32:42.385659+0000","last_active":"2024-05-27T12:32:42.386869+0000","last_peered":"2024-05-27T12:32:42.386869+0000","last_clean":"2024-05-27T12:32:42.386869+0000","last_became_active":"2024-05-27T12:32:42.385356+0000","last_became_peered":"2024-05-27T12:32:42.385356+0000","last_unstale":"2024-05-27T12:32:42.386869+0000","last_undegraded":"2024-05-27T12:32:42.386869+0000","last_fullsized":"2024-05-27T12:32:42.386869+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:08:37.481605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.386391+0000","last_change":"2024-05-27T12:32:42.382460+0000","last_active":"2024-05-27T12:32:42.386391+0000","last_peered":"2024-05-27T12:32:42.386391+0000","last_clean":"2024-05-27T12:32:42.386391+0000","last_became_active":"2024-05-27T12:32:42.382093+0000","last_became_peered":"2024-05-27T12:32:42.382093+0000","last_unstale":"2024-05-27T12:32:42.386391+0000","last_undegraded":"2024-05-27T12:32:42.386391+0000","last_fullsized":"2024-05-27T12:32:42.386391+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:44:31.058083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.389163+0000","last_change":"2024-05-27T12:32:42.384546+0000","last_active":"2024-05-27T12:32:42.389163+0000","last_peered":"2024-05-27T12:32:42.389163+0000","last_clean":"2024-05-27T12:32:42.389163+0000","last_became_active":"2024-05-27T12:32:42.384270+0000","last_became_peered":"2024-05-27T12:32:42.384270+0000","last_unstale":"2024-05-27T12:32:42.389163+0000","last_undegraded":"2024-05-27T12:32:42.389163+0000","last_fullsized":"2024-05-27T12:32:42.389163+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:53:37.721445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.389204+0000","last_change":"2024-05-27T12:32:42.385206+0000","last_active":"2024-05-27T12:32:42.389204+0000","last_peered":"2024-05-27T12:32:42.389204+0000","last_clean":"2024-05-27T12:32:42.389204+0000","last_became_active":"2024-05-27T12:32:42.384940+0000","last_became_peered":"2024-05-27T12:32:42.384940+0000","last_unstale":"2024-05-27T12:32:42.389204+0000","last_undegraded":"2024-05-27T12:32:42.389204+0000","last_fullsized":"2024-05-27T12:32:42.389204+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:08:37.481605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.378903+0000","last_change":"2024-05-27T12:32:42.376596+0000","last_active":"2024-05-27T12:32:42.378903+0000","last_peered":"2024-05-27T12:32:42.378903+0000","last_clean":"2024-05-27T12:32:42.378903+0000","last_became_active":"2024-05-27T12:32:42.376147+0000","last_became_peered":"2024-05-27T12:32:42.376147+0000","last_unstale":"2024-05-27T12:32:42.378903+0000","last_undegraded":"2024-05-27T12:32:42.378903+0000","last_fullsized":"2024-05-27T12:32:42.378903+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T23:55:02.398885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.377139+0000","last_change":"2024-05-27T12:32:42.375358+0000","last_active":"2024-05-27T12:32:42.377139+0000","last_peered":"2024-05-27T12:32:42.377139+0000","last_clean":"2024-05-27T12:32:42.377139+0000","last_became_active":"2024-05-27T12:32:42.375096+0000","last_became_peered":"2024-05-27T12:32:42.375096+0000","last_unstale":"2024-05-27T12:32:42.377139+0000","last_undegraded":"2024-05-27T12:32:42.377139+0000","last_fullsized":"2024-05-27T12:32:42.377139+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:20:05.304417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-27T12:32:41.356707+0000","last_change":"2024-05-27T12:32:41.356707+0000","last_active":"2024-05-27T12:32:41.333908+0000","last_peered":"2024-05-27T12:32:41.333908+0000","last_clean":"2024-05-27T12:32:41.333908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T12:32:41.356707+0000","last_undegraded":"2024-05-27T12:32:41.356707+0000","last_fullsized":"2024-05-27T12:32:41.356707+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.378127+0000","last_change":"2024-05-27T12:32:42.376055+0000","last_active":"2024-05-27T12:32:42.378127+0000","last_peered":"2024-05-27T12:32:42.378127+0000","last_clean":"2024-05-27T12:32:42.378127+0000","last_became_active":"2024-05-27T12:32:42.374091+0000","last_became_peered":"2024-05-27T12:32:42.374091+0000","last_unstale":"2024-05-27T12:32:42.378127+0000","last_undegraded":"2024-05-27T12:32:42.378127+0000","last_fullsized":"2024-05-27T12:32:42.378127+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:45:14.026270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.390013+0000","last_change":"2024-05-27T12:32:42.387113+0000","last_active":"2024-05-27T12:32:42.390013+0000","last_peered":"2024-05-27T12:32:42.390013+0000","last_clean":"2024-05-27T12:32:42.390013+0000","last_became_active":"2024-05-27T12:32:42.386810+0000","last_became_peered":"2024-05-27T12:32:42.386810+0000","last_unstale":"2024-05-27T12:32:42.390013+0000","last_undegraded":"2024-05-27T12:32:42.390013+0000","last_fullsized":"2024-05-27T12:32:42.390013+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:41:35.310708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.389296+0000","last_change":"2024-05-27T12:32:42.383993+0000","last_active":"2024-05-27T12:32:42.389296+0000","last_peered":"2024-05-27T12:32:42.389296+0000","last_clean":"2024-05-27T12:32:42.389296+0000","last_became_active":"2024-05-27T12:32:42.383274+0000","last_became_peered":"2024-05-27T12:32:42.383274+0000","last_unstale":"2024-05-27T12:32:42.389296+0000","last_undegraded":"2024-05-27T12:32:42.389296+0000","last_fullsized":"2024-05-27T12:32:42.389296+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:45:14.026270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.381322+0000","last_change":"2024-05-27T12:32:42.376831+0000","last_active":"2024-05-27T12:32:42.381322+0000","last_peered":"2024-05-27T12:32:42.381322+0000","last_clean":"2024-05-27T12:32:42.381322+0000","last_became_active":"2024-05-27T12:32:42.376498+0000","last_became_peered":"2024-05-27T12:32:42.376498+0000","last_unstale":"2024-05-27T12:32:42.381322+0000","last_undegraded":"2024-05-27T12:32:42.381322+0000","last_fullsized":"2024-05-27T12:32:42.381322+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:31:53.377015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.373560+0000","last_change":"2024-05-27T12:32:42.366751+0000","last_active":"2024-05-27T12:32:42.373560+0000","last_peered":"2024-05-27T12:32:42.373560+0000","last_clean":"2024-05-27T12:32:42.373560+0000","last_became_active":"2024-05-27T12:32:42.366438+0000","last_became_peered":"2024-05-27T12:32:42.366438+0000","last_unstale":"2024-05-27T12:32:42.373560+0000","last_undegraded":"2024-05-27T12:32:42.373560+0000","last_fullsized":"2024-05-27T12:32:42.373560+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:08:37.481605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.373449+0000","last_change":"2024-05-27T12:32:42.370650+0000","last_active":"2024-05-27T12:32:42.373449+0000","last_peered":"2024-05-27T12:32:42.373449+0000","last_clean":"2024-05-27T12:32:42.373449+0000","last_became_active":"2024-05-27T12:32:42.370319+0000","last_became_peered":"2024-05-27T12:32:42.370319+0000","last_unstale":"2024-05-27T12:32:42.373449+0000","last_undegraded":"2024-05-27T12:32:42.373449+0000","last_fullsized":"2024-05-27T12:32:42.373449+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:07:22.262394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-27T12:32:41.357829+0000","last_change":"2024-05-27T12:32:41.357829+0000","last_active":"2024-05-27T12:32:41.333908+0000","last_peered":"2024-05-27T12:32:41.333908+0000","last_clean":"2024-05-27T12:32:41.333908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T12:32:41.357829+0000","last_undegraded":"2024-05-27T12:32:41.357829+0000","last_fullsized":"2024-05-27T12:32:41.357829+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.386644+0000","last_change":"2024-05-27T12:32:42.383033+0000","last_active":"2024-05-27T12:32:42.386644+0000","last_peered":"2024-05-27T12:32:42.386644+0000","last_clean":"2024-05-27T12:32:42.386644+0000","last_became_active":"2024-05-27T12:32:42.382745+0000","last_became_peered":"2024-05-27T12:32:42.382745+0000","last_unstale":"2024-05-27T12:32:42.386644+0000","last_undegraded":"2024-05-27T12:32:42.386644+0000","last_fullsized":"2024-05-27T12:32:42.386644+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:21:04.918457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.380985+0000","last_change":"2024-05-27T12:32:42.378742+0000","last_active":"2024-05-27T12:32:42.380985+0000","last_peered":"2024-05-27T12:32:42.380985+0000","last_clean":"2024-05-27T12:32:42.380985+0000","last_became_active":"2024-05-27T12:32:42.378328+0000","last_became_peered":"2024-05-27T12:32:42.378328+0000","last_unstale":"2024-05-27T12:32:42.380985+0000","last_undegraded":"2024-05-27T12:32:42.380985+0000","last_fullsized":"2024-05-27T12:32:42.380985+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:21:04.918457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.386591+0000","last_change":"2024-05-27T12:32:42.381867+0000","last_active":"2024-05-27T12:32:42.386591+0000","last_peered":"2024-05-27T12:32:42.386591+0000","last_clean":"2024-05-27T12:32:42.386591+0000","last_became_active":"2024-05-27T12:32:42.381591+0000","last_became_peered":"2024-05-27T12:32:42.381591+0000","last_unstale":"2024-05-27T12:32:42.386591+0000","last_undegraded":"2024-05-27T12:32:42.386591+0000","last_fullsized":"2024-05-27T12:32:42.386591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:07:22.262394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.373759+0000","last_change":"2024-05-27T12:32:42.372176+0000","last_active":"2024-05-27T12:32:42.373759+0000","last_peered":"2024-05-27T12:32:42.373759+0000","last_clean":"2024-05-27T12:32:42.373759+0000","last_became_active":"2024-05-27T12:32:42.371874+0000","last_became_peered":"2024-05-27T12:32:42.371874+0000","last_unstale":"2024-05-27T12:32:42.373759+0000","last_undegraded":"2024-05-27T12:32:42.373759+0000","last_fullsized":"2024-05-27T12:32:42.373759+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:10:30.753626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.375586+0000","last_change":"2024-05-27T12:32:42.374766+0000","last_active":"2024-05-27T12:32:42.375586+0000","last_peered":"2024-05-27T12:32:42.375586+0000","last_clean":"2024-05-27T12:32:42.375586+0000","last_became_active":"2024-05-27T12:32:42.374450+0000","last_became_peered":"2024-05-27T12:32:42.374450+0000","last_unstale":"2024-05-27T12:32:42.375586+0000","last_undegraded":"2024-05-27T12:32:42.375586+0000","last_fullsized":"2024-05-27T12:32:42.375586+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:20:05.304417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.380262+0000","last_change":"2024-05-27T12:32:42.376636+0000","last_active":"2024-05-27T12:32:42.380262+0000","last_peered":"2024-05-27T12:32:42.380262+0000","last_clean":"2024-05-27T12:32:42.380262+0000","last_became_active":"2024-05-27T12:32:42.376364+0000","last_became_peered":"2024-05-27T12:32:42.376364+0000","last_unstale":"2024-05-27T12:32:42.380262+0000","last_undegraded":"2024-05-27T12:32:42.380262+0000","last_fullsized":"2024-05-27T12:32:42.380262+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:53:37.721445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.373632+0000","last_change":"2024-05-27T12:32:42.371595+0000","last_active":"2024-05-27T12:32:42.373632+0000","last_peered":"2024-05-27T12:32:42.373632+0000","last_clean":"2024-05-27T12:32:42.373632+0000","last_became_active":"2024-05-27T12:32:42.370375+0000","last_became_peered":"2024-05-27T12:32:42.370375+0000","last_unstale":"2024-05-27T12:32:42.373632+0000","last_undegraded":"2024-05-27T12:32:42.373632+0000","last_fullsized":"2024-05-27T12:32:42.373632+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T23:33:14.178019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-27T12:32:41.356437+0000","last_change":"2024-05-27T12:32:41.356437+0000","last_active":"2024-05-27T12:32:41.333908+0000","last_peered":"2024-05-27T12:32:41.333908+0000","last_clean":"2024-05-27T12:32:41.333908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T12:32:41.356437+0000","last_undegraded":"2024-05-27T12:32:41.356437+0000","last_fullsized":"2024-05-27T12:32:41.356437+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.389200+0000","last_change":"2024-05-27T12:32:42.384076+0000","last_active":"2024-05-27T12:32:42.389200+0000","last_peered":"2024-05-27T12:32:42.389200+0000","last_clean":"2024-05-27T12:32:42.389200+0000","last_became_active":"2024-05-27T12:32:42.383738+0000","last_became_peered":"2024-05-27T12:32:42.383738+0000","last_unstale":"2024-05-27T12:32:42.389200+0000","last_undegraded":"2024-05-27T12:32:42.389200+0000","last_fullsized":"2024-05-27T12:32:42.389200+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:53:37.721445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.382747+0000","last_change":"2024-05-27T12:32:42.379700+0000","last_active":"2024-05-27T12:32:42.382747+0000","last_peered":"2024-05-27T12:32:42.382747+0000","last_clean":"2024-05-27T12:32:42.382747+0000","last_became_active":"2024-05-27T12:32:42.379421+0000","last_became_peered":"2024-05-27T12:32:42.379421+0000","last_unstale":"2024-05-27T12:32:42.382747+0000","last_undegraded":"2024-05-27T12:32:42.382747+0000","last_fullsized":"2024-05-27T12:32:42.382747+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T23:33:14.178019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.383554+0000","last_change":"2024-05-27T12:32:42.379719+0000","last_active":"2024-05-27T12:32:42.383554+0000","last_peered":"2024-05-27T12:32:42.383554+0000","last_clean":"2024-05-27T12:32:42.383554+0000","last_became_active":"2024-05-27T12:32:42.379234+0000","last_became_peered":"2024-05-27T12:32:42.379234+0000","last_unstale":"2024-05-27T12:32:42.383554+0000","last_undegraded":"2024-05-27T12:32:42.383554+0000","last_fullsized":"2024-05-27T12:32:42.383554+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:45:14.026270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.375714+0000","last_change":"2024-05-27T12:32:42.371233+0000","last_active":"2024-05-27T12:32:42.375714+0000","last_peered":"2024-05-27T12:32:42.375714+0000","last_clean":"2024-05-27T12:32:42.375714+0000","last_became_active":"2024-05-27T12:32:42.370965+0000","last_became_peered":"2024-05-27T12:32:42.370965+0000","last_unstale":"2024-05-27T12:32:42.375714+0000","last_undegraded":"2024-05-27T12:32:42.375714+0000","last_fullsized":"2024-05-27T12:32:42.375714+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:29:16.389055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.379340+0000","last_change":"2024-05-27T12:32:41.365100+0000","last_active":"2024-05-27T12:32:42.379340+0000","last_peered":"2024-05-27T12:32:42.379340+0000","last_clean":"2024-05-27T12:32:42.379340+0000","last_became_active":"2024-05-27T12:32:41.364795+0000","last_became_peered":"2024-05-27T12:32:41.364795+0000","last_unstale":"2024-05-27T12:32:42.379340+0000","last_undegraded":"2024-05-27T12:32:42.379340+0000","last_fullsized":"2024-05-27T12:32:42.379340+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:24:00.607915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-27T12:32:41.355572+0000","last_change":"2024-05-27T12:32:41.355572+0000","last_active":"2024-05-27T12:32:41.333908+0000","last_peered":"2024-05-27T12:32:41.333908+0000","last_clean":"2024-05-27T12:32:41.333908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T12:32:41.355572+0000","last_undegraded":"2024-05-27T12:32:41.355572+0000","last_fullsized":"2024-05-27T12:32:41.355572+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.381566+0000","last_change":"2024-05-27T12:32:41.370064+0000","last_active":"2024-05-27T12:32:42.381566+0000","last_peered":"2024-05-27T12:32:42.381566+0000","last_clean":"2024-05-27T12:32:42.381566+0000","last_became_active":"2024-05-27T12:32:41.368679+0000","last_became_peered":"2024-05-27T12:32:41.368679+0000","last_unstale":"2024-05-27T12:32:42.381566+0000","last_undegraded":"2024-05-27T12:32:42.381566+0000","last_fullsized":"2024-05-27T12:32:42.381566+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:31:52.368166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.357284+0000","last_change":"2024-05-27T12:32:41.369441+0000","last_active":"2024-05-27T12:32:42.357284+0000","last_peered":"2024-05-27T12:32:42.357284+0000","last_clean":"2024-05-27T12:32:42.357284+0000","last_became_active":"2024-05-27T12:32:41.369164+0000","last_became_peered":"2024-05-27T12:32:41.369164+0000","last_unstale":"2024-05-27T12:32:42.357284+0000","last_undegraded":"2024-05-27T12:32:42.357284+0000","last_fullsized":"2024-05-27T12:32:42.357284+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:10:55.375726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.383508+0000","last_change":"2024-05-27T12:32:42.381264+0000","last_active":"2024-05-27T12:32:42.383508+0000","last_peered":"2024-05-27T12:32:42.383508+0000","last_clean":"2024-05-27T12:32:42.383508+0000","last_became_active":"2024-05-27T12:32:42.380823+0000","last_became_peered":"2024-05-27T12:32:42.380823+0000","last_unstale":"2024-05-27T12:32:42.383508+0000","last_undegraded":"2024-05-27T12:32:42.383508+0000","last_fullsized":"2024-05-27T12:32:42.383508+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:45:14.026270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.378088+0000","last_change":"2024-05-27T12:32:41.371539+0000","last_active":"2024-05-27T12:32:42.378088+0000","last_peered":"2024-05-27T12:32:42.378088+0000","last_clean":"2024-05-27T12:32:42.378088+0000","last_became_active":"2024-05-27T12:32:41.370827+0000","last_became_peered":"2024-05-27T12:32:41.370827+0000","last_unstale":"2024-05-27T12:32:42.378088+0000","last_undegraded":"2024-05-27T12:32:42.378088+0000","last_fullsized":"2024-05-27T12:32:42.378088+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T23:34:58.092780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.376399+0000","last_change":"2024-05-27T12:32:42.371446+0000","last_active":"2024-05-27T12:32:42.376399+0000","last_peered":"2024-05-27T12:32:42.376399+0000","last_clean":"2024-05-27T12:32:42.376399+0000","last_became_active":"2024-05-27T12:32:42.371197+0000","last_became_peered":"2024-05-27T12:32:42.371197+0000","last_unstale":"2024-05-27T12:32:42.376399+0000","last_undegraded":"2024-05-27T12:32:42.376399+0000","last_fullsized":"2024-05-27T12:32:42.376399+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:21:04.918457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.366123+0000","last_change":"2024-05-27T12:32:41.374793+0000","last_active":"2024-05-27T12:32:42.366123+0000","last_peered":"2024-05-27T12:32:42.366123+0000","last_clean":"2024-05-27T12:32:42.366123+0000","last_became_active":"2024-05-27T12:32:41.374503+0000","last_became_peered":"2024-05-27T12:32:41.374503+0000","last_unstale":"2024-05-27T12:32:42.366123+0000","last_undegraded":"2024-05-27T12:32:42.366123+0000","last_fullsized":"2024-05-27T12:32:42.366123+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T23:33:13.169169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.386679+0000","last_change":"2024-05-27T12:32:42.382592+0000","last_active":"2024-05-27T12:32:42.386679+0000","last_peered":"2024-05-27T12:32:42.386679+0000","last_clean":"2024-05-27T12:32:42.386679+0000","last_became_active":"2024-05-27T12:32:42.382289+0000","last_became_peered":"2024-05-27T12:32:42.382289+0000","last_unstale":"2024-05-27T12:32:42.386679+0000","last_undegraded":"2024-05-27T12:32:42.386679+0000","last_fullsized":"2024-05-27T12:32:42.386679+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:20:05.304417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.369228+0000","last_change":"2024-05-27T12:32:41.370517+0000","last_active":"2024-05-27T12:32:42.369228+0000","last_peered":"2024-05-27T12:32:42.369228+0000","last_clean":"2024-05-27T12:32:42.369228+0000","last_became_active":"2024-05-27T12:32:41.370216+0000","last_became_peered":"2024-05-27T12:32:41.370216+0000","last_unstale":"2024-05-27T12:32:42.369228+0000","last_undegraded":"2024-05-27T12:32:42.369228+0000","last_fullsized":"2024-05-27T12:32:42.369228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:24:00.607915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-27T12:32:41.355055+0000","last_change":"2024-05-27T12:32:41.355055+0000","last_active":"2024-05-27T12:32:41.333908+0000","last_peered":"2024-05-27T12:32:41.333908+0000","last_clean":"2024-05-27T12:32:41.333908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T12:32:41.355055+0000","last_undegraded":"2024-05-27T12:32:41.355055+0000","last_fullsized":"2024-05-27T12:32:41.355055+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.385260+0000","last_change":"2024-05-27T12:32:41.373060+0000","last_active":"2024-05-27T12:32:42.385260+0000","last_peered":"2024-05-27T12:32:42.385260+0000","last_clean":"2024-05-27T12:32:42.385260+0000","last_became_active":"2024-05-27T12:32:41.372729+0000","last_became_peered":"2024-05-27T12:32:41.372729+0000","last_unstale":"2024-05-27T12:32:42.385260+0000","last_undegraded":"2024-05-27T12:32:42.385260+0000","last_fullsized":"2024-05-27T12:32:42.385260+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T23:34:58.092780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.369547+0000","last_change":"2024-05-27T12:32:42.368863+0000","last_active":"2024-05-27T12:32:42.369547+0000","last_peered":"2024-05-27T12:32:42.369547+0000","last_clean":"2024-05-27T12:32:42.369547+0000","last_became_active":"2024-05-27T12:32:42.368593+0000","last_became_peered":"2024-05-27T12:32:42.368593+0000","last_unstale":"2024-05-27T12:32:42.369547+0000","last_undegraded":"2024-05-27T12:32:42.369547+0000","last_fullsized":"2024-05-27T12:32:42.369547+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:17:15.780477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"22'6","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.389628+0000","last_change":"2024-05-27T12:32:41.369617+0000","last_active":"2024-05-27T12:32:42.389628+0000","last_peered":"2024-05-27T12:32:42.389628+0000","last_clean":"2024-05-27T12:32:42.389628+0000","last_became_active":"2024-05-27T12:32:41.369371+0000","last_became_peered":"2024-05-27T12:32:41.369371+0000","last_unstale":"2024-05-27T12:32:42.389628+0000","last_undegraded":"2024-05-27T12:32:42.389628+0000","last_fullsized":"2024-05-27T12:32:42.389628+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:24:00.607915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.365054+0000","last_change":"2024-05-27T12:32:42.362804+0000","last_active":"2024-05-27T12:32:42.365054+0000","last_peered":"2024-05-27T12:32:42.365054+0000","last_clean":"2024-05-27T12:32:42.365054+0000","last_became_active":"2024-05-27T12:32:42.362483+0000","last_became_peered":"2024-05-27T12:32:42.362483+0000","last_unstale":"2024-05-27T12:32:42.365054+0000","last_undegraded":"2024-05-27T12:32:42.365054+0000","last_fullsized":"2024-05-27T12:32:42.365054+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:53:37.721445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-27T12:32:41.369052+0000","last_change":"2024-05-27T12:32:41.365663+0000","last_active":"2024-05-27T12:32:41.369052+0000","last_peered":"2024-05-27T12:32:41.369052+0000","last_clean":"2024-05-27T12:32:41.369052+0000","last_became_active":"2024-05-27T12:32:41.365362+0000","last_became_peered":"2024-05-27T12:32:41.365362+0000","last_unstale":"2024-05-27T12:32:41.369052+0000","last_undegraded":"2024-05-27T12:32:41.369052+0000","last_fullsized":"2024-05-27T12:32:41.369052+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:56:40.549127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-27T12:32:41.355128+0000","last_change":"2024-05-27T12:32:41.355128+0000","last_active":"2024-05-27T12:32:41.333908+0000","last_peered":"2024-05-27T12:32:41.333908+0000","last_clean":"2024-05-27T12:32:41.333908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T12:32:41.355128+0000","last_undegraded":"2024-05-27T12:32:41.355128+0000","last_fullsized":"2024-05-27T12:32:41.355128+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.378054+0000","last_change":"2024-05-27T12:32:41.371087+0000","last_active":"2024-05-27T12:32:42.378054+0000","last_peered":"2024-05-27T12:32:42.378054+0000","last_clean":"2024-05-27T12:32:42.378054+0000","last_became_active":"2024-05-27T12:32:41.370237+0000","last_became_peered":"2024-05-27T12:32:41.370237+0000","last_unstale":"2024-05-27T12:32:42.378054+0000","last_undegraded":"2024-05-27T12:32:42.378054+0000","last_fullsized":"2024-05-27T12:32:42.378054+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:31:52.368166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.374122+0000","last_change":"2024-05-27T12:32:42.371339+0000","last_active":"2024-05-27T12:32:42.374122+0000","last_peered":"2024-05-27T12:32:42.374122+0000","last_clean":"2024-05-27T12:32:42.374122+0000","last_became_active":"2024-05-27T12:32:42.370848+0000","last_became_peered":"2024-05-27T12:32:42.370848+0000","last_unstale":"2024-05-27T12:32:42.374122+0000","last_undegraded":"2024-05-27T12:32:42.374122+0000","last_fullsized":"2024-05-27T12:32:42.374122+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:41:35.310708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.360647+0000","last_change":"2024-05-27T12:32:41.368354+0000","last_active":"2024-05-27T12:32:42.360647+0000","last_peered":"2024-05-27T12:32:42.360647+0000","last_clean":"2024-05-27T12:32:42.360647+0000","last_became_active":"2024-05-27T12:32:41.368086+0000","last_became_peered":"2024-05-27T12:32:41.368086+0000","last_unstale":"2024-05-27T12:32:42.360647+0000","last_undegraded":"2024-05-27T12:32:42.360647+0000","last_fullsized":"2024-05-27T12:32:42.360647+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T23:55:01.390036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.383529+0000","last_change":"2024-05-27T12:32:42.379489+0000","last_active":"2024-05-27T12:32:42.383529+0000","last_peered":"2024-05-27T12:32:42.383529+0000","last_clean":"2024-05-27T12:32:42.383529+0000","last_became_active":"2024-05-27T12:32:42.378880+0000","last_became_peered":"2024-05-27T12:32:42.378880+0000","last_unstale":"2024-05-27T12:32:42.383529+0000","last_undegraded":"2024-05-27T12:32:42.383529+0000","last_fullsized":"2024-05-27T12:32:42.383529+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:21:04.918457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.385950+0000","last_change":"2024-05-27T12:32:41.362154+0000","last_active":"2024-05-27T12:32:42.385950+0000","last_peered":"2024-05-27T12:32:42.385950+0000","last_clean":"2024-05-27T12:32:42.385950+0000","last_became_active":"2024-05-27T12:32:41.361845+0000","last_became_peered":"2024-05-27T12:32:41.361845+0000","last_unstale":"2024-05-27T12:32:42.385950+0000","last_undegraded":"2024-05-27T12:32:42.385950+0000","last_fullsized":"2024-05-27T12:32:42.385950+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:10:55.375726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.383492+0000","last_change":"2024-05-27T12:32:42.378975+0000","last_active":"2024-05-27T12:32:42.383492+0000","last_peered":"2024-05-27T12:32:42.383492+0000","last_clean":"2024-05-27T12:32:42.383492+0000","last_became_active":"2024-05-27T12:32:42.378666+0000","last_became_peered":"2024-05-27T12:32:42.378666+0000","last_unstale":"2024-05-27T12:32:42.383492+0000","last_undegraded":"2024-05-27T12:32:42.383492+0000","last_fullsized":"2024-05-27T12:32:42.383492+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:46:07.761461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.386837+0000","last_change":"2024-05-27T12:32:41.363195+0000","last_active":"2024-05-27T12:32:42.386837+0000","last_peered":"2024-05-27T12:32:42.386837+0000","last_clean":"2024-05-27T12:32:42.386837+0000","last_became_active":"2024-05-27T12:32:41.362693+0000","last_became_peered":"2024-05-27T12:32:41.362693+0000","last_unstale":"2024-05-27T12:32:42.386837+0000","last_undegraded":"2024-05-27T12:32:42.386837+0000","last_fullsized":"2024-05-27T12:32:42.386837+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:10:55.375726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.372618+0000","last_change":"2024-05-27T12:32:42.370922+0000","last_active":"2024-05-27T12:32:42.372618+0000","last_peered":"2024-05-27T12:32:42.372618+0000","last_clean":"2024-05-27T12:32:42.372618+0000","last_became_active":"2024-05-27T12:32:42.370170+0000","last_became_peered":"2024-05-27T12:32:42.370170+0000","last_unstale":"2024-05-27T12:32:42.372618+0000","last_undegraded":"2024-05-27T12:32:42.372618+0000","last_fullsized":"2024-05-27T12:32:42.372618+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:46:59.701728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.381265+0000","last_change":"2024-05-27T12:32:41.366108+0000","last_active":"2024-05-27T12:32:42.381265+0000","last_peered":"2024-05-27T12:32:42.381265+0000","last_clean":"2024-05-27T12:32:42.381265+0000","last_became_active":"2024-05-27T12:32:41.365777+0000","last_became_peered":"2024-05-27T12:32:41.365777+0000","last_unstale":"2024-05-27T12:32:42.381265+0000","last_undegraded":"2024-05-27T12:32:42.381265+0000","last_fullsized":"2024-05-27T12:32:42.381265+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:24:00.607915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.378712+0000","last_change":"2024-05-27T12:32:42.374653+0000","last_active":"2024-05-27T12:32:42.378712+0000","last_peered":"2024-05-27T12:32:42.378712+0000","last_clean":"2024-05-27T12:32:42.378712+0000","last_became_active":"2024-05-27T12:32:42.370933+0000","last_became_peered":"2024-05-27T12:32:42.370933+0000","last_unstale":"2024-05-27T12:32:42.378712+0000","last_undegraded":"2024-05-27T12:32:42.378712+0000","last_fullsized":"2024-05-27T12:32:42.378712+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:17:24.104572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.376016+0000","last_change":"2024-05-27T12:32:41.366243+0000","last_active":"2024-05-27T12:32:42.376016+0000","last_peered":"2024-05-27T12:32:42.376016+0000","last_clean":"2024-05-27T12:32:42.376016+0000","last_became_active":"2024-05-27T12:32:41.365843+0000","last_became_peered":"2024-05-27T12:32:41.365843+0000","last_unstale":"2024-05-27T12:32:42.376016+0000","last_undegraded":"2024-05-27T12:32:42.376016+0000","last_fullsized":"2024-05-27T12:32:42.376016+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:31:52.368166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.389274+0000","last_change":"2024-05-27T12:32:42.384741+0000","last_active":"2024-05-27T12:32:42.389274+0000","last_peered":"2024-05-27T12:32:42.389274+0000","last_clean":"2024-05-27T12:32:42.389274+0000","last_became_active":"2024-05-27T12:32:42.383818+0000","last_became_peered":"2024-05-27T12:32:42.383818+0000","last_unstale":"2024-05-27T12:32:42.389274+0000","last_undegraded":"2024-05-27T12:32:42.389274+0000","last_fullsized":"2024-05-27T12:32:42.389274+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:04:04.818266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.358263+0000","last_change":"2024-05-27T12:32:41.374511+0000","last_active":"2024-05-27T12:32:42.358263+0000","last_peered":"2024-05-27T12:32:42.358263+0000","last_clean":"2024-05-27T12:32:42.358263+0000","last_became_active":"2024-05-27T12:32:41.374221+0000","last_became_peered":"2024-05-27T12:32:41.374221+0000","last_unstale":"2024-05-27T12:32:42.358263+0000","last_undegraded":"2024-05-27T12:32:42.358263+0000","last_fullsized":"2024-05-27T12:32:42.358263+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T23:34:58.092780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.389356+0000","last_change":"2024-05-27T12:32:42.384647+0000","last_active":"2024-05-27T12:32:42.389356+0000","last_peered":"2024-05-27T12:32:42.389356+0000","last_clean":"2024-05-27T12:32:42.389356+0000","last_became_active":"2024-05-27T12:32:42.384389+0000","last_became_peered":"2024-05-27T12:32:42.384389+0000","last_unstale":"2024-05-27T12:32:42.389356+0000","last_undegraded":"2024-05-27T12:32:42.389356+0000","last_fullsized":"2024-05-27T12:32:42.389356+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:03:50.593154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":168,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.355803+0000","last_change":"2024-05-27T12:32:31.185664+0000","last_active":"2024-05-27T12:32:42.355803+0000","last_peered":"2024-05-27T12:32:42.355803+0000","last_clean":"2024-05-27T12:32:42.355803+0000","last_became_active":"2024-05-27T12:32:31.184757+0000","last_became_peered":"2024-05-27T12:32:31.184757+0000","last_unstale":"2024-05-27T12:32:42.355803+0000","last_undegraded":"2024-05-27T12:32:42.355803+0000","last_fullsized":"2024-05-27T12:32:42.355803+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:30.136480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:30.136480+0000","last_clean_scrub_stamp":"2024-05-27T12:32:30.136480+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:49:13.241747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.367240+0000","last_change":"2024-05-27T12:32:41.371475+0000","last_active":"2024-05-27T12:32:42.367240+0000","last_peered":"2024-05-27T12:32:42.367240+0000","last_clean":"2024-05-27T12:32:42.367240+0000","last_became_active":"2024-05-27T12:32:41.371198+0000","last_became_peered":"2024-05-27T12:32:41.371198+0000","last_unstale":"2024-05-27T12:32:42.367240+0000","last_undegraded":"2024-05-27T12:32:42.367240+0000","last_fullsized":"2024-05-27T12:32:42.367240+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T23:55:01.390036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.386892+0000","last_change":"2024-05-27T12:32:42.385699+0000","last_active":"2024-05-27T12:32:42.386892+0000","last_peered":"2024-05-27T12:32:42.386892+0000","last_clean":"2024-05-27T12:32:42.386892+0000","last_became_active":"2024-05-27T12:32:42.385464+0000","last_became_peered":"2024-05-27T12:32:42.385464+0000","last_unstale":"2024-05-27T12:32:42.386892+0000","last_undegraded":"2024-05-27T12:32:42.386892+0000","last_fullsized":"2024-05-27T12:32:42.386892+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:04:04.818266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.356248+0000","last_change":"2024-05-27T12:32:41.371263+0000","last_active":"2024-05-27T12:32:42.356248+0000","last_peered":"2024-05-27T12:32:42.356248+0000","last_clean":"2024-05-27T12:32:42.356248+0000","last_became_active":"2024-05-27T12:32:41.370961+0000","last_became_peered":"2024-05-27T12:32:41.370961+0000","last_unstale":"2024-05-27T12:32:42.356248+0000","last_undegraded":"2024-05-27T12:32:42.356248+0000","last_fullsized":"2024-05-27T12:32:42.356248+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:07:21.253545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-27T12:32:41.355359+0000","last_change":"2024-05-27T12:32:41.355359+0000","last_active":"2024-05-27T12:32:41.333908+0000","last_peered":"2024-05-27T12:32:41.333908+0000","last_clean":"2024-05-27T12:32:41.333908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T12:32:41.355359+0000","last_undegraded":"2024-05-27T12:32:41.355359+0000","last_fullsized":"2024-05-27T12:32:41.355359+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.357960+0000","last_change":"2024-05-27T12:32:41.366189+0000","last_active":"2024-05-27T12:32:42.357960+0000","last_peered":"2024-05-27T12:32:42.357960+0000","last_clean":"2024-05-27T12:32:42.357960+0000","last_became_active":"2024-05-27T12:32:41.365860+0000","last_became_peered":"2024-05-27T12:32:41.365860+0000","last_unstale":"2024-05-27T12:32:42.357960+0000","last_undegraded":"2024-05-27T12:32:42.357960+0000","last_fullsized":"2024-05-27T12:32:42.357960+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T23:55:01.390036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.375838+0000","last_change":"2024-05-27T12:32:42.370436+0000","last_active":"2024-05-27T12:32:42.375838+0000","last_peered":"2024-05-27T12:32:42.375838+0000","last_clean":"2024-05-27T12:32:42.375838+0000","last_became_active":"2024-05-27T12:32:42.370051+0000","last_became_peered":"2024-05-27T12:32:42.370051+0000","last_unstale":"2024-05-27T12:32:42.375838+0000","last_undegraded":"2024-05-27T12:32:42.375838+0000","last_fullsized":"2024-05-27T12:32:42.375838+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:10:30.753626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.378150+0000","last_change":"2024-05-27T12:32:41.368242+0000","last_active":"2024-05-27T12:32:42.378150+0000","last_peered":"2024-05-27T12:32:42.378150+0000","last_clean":"2024-05-27T12:32:42.378150+0000","last_became_active":"2024-05-27T12:32:41.366995+0000","last_became_peered":"2024-05-27T12:32:41.366995+0000","last_unstale":"2024-05-27T12:32:42.378150+0000","last_undegraded":"2024-05-27T12:32:42.378150+0000","last_fullsized":"2024-05-27T12:32:42.378150+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T23:33:13.169169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.389268+0000","last_change":"2024-05-27T12:32:42.382859+0000","last_active":"2024-05-27T12:32:42.389268+0000","last_peered":"2024-05-27T12:32:42.389268+0000","last_clean":"2024-05-27T12:32:42.389268+0000","last_became_active":"2024-05-27T12:32:42.382312+0000","last_became_peered":"2024-05-27T12:32:42.382312+0000","last_unstale":"2024-05-27T12:32:42.389268+0000","last_undegraded":"2024-05-27T12:32:42.389268+0000","last_fullsized":"2024-05-27T12:32:42.389268+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:24:01.616764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.366276+0000","last_change":"2024-05-27T12:32:41.362976+0000","last_active":"2024-05-27T12:32:42.366276+0000","last_peered":"2024-05-27T12:32:42.366276+0000","last_clean":"2024-05-27T12:32:42.366276+0000","last_became_active":"2024-05-27T12:32:41.362645+0000","last_became_peered":"2024-05-27T12:32:41.362645+0000","last_unstale":"2024-05-27T12:32:42.366276+0000","last_undegraded":"2024-05-27T12:32:42.366276+0000","last_fullsized":"2024-05-27T12:32:42.366276+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T23:55:01.390036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.386721+0000","last_change":"2024-05-27T12:32:42.382156+0000","last_active":"2024-05-27T12:32:42.386721+0000","last_peered":"2024-05-27T12:32:42.386721+0000","last_clean":"2024-05-27T12:32:42.386721+0000","last_became_active":"2024-05-27T12:32:42.381678+0000","last_became_peered":"2024-05-27T12:32:42.381678+0000","last_unstale":"2024-05-27T12:32:42.386721+0000","last_undegraded":"2024-05-27T12:32:42.386721+0000","last_fullsized":"2024-05-27T12:32:42.386721+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:10:30.753626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.357204+0000","last_change":"2024-05-27T12:32:41.371270+0000","last_active":"2024-05-27T12:32:42.357204+0000","last_peered":"2024-05-27T12:32:42.357204+0000","last_clean":"2024-05-27T12:32:42.357204+0000","last_became_active":"2024-05-27T12:32:41.370665+0000","last_became_peered":"2024-05-27T12:32:41.370665+0000","last_unstale":"2024-05-27T12:32:42.357204+0000","last_undegraded":"2024-05-27T12:32:42.357204+0000","last_fullsized":"2024-05-27T12:32:42.357204+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:45:13.017421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.375875+0000","last_change":"2024-05-27T12:32:42.371153+0000","last_active":"2024-05-27T12:32:42.375875+0000","last_peered":"2024-05-27T12:32:42.375875+0000","last_clean":"2024-05-27T12:32:42.375875+0000","last_became_active":"2024-05-27T12:32:42.370862+0000","last_became_peered":"2024-05-27T12:32:42.370862+0000","last_unstale":"2024-05-27T12:32:42.375875+0000","last_undegraded":"2024-05-27T12:32:42.375875+0000","last_fullsized":"2024-05-27T12:32:42.375875+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:20:05.304417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.368179+0000","last_change":"2024-05-27T12:32:41.368774+0000","last_active":"2024-05-27T12:32:42.368179+0000","last_peered":"2024-05-27T12:32:42.368179+0000","last_clean":"2024-05-27T12:32:42.368179+0000","last_became_active":"2024-05-27T12:32:41.368343+0000","last_became_peered":"2024-05-27T12:32:41.368343+0000","last_unstale":"2024-05-27T12:32:42.368179+0000","last_undegraded":"2024-05-27T12:32:42.368179+0000","last_fullsized":"2024-05-27T12:32:42.368179+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:07:21.253545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.365718+0000","last_change":"2024-05-27T12:32:42.361807+0000","last_active":"2024-05-27T12:32:42.365718+0000","last_peered":"2024-05-27T12:32:42.365718+0000","last_clean":"2024-05-27T12:32:42.365718+0000","last_became_active":"2024-05-27T12:32:42.361508+0000","last_became_peered":"2024-05-27T12:32:42.361508+0000","last_unstale":"2024-05-27T12:32:42.365718+0000","last_undegraded":"2024-05-27T12:32:42.365718+0000","last_fullsized":"2024-05-27T12:32:42.365718+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T23:34:59.101630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.382030+0000","last_change":"2024-05-27T12:32:41.368907+0000","last_active":"2024-05-27T12:32:42.382030+0000","last_peered":"2024-05-27T12:32:42.382030+0000","last_clean":"2024-05-27T12:32:42.382030+0000","last_became_active":"2024-05-27T12:32:41.368392+0000","last_became_peered":"2024-05-27T12:32:41.368392+0000","last_unstale":"2024-05-27T12:32:42.382030+0000","last_undegraded":"2024-05-27T12:32:42.382030+0000","last_fullsized":"2024-05-27T12:32:42.382030+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T23:34:58.092780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-27T12:32:41.355247+0000","last_change":"2024-05-27T12:32:41.355247+0000","last_active":"2024-05-27T12:32:41.333908+0000","last_peered":"2024-05-27T12:32:41.333908+0000","last_clean":"2024-05-27T12:32:41.333908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T12:32:41.355247+0000","last_undegraded":"2024-05-27T12:32:41.355247+0000","last_fullsized":"2024-05-27T12:32:41.355247+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.355748+0000","last_change":"2024-05-27T12:32:41.369723+0000","last_active":"2024-05-27T12:32:42.355748+0000","last_peered":"2024-05-27T12:32:42.355748+0000","last_clean":"2024-05-27T12:32:42.355748+0000","last_became_active":"2024-05-27T12:32:41.369404+0000","last_became_peered":"2024-05-27T12:32:41.369404+0000","last_unstale":"2024-05-27T12:32:42.355748+0000","last_undegraded":"2024-05-27T12:32:42.355748+0000","last_fullsized":"2024-05-27T12:32:42.355748+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T23:33:13.169169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.377750+0000","last_change":"2024-05-27T12:32:42.371958+0000","last_active":"2024-05-27T12:32:42.377750+0000","last_peered":"2024-05-27T12:32:42.377750+0000","last_clean":"2024-05-27T12:32:42.377750+0000","last_became_active":"2024-05-27T12:32:42.371689+0000","last_became_peered":"2024-05-27T12:32:42.371689+0000","last_unstale":"2024-05-27T12:32:42.377750+0000","last_undegraded":"2024-05-27T12:32:42.377750+0000","last_fullsized":"2024-05-27T12:32:42.377750+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:41:36.904875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.367113+0000","last_change":"2024-05-27T12:32:41.367208+0000","last_active":"2024-05-27T12:32:42.367113+0000","last_peered":"2024-05-27T12:32:42.367113+0000","last_clean":"2024-05-27T12:32:42.367113+0000","last_became_active":"2024-05-27T12:32:41.366772+0000","last_became_peered":"2024-05-27T12:32:41.366772+0000","last_unstale":"2024-05-27T12:32:42.367113+0000","last_undegraded":"2024-05-27T12:32:42.367113+0000","last_fullsized":"2024-05-27T12:32:42.367113+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T23:33:13.169169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.373596+0000","last_change":"2024-05-27T12:32:42.371618+0000","last_active":"2024-05-27T12:32:42.373596+0000","last_peered":"2024-05-27T12:32:42.373596+0000","last_clean":"2024-05-27T12:32:42.373596+0000","last_became_active":"2024-05-27T12:32:42.369525+0000","last_became_peered":"2024-05-27T12:32:42.369525+0000","last_unstale":"2024-05-27T12:32:42.373596+0000","last_undegraded":"2024-05-27T12:32:42.373596+0000","last_fullsized":"2024-05-27T12:32:42.373596+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:07:22.262394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.366697+0000","last_change":"2024-05-27T12:32:41.366388+0000","last_active":"2024-05-27T12:32:42.366697+0000","last_peered":"2024-05-27T12:32:42.366697+0000","last_clean":"2024-05-27T12:32:42.366697+0000","last_became_active":"2024-05-27T12:32:41.365881+0000","last_became_peered":"2024-05-27T12:32:41.365881+0000","last_unstale":"2024-05-27T12:32:42.366697+0000","last_undegraded":"2024-05-27T12:32:42.366697+0000","last_fullsized":"2024-05-27T12:32:42.366697+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:24:00.607915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.384844+0000","last_change":"2024-05-27T12:32:42.383798+0000","last_active":"2024-05-27T12:32:42.384844+0000","last_peered":"2024-05-27T12:32:42.384844+0000","last_clean":"2024-05-27T12:32:42.384844+0000","last_became_active":"2024-05-27T12:32:42.383431+0000","last_became_peered":"2024-05-27T12:32:42.383431+0000","last_unstale":"2024-05-27T12:32:42.384844+0000","last_undegraded":"2024-05-27T12:32:42.384844+0000","last_fullsized":"2024-05-27T12:32:42.384844+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:53:37.721445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.386769+0000","last_change":"2024-05-27T12:32:41.373716+0000","last_active":"2024-05-27T12:32:42.386769+0000","last_peered":"2024-05-27T12:32:42.386769+0000","last_clean":"2024-05-27T12:32:42.386769+0000","last_became_active":"2024-05-27T12:32:41.373364+0000","last_became_peered":"2024-05-27T12:32:41.373364+0000","last_unstale":"2024-05-27T12:32:42.386769+0000","last_undegraded":"2024-05-27T12:32:42.386769+0000","last_fullsized":"2024-05-27T12:32:42.386769+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:21:03.909608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.372702+0000","last_change":"2024-05-27T12:32:42.370445+0000","last_active":"2024-05-27T12:32:42.372702+0000","last_peered":"2024-05-27T12:32:42.372702+0000","last_clean":"2024-05-27T12:32:42.372702+0000","last_became_active":"2024-05-27T12:32:42.370164+0000","last_became_peered":"2024-05-27T12:32:42.370164+0000","last_unstale":"2024-05-27T12:32:42.372702+0000","last_undegraded":"2024-05-27T12:32:42.372702+0000","last_fullsized":"2024-05-27T12:32:42.372702+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:10:30.753626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.389983+0000","last_change":"2024-05-27T12:32:42.386589+0000","last_active":"2024-05-27T12:32:42.389983+0000","last_peered":"2024-05-27T12:32:42.389983+0000","last_clean":"2024-05-27T12:32:42.389983+0000","last_became_active":"2024-05-27T12:32:42.386297+0000","last_became_peered":"2024-05-27T12:32:42.386297+0000","last_unstale":"2024-05-27T12:32:42.389983+0000","last_undegraded":"2024-05-27T12:32:42.389983+0000","last_fullsized":"2024-05-27T12:32:42.389983+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:46:59.701728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.384700+0000","last_change":"2024-05-27T12:32:41.374812+0000","last_active":"2024-05-27T12:32:42.384700+0000","last_peered":"2024-05-27T12:32:42.384700+0000","last_clean":"2024-05-27T12:32:42.384700+0000","last_became_active":"2024-05-27T12:32:41.374488+0000","last_became_peered":"2024-05-27T12:32:41.374488+0000","last_unstale":"2024-05-27T12:32:42.384700+0000","last_undegraded":"2024-05-27T12:32:42.384700+0000","last_fullsized":"2024-05-27T12:32:42.384700+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:10:29.744776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.393996+0000","last_change":"2024-05-27T12:32:42.389941+0000","last_active":"2024-05-27T12:32:42.393996+0000","last_peered":"2024-05-27T12:32:42.393996+0000","last_clean":"2024-05-27T12:32:42.393996+0000","last_became_active":"2024-05-27T12:32:42.389630+0000","last_became_peered":"2024-05-27T12:32:42.389630+0000","last_unstale":"2024-05-27T12:32:42.393996+0000","last_undegraded":"2024-05-27T12:32:42.393996+0000","last_fullsized":"2024-05-27T12:32:42.393996+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:17:24.104572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.375424+0000","last_change":"2024-05-27T12:32:41.371373+0000","last_active":"2024-05-27T12:32:42.375424+0000","last_peered":"2024-05-27T12:32:42.375424+0000","last_clean":"2024-05-27T12:32:42.375424+0000","last_became_active":"2024-05-27T12:32:41.371009+0000","last_became_peered":"2024-05-27T12:32:41.371009+0000","last_unstale":"2024-05-27T12:32:42.375424+0000","last_undegraded":"2024-05-27T12:32:42.375424+0000","last_fullsized":"2024-05-27T12:32:42.375424+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:20:04.295568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-27T12:32:41.357214+0000","last_change":"2024-05-27T12:32:41.357214+0000","last_active":"2024-05-27T12:32:41.333908+0000","last_peered":"2024-05-27T12:32:41.333908+0000","last_clean":"2024-05-27T12:32:41.333908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T12:32:41.357214+0000","last_undegraded":"2024-05-27T12:32:41.357214+0000","last_fullsized":"2024-05-27T12:32:41.357214+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.386157+0000","last_change":"2024-05-27T12:32:41.362828+0000","last_active":"2024-05-27T12:32:42.386157+0000","last_peered":"2024-05-27T12:32:42.386157+0000","last_clean":"2024-05-27T12:32:42.386157+0000","last_became_active":"2024-05-27T12:32:41.362526+0000","last_became_peered":"2024-05-27T12:32:41.362526+0000","last_unstale":"2024-05-27T12:32:42.386157+0000","last_undegraded":"2024-05-27T12:32:42.386157+0000","last_fullsized":"2024-05-27T12:32:42.386157+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T23:55:01.390036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.373006+0000","last_change":"2024-05-27T12:32:42.368191+0000","last_active":"2024-05-27T12:32:42.373006+0000","last_peered":"2024-05-27T12:32:42.373006+0000","last_clean":"2024-05-27T12:32:42.373006+0000","last_became_active":"2024-05-27T12:32:42.367914+0000","last_became_peered":"2024-05-27T12:32:42.367914+0000","last_unstale":"2024-05-27T12:32:42.373006+0000","last_undegraded":"2024-05-27T12:32:42.373006+0000","last_fullsized":"2024-05-27T12:32:42.373006+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:31:53.377015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-27T12:32:41.369794+0000","last_change":"2024-05-27T12:32:41.364608+0000","last_active":"2024-05-27T12:32:41.369794+0000","last_peered":"2024-05-27T12:32:41.369794+0000","last_clean":"2024-05-27T12:32:41.369794+0000","last_became_active":"2024-05-27T12:32:41.364245+0000","last_became_peered":"2024-05-27T12:32:41.364245+0000","last_unstale":"2024-05-27T12:32:41.369794+0000","last_undegraded":"2024-05-27T12:32:41.369794+0000","last_fullsized":"2024-05-27T12:32:41.369794+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:20:13.667380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1794,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":4182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32,"ondisk_log_size":32,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509445,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":819200,"data_stored":665605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509445,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":233472,"data_stored":76267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509445,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":225280,"data_stored":74745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509445,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":233472,"data_stored":74781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509445,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":233472,"data_stored":76267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509445,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31396,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340444,"statfs":{"total":96636764160,"available":96604614656,"internally_reserved":0,"allocated":221184,"data_stored":74655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":229376,"data_stored":74815,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542150,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31964,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339876,"statfs":{"total":96636764160,"available":96604033024,"internally_reserved":0,"allocated":802816,"data_stored":658248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-27T12:32:45.383 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-27T12:32:45.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.522+0000 7ff7b5f3d640 1 Processor -- start 2024-05-27T12:32:45.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.522+0000 7ff7b5f3d640 1 -- start start 2024-05-27T12:32:45.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.523+0000 7ff7b5f3d640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff7b01620b0 0x7ff7b00b79c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:45.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.523+0000 7ff7b5f3d640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff7b006d590 0x7ff7b00d3950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:45.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.523+0000 7ff7b5f3d640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7b00b39a0 con 0x7ff7b00cf8d0 2024-05-27T12:32:45.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.523+0000 7ff7b5f3d640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7ff7b00d56d0 con 0x7ff7b01620b0 2024-05-27T12:32:45.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.523+0000 7ff7b5f3d640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7ff7b00b7f00 con 0x7ff7b006d590 2024-05-27T12:32:45.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.523+0000 7ff7affff640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff7b006d590 0x7ff7b00d3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:45.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.523+0000 7ff7af7fe640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff7b01620b0 0x7ff7b00b79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:45.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.523+0000 7ff7a6ffd640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7ff7b00cf8d0 0x7ff7b006ce80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.55:55528/0 (socket says 172.21.15.55:55528) 2024-05-27T12:32:45.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.523+0000 7ff7af7fe640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff7b01620b0 0x7ff7b00b79c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.55:48840/0 (socket says 172.21.15.55:48840) 2024-05-27T12:32:45.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.523+0000 7ff7affff640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff7b006d590 0x7ff7b00d3950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.55:45680/0 (socket says 172.21.15.55:45680) 2024-05-27T12:32:45.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.523+0000 7ff7a6ffd640 1 -- 172.21.15.55:0/2234249478 learned_addr learned my addr 172.21.15.55:0/2234249478 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-27T12:32:45.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.524+0000 7ff7aeffd640 1 -- 172.21.15.55:0/2234249478 <== mon.1 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3094519921 0 0) 0x7ff7b00b39a0 con 0x7ff7b00cf8d0 2024-05-27T12:32:45.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.524+0000 7ff7aeffd640 1 -- 172.21.15.55:0/2234249478 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff79c003520 con 0x7ff7b00cf8d0 2024-05-27T12:32:45.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.524+0000 7ff7af7fe640 1 -- 172.21.15.55:0/2234249478 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff7b006d590 msgr2=0x7ff7b00d3950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:32:45.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.524+0000 7ff7af7fe640 1 --2- 172.21.15.55:0/2234249478 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff7b006d590 0x7ff7b00d3950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:45.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.524+0000 7ff7af7fe640 1 -- 172.21.15.55:0/2234249478 >> v1:172.21.15.72:6789/0 conn(0x7ff7b00cf8d0 legacy=0x7ff7b006ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:45.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.524+0000 7ff7af7fe640 1 -- 172.21.15.55:0/2234249478 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7b00b3c80 con 0x7ff7b01620b0 2024-05-27T12:32:45.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.524+0000 7ff7affff640 1 --2- 172.21.15.55:0/2234249478 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff7b006d590 0x7ff7b00d3950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T12:32:45.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.524+0000 7ff7af7fe640 1 --2- 172.21.15.55:0/2234249478 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7b01620b0 0x7ff7b00b79c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff7a00097a0 tx=0x7ff7a002a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1b755e7cff47a4f3 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:45.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.525+0000 7ff7aeffd640 1 -- 172.21.15.55:0/2234249478 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7a0037070 con 0x7ff7b01620b0 2024-05-27T12:32:45.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.525+0000 7ff7aeffd640 1 -- 172.21.15.55:0/2234249478 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7a0032440 con 0x7ff7b01620b0 2024-05-27T12:32:45.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.525+0000 7ff7aeffd640 1 -- 172.21.15.55:0/2234249478 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7a0032810 con 0x7ff7b01620b0 2024-05-27T12:32:45.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.525+0000 7ff7b5f3d640 1 -- 172.21.15.55:0/2234249478 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7b01620b0 msgr2=0x7ff7b00b79c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:45.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.525+0000 7ff7b5f3d640 1 --2- 172.21.15.55:0/2234249478 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7b01620b0 0x7ff7b00b79c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff7a00097a0 tx=0x7ff7a002a180 comp rx=0 tx=0).stop 2024-05-27T12:32:45.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.525+0000 7ff7b5f3d640 1 -- 172.21.15.55:0/2234249478 shutdown_connections 2024-05-27T12:32:45.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.525+0000 7ff7b5f3d640 1 --2- 172.21.15.55:0/2234249478 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff7b006d590 0x7ff7b00d3950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:45.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.525+0000 7ff7b5f3d640 1 --2- 172.21.15.55:0/2234249478 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7b01620b0 0x7ff7b00b79c0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:45.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.525+0000 7ff7b5f3d640 1 -- 172.21.15.55:0/2234249478 >> 172.21.15.55:0/2234249478 conn(0x7ff7b00d1940 msgr2=0x7ff7b00d4890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:45.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.525+0000 7ff7b5f3d640 1 -- 172.21.15.55:0/2234249478 shutdown_connections 2024-05-27T12:32:45.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.525+0000 7ff7b5f3d640 1 -- 172.21.15.55:0/2234249478 wait complete. 2024-05-27T12:32:45.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.526+0000 7ff7b5f3d640 1 Processor -- start 2024-05-27T12:32:45.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.527+0000 7ff7b5f3d640 1 -- start start 2024-05-27T12:32:45.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.527+0000 7ff7b5f3d640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7b006d590 0x7ff7b01505e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:45.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.527+0000 7ff7b5f3d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff7b00cf8d0 0x7ff7b014d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:45.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.527+0000 7ff7b5f3d640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff7b01620b0 0x7ff7b014f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:45.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.527+0000 7ff7b5f3d640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7ff7b00d3430 con 0x7ff7b00cf8d0 2024-05-27T12:32:45.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.527+0000 7ff7b5f3d640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7ff7b00d3150 con 0x7ff7b006d590 2024-05-27T12:32:45.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.527+0000 7ff7b5f3d640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7ff7b00b3650 con 0x7ff7b01620b0 2024-05-27T12:32:45.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.527+0000 7ff7a6ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff7b00cf8d0 0x7ff7b014d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:45.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.528+0000 7ff7a6ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff7b00cf8d0 0x7ff7b014d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55290/0 (socket says 172.21.15.55:55290) 2024-05-27T12:32:45.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.528+0000 7ff7a6ffd640 1 -- 172.21.15.55:0/2527726045 learned_addr learned my addr 172.21.15.55:0/2527726045 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:32:45.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.528+0000 7ff7af7fe640 1 --2- 172.21.15.55:0/2527726045 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7b006d590 0x7ff7b01505e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:45.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.528+0000 7ff7affff640 1 --2- 172.21.15.55:0/2527726045 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff7b01620b0 0x7ff7b014f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:45.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.528+0000 7ff7a6ffd640 1 -- 172.21.15.55:0/2527726045 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff7b01620b0 msgr2=0x7ff7b014f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:45.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.528+0000 7ff7a6ffd640 1 --2- 172.21.15.55:0/2527726045 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff7b01620b0 0x7ff7b014f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:45.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.528+0000 7ff7a6ffd640 1 -- 172.21.15.55:0/2527726045 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7b006d590 msgr2=0x7ff7b01505e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:45.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.528+0000 7ff7a6ffd640 1 --2- 172.21.15.55:0/2527726045 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7b006d590 0x7ff7b01505e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:45.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.528+0000 7ff7a6ffd640 1 -- 172.21.15.55:0/2527726045 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7b014e150 con 0x7ff7b00cf8d0 2024-05-27T12:32:45.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.528+0000 7ff7a6ffd640 1 --2- 172.21.15.55:0/2527726045 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff7b00cf8d0 0x7ff7b014d9b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff79800c430 tx=0x7ff79800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:45.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.528+0000 7ff7acff9640 1 -- 172.21.15.55:0/2527726045 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff798017070 con 0x7ff7b00cf8d0 2024-05-27T12:32:45.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.528+0000 7ff7acff9640 1 -- 172.21.15.55:0/2527726045 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff798005ce0 con 0x7ff7b00cf8d0 2024-05-27T12:32:45.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.528+0000 7ff7b5f3d640 1 -- 172.21.15.55:0/2527726045 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7b014e430 con 0x7ff7b00cf8d0 2024-05-27T12:32:45.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.528+0000 7ff7acff9640 1 -- 172.21.15.55:0/2527726045 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7980072f0 con 0x7ff7b00cf8d0 2024-05-27T12:32:45.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.528+0000 7ff7b5f3d640 1 -- 172.21.15.55:0/2527726045 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7b014e9f0 con 0x7ff7b00cf8d0 2024-05-27T12:32:45.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.529+0000 7ff7b5f3d640 1 -- 172.21.15.55:0/2527726045 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7b0075460 con 0x7ff7b00cf8d0 2024-05-27T12:32:45.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.530+0000 7ff7acff9640 1 -- 172.21.15.55:0/2527726045 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff79801a070 con 0x7ff7b00cf8d0 2024-05-27T12:32:45.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.530+0000 7ff7acff9640 1 --2- 172.21.15.55:0/2527726045 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7ff79006c8f0 0x7ff79006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:45.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.531+0000 7ff7acff9640 1 -- 172.21.15.55:0/2527726045 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7ff79808aec0 con 0x7ff7b00cf8d0 2024-05-27T12:32:45.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.531+0000 7ff7af7fe640 1 --2- 172.21.15.55:0/2527726045 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7ff79006c8f0 0x7ff79006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:45.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.531+0000 7ff7af7fe640 1 --2- 172.21.15.55:0/2527726045 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7ff79006c8f0 0x7ff79006edb0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff7a0034000 tx=0x7ff7a002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:45.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.535+0000 7ff7acff9640 1 -- 172.21.15.55:0/2527726045 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff798058ca0 con 0x7ff7b00cf8d0 2024-05-27T12:32:45.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.719+0000 7ff7b5f3d640 1 -- 172.21.15.55:0/2527726045 --> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff7b00b7980 con 0x7ff79006c8f0 2024-05-27T12:32:45.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.726+0000 7ff7acff9640 1 -- 172.21.15.55:0/2527726045 <== mgr.4105 v2:172.21.15.72:6832/3152720583 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251063 (secure 0 0 0) 0x7ff7b00b7980 con 0x7ff79006c8f0 2024-05-27T12:32:45.728 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-27T12:32:45.729 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2024-05-27T12:32:45.731 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.728+0000 7ff7b5f3d640 1 -- 172.21.15.55:0/2527726045 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7ff79006c8f0 msgr2=0x7ff79006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:45.731 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.728+0000 7ff7b5f3d640 1 --2- 172.21.15.55:0/2527726045 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7ff79006c8f0 0x7ff79006edb0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff7a0034000 tx=0x7ff7a002e000 comp rx=0 tx=0).stop 2024-05-27T12:32:45.731 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.728+0000 7ff7b5f3d640 1 -- 172.21.15.55:0/2527726045 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff7b00cf8d0 msgr2=0x7ff7b014d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:45.731 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.728+0000 7ff7b5f3d640 1 --2- 172.21.15.55:0/2527726045 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff7b00cf8d0 0x7ff7b014d9b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff79800c430 tx=0x7ff79800c830 comp rx=0 tx=0).stop 2024-05-27T12:32:45.731 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.728+0000 7ff7b5f3d640 1 -- 172.21.15.55:0/2527726045 shutdown_connections 2024-05-27T12:32:45.731 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.728+0000 7ff7b5f3d640 1 --2- 172.21.15.55:0/2527726045 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff7b01620b0 0x7ff7b014f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:45.731 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.728+0000 7ff7b5f3d640 1 --2- 172.21.15.55:0/2527726045 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff7b00cf8d0 0x7ff7b014d9b0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:45.731 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.728+0000 7ff7b5f3d640 1 --2- 172.21.15.55:0/2527726045 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7ff79006c8f0 0x7ff79006edb0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:45.732 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.728+0000 7ff7b5f3d640 1 --2- 172.21.15.55:0/2527726045 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7b006d590 0x7ff7b01505e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:45.732 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.728+0000 7ff7b5f3d640 1 -- 172.21.15.55:0/2527726045 >> 172.21.15.55:0/2527726045 conn(0x7ff7b00d1940 msgr2=0x7ff7b0160fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:45.732 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.728+0000 7ff7b5f3d640 1 -- 172.21.15.55:0/2527726045 shutdown_connections 2024-05-27T12:32:45.732 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.729+0000 7ff7b5f3d640 1 -- 172.21.15.55:0/2527726045 wait complete. 2024-05-27T12:32:45.739 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-05-27T12:32:45.263246+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592162,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":196,"num_write_kb":2422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":149,"ondisk_log_size":149,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":84,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235728,"kb_used_data":2928,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738992,"statfs":{"total":773094113280,"available":772852727808,"internally_reserved":0,"allocated":2998272,"data_stored":1775383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1794,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.925680"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.374797+0000","last_change":"2024-05-27T12:32:42.368378+0000","last_active":"2024-05-27T12:32:42.374797+0000","last_peered":"2024-05-27T12:32:42.374797+0000","last_clean":"2024-05-27T12:32:42.374797+0000","last_became_active":"2024-05-27T12:32:42.367689+0000","last_became_peered":"2024-05-27T12:32:42.367689+0000","last_unstale":"2024-05-27T12:32:42.374797+0000","last_undegraded":"2024-05-27T12:32:42.374797+0000","last_fullsized":"2024-05-27T12:32:42.374797+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:23:59.137419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.381869+0000","last_change":"2024-05-27T12:32:42.380372+0000","last_active":"2024-05-27T12:32:42.381869+0000","last_peered":"2024-05-27T12:32:42.381869+0000","last_clean":"2024-05-27T12:32:42.381869+0000","last_became_active":"2024-05-27T12:32:42.379503+0000","last_became_peered":"2024-05-27T12:32:42.379503+0000","last_unstale":"2024-05-27T12:32:42.381869+0000","last_undegraded":"2024-05-27T12:32:42.381869+0000","last_fullsized":"2024-05-27T12:32:42.381869+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:08:37.481605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-27T12:32:41.357767+0000","last_change":"2024-05-27T12:32:41.357767+0000","last_active":"2024-05-27T12:32:41.333908+0000","last_peered":"2024-05-27T12:32:41.333908+0000","last_clean":"2024-05-27T12:32:41.333908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T12:32:41.357767+0000","last_undegraded":"2024-05-27T12:32:41.357767+0000","last_fullsized":"2024-05-27T12:32:41.357767+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.389251+0000","last_change":"2024-05-27T12:32:42.384566+0000","last_active":"2024-05-27T12:32:42.389251+0000","last_peered":"2024-05-27T12:32:42.389251+0000","last_clean":"2024-05-27T12:32:42.389251+0000","last_became_active":"2024-05-27T12:32:42.384269+0000","last_became_peered":"2024-05-27T12:32:42.384269+0000","last_unstale":"2024-05-27T12:32:42.389251+0000","last_undegraded":"2024-05-27T12:32:42.389251+0000","last_fullsized":"2024-05-27T12:32:42.389251+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:08:37.481605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.374093+0000","last_change":"2024-05-27T12:32:42.367164+0000","last_active":"2024-05-27T12:32:42.374093+0000","last_peered":"2024-05-27T12:32:42.374093+0000","last_clean":"2024-05-27T12:32:42.374093+0000","last_became_active":"2024-05-27T12:32:42.366882+0000","last_became_peered":"2024-05-27T12:32:42.366882+0000","last_unstale":"2024-05-27T12:32:42.374093+0000","last_undegraded":"2024-05-27T12:32:42.374093+0000","last_fullsized":"2024-05-27T12:32:42.374093+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:04:04.818266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.389344+0000","last_change":"2024-05-27T12:32:42.385413+0000","last_active":"2024-05-27T12:32:42.389344+0000","last_peered":"2024-05-27T12:32:42.389344+0000","last_clean":"2024-05-27T12:32:42.389344+0000","last_became_active":"2024-05-27T12:32:42.385163+0000","last_became_peered":"2024-05-27T12:32:42.385163+0000","last_unstale":"2024-05-27T12:32:42.389344+0000","last_undegraded":"2024-05-27T12:32:42.389344+0000","last_fullsized":"2024-05-27T12:32:42.389344+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:23:59.137419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.380885+0000","last_change":"2024-05-27T12:32:42.376081+0000","last_active":"2024-05-27T12:32:42.380885+0000","last_peered":"2024-05-27T12:32:42.380885+0000","last_clean":"2024-05-27T12:32:42.380885+0000","last_became_active":"2024-05-27T12:32:42.375689+0000","last_became_peered":"2024-05-27T12:32:42.375689+0000","last_unstale":"2024-05-27T12:32:42.380885+0000","last_undegraded":"2024-05-27T12:32:42.380885+0000","last_fullsized":"2024-05-27T12:32:42.380885+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:45:06.261408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.386869+0000","last_change":"2024-05-27T12:32:42.385659+0000","last_active":"2024-05-27T12:32:42.386869+0000","last_peered":"2024-05-27T12:32:42.386869+0000","last_clean":"2024-05-27T12:32:42.386869+0000","last_became_active":"2024-05-27T12:32:42.385356+0000","last_became_peered":"2024-05-27T12:32:42.385356+0000","last_unstale":"2024-05-27T12:32:42.386869+0000","last_undegraded":"2024-05-27T12:32:42.386869+0000","last_fullsized":"2024-05-27T12:32:42.386869+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:08:37.481605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.386391+0000","last_change":"2024-05-27T12:32:42.382460+0000","last_active":"2024-05-27T12:32:42.386391+0000","last_peered":"2024-05-27T12:32:42.386391+0000","last_clean":"2024-05-27T12:32:42.386391+0000","last_became_active":"2024-05-27T12:32:42.382093+0000","last_became_peered":"2024-05-27T12:32:42.382093+0000","last_unstale":"2024-05-27T12:32:42.386391+0000","last_undegraded":"2024-05-27T12:32:42.386391+0000","last_fullsized":"2024-05-27T12:32:42.386391+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:44:31.058083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.389163+0000","last_change":"2024-05-27T12:32:42.384546+0000","last_active":"2024-05-27T12:32:42.389163+0000","last_peered":"2024-05-27T12:32:42.389163+0000","last_clean":"2024-05-27T12:32:42.389163+0000","last_became_active":"2024-05-27T12:32:42.384270+0000","last_became_peered":"2024-05-27T12:32:42.384270+0000","last_unstale":"2024-05-27T12:32:42.389163+0000","last_undegraded":"2024-05-27T12:32:42.389163+0000","last_fullsized":"2024-05-27T12:32:42.389163+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:53:37.721445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.389204+0000","last_change":"2024-05-27T12:32:42.385206+0000","last_active":"2024-05-27T12:32:42.389204+0000","last_peered":"2024-05-27T12:32:42.389204+0000","last_clean":"2024-05-27T12:32:42.389204+0000","last_became_active":"2024-05-27T12:32:42.384940+0000","last_became_peered":"2024-05-27T12:32:42.384940+0000","last_unstale":"2024-05-27T12:32:42.389204+0000","last_undegraded":"2024-05-27T12:32:42.389204+0000","last_fullsized":"2024-05-27T12:32:42.389204+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:08:37.481605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.378903+0000","last_change":"2024-05-27T12:32:42.376596+0000","last_active":"2024-05-27T12:32:42.378903+0000","last_peered":"2024-05-27T12:32:42.378903+0000","last_clean":"2024-05-27T12:32:42.378903+0000","last_became_active":"2024-05-27T12:32:42.376147+0000","last_became_peered":"2024-05-27T12:32:42.376147+0000","last_unstale":"2024-05-27T12:32:42.378903+0000","last_undegraded":"2024-05-27T12:32:42.378903+0000","last_fullsized":"2024-05-27T12:32:42.378903+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T23:55:02.398885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.377139+0000","last_change":"2024-05-27T12:32:42.375358+0000","last_active":"2024-05-27T12:32:42.377139+0000","last_peered":"2024-05-27T12:32:42.377139+0000","last_clean":"2024-05-27T12:32:42.377139+0000","last_became_active":"2024-05-27T12:32:42.375096+0000","last_became_peered":"2024-05-27T12:32:42.375096+0000","last_unstale":"2024-05-27T12:32:42.377139+0000","last_undegraded":"2024-05-27T12:32:42.377139+0000","last_fullsized":"2024-05-27T12:32:42.377139+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:20:05.304417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-27T12:32:41.356707+0000","last_change":"2024-05-27T12:32:41.356707+0000","last_active":"2024-05-27T12:32:41.333908+0000","last_peered":"2024-05-27T12:32:41.333908+0000","last_clean":"2024-05-27T12:32:41.333908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T12:32:41.356707+0000","last_undegraded":"2024-05-27T12:32:41.356707+0000","last_fullsized":"2024-05-27T12:32:41.356707+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.378127+0000","last_change":"2024-05-27T12:32:42.376055+0000","last_active":"2024-05-27T12:32:42.378127+0000","last_peered":"2024-05-27T12:32:42.378127+0000","last_clean":"2024-05-27T12:32:42.378127+0000","last_became_active":"2024-05-27T12:32:42.374091+0000","last_became_peered":"2024-05-27T12:32:42.374091+0000","last_unstale":"2024-05-27T12:32:42.378127+0000","last_undegraded":"2024-05-27T12:32:42.378127+0000","last_fullsized":"2024-05-27T12:32:42.378127+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:45:14.026270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.390013+0000","last_change":"2024-05-27T12:32:42.387113+0000","last_active":"2024-05-27T12:32:42.390013+0000","last_peered":"2024-05-27T12:32:42.390013+0000","last_clean":"2024-05-27T12:32:42.390013+0000","last_became_active":"2024-05-27T12:32:42.386810+0000","last_became_peered":"2024-05-27T12:32:42.386810+0000","last_unstale":"2024-05-27T12:32:42.390013+0000","last_undegraded":"2024-05-27T12:32:42.390013+0000","last_fullsized":"2024-05-27T12:32:42.390013+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:41:35.310708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.389296+0000","last_change":"2024-05-27T12:32:42.383993+0000","last_active":"2024-05-27T12:32:42.389296+0000","last_peered":"2024-05-27T12:32:42.389296+0000","last_clean":"2024-05-27T12:32:42.389296+0000","last_became_active":"2024-05-27T12:32:42.383274+0000","last_became_peered":"2024-05-27T12:32:42.383274+0000","last_unstale":"2024-05-27T12:32:42.389296+0000","last_undegraded":"2024-05-27T12:32:42.389296+0000","last_fullsized":"2024-05-27T12:32:42.389296+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:45:14.026270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.381322+0000","last_change":"2024-05-27T12:32:42.376831+0000","last_active":"2024-05-27T12:32:42.381322+0000","last_peered":"2024-05-27T12:32:42.381322+0000","last_clean":"2024-05-27T12:32:42.381322+0000","last_became_active":"2024-05-27T12:32:42.376498+0000","last_became_peered":"2024-05-27T12:32:42.376498+0000","last_unstale":"2024-05-27T12:32:42.381322+0000","last_undegraded":"2024-05-27T12:32:42.381322+0000","last_fullsized":"2024-05-27T12:32:42.381322+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:31:53.377015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.373560+0000","last_change":"2024-05-27T12:32:42.366751+0000","last_active":"2024-05-27T12:32:42.373560+0000","last_peered":"2024-05-27T12:32:42.373560+0000","last_clean":"2024-05-27T12:32:42.373560+0000","last_became_active":"2024-05-27T12:32:42.366438+0000","last_became_peered":"2024-05-27T12:32:42.366438+0000","last_unstale":"2024-05-27T12:32:42.373560+0000","last_undegraded":"2024-05-27T12:32:42.373560+0000","last_fullsized":"2024-05-27T12:32:42.373560+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:08:37.481605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.373449+0000","last_change":"2024-05-27T12:32:42.370650+0000","last_active":"2024-05-27T12:32:42.373449+0000","last_peered":"2024-05-27T12:32:42.373449+0000","last_clean":"2024-05-27T12:32:42.373449+0000","last_became_active":"2024-05-27T12:32:42.370319+0000","last_became_peered":"2024-05-27T12:32:42.370319+0000","last_unstale":"2024-05-27T12:32:42.373449+0000","last_undegraded":"2024-05-27T12:32:42.373449+0000","last_fullsized":"2024-05-27T12:32:42.373449+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:07:22.262394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-27T12:32:41.357829+0000","last_change":"2024-05-27T12:32:41.357829+0000","last_active":"2024-05-27T12:32:41.333908+0000","last_peered":"2024-05-27T12:32:41.333908+0000","last_clean":"2024-05-27T12:32:41.333908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T12:32:41.357829+0000","last_undegraded":"2024-05-27T12:32:41.357829+0000","last_fullsized":"2024-05-27T12:32:41.357829+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.386644+0000","last_change":"2024-05-27T12:32:42.383033+0000","last_active":"2024-05-27T12:32:42.386644+0000","last_peered":"2024-05-27T12:32:42.386644+0000","last_clean":"2024-05-27T12:32:42.386644+0000","last_became_active":"2024-05-27T12:32:42.382745+0000","last_became_peered":"2024-05-27T12:32:42.382745+0000","last_unstale":"2024-05-27T12:32:42.386644+0000","last_undegraded":"2024-05-27T12:32:42.386644+0000","last_fullsized":"2024-05-27T12:32:42.386644+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:21:04.918457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.380985+0000","last_change":"2024-05-27T12:32:42.378742+0000","last_active":"2024-05-27T12:32:42.380985+0000","last_peered":"2024-05-27T12:32:42.380985+0000","last_clean":"2024-05-27T12:32:42.380985+0000","last_became_active":"2024-05-27T12:32:42.378328+0000","last_became_peered":"2024-05-27T12:32:42.378328+0000","last_unstale":"2024-05-27T12:32:42.380985+0000","last_undegraded":"2024-05-27T12:32:42.380985+0000","last_fullsized":"2024-05-27T12:32:42.380985+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:21:04.918457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.386591+0000","last_change":"2024-05-27T12:32:42.381867+0000","last_active":"2024-05-27T12:32:42.386591+0000","last_peered":"2024-05-27T12:32:42.386591+0000","last_clean":"2024-05-27T12:32:42.386591+0000","last_became_active":"2024-05-27T12:32:42.381591+0000","last_became_peered":"2024-05-27T12:32:42.381591+0000","last_unstale":"2024-05-27T12:32:42.386591+0000","last_undegraded":"2024-05-27T12:32:42.386591+0000","last_fullsized":"2024-05-27T12:32:42.386591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:07:22.262394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.373759+0000","last_change":"2024-05-27T12:32:42.372176+0000","last_active":"2024-05-27T12:32:42.373759+0000","last_peered":"2024-05-27T12:32:42.373759+0000","last_clean":"2024-05-27T12:32:42.373759+0000","last_became_active":"2024-05-27T12:32:42.371874+0000","last_became_peered":"2024-05-27T12:32:42.371874+0000","last_unstale":"2024-05-27T12:32:42.373759+0000","last_undegraded":"2024-05-27T12:32:42.373759+0000","last_fullsized":"2024-05-27T12:32:42.373759+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:10:30.753626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.375586+0000","last_change":"2024-05-27T12:32:42.374766+0000","last_active":"2024-05-27T12:32:42.375586+0000","last_peered":"2024-05-27T12:32:42.375586+0000","last_clean":"2024-05-27T12:32:42.375586+0000","last_became_active":"2024-05-27T12:32:42.374450+0000","last_became_peered":"2024-05-27T12:32:42.374450+0000","last_unstale":"2024-05-27T12:32:42.375586+0000","last_undegraded":"2024-05-27T12:32:42.375586+0000","last_fullsized":"2024-05-27T12:32:42.375586+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:20:05.304417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.380262+0000","last_change":"2024-05-27T12:32:42.376636+0000","last_active":"2024-05-27T12:32:42.380262+0000","last_peered":"2024-05-27T12:32:42.380262+0000","last_clean":"2024-05-27T12:32:42.380262+0000","last_became_active":"2024-05-27T12:32:42.376364+0000","last_became_peered":"2024-05-27T12:32:42.376364+0000","last_unstale":"2024-05-27T12:32:42.380262+0000","last_undegraded":"2024-05-27T12:32:42.380262+0000","last_fullsized":"2024-05-27T12:32:42.380262+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:53:37.721445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.373632+0000","last_change":"2024-05-27T12:32:42.371595+0000","last_active":"2024-05-27T12:32:42.373632+0000","last_peered":"2024-05-27T12:32:42.373632+0000","last_clean":"2024-05-27T12:32:42.373632+0000","last_became_active":"2024-05-27T12:32:42.370375+0000","last_became_peered":"2024-05-27T12:32:42.370375+0000","last_unstale":"2024-05-27T12:32:42.373632+0000","last_undegraded":"2024-05-27T12:32:42.373632+0000","last_fullsized":"2024-05-27T12:32:42.373632+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T23:33:14.178019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-27T12:32:41.356437+0000","last_change":"2024-05-27T12:32:41.356437+0000","last_active":"2024-05-27T12:32:41.333908+0000","last_peered":"2024-05-27T12:32:41.333908+0000","last_clean":"2024-05-27T12:32:41.333908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T12:32:41.356437+0000","last_undegraded":"2024-05-27T12:32:41.356437+0000","last_fullsized":"2024-05-27T12:32:41.356437+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.389200+0000","last_change":"2024-05-27T12:32:42.384076+0000","last_active":"2024-05-27T12:32:42.389200+0000","last_peered":"2024-05-27T12:32:42.389200+0000","last_clean":"2024-05-27T12:32:42.389200+0000","last_became_active":"2024-05-27T12:32:42.383738+0000","last_became_peered":"2024-05-27T12:32:42.383738+0000","last_unstale":"2024-05-27T12:32:42.389200+0000","last_undegraded":"2024-05-27T12:32:42.389200+0000","last_fullsized":"2024-05-27T12:32:42.389200+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:53:37.721445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.382747+0000","last_change":"2024-05-27T12:32:42.379700+0000","last_active":"2024-05-27T12:32:42.382747+0000","last_peered":"2024-05-27T12:32:42.382747+0000","last_clean":"2024-05-27T12:32:42.382747+0000","last_became_active":"2024-05-27T12:32:42.379421+0000","last_became_peered":"2024-05-27T12:32:42.379421+0000","last_unstale":"2024-05-27T12:32:42.382747+0000","last_undegraded":"2024-05-27T12:32:42.382747+0000","last_fullsized":"2024-05-27T12:32:42.382747+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T23:33:14.178019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.383554+0000","last_change":"2024-05-27T12:32:42.379719+0000","last_active":"2024-05-27T12:32:42.383554+0000","last_peered":"2024-05-27T12:32:42.383554+0000","last_clean":"2024-05-27T12:32:42.383554+0000","last_became_active":"2024-05-27T12:32:42.379234+0000","last_became_peered":"2024-05-27T12:32:42.379234+0000","last_unstale":"2024-05-27T12:32:42.383554+0000","last_undegraded":"2024-05-27T12:32:42.383554+0000","last_fullsized":"2024-05-27T12:32:42.383554+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:45:14.026270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.375714+0000","last_change":"2024-05-27T12:32:42.371233+0000","last_active":"2024-05-27T12:32:42.375714+0000","last_peered":"2024-05-27T12:32:42.375714+0000","last_clean":"2024-05-27T12:32:42.375714+0000","last_became_active":"2024-05-27T12:32:42.370965+0000","last_became_peered":"2024-05-27T12:32:42.370965+0000","last_unstale":"2024-05-27T12:32:42.375714+0000","last_undegraded":"2024-05-27T12:32:42.375714+0000","last_fullsized":"2024-05-27T12:32:42.375714+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:29:16.389055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.379340+0000","last_change":"2024-05-27T12:32:41.365100+0000","last_active":"2024-05-27T12:32:42.379340+0000","last_peered":"2024-05-27T12:32:42.379340+0000","last_clean":"2024-05-27T12:32:42.379340+0000","last_became_active":"2024-05-27T12:32:41.364795+0000","last_became_peered":"2024-05-27T12:32:41.364795+0000","last_unstale":"2024-05-27T12:32:42.379340+0000","last_undegraded":"2024-05-27T12:32:42.379340+0000","last_fullsized":"2024-05-27T12:32:42.379340+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:24:00.607915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-27T12:32:41.355572+0000","last_change":"2024-05-27T12:32:41.355572+0000","last_active":"2024-05-27T12:32:41.333908+0000","last_peered":"2024-05-27T12:32:41.333908+0000","last_clean":"2024-05-27T12:32:41.333908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T12:32:41.355572+0000","last_undegraded":"2024-05-27T12:32:41.355572+0000","last_fullsized":"2024-05-27T12:32:41.355572+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.381566+0000","last_change":"2024-05-27T12:32:41.370064+0000","last_active":"2024-05-27T12:32:42.381566+0000","last_peered":"2024-05-27T12:32:42.381566+0000","last_clean":"2024-05-27T12:32:42.381566+0000","last_became_active":"2024-05-27T12:32:41.368679+0000","last_became_peered":"2024-05-27T12:32:41.368679+0000","last_unstale":"2024-05-27T12:32:42.381566+0000","last_undegraded":"2024-05-27T12:32:42.381566+0000","last_fullsized":"2024-05-27T12:32:42.381566+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:31:52.368166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.357284+0000","last_change":"2024-05-27T12:32:41.369441+0000","last_active":"2024-05-27T12:32:42.357284+0000","last_peered":"2024-05-27T12:32:42.357284+0000","last_clean":"2024-05-27T12:32:42.357284+0000","last_became_active":"2024-05-27T12:32:41.369164+0000","last_became_peered":"2024-05-27T12:32:41.369164+0000","last_unstale":"2024-05-27T12:32:42.357284+0000","last_undegraded":"2024-05-27T12:32:42.357284+0000","last_fullsized":"2024-05-27T12:32:42.357284+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:10:55.375726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.383508+0000","last_change":"2024-05-27T12:32:42.381264+0000","last_active":"2024-05-27T12:32:42.383508+0000","last_peered":"2024-05-27T12:32:42.383508+0000","last_clean":"2024-05-27T12:32:42.383508+0000","last_became_active":"2024-05-27T12:32:42.380823+0000","last_became_peered":"2024-05-27T12:32:42.380823+0000","last_unstale":"2024-05-27T12:32:42.383508+0000","last_undegraded":"2024-05-27T12:32:42.383508+0000","last_fullsized":"2024-05-27T12:32:42.383508+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:45:14.026270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.378088+0000","last_change":"2024-05-27T12:32:41.371539+0000","last_active":"2024-05-27T12:32:42.378088+0000","last_peered":"2024-05-27T12:32:42.378088+0000","last_clean":"2024-05-27T12:32:42.378088+0000","last_became_active":"2024-05-27T12:32:41.370827+0000","last_became_peered":"2024-05-27T12:32:41.370827+0000","last_unstale":"2024-05-27T12:32:42.378088+0000","last_undegraded":"2024-05-27T12:32:42.378088+0000","last_fullsized":"2024-05-27T12:32:42.378088+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T23:34:58.092780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.376399+0000","last_change":"2024-05-27T12:32:42.371446+0000","last_active":"2024-05-27T12:32:42.376399+0000","last_peered":"2024-05-27T12:32:42.376399+0000","last_clean":"2024-05-27T12:32:42.376399+0000","last_became_active":"2024-05-27T12:32:42.371197+0000","last_became_peered":"2024-05-27T12:32:42.371197+0000","last_unstale":"2024-05-27T12:32:42.376399+0000","last_undegraded":"2024-05-27T12:32:42.376399+0000","last_fullsized":"2024-05-27T12:32:42.376399+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:21:04.918457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.366123+0000","last_change":"2024-05-27T12:32:41.374793+0000","last_active":"2024-05-27T12:32:42.366123+0000","last_peered":"2024-05-27T12:32:42.366123+0000","last_clean":"2024-05-27T12:32:42.366123+0000","last_became_active":"2024-05-27T12:32:41.374503+0000","last_became_peered":"2024-05-27T12:32:41.374503+0000","last_unstale":"2024-05-27T12:32:42.366123+0000","last_undegraded":"2024-05-27T12:32:42.366123+0000","last_fullsized":"2024-05-27T12:32:42.366123+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T23:33:13.169169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.386679+0000","last_change":"2024-05-27T12:32:42.382592+0000","last_active":"2024-05-27T12:32:42.386679+0000","last_peered":"2024-05-27T12:32:42.386679+0000","last_clean":"2024-05-27T12:32:42.386679+0000","last_became_active":"2024-05-27T12:32:42.382289+0000","last_became_peered":"2024-05-27T12:32:42.382289+0000","last_unstale":"2024-05-27T12:32:42.386679+0000","last_undegraded":"2024-05-27T12:32:42.386679+0000","last_fullsized":"2024-05-27T12:32:42.386679+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:20:05.304417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.369228+0000","last_change":"2024-05-27T12:32:41.370517+0000","last_active":"2024-05-27T12:32:42.369228+0000","last_peered":"2024-05-27T12:32:42.369228+0000","last_clean":"2024-05-27T12:32:42.369228+0000","last_became_active":"2024-05-27T12:32:41.370216+0000","last_became_peered":"2024-05-27T12:32:41.370216+0000","last_unstale":"2024-05-27T12:32:42.369228+0000","last_undegraded":"2024-05-27T12:32:42.369228+0000","last_fullsized":"2024-05-27T12:32:42.369228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:24:00.607915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-27T12:32:41.355055+0000","last_change":"2024-05-27T12:32:41.355055+0000","last_active":"2024-05-27T12:32:41.333908+0000","last_peered":"2024-05-27T12:32:41.333908+0000","last_clean":"2024-05-27T12:32:41.333908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T12:32:41.355055+0000","last_undegraded":"2024-05-27T12:32:41.355055+0000","last_fullsized":"2024-05-27T12:32:41.355055+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.385260+0000","last_change":"2024-05-27T12:32:41.373060+0000","last_active":"2024-05-27T12:32:42.385260+0000","last_peered":"2024-05-27T12:32:42.385260+0000","last_clean":"2024-05-27T12:32:42.385260+0000","last_became_active":"2024-05-27T12:32:41.372729+0000","last_became_peered":"2024-05-27T12:32:41.372729+0000","last_unstale":"2024-05-27T12:32:42.385260+0000","last_undegraded":"2024-05-27T12:32:42.385260+0000","last_fullsized":"2024-05-27T12:32:42.385260+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T23:34:58.092780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.369547+0000","last_change":"2024-05-27T12:32:42.368863+0000","last_active":"2024-05-27T12:32:42.369547+0000","last_peered":"2024-05-27T12:32:42.369547+0000","last_clean":"2024-05-27T12:32:42.369547+0000","last_became_active":"2024-05-27T12:32:42.368593+0000","last_became_peered":"2024-05-27T12:32:42.368593+0000","last_unstale":"2024-05-27T12:32:42.369547+0000","last_undegraded":"2024-05-27T12:32:42.369547+0000","last_fullsized":"2024-05-27T12:32:42.369547+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:17:15.780477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"22'6","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.389628+0000","last_change":"2024-05-27T12:32:41.369617+0000","last_active":"2024-05-27T12:32:42.389628+0000","last_peered":"2024-05-27T12:32:42.389628+0000","last_clean":"2024-05-27T12:32:42.389628+0000","last_became_active":"2024-05-27T12:32:41.369371+0000","last_became_peered":"2024-05-27T12:32:41.369371+0000","last_unstale":"2024-05-27T12:32:42.389628+0000","last_undegraded":"2024-05-27T12:32:42.389628+0000","last_fullsized":"2024-05-27T12:32:42.389628+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:24:00.607915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.365054+0000","last_change":"2024-05-27T12:32:42.362804+0000","last_active":"2024-05-27T12:32:42.365054+0000","last_peered":"2024-05-27T12:32:42.365054+0000","last_clean":"2024-05-27T12:32:42.365054+0000","last_became_active":"2024-05-27T12:32:42.362483+0000","last_became_peered":"2024-05-27T12:32:42.362483+0000","last_unstale":"2024-05-27T12:32:42.365054+0000","last_undegraded":"2024-05-27T12:32:42.365054+0000","last_fullsized":"2024-05-27T12:32:42.365054+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:53:37.721445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-27T12:32:41.369052+0000","last_change":"2024-05-27T12:32:41.365663+0000","last_active":"2024-05-27T12:32:41.369052+0000","last_peered":"2024-05-27T12:32:41.369052+0000","last_clean":"2024-05-27T12:32:41.369052+0000","last_became_active":"2024-05-27T12:32:41.365362+0000","last_became_peered":"2024-05-27T12:32:41.365362+0000","last_unstale":"2024-05-27T12:32:41.369052+0000","last_undegraded":"2024-05-27T12:32:41.369052+0000","last_fullsized":"2024-05-27T12:32:41.369052+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:56:40.549127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-27T12:32:41.355128+0000","last_change":"2024-05-27T12:32:41.355128+0000","last_active":"2024-05-27T12:32:41.333908+0000","last_peered":"2024-05-27T12:32:41.333908+0000","last_clean":"2024-05-27T12:32:41.333908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T12:32:41.355128+0000","last_undegraded":"2024-05-27T12:32:41.355128+0000","last_fullsized":"2024-05-27T12:32:41.355128+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.378054+0000","last_change":"2024-05-27T12:32:41.371087+0000","last_active":"2024-05-27T12:32:42.378054+0000","last_peered":"2024-05-27T12:32:42.378054+0000","last_clean":"2024-05-27T12:32:42.378054+0000","last_became_active":"2024-05-27T12:32:41.370237+0000","last_became_peered":"2024-05-27T12:32:41.370237+0000","last_unstale":"2024-05-27T12:32:42.378054+0000","last_undegraded":"2024-05-27T12:32:42.378054+0000","last_fullsized":"2024-05-27T12:32:42.378054+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:31:52.368166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.374122+0000","last_change":"2024-05-27T12:32:42.371339+0000","last_active":"2024-05-27T12:32:42.374122+0000","last_peered":"2024-05-27T12:32:42.374122+0000","last_clean":"2024-05-27T12:32:42.374122+0000","last_became_active":"2024-05-27T12:32:42.370848+0000","last_became_peered":"2024-05-27T12:32:42.370848+0000","last_unstale":"2024-05-27T12:32:42.374122+0000","last_undegraded":"2024-05-27T12:32:42.374122+0000","last_fullsized":"2024-05-27T12:32:42.374122+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:41:35.310708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.360647+0000","last_change":"2024-05-27T12:32:41.368354+0000","last_active":"2024-05-27T12:32:42.360647+0000","last_peered":"2024-05-27T12:32:42.360647+0000","last_clean":"2024-05-27T12:32:42.360647+0000","last_became_active":"2024-05-27T12:32:41.368086+0000","last_became_peered":"2024-05-27T12:32:41.368086+0000","last_unstale":"2024-05-27T12:32:42.360647+0000","last_undegraded":"2024-05-27T12:32:42.360647+0000","last_fullsized":"2024-05-27T12:32:42.360647+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T23:55:01.390036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.383529+0000","last_change":"2024-05-27T12:32:42.379489+0000","last_active":"2024-05-27T12:32:42.383529+0000","last_peered":"2024-05-27T12:32:42.383529+0000","last_clean":"2024-05-27T12:32:42.383529+0000","last_became_active":"2024-05-27T12:32:42.378880+0000","last_became_peered":"2024-05-27T12:32:42.378880+0000","last_unstale":"2024-05-27T12:32:42.383529+0000","last_undegraded":"2024-05-27T12:32:42.383529+0000","last_fullsized":"2024-05-27T12:32:42.383529+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:21:04.918457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.385950+0000","last_change":"2024-05-27T12:32:41.362154+0000","last_active":"2024-05-27T12:32:42.385950+0000","last_peered":"2024-05-27T12:32:42.385950+0000","last_clean":"2024-05-27T12:32:42.385950+0000","last_became_active":"2024-05-27T12:32:41.361845+0000","last_became_peered":"2024-05-27T12:32:41.361845+0000","last_unstale":"2024-05-27T12:32:42.385950+0000","last_undegraded":"2024-05-27T12:32:42.385950+0000","last_fullsized":"2024-05-27T12:32:42.385950+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:10:55.375726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.383492+0000","last_change":"2024-05-27T12:32:42.378975+0000","last_active":"2024-05-27T12:32:42.383492+0000","last_peered":"2024-05-27T12:32:42.383492+0000","last_clean":"2024-05-27T12:32:42.383492+0000","last_became_active":"2024-05-27T12:32:42.378666+0000","last_became_peered":"2024-05-27T12:32:42.378666+0000","last_unstale":"2024-05-27T12:32:42.383492+0000","last_undegraded":"2024-05-27T12:32:42.383492+0000","last_fullsized":"2024-05-27T12:32:42.383492+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:46:07.761461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.386837+0000","last_change":"2024-05-27T12:32:41.363195+0000","last_active":"2024-05-27T12:32:42.386837+0000","last_peered":"2024-05-27T12:32:42.386837+0000","last_clean":"2024-05-27T12:32:42.386837+0000","last_became_active":"2024-05-27T12:32:41.362693+0000","last_became_peered":"2024-05-27T12:32:41.362693+0000","last_unstale":"2024-05-27T12:32:42.386837+0000","last_undegraded":"2024-05-27T12:32:42.386837+0000","last_fullsized":"2024-05-27T12:32:42.386837+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:10:55.375726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.372618+0000","last_change":"2024-05-27T12:32:42.370922+0000","last_active":"2024-05-27T12:32:42.372618+0000","last_peered":"2024-05-27T12:32:42.372618+0000","last_clean":"2024-05-27T12:32:42.372618+0000","last_became_active":"2024-05-27T12:32:42.370170+0000","last_became_peered":"2024-05-27T12:32:42.370170+0000","last_unstale":"2024-05-27T12:32:42.372618+0000","last_undegraded":"2024-05-27T12:32:42.372618+0000","last_fullsized":"2024-05-27T12:32:42.372618+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:46:59.701728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.381265+0000","last_change":"2024-05-27T12:32:41.366108+0000","last_active":"2024-05-27T12:32:42.381265+0000","last_peered":"2024-05-27T12:32:42.381265+0000","last_clean":"2024-05-27T12:32:42.381265+0000","last_became_active":"2024-05-27T12:32:41.365777+0000","last_became_peered":"2024-05-27T12:32:41.365777+0000","last_unstale":"2024-05-27T12:32:42.381265+0000","last_undegraded":"2024-05-27T12:32:42.381265+0000","last_fullsized":"2024-05-27T12:32:42.381265+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:24:00.607915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.378712+0000","last_change":"2024-05-27T12:32:42.374653+0000","last_active":"2024-05-27T12:32:42.378712+0000","last_peered":"2024-05-27T12:32:42.378712+0000","last_clean":"2024-05-27T12:32:42.378712+0000","last_became_active":"2024-05-27T12:32:42.370933+0000","last_became_peered":"2024-05-27T12:32:42.370933+0000","last_unstale":"2024-05-27T12:32:42.378712+0000","last_undegraded":"2024-05-27T12:32:42.378712+0000","last_fullsized":"2024-05-27T12:32:42.378712+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:17:24.104572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.376016+0000","last_change":"2024-05-27T12:32:41.366243+0000","last_active":"2024-05-27T12:32:42.376016+0000","last_peered":"2024-05-27T12:32:42.376016+0000","last_clean":"2024-05-27T12:32:42.376016+0000","last_became_active":"2024-05-27T12:32:41.365843+0000","last_became_peered":"2024-05-27T12:32:41.365843+0000","last_unstale":"2024-05-27T12:32:42.376016+0000","last_undegraded":"2024-05-27T12:32:42.376016+0000","last_fullsized":"2024-05-27T12:32:42.376016+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:31:52.368166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.389274+0000","last_change":"2024-05-27T12:32:42.384741+0000","last_active":"2024-05-27T12:32:42.389274+0000","last_peered":"2024-05-27T12:32:42.389274+0000","last_clean":"2024-05-27T12:32:42.389274+0000","last_became_active":"2024-05-27T12:32:42.383818+0000","last_became_peered":"2024-05-27T12:32:42.383818+0000","last_unstale":"2024-05-27T12:32:42.389274+0000","last_undegraded":"2024-05-27T12:32:42.389274+0000","last_fullsized":"2024-05-27T12:32:42.389274+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:04:04.818266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.358263+0000","last_change":"2024-05-27T12:32:41.374511+0000","last_active":"2024-05-27T12:32:42.358263+0000","last_peered":"2024-05-27T12:32:42.358263+0000","last_clean":"2024-05-27T12:32:42.358263+0000","last_became_active":"2024-05-27T12:32:41.374221+0000","last_became_peered":"2024-05-27T12:32:41.374221+0000","last_unstale":"2024-05-27T12:32:42.358263+0000","last_undegraded":"2024-05-27T12:32:42.358263+0000","last_fullsized":"2024-05-27T12:32:42.358263+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T23:34:58.092780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.389356+0000","last_change":"2024-05-27T12:32:42.384647+0000","last_active":"2024-05-27T12:32:42.389356+0000","last_peered":"2024-05-27T12:32:42.389356+0000","last_clean":"2024-05-27T12:32:42.389356+0000","last_became_active":"2024-05-27T12:32:42.384389+0000","last_became_peered":"2024-05-27T12:32:42.384389+0000","last_unstale":"2024-05-27T12:32:42.389356+0000","last_undegraded":"2024-05-27T12:32:42.389356+0000","last_fullsized":"2024-05-27T12:32:42.389356+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:03:50.593154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":168,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.355803+0000","last_change":"2024-05-27T12:32:31.185664+0000","last_active":"2024-05-27T12:32:42.355803+0000","last_peered":"2024-05-27T12:32:42.355803+0000","last_clean":"2024-05-27T12:32:42.355803+0000","last_became_active":"2024-05-27T12:32:31.184757+0000","last_became_peered":"2024-05-27T12:32:31.184757+0000","last_unstale":"2024-05-27T12:32:42.355803+0000","last_undegraded":"2024-05-27T12:32:42.355803+0000","last_fullsized":"2024-05-27T12:32:42.355803+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:30.136480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:30.136480+0000","last_clean_scrub_stamp":"2024-05-27T12:32:30.136480+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:49:13.241747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.367240+0000","last_change":"2024-05-27T12:32:41.371475+0000","last_active":"2024-05-27T12:32:42.367240+0000","last_peered":"2024-05-27T12:32:42.367240+0000","last_clean":"2024-05-27T12:32:42.367240+0000","last_became_active":"2024-05-27T12:32:41.371198+0000","last_became_peered":"2024-05-27T12:32:41.371198+0000","last_unstale":"2024-05-27T12:32:42.367240+0000","last_undegraded":"2024-05-27T12:32:42.367240+0000","last_fullsized":"2024-05-27T12:32:42.367240+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T23:55:01.390036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.386892+0000","last_change":"2024-05-27T12:32:42.385699+0000","last_active":"2024-05-27T12:32:42.386892+0000","last_peered":"2024-05-27T12:32:42.386892+0000","last_clean":"2024-05-27T12:32:42.386892+0000","last_became_active":"2024-05-27T12:32:42.385464+0000","last_became_peered":"2024-05-27T12:32:42.385464+0000","last_unstale":"2024-05-27T12:32:42.386892+0000","last_undegraded":"2024-05-27T12:32:42.386892+0000","last_fullsized":"2024-05-27T12:32:42.386892+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:04:04.818266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.356248+0000","last_change":"2024-05-27T12:32:41.371263+0000","last_active":"2024-05-27T12:32:42.356248+0000","last_peered":"2024-05-27T12:32:42.356248+0000","last_clean":"2024-05-27T12:32:42.356248+0000","last_became_active":"2024-05-27T12:32:41.370961+0000","last_became_peered":"2024-05-27T12:32:41.370961+0000","last_unstale":"2024-05-27T12:32:42.356248+0000","last_undegraded":"2024-05-27T12:32:42.356248+0000","last_fullsized":"2024-05-27T12:32:42.356248+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:07:21.253545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-27T12:32:41.355359+0000","last_change":"2024-05-27T12:32:41.355359+0000","last_active":"2024-05-27T12:32:41.333908+0000","last_peered":"2024-05-27T12:32:41.333908+0000","last_clean":"2024-05-27T12:32:41.333908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T12:32:41.355359+0000","last_undegraded":"2024-05-27T12:32:41.355359+0000","last_fullsized":"2024-05-27T12:32:41.355359+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.357960+0000","last_change":"2024-05-27T12:32:41.366189+0000","last_active":"2024-05-27T12:32:42.357960+0000","last_peered":"2024-05-27T12:32:42.357960+0000","last_clean":"2024-05-27T12:32:42.357960+0000","last_became_active":"2024-05-27T12:32:41.365860+0000","last_became_peered":"2024-05-27T12:32:41.365860+0000","last_unstale":"2024-05-27T12:32:42.357960+0000","last_undegraded":"2024-05-27T12:32:42.357960+0000","last_fullsized":"2024-05-27T12:32:42.357960+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T23:55:01.390036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.375838+0000","last_change":"2024-05-27T12:32:42.370436+0000","last_active":"2024-05-27T12:32:42.375838+0000","last_peered":"2024-05-27T12:32:42.375838+0000","last_clean":"2024-05-27T12:32:42.375838+0000","last_became_active":"2024-05-27T12:32:42.370051+0000","last_became_peered":"2024-05-27T12:32:42.370051+0000","last_unstale":"2024-05-27T12:32:42.375838+0000","last_undegraded":"2024-05-27T12:32:42.375838+0000","last_fullsized":"2024-05-27T12:32:42.375838+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:10:30.753626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.378150+0000","last_change":"2024-05-27T12:32:41.368242+0000","last_active":"2024-05-27T12:32:42.378150+0000","last_peered":"2024-05-27T12:32:42.378150+0000","last_clean":"2024-05-27T12:32:42.378150+0000","last_became_active":"2024-05-27T12:32:41.366995+0000","last_became_peered":"2024-05-27T12:32:41.366995+0000","last_unstale":"2024-05-27T12:32:42.378150+0000","last_undegraded":"2024-05-27T12:32:42.378150+0000","last_fullsized":"2024-05-27T12:32:42.378150+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T23:33:13.169169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.389268+0000","last_change":"2024-05-27T12:32:42.382859+0000","last_active":"2024-05-27T12:32:42.389268+0000","last_peered":"2024-05-27T12:32:42.389268+0000","last_clean":"2024-05-27T12:32:42.389268+0000","last_became_active":"2024-05-27T12:32:42.382312+0000","last_became_peered":"2024-05-27T12:32:42.382312+0000","last_unstale":"2024-05-27T12:32:42.389268+0000","last_undegraded":"2024-05-27T12:32:42.389268+0000","last_fullsized":"2024-05-27T12:32:42.389268+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:24:01.616764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.366276+0000","last_change":"2024-05-27T12:32:41.362976+0000","last_active":"2024-05-27T12:32:42.366276+0000","last_peered":"2024-05-27T12:32:42.366276+0000","last_clean":"2024-05-27T12:32:42.366276+0000","last_became_active":"2024-05-27T12:32:41.362645+0000","last_became_peered":"2024-05-27T12:32:41.362645+0000","last_unstale":"2024-05-27T12:32:42.366276+0000","last_undegraded":"2024-05-27T12:32:42.366276+0000","last_fullsized":"2024-05-27T12:32:42.366276+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T23:55:01.390036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.386721+0000","last_change":"2024-05-27T12:32:42.382156+0000","last_active":"2024-05-27T12:32:42.386721+0000","last_peered":"2024-05-27T12:32:42.386721+0000","last_clean":"2024-05-27T12:32:42.386721+0000","last_became_active":"2024-05-27T12:32:42.381678+0000","last_became_peered":"2024-05-27T12:32:42.381678+0000","last_unstale":"2024-05-27T12:32:42.386721+0000","last_undegraded":"2024-05-27T12:32:42.386721+0000","last_fullsized":"2024-05-27T12:32:42.386721+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:10:30.753626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.357204+0000","last_change":"2024-05-27T12:32:41.371270+0000","last_active":"2024-05-27T12:32:42.357204+0000","last_peered":"2024-05-27T12:32:42.357204+0000","last_clean":"2024-05-27T12:32:42.357204+0000","last_became_active":"2024-05-27T12:32:41.370665+0000","last_became_peered":"2024-05-27T12:32:41.370665+0000","last_unstale":"2024-05-27T12:32:42.357204+0000","last_undegraded":"2024-05-27T12:32:42.357204+0000","last_fullsized":"2024-05-27T12:32:42.357204+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:45:13.017421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.375875+0000","last_change":"2024-05-27T12:32:42.371153+0000","last_active":"2024-05-27T12:32:42.375875+0000","last_peered":"2024-05-27T12:32:42.375875+0000","last_clean":"2024-05-27T12:32:42.375875+0000","last_became_active":"2024-05-27T12:32:42.370862+0000","last_became_peered":"2024-05-27T12:32:42.370862+0000","last_unstale":"2024-05-27T12:32:42.375875+0000","last_undegraded":"2024-05-27T12:32:42.375875+0000","last_fullsized":"2024-05-27T12:32:42.375875+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:20:05.304417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.368179+0000","last_change":"2024-05-27T12:32:41.368774+0000","last_active":"2024-05-27T12:32:42.368179+0000","last_peered":"2024-05-27T12:32:42.368179+0000","last_clean":"2024-05-27T12:32:42.368179+0000","last_became_active":"2024-05-27T12:32:41.368343+0000","last_became_peered":"2024-05-27T12:32:41.368343+0000","last_unstale":"2024-05-27T12:32:42.368179+0000","last_undegraded":"2024-05-27T12:32:42.368179+0000","last_fullsized":"2024-05-27T12:32:42.368179+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:07:21.253545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.365718+0000","last_change":"2024-05-27T12:32:42.361807+0000","last_active":"2024-05-27T12:32:42.365718+0000","last_peered":"2024-05-27T12:32:42.365718+0000","last_clean":"2024-05-27T12:32:42.365718+0000","last_became_active":"2024-05-27T12:32:42.361508+0000","last_became_peered":"2024-05-27T12:32:42.361508+0000","last_unstale":"2024-05-27T12:32:42.365718+0000","last_undegraded":"2024-05-27T12:32:42.365718+0000","last_fullsized":"2024-05-27T12:32:42.365718+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T23:34:59.101630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.382030+0000","last_change":"2024-05-27T12:32:41.368907+0000","last_active":"2024-05-27T12:32:42.382030+0000","last_peered":"2024-05-27T12:32:42.382030+0000","last_clean":"2024-05-27T12:32:42.382030+0000","last_became_active":"2024-05-27T12:32:41.368392+0000","last_became_peered":"2024-05-27T12:32:41.368392+0000","last_unstale":"2024-05-27T12:32:42.382030+0000","last_undegraded":"2024-05-27T12:32:42.382030+0000","last_fullsized":"2024-05-27T12:32:42.382030+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T23:34:58.092780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-27T12:32:41.355247+0000","last_change":"2024-05-27T12:32:41.355247+0000","last_active":"2024-05-27T12:32:41.333908+0000","last_peered":"2024-05-27T12:32:41.333908+0000","last_clean":"2024-05-27T12:32:41.333908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T12:32:41.355247+0000","last_undegraded":"2024-05-27T12:32:41.355247+0000","last_fullsized":"2024-05-27T12:32:41.355247+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.355748+0000","last_change":"2024-05-27T12:32:41.369723+0000","last_active":"2024-05-27T12:32:42.355748+0000","last_peered":"2024-05-27T12:32:42.355748+0000","last_clean":"2024-05-27T12:32:42.355748+0000","last_became_active":"2024-05-27T12:32:41.369404+0000","last_became_peered":"2024-05-27T12:32:41.369404+0000","last_unstale":"2024-05-27T12:32:42.355748+0000","last_undegraded":"2024-05-27T12:32:42.355748+0000","last_fullsized":"2024-05-27T12:32:42.355748+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T23:33:13.169169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.377750+0000","last_change":"2024-05-27T12:32:42.371958+0000","last_active":"2024-05-27T12:32:42.377750+0000","last_peered":"2024-05-27T12:32:42.377750+0000","last_clean":"2024-05-27T12:32:42.377750+0000","last_became_active":"2024-05-27T12:32:42.371689+0000","last_became_peered":"2024-05-27T12:32:42.371689+0000","last_unstale":"2024-05-27T12:32:42.377750+0000","last_undegraded":"2024-05-27T12:32:42.377750+0000","last_fullsized":"2024-05-27T12:32:42.377750+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:41:36.904875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.367113+0000","last_change":"2024-05-27T12:32:41.367208+0000","last_active":"2024-05-27T12:32:42.367113+0000","last_peered":"2024-05-27T12:32:42.367113+0000","last_clean":"2024-05-27T12:32:42.367113+0000","last_became_active":"2024-05-27T12:32:41.366772+0000","last_became_peered":"2024-05-27T12:32:41.366772+0000","last_unstale":"2024-05-27T12:32:42.367113+0000","last_undegraded":"2024-05-27T12:32:42.367113+0000","last_fullsized":"2024-05-27T12:32:42.367113+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T23:33:13.169169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.373596+0000","last_change":"2024-05-27T12:32:42.371618+0000","last_active":"2024-05-27T12:32:42.373596+0000","last_peered":"2024-05-27T12:32:42.373596+0000","last_clean":"2024-05-27T12:32:42.373596+0000","last_became_active":"2024-05-27T12:32:42.369525+0000","last_became_peered":"2024-05-27T12:32:42.369525+0000","last_unstale":"2024-05-27T12:32:42.373596+0000","last_undegraded":"2024-05-27T12:32:42.373596+0000","last_fullsized":"2024-05-27T12:32:42.373596+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:07:22.262394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.366697+0000","last_change":"2024-05-27T12:32:41.366388+0000","last_active":"2024-05-27T12:32:42.366697+0000","last_peered":"2024-05-27T12:32:42.366697+0000","last_clean":"2024-05-27T12:32:42.366697+0000","last_became_active":"2024-05-27T12:32:41.365881+0000","last_became_peered":"2024-05-27T12:32:41.365881+0000","last_unstale":"2024-05-27T12:32:42.366697+0000","last_undegraded":"2024-05-27T12:32:42.366697+0000","last_fullsized":"2024-05-27T12:32:42.366697+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:24:00.607915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.384844+0000","last_change":"2024-05-27T12:32:42.383798+0000","last_active":"2024-05-27T12:32:42.384844+0000","last_peered":"2024-05-27T12:32:42.384844+0000","last_clean":"2024-05-27T12:32:42.384844+0000","last_became_active":"2024-05-27T12:32:42.383431+0000","last_became_peered":"2024-05-27T12:32:42.383431+0000","last_unstale":"2024-05-27T12:32:42.384844+0000","last_undegraded":"2024-05-27T12:32:42.384844+0000","last_fullsized":"2024-05-27T12:32:42.384844+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:53:37.721445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.386769+0000","last_change":"2024-05-27T12:32:41.373716+0000","last_active":"2024-05-27T12:32:42.386769+0000","last_peered":"2024-05-27T12:32:42.386769+0000","last_clean":"2024-05-27T12:32:42.386769+0000","last_became_active":"2024-05-27T12:32:41.373364+0000","last_became_peered":"2024-05-27T12:32:41.373364+0000","last_unstale":"2024-05-27T12:32:42.386769+0000","last_undegraded":"2024-05-27T12:32:42.386769+0000","last_fullsized":"2024-05-27T12:32:42.386769+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:21:03.909608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.372702+0000","last_change":"2024-05-27T12:32:42.370445+0000","last_active":"2024-05-27T12:32:42.372702+0000","last_peered":"2024-05-27T12:32:42.372702+0000","last_clean":"2024-05-27T12:32:42.372702+0000","last_became_active":"2024-05-27T12:32:42.370164+0000","last_became_peered":"2024-05-27T12:32:42.370164+0000","last_unstale":"2024-05-27T12:32:42.372702+0000","last_undegraded":"2024-05-27T12:32:42.372702+0000","last_fullsized":"2024-05-27T12:32:42.372702+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:10:30.753626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.389983+0000","last_change":"2024-05-27T12:32:42.386589+0000","last_active":"2024-05-27T12:32:42.389983+0000","last_peered":"2024-05-27T12:32:42.389983+0000","last_clean":"2024-05-27T12:32:42.389983+0000","last_became_active":"2024-05-27T12:32:42.386297+0000","last_became_peered":"2024-05-27T12:32:42.386297+0000","last_unstale":"2024-05-27T12:32:42.389983+0000","last_undegraded":"2024-05-27T12:32:42.389983+0000","last_fullsized":"2024-05-27T12:32:42.389983+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:46:59.701728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.384700+0000","last_change":"2024-05-27T12:32:41.374812+0000","last_active":"2024-05-27T12:32:42.384700+0000","last_peered":"2024-05-27T12:32:42.384700+0000","last_clean":"2024-05-27T12:32:42.384700+0000","last_became_active":"2024-05-27T12:32:41.374488+0000","last_became_peered":"2024-05-27T12:32:41.374488+0000","last_unstale":"2024-05-27T12:32:42.384700+0000","last_undegraded":"2024-05-27T12:32:42.384700+0000","last_fullsized":"2024-05-27T12:32:42.384700+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:10:29.744776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.393996+0000","last_change":"2024-05-27T12:32:42.389941+0000","last_active":"2024-05-27T12:32:42.393996+0000","last_peered":"2024-05-27T12:32:42.393996+0000","last_clean":"2024-05-27T12:32:42.393996+0000","last_became_active":"2024-05-27T12:32:42.389630+0000","last_became_peered":"2024-05-27T12:32:42.389630+0000","last_unstale":"2024-05-27T12:32:42.393996+0000","last_undegraded":"2024-05-27T12:32:42.393996+0000","last_fullsized":"2024-05-27T12:32:42.393996+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:17:24.104572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.375424+0000","last_change":"2024-05-27T12:32:41.371373+0000","last_active":"2024-05-27T12:32:42.375424+0000","last_peered":"2024-05-27T12:32:42.375424+0000","last_clean":"2024-05-27T12:32:42.375424+0000","last_became_active":"2024-05-27T12:32:41.371009+0000","last_became_peered":"2024-05-27T12:32:41.371009+0000","last_unstale":"2024-05-27T12:32:42.375424+0000","last_undegraded":"2024-05-27T12:32:42.375424+0000","last_fullsized":"2024-05-27T12:32:42.375424+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:20:04.295568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-27T12:32:41.357214+0000","last_change":"2024-05-27T12:32:41.357214+0000","last_active":"2024-05-27T12:32:41.333908+0000","last_peered":"2024-05-27T12:32:41.333908+0000","last_clean":"2024-05-27T12:32:41.333908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T12:32:41.357214+0000","last_undegraded":"2024-05-27T12:32:41.357214+0000","last_fullsized":"2024-05-27T12:32:41.357214+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.386157+0000","last_change":"2024-05-27T12:32:41.362828+0000","last_active":"2024-05-27T12:32:42.386157+0000","last_peered":"2024-05-27T12:32:42.386157+0000","last_clean":"2024-05-27T12:32:42.386157+0000","last_became_active":"2024-05-27T12:32:41.362526+0000","last_became_peered":"2024-05-27T12:32:41.362526+0000","last_unstale":"2024-05-27T12:32:42.386157+0000","last_undegraded":"2024-05-27T12:32:42.386157+0000","last_fullsized":"2024-05-27T12:32:42.386157+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T23:55:01.390036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.373006+0000","last_change":"2024-05-27T12:32:42.368191+0000","last_active":"2024-05-27T12:32:42.373006+0000","last_peered":"2024-05-27T12:32:42.373006+0000","last_clean":"2024-05-27T12:32:42.373006+0000","last_became_active":"2024-05-27T12:32:42.367914+0000","last_became_peered":"2024-05-27T12:32:42.367914+0000","last_unstale":"2024-05-27T12:32:42.373006+0000","last_undegraded":"2024-05-27T12:32:42.373006+0000","last_fullsized":"2024-05-27T12:32:42.373006+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:31:53.377015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-27T12:32:41.369794+0000","last_change":"2024-05-27T12:32:41.364608+0000","last_active":"2024-05-27T12:32:41.369794+0000","last_peered":"2024-05-27T12:32:41.369794+0000","last_clean":"2024-05-27T12:32:41.369794+0000","last_became_active":"2024-05-27T12:32:41.364245+0000","last_became_peered":"2024-05-27T12:32:41.364245+0000","last_unstale":"2024-05-27T12:32:41.369794+0000","last_undegraded":"2024-05-27T12:32:41.369794+0000","last_fullsized":"2024-05-27T12:32:41.369794+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:20:13.667380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1794,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":4182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32,"ondisk_log_size":32,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509445,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":819200,"data_stored":665605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509445,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":233472,"data_stored":76267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509445,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":225280,"data_stored":74745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509445,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":233472,"data_stored":74781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509445,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":233472,"data_stored":76267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509445,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31396,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340444,"statfs":{"total":96636764160,"available":96604614656,"internally_reserved":0,"allocated":221184,"data_stored":74655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":229376,"data_stored":74815,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542150,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31964,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339876,"statfs":{"total":96636764160,"available":96604033024,"internally_reserved":0,"allocated":802816,"data_stored":658248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-27T12:32:45.743 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-27T12:32:45.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.884+0000 7fe313120640 1 Processor -- start 2024-05-27T12:32:45.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.884+0000 7fe313120640 1 -- start start 2024-05-27T12:32:45.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.885+0000 7fe313120640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe30c15ec00 0x7fe30c0b3db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:45.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.885+0000 7fe313120640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe30c0b6370 0x7fe30c0b67c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:45.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.885+0000 7fe313120640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe30c1632f0 con 0x7fe30c0b3860 2024-05-27T12:32:45.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.885+0000 7fe313120640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7fe30c0b6d00 con 0x7fe30c15ec00 2024-05-27T12:32:45.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.885+0000 7fe313120640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fe30c0cf2e0 con 0x7fe30c0b6370 2024-05-27T12:32:45.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.885+0000 7fe310ebc640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe30c15ec00 0x7fe30c0b3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:45.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.885+0000 7fe310ebc640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe30c15ec00 0x7fe30c0b3db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55294/0 (socket says 172.21.15.55:55294) 2024-05-27T12:32:45.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.885+0000 7fe310ebc640 1 -- 172.21.15.55:0/1481440260 learned_addr learned my addr 172.21.15.55:0/1481440260 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:32:45.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.885+0000 7fe3116bd640 1 --2- 172.21.15.55:0/1481440260 >> v2:172.21.15.72:3300/0 conn(0x7fe30c0b6370 0x7fe30c0b67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:45.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.885+0000 7fe310ebc640 1 -- 172.21.15.55:0/1481440260 >> v2:172.21.15.72:3300/0 conn(0x7fe30c0b6370 msgr2=0x7fe30c0b67c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:32:45.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.885+0000 7fe310ebc640 1 --2- 172.21.15.55:0/1481440260 >> v2:172.21.15.72:3300/0 conn(0x7fe30c0b6370 0x7fe30c0b67c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:45.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.885+0000 7fe310ebc640 1 -- 172.21.15.55:0/1481440260 >> v1:172.21.15.72:6789/0 conn(0x7fe30c0b3860 legacy=0x7fe30c0cfd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:32:45.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.885+0000 7fe310ebc640 1 -- 172.21.15.55:0/1481440260 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe30c1635d0 con 0x7fe30c15ec00 2024-05-27T12:32:45.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.885+0000 7fe3116bd640 1 --2- 172.21.15.55:0/1481440260 >> v2:172.21.15.72:3300/0 conn(0x7fe30c0b6370 0x7fe30c0b67c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T12:32:45.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.886+0000 7fe310ebc640 1 --2- 172.21.15.55:0/1481440260 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe30c15ec00 0x7fe30c0b3db0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe30c0b77d0 tx=0x7fe2fc02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acc5e616b5f4c46a server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:45.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.886+0000 7fe30b7fe640 1 -- 172.21.15.55:0/1481440260 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2fc037070 con 0x7fe30c15ec00 2024-05-27T12:32:45.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.886+0000 7fe30b7fe640 1 -- 172.21.15.55:0/1481440260 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2fc032440 con 0x7fe30c15ec00 2024-05-27T12:32:45.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.886+0000 7fe30b7fe640 1 -- 172.21.15.55:0/1481440260 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2fc032810 con 0x7fe30c15ec00 2024-05-27T12:32:45.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.887+0000 7fe313120640 1 -- 172.21.15.55:0/1481440260 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe30c15ec00 msgr2=0x7fe30c0b3db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:45.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.887+0000 7fe313120640 1 --2- 172.21.15.55:0/1481440260 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe30c15ec00 0x7fe30c0b3db0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe30c0b77d0 tx=0x7fe2fc02a230 comp rx=0 tx=0).stop 2024-05-27T12:32:45.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.887+0000 7fe313120640 1 -- 172.21.15.55:0/1481440260 shutdown_connections 2024-05-27T12:32:45.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.887+0000 7fe313120640 1 --2- 172.21.15.55:0/1481440260 >> v2:172.21.15.72:3300/0 conn(0x7fe30c0b6370 0x7fe30c0b67c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:45.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.887+0000 7fe313120640 1 --2- 172.21.15.55:0/1481440260 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe30c15ec00 0x7fe30c0b3db0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:45.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.887+0000 7fe313120640 1 -- 172.21.15.55:0/1481440260 >> 172.21.15.55:0/1481440260 conn(0x7fe30c0d1370 msgr2=0x7fe30c0d1780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:45.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.887+0000 7fe313120640 1 -- 172.21.15.55:0/1481440260 shutdown_connections 2024-05-27T12:32:45.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.887+0000 7fe313120640 1 -- 172.21.15.55:0/1481440260 wait complete. 2024-05-27T12:32:45.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.888+0000 7fe313120640 1 Processor -- start 2024-05-27T12:32:45.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.888+0000 7fe313120640 1 -- start start 2024-05-27T12:32:45.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.889+0000 7fe313120640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe30c0b3860 0x7fe30c152df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:45.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.889+0000 7fe313120640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe30c0b6370 0x7fe30c0b8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:45.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.889+0000 7fe313120640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe30c15ec00 0x7fe30c0b94f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:45.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.889+0000 7fe313120640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7fe30c0b3530 con 0x7fe30c0b6370 2024-05-27T12:32:45.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.889+0000 7fe313120640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fe30c0cf810 con 0x7fe30c0b3860 2024-05-27T12:32:45.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.889+0000 7fe313120640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fe30c15efe0 con 0x7fe30c15ec00 2024-05-27T12:32:45.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.889+0000 7fe30bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe30c0b6370 0x7fe30c0b8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:45.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.889+0000 7fe30bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe30c0b6370 0x7fe30c0b8fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55298/0 (socket says 172.21.15.55:55298) 2024-05-27T12:32:45.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.889+0000 7fe30bfff640 1 -- 172.21.15.55:0/3036414264 learned_addr learned my addr 172.21.15.55:0/3036414264 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:32:45.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.889+0000 7fe310ebc640 1 --2- 172.21.15.55:0/3036414264 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe30c0b3860 0x7fe30c152df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:45.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.889+0000 7fe3116bd640 1 --2- 172.21.15.55:0/3036414264 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe30c15ec00 0x7fe30c0b94f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:45.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.889+0000 7fe30bfff640 1 -- 172.21.15.55:0/3036414264 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe30c15ec00 msgr2=0x7fe30c0b94f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:45.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.889+0000 7fe30bfff640 1 --2- 172.21.15.55:0/3036414264 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe30c15ec00 0x7fe30c0b94f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:45.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.889+0000 7fe30bfff640 1 -- 172.21.15.55:0/3036414264 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe30c0b3860 msgr2=0x7fe30c152df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:45.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.889+0000 7fe30bfff640 1 --2- 172.21.15.55:0/3036414264 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe30c0b3860 0x7fe30c152df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:45.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.889+0000 7fe30bfff640 1 -- 172.21.15.55:0/3036414264 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe30c0cd890 con 0x7fe30c0b6370 2024-05-27T12:32:45.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.890+0000 7fe30bfff640 1 --2- 172.21.15.55:0/3036414264 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe30c0b6370 0x7fe30c0b8fb0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe30000c430 tx=0x7fe30000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:45.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.890+0000 7fe3097fa640 1 -- 172.21.15.55:0/3036414264 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe300011790 con 0x7fe30c0b6370 2024-05-27T12:32:45.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.890+0000 7fe3097fa640 1 -- 172.21.15.55:0/3036414264 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe300017070 con 0x7fe30c0b6370 2024-05-27T12:32:45.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.890+0000 7fe313120640 1 -- 172.21.15.55:0/3036414264 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe30c0cdb70 con 0x7fe30c0b6370 2024-05-27T12:32:45.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.890+0000 7fe3097fa640 1 -- 172.21.15.55:0/3036414264 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe300011bb0 con 0x7fe30c0b6370 2024-05-27T12:32:45.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.890+0000 7fe313120640 1 -- 172.21.15.55:0/3036414264 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe30c0ce130 con 0x7fe30c0b6370 2024-05-27T12:32:45.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.891+0000 7fe313120640 1 -- 172.21.15.55:0/3036414264 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe30c06db20 con 0x7fe30c0b6370 2024-05-27T12:32:45.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.891+0000 7fe3097fa640 1 -- 172.21.15.55:0/3036414264 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe30001c460 con 0x7fe30c0b6370 2024-05-27T12:32:45.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.892+0000 7fe3097fa640 1 --2- 172.21.15.55:0/3036414264 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fe2f806c920 0x7fe2f806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:45.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.892+0000 7fe3097fa640 1 -- 172.21.15.55:0/3036414264 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fe30008b8e0 con 0x7fe30c0b6370 2024-05-27T12:32:45.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.892+0000 7fe310ebc640 1 --2- 172.21.15.55:0/3036414264 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fe2f806c920 0x7fe2f806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:45.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.892+0000 7fe310ebc640 1 --2- 172.21.15.55:0/3036414264 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fe2f806c920 0x7fe2f806ede0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc034000 tx=0x7fe2fc02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:45.896 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:45.896+0000 7fe3097fa640 1 -- 172.21.15.55:0/3036414264 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe30c06db20 con 0x7fe30c0b6370 2024-05-27T12:32:45.901 INFO:tasks.ceph.mds.b.smithi072.stderr:2024-05-27T12:32:45.901+0000 7f87a288a640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-27T12:32:46.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.078+0000 7fe313120640 1 -- 172.21.15.55:0/3036414264 --> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe30c075460 con 0x7fe2f806c920 2024-05-27T12:32:46.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.085+0000 7fe3097fa640 1 -- 172.21.15.55:0/3036414264 <== mgr.4105 v2:172.21.15.72:6832/3152720583 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251063 (secure 0 0 0) 0x7fe30c075460 con 0x7fe2f806c920 2024-05-27T12:32:46.087 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-27T12:32:46.088 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2024-05-27T12:32:46.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.087+0000 7fe313120640 1 -- 172.21.15.55:0/3036414264 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fe2f806c920 msgr2=0x7fe2f806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:46.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.087+0000 7fe313120640 1 --2- 172.21.15.55:0/3036414264 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fe2f806c920 0x7fe2f806ede0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc034000 tx=0x7fe2fc02e000 comp rx=0 tx=0).stop 2024-05-27T12:32:46.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.087+0000 7fe313120640 1 -- 172.21.15.55:0/3036414264 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe30c0b6370 msgr2=0x7fe30c0b8fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:46.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.087+0000 7fe313120640 1 --2- 172.21.15.55:0/3036414264 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe30c0b6370 0x7fe30c0b8fb0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe30000c430 tx=0x7fe30000c8f0 comp rx=0 tx=0).stop 2024-05-27T12:32:46.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.087+0000 7fe313120640 1 -- 172.21.15.55:0/3036414264 shutdown_connections 2024-05-27T12:32:46.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.087+0000 7fe313120640 1 --2- 172.21.15.55:0/3036414264 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe30c15ec00 0x7fe30c0b94f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:46.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.087+0000 7fe313120640 1 --2- 172.21.15.55:0/3036414264 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe30c0b6370 0x7fe30c0b8fb0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:46.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.087+0000 7fe313120640 1 --2- 172.21.15.55:0/3036414264 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fe2f806c920 0x7fe2f806ede0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:46.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.087+0000 7fe313120640 1 --2- 172.21.15.55:0/3036414264 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe30c0b3860 0x7fe30c152df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:46.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.087+0000 7fe313120640 1 -- 172.21.15.55:0/3036414264 >> 172.21.15.55:0/3036414264 conn(0x7fe30c0d1370 msgr2=0x7fe30c0d4400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:46.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.087+0000 7fe313120640 1 -- 172.21.15.55:0/3036414264 shutdown_connections 2024-05-27T12:32:46.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.087+0000 7fe313120640 1 -- 172.21.15.55:0/3036414264 wait complete. 2024-05-27T12:32:46.099 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-05-27T12:32:45.263246+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592162,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":196,"num_write_kb":2422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":149,"ondisk_log_size":149,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":84,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235728,"kb_used_data":2928,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738992,"statfs":{"total":773094113280,"available":772852727808,"internally_reserved":0,"allocated":2998272,"data_stored":1775383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1794,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.925680"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.374797+0000","last_change":"2024-05-27T12:32:42.368378+0000","last_active":"2024-05-27T12:32:42.374797+0000","last_peered":"2024-05-27T12:32:42.374797+0000","last_clean":"2024-05-27T12:32:42.374797+0000","last_became_active":"2024-05-27T12:32:42.367689+0000","last_became_peered":"2024-05-27T12:32:42.367689+0000","last_unstale":"2024-05-27T12:32:42.374797+0000","last_undegraded":"2024-05-27T12:32:42.374797+0000","last_fullsized":"2024-05-27T12:32:42.374797+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:23:59.137419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.381869+0000","last_change":"2024-05-27T12:32:42.380372+0000","last_active":"2024-05-27T12:32:42.381869+0000","last_peered":"2024-05-27T12:32:42.381869+0000","last_clean":"2024-05-27T12:32:42.381869+0000","last_became_active":"2024-05-27T12:32:42.379503+0000","last_became_peered":"2024-05-27T12:32:42.379503+0000","last_unstale":"2024-05-27T12:32:42.381869+0000","last_undegraded":"2024-05-27T12:32:42.381869+0000","last_fullsized":"2024-05-27T12:32:42.381869+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:08:37.481605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-27T12:32:41.357767+0000","last_change":"2024-05-27T12:32:41.357767+0000","last_active":"2024-05-27T12:32:41.333908+0000","last_peered":"2024-05-27T12:32:41.333908+0000","last_clean":"2024-05-27T12:32:41.333908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T12:32:41.357767+0000","last_undegraded":"2024-05-27T12:32:41.357767+0000","last_fullsized":"2024-05-27T12:32:41.357767+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.389251+0000","last_change":"2024-05-27T12:32:42.384566+0000","last_active":"2024-05-27T12:32:42.389251+0000","last_peered":"2024-05-27T12:32:42.389251+0000","last_clean":"2024-05-27T12:32:42.389251+0000","last_became_active":"2024-05-27T12:32:42.384269+0000","last_became_peered":"2024-05-27T12:32:42.384269+0000","last_unstale":"2024-05-27T12:32:42.389251+0000","last_undegraded":"2024-05-27T12:32:42.389251+0000","last_fullsized":"2024-05-27T12:32:42.389251+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:08:37.481605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.374093+0000","last_change":"2024-05-27T12:32:42.367164+0000","last_active":"2024-05-27T12:32:42.374093+0000","last_peered":"2024-05-27T12:32:42.374093+0000","last_clean":"2024-05-27T12:32:42.374093+0000","last_became_active":"2024-05-27T12:32:42.366882+0000","last_became_peered":"2024-05-27T12:32:42.366882+0000","last_unstale":"2024-05-27T12:32:42.374093+0000","last_undegraded":"2024-05-27T12:32:42.374093+0000","last_fullsized":"2024-05-27T12:32:42.374093+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:04:04.818266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.389344+0000","last_change":"2024-05-27T12:32:42.385413+0000","last_active":"2024-05-27T12:32:42.389344+0000","last_peered":"2024-05-27T12:32:42.389344+0000","last_clean":"2024-05-27T12:32:42.389344+0000","last_became_active":"2024-05-27T12:32:42.385163+0000","last_became_peered":"2024-05-27T12:32:42.385163+0000","last_unstale":"2024-05-27T12:32:42.389344+0000","last_undegraded":"2024-05-27T12:32:42.389344+0000","last_fullsized":"2024-05-27T12:32:42.389344+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:23:59.137419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.380885+0000","last_change":"2024-05-27T12:32:42.376081+0000","last_active":"2024-05-27T12:32:42.380885+0000","last_peered":"2024-05-27T12:32:42.380885+0000","last_clean":"2024-05-27T12:32:42.380885+0000","last_became_active":"2024-05-27T12:32:42.375689+0000","last_became_peered":"2024-05-27T12:32:42.375689+0000","last_unstale":"2024-05-27T12:32:42.380885+0000","last_undegraded":"2024-05-27T12:32:42.380885+0000","last_fullsized":"2024-05-27T12:32:42.380885+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:45:06.261408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.386869+0000","last_change":"2024-05-27T12:32:42.385659+0000","last_active":"2024-05-27T12:32:42.386869+0000","last_peered":"2024-05-27T12:32:42.386869+0000","last_clean":"2024-05-27T12:32:42.386869+0000","last_became_active":"2024-05-27T12:32:42.385356+0000","last_became_peered":"2024-05-27T12:32:42.385356+0000","last_unstale":"2024-05-27T12:32:42.386869+0000","last_undegraded":"2024-05-27T12:32:42.386869+0000","last_fullsized":"2024-05-27T12:32:42.386869+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:08:37.481605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.386391+0000","last_change":"2024-05-27T12:32:42.382460+0000","last_active":"2024-05-27T12:32:42.386391+0000","last_peered":"2024-05-27T12:32:42.386391+0000","last_clean":"2024-05-27T12:32:42.386391+0000","last_became_active":"2024-05-27T12:32:42.382093+0000","last_became_peered":"2024-05-27T12:32:42.382093+0000","last_unstale":"2024-05-27T12:32:42.386391+0000","last_undegraded":"2024-05-27T12:32:42.386391+0000","last_fullsized":"2024-05-27T12:32:42.386391+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:44:31.058083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.389163+0000","last_change":"2024-05-27T12:32:42.384546+0000","last_active":"2024-05-27T12:32:42.389163+0000","last_peered":"2024-05-27T12:32:42.389163+0000","last_clean":"2024-05-27T12:32:42.389163+0000","last_became_active":"2024-05-27T12:32:42.384270+0000","last_became_peered":"2024-05-27T12:32:42.384270+0000","last_unstale":"2024-05-27T12:32:42.389163+0000","last_undegraded":"2024-05-27T12:32:42.389163+0000","last_fullsized":"2024-05-27T12:32:42.389163+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:53:37.721445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.389204+0000","last_change":"2024-05-27T12:32:42.385206+0000","last_active":"2024-05-27T12:32:42.389204+0000","last_peered":"2024-05-27T12:32:42.389204+0000","last_clean":"2024-05-27T12:32:42.389204+0000","last_became_active":"2024-05-27T12:32:42.384940+0000","last_became_peered":"2024-05-27T12:32:42.384940+0000","last_unstale":"2024-05-27T12:32:42.389204+0000","last_undegraded":"2024-05-27T12:32:42.389204+0000","last_fullsized":"2024-05-27T12:32:42.389204+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:08:37.481605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.378903+0000","last_change":"2024-05-27T12:32:42.376596+0000","last_active":"2024-05-27T12:32:42.378903+0000","last_peered":"2024-05-27T12:32:42.378903+0000","last_clean":"2024-05-27T12:32:42.378903+0000","last_became_active":"2024-05-27T12:32:42.376147+0000","last_became_peered":"2024-05-27T12:32:42.376147+0000","last_unstale":"2024-05-27T12:32:42.378903+0000","last_undegraded":"2024-05-27T12:32:42.378903+0000","last_fullsized":"2024-05-27T12:32:42.378903+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T23:55:02.398885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.377139+0000","last_change":"2024-05-27T12:32:42.375358+0000","last_active":"2024-05-27T12:32:42.377139+0000","last_peered":"2024-05-27T12:32:42.377139+0000","last_clean":"2024-05-27T12:32:42.377139+0000","last_became_active":"2024-05-27T12:32:42.375096+0000","last_became_peered":"2024-05-27T12:32:42.375096+0000","last_unstale":"2024-05-27T12:32:42.377139+0000","last_undegraded":"2024-05-27T12:32:42.377139+0000","last_fullsized":"2024-05-27T12:32:42.377139+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:20:05.304417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-27T12:32:41.356707+0000","last_change":"2024-05-27T12:32:41.356707+0000","last_active":"2024-05-27T12:32:41.333908+0000","last_peered":"2024-05-27T12:32:41.333908+0000","last_clean":"2024-05-27T12:32:41.333908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T12:32:41.356707+0000","last_undegraded":"2024-05-27T12:32:41.356707+0000","last_fullsized":"2024-05-27T12:32:41.356707+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.378127+0000","last_change":"2024-05-27T12:32:42.376055+0000","last_active":"2024-05-27T12:32:42.378127+0000","last_peered":"2024-05-27T12:32:42.378127+0000","last_clean":"2024-05-27T12:32:42.378127+0000","last_became_active":"2024-05-27T12:32:42.374091+0000","last_became_peered":"2024-05-27T12:32:42.374091+0000","last_unstale":"2024-05-27T12:32:42.378127+0000","last_undegraded":"2024-05-27T12:32:42.378127+0000","last_fullsized":"2024-05-27T12:32:42.378127+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:45:14.026270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.390013+0000","last_change":"2024-05-27T12:32:42.387113+0000","last_active":"2024-05-27T12:32:42.390013+0000","last_peered":"2024-05-27T12:32:42.390013+0000","last_clean":"2024-05-27T12:32:42.390013+0000","last_became_active":"2024-05-27T12:32:42.386810+0000","last_became_peered":"2024-05-27T12:32:42.386810+0000","last_unstale":"2024-05-27T12:32:42.390013+0000","last_undegraded":"2024-05-27T12:32:42.390013+0000","last_fullsized":"2024-05-27T12:32:42.390013+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:41:35.310708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.389296+0000","last_change":"2024-05-27T12:32:42.383993+0000","last_active":"2024-05-27T12:32:42.389296+0000","last_peered":"2024-05-27T12:32:42.389296+0000","last_clean":"2024-05-27T12:32:42.389296+0000","last_became_active":"2024-05-27T12:32:42.383274+0000","last_became_peered":"2024-05-27T12:32:42.383274+0000","last_unstale":"2024-05-27T12:32:42.389296+0000","last_undegraded":"2024-05-27T12:32:42.389296+0000","last_fullsized":"2024-05-27T12:32:42.389296+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:45:14.026270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.381322+0000","last_change":"2024-05-27T12:32:42.376831+0000","last_active":"2024-05-27T12:32:42.381322+0000","last_peered":"2024-05-27T12:32:42.381322+0000","last_clean":"2024-05-27T12:32:42.381322+0000","last_became_active":"2024-05-27T12:32:42.376498+0000","last_became_peered":"2024-05-27T12:32:42.376498+0000","last_unstale":"2024-05-27T12:32:42.381322+0000","last_undegraded":"2024-05-27T12:32:42.381322+0000","last_fullsized":"2024-05-27T12:32:42.381322+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:31:53.377015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.373560+0000","last_change":"2024-05-27T12:32:42.366751+0000","last_active":"2024-05-27T12:32:42.373560+0000","last_peered":"2024-05-27T12:32:42.373560+0000","last_clean":"2024-05-27T12:32:42.373560+0000","last_became_active":"2024-05-27T12:32:42.366438+0000","last_became_peered":"2024-05-27T12:32:42.366438+0000","last_unstale":"2024-05-27T12:32:42.373560+0000","last_undegraded":"2024-05-27T12:32:42.373560+0000","last_fullsized":"2024-05-27T12:32:42.373560+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:08:37.481605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.373449+0000","last_change":"2024-05-27T12:32:42.370650+0000","last_active":"2024-05-27T12:32:42.373449+0000","last_peered":"2024-05-27T12:32:42.373449+0000","last_clean":"2024-05-27T12:32:42.373449+0000","last_became_active":"2024-05-27T12:32:42.370319+0000","last_became_peered":"2024-05-27T12:32:42.370319+0000","last_unstale":"2024-05-27T12:32:42.373449+0000","last_undegraded":"2024-05-27T12:32:42.373449+0000","last_fullsized":"2024-05-27T12:32:42.373449+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:07:22.262394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-27T12:32:41.357829+0000","last_change":"2024-05-27T12:32:41.357829+0000","last_active":"2024-05-27T12:32:41.333908+0000","last_peered":"2024-05-27T12:32:41.333908+0000","last_clean":"2024-05-27T12:32:41.333908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T12:32:41.357829+0000","last_undegraded":"2024-05-27T12:32:41.357829+0000","last_fullsized":"2024-05-27T12:32:41.357829+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.386644+0000","last_change":"2024-05-27T12:32:42.383033+0000","last_active":"2024-05-27T12:32:42.386644+0000","last_peered":"2024-05-27T12:32:42.386644+0000","last_clean":"2024-05-27T12:32:42.386644+0000","last_became_active":"2024-05-27T12:32:42.382745+0000","last_became_peered":"2024-05-27T12:32:42.382745+0000","last_unstale":"2024-05-27T12:32:42.386644+0000","last_undegraded":"2024-05-27T12:32:42.386644+0000","last_fullsized":"2024-05-27T12:32:42.386644+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:21:04.918457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.380985+0000","last_change":"2024-05-27T12:32:42.378742+0000","last_active":"2024-05-27T12:32:42.380985+0000","last_peered":"2024-05-27T12:32:42.380985+0000","last_clean":"2024-05-27T12:32:42.380985+0000","last_became_active":"2024-05-27T12:32:42.378328+0000","last_became_peered":"2024-05-27T12:32:42.378328+0000","last_unstale":"2024-05-27T12:32:42.380985+0000","last_undegraded":"2024-05-27T12:32:42.380985+0000","last_fullsized":"2024-05-27T12:32:42.380985+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:21:04.918457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.386591+0000","last_change":"2024-05-27T12:32:42.381867+0000","last_active":"2024-05-27T12:32:42.386591+0000","last_peered":"2024-05-27T12:32:42.386591+0000","last_clean":"2024-05-27T12:32:42.386591+0000","last_became_active":"2024-05-27T12:32:42.381591+0000","last_became_peered":"2024-05-27T12:32:42.381591+0000","last_unstale":"2024-05-27T12:32:42.386591+0000","last_undegraded":"2024-05-27T12:32:42.386591+0000","last_fullsized":"2024-05-27T12:32:42.386591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:07:22.262394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.373759+0000","last_change":"2024-05-27T12:32:42.372176+0000","last_active":"2024-05-27T12:32:42.373759+0000","last_peered":"2024-05-27T12:32:42.373759+0000","last_clean":"2024-05-27T12:32:42.373759+0000","last_became_active":"2024-05-27T12:32:42.371874+0000","last_became_peered":"2024-05-27T12:32:42.371874+0000","last_unstale":"2024-05-27T12:32:42.373759+0000","last_undegraded":"2024-05-27T12:32:42.373759+0000","last_fullsized":"2024-05-27T12:32:42.373759+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:10:30.753626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.375586+0000","last_change":"2024-05-27T12:32:42.374766+0000","last_active":"2024-05-27T12:32:42.375586+0000","last_peered":"2024-05-27T12:32:42.375586+0000","last_clean":"2024-05-27T12:32:42.375586+0000","last_became_active":"2024-05-27T12:32:42.374450+0000","last_became_peered":"2024-05-27T12:32:42.374450+0000","last_unstale":"2024-05-27T12:32:42.375586+0000","last_undegraded":"2024-05-27T12:32:42.375586+0000","last_fullsized":"2024-05-27T12:32:42.375586+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:20:05.304417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.380262+0000","last_change":"2024-05-27T12:32:42.376636+0000","last_active":"2024-05-27T12:32:42.380262+0000","last_peered":"2024-05-27T12:32:42.380262+0000","last_clean":"2024-05-27T12:32:42.380262+0000","last_became_active":"2024-05-27T12:32:42.376364+0000","last_became_peered":"2024-05-27T12:32:42.376364+0000","last_unstale":"2024-05-27T12:32:42.380262+0000","last_undegraded":"2024-05-27T12:32:42.380262+0000","last_fullsized":"2024-05-27T12:32:42.380262+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:53:37.721445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.373632+0000","last_change":"2024-05-27T12:32:42.371595+0000","last_active":"2024-05-27T12:32:42.373632+0000","last_peered":"2024-05-27T12:32:42.373632+0000","last_clean":"2024-05-27T12:32:42.373632+0000","last_became_active":"2024-05-27T12:32:42.370375+0000","last_became_peered":"2024-05-27T12:32:42.370375+0000","last_unstale":"2024-05-27T12:32:42.373632+0000","last_undegraded":"2024-05-27T12:32:42.373632+0000","last_fullsized":"2024-05-27T12:32:42.373632+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T23:33:14.178019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-27T12:32:41.356437+0000","last_change":"2024-05-27T12:32:41.356437+0000","last_active":"2024-05-27T12:32:41.333908+0000","last_peered":"2024-05-27T12:32:41.333908+0000","last_clean":"2024-05-27T12:32:41.333908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T12:32:41.356437+0000","last_undegraded":"2024-05-27T12:32:41.356437+0000","last_fullsized":"2024-05-27T12:32:41.356437+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.389200+0000","last_change":"2024-05-27T12:32:42.384076+0000","last_active":"2024-05-27T12:32:42.389200+0000","last_peered":"2024-05-27T12:32:42.389200+0000","last_clean":"2024-05-27T12:32:42.389200+0000","last_became_active":"2024-05-27T12:32:42.383738+0000","last_became_peered":"2024-05-27T12:32:42.383738+0000","last_unstale":"2024-05-27T12:32:42.389200+0000","last_undegraded":"2024-05-27T12:32:42.389200+0000","last_fullsized":"2024-05-27T12:32:42.389200+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:53:37.721445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.382747+0000","last_change":"2024-05-27T12:32:42.379700+0000","last_active":"2024-05-27T12:32:42.382747+0000","last_peered":"2024-05-27T12:32:42.382747+0000","last_clean":"2024-05-27T12:32:42.382747+0000","last_became_active":"2024-05-27T12:32:42.379421+0000","last_became_peered":"2024-05-27T12:32:42.379421+0000","last_unstale":"2024-05-27T12:32:42.382747+0000","last_undegraded":"2024-05-27T12:32:42.382747+0000","last_fullsized":"2024-05-27T12:32:42.382747+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T23:33:14.178019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.383554+0000","last_change":"2024-05-27T12:32:42.379719+0000","last_active":"2024-05-27T12:32:42.383554+0000","last_peered":"2024-05-27T12:32:42.383554+0000","last_clean":"2024-05-27T12:32:42.383554+0000","last_became_active":"2024-05-27T12:32:42.379234+0000","last_became_peered":"2024-05-27T12:32:42.379234+0000","last_unstale":"2024-05-27T12:32:42.383554+0000","last_undegraded":"2024-05-27T12:32:42.383554+0000","last_fullsized":"2024-05-27T12:32:42.383554+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:45:14.026270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.375714+0000","last_change":"2024-05-27T12:32:42.371233+0000","last_active":"2024-05-27T12:32:42.375714+0000","last_peered":"2024-05-27T12:32:42.375714+0000","last_clean":"2024-05-27T12:32:42.375714+0000","last_became_active":"2024-05-27T12:32:42.370965+0000","last_became_peered":"2024-05-27T12:32:42.370965+0000","last_unstale":"2024-05-27T12:32:42.375714+0000","last_undegraded":"2024-05-27T12:32:42.375714+0000","last_fullsized":"2024-05-27T12:32:42.375714+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:29:16.389055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.379340+0000","last_change":"2024-05-27T12:32:41.365100+0000","last_active":"2024-05-27T12:32:42.379340+0000","last_peered":"2024-05-27T12:32:42.379340+0000","last_clean":"2024-05-27T12:32:42.379340+0000","last_became_active":"2024-05-27T12:32:41.364795+0000","last_became_peered":"2024-05-27T12:32:41.364795+0000","last_unstale":"2024-05-27T12:32:42.379340+0000","last_undegraded":"2024-05-27T12:32:42.379340+0000","last_fullsized":"2024-05-27T12:32:42.379340+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:24:00.607915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-27T12:32:41.355572+0000","last_change":"2024-05-27T12:32:41.355572+0000","last_active":"2024-05-27T12:32:41.333908+0000","last_peered":"2024-05-27T12:32:41.333908+0000","last_clean":"2024-05-27T12:32:41.333908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T12:32:41.355572+0000","last_undegraded":"2024-05-27T12:32:41.355572+0000","last_fullsized":"2024-05-27T12:32:41.355572+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.381566+0000","last_change":"2024-05-27T12:32:41.370064+0000","last_active":"2024-05-27T12:32:42.381566+0000","last_peered":"2024-05-27T12:32:42.381566+0000","last_clean":"2024-05-27T12:32:42.381566+0000","last_became_active":"2024-05-27T12:32:41.368679+0000","last_became_peered":"2024-05-27T12:32:41.368679+0000","last_unstale":"2024-05-27T12:32:42.381566+0000","last_undegraded":"2024-05-27T12:32:42.381566+0000","last_fullsized":"2024-05-27T12:32:42.381566+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:31:52.368166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.357284+0000","last_change":"2024-05-27T12:32:41.369441+0000","last_active":"2024-05-27T12:32:42.357284+0000","last_peered":"2024-05-27T12:32:42.357284+0000","last_clean":"2024-05-27T12:32:42.357284+0000","last_became_active":"2024-05-27T12:32:41.369164+0000","last_became_peered":"2024-05-27T12:32:41.369164+0000","last_unstale":"2024-05-27T12:32:42.357284+0000","last_undegraded":"2024-05-27T12:32:42.357284+0000","last_fullsized":"2024-05-27T12:32:42.357284+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:10:55.375726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.383508+0000","last_change":"2024-05-27T12:32:42.381264+0000","last_active":"2024-05-27T12:32:42.383508+0000","last_peered":"2024-05-27T12:32:42.383508+0000","last_clean":"2024-05-27T12:32:42.383508+0000","last_became_active":"2024-05-27T12:32:42.380823+0000","last_became_peered":"2024-05-27T12:32:42.380823+0000","last_unstale":"2024-05-27T12:32:42.383508+0000","last_undegraded":"2024-05-27T12:32:42.383508+0000","last_fullsized":"2024-05-27T12:32:42.383508+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:45:14.026270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.378088+0000","last_change":"2024-05-27T12:32:41.371539+0000","last_active":"2024-05-27T12:32:42.378088+0000","last_peered":"2024-05-27T12:32:42.378088+0000","last_clean":"2024-05-27T12:32:42.378088+0000","last_became_active":"2024-05-27T12:32:41.370827+0000","last_became_peered":"2024-05-27T12:32:41.370827+0000","last_unstale":"2024-05-27T12:32:42.378088+0000","last_undegraded":"2024-05-27T12:32:42.378088+0000","last_fullsized":"2024-05-27T12:32:42.378088+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T23:34:58.092780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.376399+0000","last_change":"2024-05-27T12:32:42.371446+0000","last_active":"2024-05-27T12:32:42.376399+0000","last_peered":"2024-05-27T12:32:42.376399+0000","last_clean":"2024-05-27T12:32:42.376399+0000","last_became_active":"2024-05-27T12:32:42.371197+0000","last_became_peered":"2024-05-27T12:32:42.371197+0000","last_unstale":"2024-05-27T12:32:42.376399+0000","last_undegraded":"2024-05-27T12:32:42.376399+0000","last_fullsized":"2024-05-27T12:32:42.376399+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:21:04.918457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.366123+0000","last_change":"2024-05-27T12:32:41.374793+0000","last_active":"2024-05-27T12:32:42.366123+0000","last_peered":"2024-05-27T12:32:42.366123+0000","last_clean":"2024-05-27T12:32:42.366123+0000","last_became_active":"2024-05-27T12:32:41.374503+0000","last_became_peered":"2024-05-27T12:32:41.374503+0000","last_unstale":"2024-05-27T12:32:42.366123+0000","last_undegraded":"2024-05-27T12:32:42.366123+0000","last_fullsized":"2024-05-27T12:32:42.366123+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T23:33:13.169169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.386679+0000","last_change":"2024-05-27T12:32:42.382592+0000","last_active":"2024-05-27T12:32:42.386679+0000","last_peered":"2024-05-27T12:32:42.386679+0000","last_clean":"2024-05-27T12:32:42.386679+0000","last_became_active":"2024-05-27T12:32:42.382289+0000","last_became_peered":"2024-05-27T12:32:42.382289+0000","last_unstale":"2024-05-27T12:32:42.386679+0000","last_undegraded":"2024-05-27T12:32:42.386679+0000","last_fullsized":"2024-05-27T12:32:42.386679+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:20:05.304417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.369228+0000","last_change":"2024-05-27T12:32:41.370517+0000","last_active":"2024-05-27T12:32:42.369228+0000","last_peered":"2024-05-27T12:32:42.369228+0000","last_clean":"2024-05-27T12:32:42.369228+0000","last_became_active":"2024-05-27T12:32:41.370216+0000","last_became_peered":"2024-05-27T12:32:41.370216+0000","last_unstale":"2024-05-27T12:32:42.369228+0000","last_undegraded":"2024-05-27T12:32:42.369228+0000","last_fullsized":"2024-05-27T12:32:42.369228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:24:00.607915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-27T12:32:41.355055+0000","last_change":"2024-05-27T12:32:41.355055+0000","last_active":"2024-05-27T12:32:41.333908+0000","last_peered":"2024-05-27T12:32:41.333908+0000","last_clean":"2024-05-27T12:32:41.333908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T12:32:41.355055+0000","last_undegraded":"2024-05-27T12:32:41.355055+0000","last_fullsized":"2024-05-27T12:32:41.355055+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.385260+0000","last_change":"2024-05-27T12:32:41.373060+0000","last_active":"2024-05-27T12:32:42.385260+0000","last_peered":"2024-05-27T12:32:42.385260+0000","last_clean":"2024-05-27T12:32:42.385260+0000","last_became_active":"2024-05-27T12:32:41.372729+0000","last_became_peered":"2024-05-27T12:32:41.372729+0000","last_unstale":"2024-05-27T12:32:42.385260+0000","last_undegraded":"2024-05-27T12:32:42.385260+0000","last_fullsized":"2024-05-27T12:32:42.385260+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T23:34:58.092780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.369547+0000","last_change":"2024-05-27T12:32:42.368863+0000","last_active":"2024-05-27T12:32:42.369547+0000","last_peered":"2024-05-27T12:32:42.369547+0000","last_clean":"2024-05-27T12:32:42.369547+0000","last_became_active":"2024-05-27T12:32:42.368593+0000","last_became_peered":"2024-05-27T12:32:42.368593+0000","last_unstale":"2024-05-27T12:32:42.369547+0000","last_undegraded":"2024-05-27T12:32:42.369547+0000","last_fullsized":"2024-05-27T12:32:42.369547+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:17:15.780477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"22'6","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.389628+0000","last_change":"2024-05-27T12:32:41.369617+0000","last_active":"2024-05-27T12:32:42.389628+0000","last_peered":"2024-05-27T12:32:42.389628+0000","last_clean":"2024-05-27T12:32:42.389628+0000","last_became_active":"2024-05-27T12:32:41.369371+0000","last_became_peered":"2024-05-27T12:32:41.369371+0000","last_unstale":"2024-05-27T12:32:42.389628+0000","last_undegraded":"2024-05-27T12:32:42.389628+0000","last_fullsized":"2024-05-27T12:32:42.389628+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:24:00.607915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.365054+0000","last_change":"2024-05-27T12:32:42.362804+0000","last_active":"2024-05-27T12:32:42.365054+0000","last_peered":"2024-05-27T12:32:42.365054+0000","last_clean":"2024-05-27T12:32:42.365054+0000","last_became_active":"2024-05-27T12:32:42.362483+0000","last_became_peered":"2024-05-27T12:32:42.362483+0000","last_unstale":"2024-05-27T12:32:42.365054+0000","last_undegraded":"2024-05-27T12:32:42.365054+0000","last_fullsized":"2024-05-27T12:32:42.365054+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:53:37.721445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-27T12:32:41.369052+0000","last_change":"2024-05-27T12:32:41.365663+0000","last_active":"2024-05-27T12:32:41.369052+0000","last_peered":"2024-05-27T12:32:41.369052+0000","last_clean":"2024-05-27T12:32:41.369052+0000","last_became_active":"2024-05-27T12:32:41.365362+0000","last_became_peered":"2024-05-27T12:32:41.365362+0000","last_unstale":"2024-05-27T12:32:41.369052+0000","last_undegraded":"2024-05-27T12:32:41.369052+0000","last_fullsized":"2024-05-27T12:32:41.369052+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:56:40.549127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-27T12:32:41.355128+0000","last_change":"2024-05-27T12:32:41.355128+0000","last_active":"2024-05-27T12:32:41.333908+0000","last_peered":"2024-05-27T12:32:41.333908+0000","last_clean":"2024-05-27T12:32:41.333908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T12:32:41.355128+0000","last_undegraded":"2024-05-27T12:32:41.355128+0000","last_fullsized":"2024-05-27T12:32:41.355128+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.378054+0000","last_change":"2024-05-27T12:32:41.371087+0000","last_active":"2024-05-27T12:32:42.378054+0000","last_peered":"2024-05-27T12:32:42.378054+0000","last_clean":"2024-05-27T12:32:42.378054+0000","last_became_active":"2024-05-27T12:32:41.370237+0000","last_became_peered":"2024-05-27T12:32:41.370237+0000","last_unstale":"2024-05-27T12:32:42.378054+0000","last_undegraded":"2024-05-27T12:32:42.378054+0000","last_fullsized":"2024-05-27T12:32:42.378054+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:31:52.368166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.374122+0000","last_change":"2024-05-27T12:32:42.371339+0000","last_active":"2024-05-27T12:32:42.374122+0000","last_peered":"2024-05-27T12:32:42.374122+0000","last_clean":"2024-05-27T12:32:42.374122+0000","last_became_active":"2024-05-27T12:32:42.370848+0000","last_became_peered":"2024-05-27T12:32:42.370848+0000","last_unstale":"2024-05-27T12:32:42.374122+0000","last_undegraded":"2024-05-27T12:32:42.374122+0000","last_fullsized":"2024-05-27T12:32:42.374122+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:41:35.310708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.360647+0000","last_change":"2024-05-27T12:32:41.368354+0000","last_active":"2024-05-27T12:32:42.360647+0000","last_peered":"2024-05-27T12:32:42.360647+0000","last_clean":"2024-05-27T12:32:42.360647+0000","last_became_active":"2024-05-27T12:32:41.368086+0000","last_became_peered":"2024-05-27T12:32:41.368086+0000","last_unstale":"2024-05-27T12:32:42.360647+0000","last_undegraded":"2024-05-27T12:32:42.360647+0000","last_fullsized":"2024-05-27T12:32:42.360647+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T23:55:01.390036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.383529+0000","last_change":"2024-05-27T12:32:42.379489+0000","last_active":"2024-05-27T12:32:42.383529+0000","last_peered":"2024-05-27T12:32:42.383529+0000","last_clean":"2024-05-27T12:32:42.383529+0000","last_became_active":"2024-05-27T12:32:42.378880+0000","last_became_peered":"2024-05-27T12:32:42.378880+0000","last_unstale":"2024-05-27T12:32:42.383529+0000","last_undegraded":"2024-05-27T12:32:42.383529+0000","last_fullsized":"2024-05-27T12:32:42.383529+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:21:04.918457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.385950+0000","last_change":"2024-05-27T12:32:41.362154+0000","last_active":"2024-05-27T12:32:42.385950+0000","last_peered":"2024-05-27T12:32:42.385950+0000","last_clean":"2024-05-27T12:32:42.385950+0000","last_became_active":"2024-05-27T12:32:41.361845+0000","last_became_peered":"2024-05-27T12:32:41.361845+0000","last_unstale":"2024-05-27T12:32:42.385950+0000","last_undegraded":"2024-05-27T12:32:42.385950+0000","last_fullsized":"2024-05-27T12:32:42.385950+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:10:55.375726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.383492+0000","last_change":"2024-05-27T12:32:42.378975+0000","last_active":"2024-05-27T12:32:42.383492+0000","last_peered":"2024-05-27T12:32:42.383492+0000","last_clean":"2024-05-27T12:32:42.383492+0000","last_became_active":"2024-05-27T12:32:42.378666+0000","last_became_peered":"2024-05-27T12:32:42.378666+0000","last_unstale":"2024-05-27T12:32:42.383492+0000","last_undegraded":"2024-05-27T12:32:42.383492+0000","last_fullsized":"2024-05-27T12:32:42.383492+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:46:07.761461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.386837+0000","last_change":"2024-05-27T12:32:41.363195+0000","last_active":"2024-05-27T12:32:42.386837+0000","last_peered":"2024-05-27T12:32:42.386837+0000","last_clean":"2024-05-27T12:32:42.386837+0000","last_became_active":"2024-05-27T12:32:41.362693+0000","last_became_peered":"2024-05-27T12:32:41.362693+0000","last_unstale":"2024-05-27T12:32:42.386837+0000","last_undegraded":"2024-05-27T12:32:42.386837+0000","last_fullsized":"2024-05-27T12:32:42.386837+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:10:55.375726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.372618+0000","last_change":"2024-05-27T12:32:42.370922+0000","last_active":"2024-05-27T12:32:42.372618+0000","last_peered":"2024-05-27T12:32:42.372618+0000","last_clean":"2024-05-27T12:32:42.372618+0000","last_became_active":"2024-05-27T12:32:42.370170+0000","last_became_peered":"2024-05-27T12:32:42.370170+0000","last_unstale":"2024-05-27T12:32:42.372618+0000","last_undegraded":"2024-05-27T12:32:42.372618+0000","last_fullsized":"2024-05-27T12:32:42.372618+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:46:59.701728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.381265+0000","last_change":"2024-05-27T12:32:41.366108+0000","last_active":"2024-05-27T12:32:42.381265+0000","last_peered":"2024-05-27T12:32:42.381265+0000","last_clean":"2024-05-27T12:32:42.381265+0000","last_became_active":"2024-05-27T12:32:41.365777+0000","last_became_peered":"2024-05-27T12:32:41.365777+0000","last_unstale":"2024-05-27T12:32:42.381265+0000","last_undegraded":"2024-05-27T12:32:42.381265+0000","last_fullsized":"2024-05-27T12:32:42.381265+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:24:00.607915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.378712+0000","last_change":"2024-05-27T12:32:42.374653+0000","last_active":"2024-05-27T12:32:42.378712+0000","last_peered":"2024-05-27T12:32:42.378712+0000","last_clean":"2024-05-27T12:32:42.378712+0000","last_became_active":"2024-05-27T12:32:42.370933+0000","last_became_peered":"2024-05-27T12:32:42.370933+0000","last_unstale":"2024-05-27T12:32:42.378712+0000","last_undegraded":"2024-05-27T12:32:42.378712+0000","last_fullsized":"2024-05-27T12:32:42.378712+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:17:24.104572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.376016+0000","last_change":"2024-05-27T12:32:41.366243+0000","last_active":"2024-05-27T12:32:42.376016+0000","last_peered":"2024-05-27T12:32:42.376016+0000","last_clean":"2024-05-27T12:32:42.376016+0000","last_became_active":"2024-05-27T12:32:41.365843+0000","last_became_peered":"2024-05-27T12:32:41.365843+0000","last_unstale":"2024-05-27T12:32:42.376016+0000","last_undegraded":"2024-05-27T12:32:42.376016+0000","last_fullsized":"2024-05-27T12:32:42.376016+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:31:52.368166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.389274+0000","last_change":"2024-05-27T12:32:42.384741+0000","last_active":"2024-05-27T12:32:42.389274+0000","last_peered":"2024-05-27T12:32:42.389274+0000","last_clean":"2024-05-27T12:32:42.389274+0000","last_became_active":"2024-05-27T12:32:42.383818+0000","last_became_peered":"2024-05-27T12:32:42.383818+0000","last_unstale":"2024-05-27T12:32:42.389274+0000","last_undegraded":"2024-05-27T12:32:42.389274+0000","last_fullsized":"2024-05-27T12:32:42.389274+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:04:04.818266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.358263+0000","last_change":"2024-05-27T12:32:41.374511+0000","last_active":"2024-05-27T12:32:42.358263+0000","last_peered":"2024-05-27T12:32:42.358263+0000","last_clean":"2024-05-27T12:32:42.358263+0000","last_became_active":"2024-05-27T12:32:41.374221+0000","last_became_peered":"2024-05-27T12:32:41.374221+0000","last_unstale":"2024-05-27T12:32:42.358263+0000","last_undegraded":"2024-05-27T12:32:42.358263+0000","last_fullsized":"2024-05-27T12:32:42.358263+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T23:34:58.092780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.389356+0000","last_change":"2024-05-27T12:32:42.384647+0000","last_active":"2024-05-27T12:32:42.389356+0000","last_peered":"2024-05-27T12:32:42.389356+0000","last_clean":"2024-05-27T12:32:42.389356+0000","last_became_active":"2024-05-27T12:32:42.384389+0000","last_became_peered":"2024-05-27T12:32:42.384389+0000","last_unstale":"2024-05-27T12:32:42.389356+0000","last_undegraded":"2024-05-27T12:32:42.389356+0000","last_fullsized":"2024-05-27T12:32:42.389356+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:03:50.593154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":168,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.355803+0000","last_change":"2024-05-27T12:32:31.185664+0000","last_active":"2024-05-27T12:32:42.355803+0000","last_peered":"2024-05-27T12:32:42.355803+0000","last_clean":"2024-05-27T12:32:42.355803+0000","last_became_active":"2024-05-27T12:32:31.184757+0000","last_became_peered":"2024-05-27T12:32:31.184757+0000","last_unstale":"2024-05-27T12:32:42.355803+0000","last_undegraded":"2024-05-27T12:32:42.355803+0000","last_fullsized":"2024-05-27T12:32:42.355803+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:30.136480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:30.136480+0000","last_clean_scrub_stamp":"2024-05-27T12:32:30.136480+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:49:13.241747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.367240+0000","last_change":"2024-05-27T12:32:41.371475+0000","last_active":"2024-05-27T12:32:42.367240+0000","last_peered":"2024-05-27T12:32:42.367240+0000","last_clean":"2024-05-27T12:32:42.367240+0000","last_became_active":"2024-05-27T12:32:41.371198+0000","last_became_peered":"2024-05-27T12:32:41.371198+0000","last_unstale":"2024-05-27T12:32:42.367240+0000","last_undegraded":"2024-05-27T12:32:42.367240+0000","last_fullsized":"2024-05-27T12:32:42.367240+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T23:55:01.390036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.386892+0000","last_change":"2024-05-27T12:32:42.385699+0000","last_active":"2024-05-27T12:32:42.386892+0000","last_peered":"2024-05-27T12:32:42.386892+0000","last_clean":"2024-05-27T12:32:42.386892+0000","last_became_active":"2024-05-27T12:32:42.385464+0000","last_became_peered":"2024-05-27T12:32:42.385464+0000","last_unstale":"2024-05-27T12:32:42.386892+0000","last_undegraded":"2024-05-27T12:32:42.386892+0000","last_fullsized":"2024-05-27T12:32:42.386892+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:04:04.818266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.356248+0000","last_change":"2024-05-27T12:32:41.371263+0000","last_active":"2024-05-27T12:32:42.356248+0000","last_peered":"2024-05-27T12:32:42.356248+0000","last_clean":"2024-05-27T12:32:42.356248+0000","last_became_active":"2024-05-27T12:32:41.370961+0000","last_became_peered":"2024-05-27T12:32:41.370961+0000","last_unstale":"2024-05-27T12:32:42.356248+0000","last_undegraded":"2024-05-27T12:32:42.356248+0000","last_fullsized":"2024-05-27T12:32:42.356248+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:07:21.253545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-27T12:32:41.355359+0000","last_change":"2024-05-27T12:32:41.355359+0000","last_active":"2024-05-27T12:32:41.333908+0000","last_peered":"2024-05-27T12:32:41.333908+0000","last_clean":"2024-05-27T12:32:41.333908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T12:32:41.355359+0000","last_undegraded":"2024-05-27T12:32:41.355359+0000","last_fullsized":"2024-05-27T12:32:41.355359+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.357960+0000","last_change":"2024-05-27T12:32:41.366189+0000","last_active":"2024-05-27T12:32:42.357960+0000","last_peered":"2024-05-27T12:32:42.357960+0000","last_clean":"2024-05-27T12:32:42.357960+0000","last_became_active":"2024-05-27T12:32:41.365860+0000","last_became_peered":"2024-05-27T12:32:41.365860+0000","last_unstale":"2024-05-27T12:32:42.357960+0000","last_undegraded":"2024-05-27T12:32:42.357960+0000","last_fullsized":"2024-05-27T12:32:42.357960+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T23:55:01.390036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.375838+0000","last_change":"2024-05-27T12:32:42.370436+0000","last_active":"2024-05-27T12:32:42.375838+0000","last_peered":"2024-05-27T12:32:42.375838+0000","last_clean":"2024-05-27T12:32:42.375838+0000","last_became_active":"2024-05-27T12:32:42.370051+0000","last_became_peered":"2024-05-27T12:32:42.370051+0000","last_unstale":"2024-05-27T12:32:42.375838+0000","last_undegraded":"2024-05-27T12:32:42.375838+0000","last_fullsized":"2024-05-27T12:32:42.375838+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:10:30.753626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.378150+0000","last_change":"2024-05-27T12:32:41.368242+0000","last_active":"2024-05-27T12:32:42.378150+0000","last_peered":"2024-05-27T12:32:42.378150+0000","last_clean":"2024-05-27T12:32:42.378150+0000","last_became_active":"2024-05-27T12:32:41.366995+0000","last_became_peered":"2024-05-27T12:32:41.366995+0000","last_unstale":"2024-05-27T12:32:42.378150+0000","last_undegraded":"2024-05-27T12:32:42.378150+0000","last_fullsized":"2024-05-27T12:32:42.378150+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T23:33:13.169169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.389268+0000","last_change":"2024-05-27T12:32:42.382859+0000","last_active":"2024-05-27T12:32:42.389268+0000","last_peered":"2024-05-27T12:32:42.389268+0000","last_clean":"2024-05-27T12:32:42.389268+0000","last_became_active":"2024-05-27T12:32:42.382312+0000","last_became_peered":"2024-05-27T12:32:42.382312+0000","last_unstale":"2024-05-27T12:32:42.389268+0000","last_undegraded":"2024-05-27T12:32:42.389268+0000","last_fullsized":"2024-05-27T12:32:42.389268+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:24:01.616764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.366276+0000","last_change":"2024-05-27T12:32:41.362976+0000","last_active":"2024-05-27T12:32:42.366276+0000","last_peered":"2024-05-27T12:32:42.366276+0000","last_clean":"2024-05-27T12:32:42.366276+0000","last_became_active":"2024-05-27T12:32:41.362645+0000","last_became_peered":"2024-05-27T12:32:41.362645+0000","last_unstale":"2024-05-27T12:32:42.366276+0000","last_undegraded":"2024-05-27T12:32:42.366276+0000","last_fullsized":"2024-05-27T12:32:42.366276+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T23:55:01.390036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.386721+0000","last_change":"2024-05-27T12:32:42.382156+0000","last_active":"2024-05-27T12:32:42.386721+0000","last_peered":"2024-05-27T12:32:42.386721+0000","last_clean":"2024-05-27T12:32:42.386721+0000","last_became_active":"2024-05-27T12:32:42.381678+0000","last_became_peered":"2024-05-27T12:32:42.381678+0000","last_unstale":"2024-05-27T12:32:42.386721+0000","last_undegraded":"2024-05-27T12:32:42.386721+0000","last_fullsized":"2024-05-27T12:32:42.386721+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:10:30.753626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.357204+0000","last_change":"2024-05-27T12:32:41.371270+0000","last_active":"2024-05-27T12:32:42.357204+0000","last_peered":"2024-05-27T12:32:42.357204+0000","last_clean":"2024-05-27T12:32:42.357204+0000","last_became_active":"2024-05-27T12:32:41.370665+0000","last_became_peered":"2024-05-27T12:32:41.370665+0000","last_unstale":"2024-05-27T12:32:42.357204+0000","last_undegraded":"2024-05-27T12:32:42.357204+0000","last_fullsized":"2024-05-27T12:32:42.357204+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:45:13.017421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.375875+0000","last_change":"2024-05-27T12:32:42.371153+0000","last_active":"2024-05-27T12:32:42.375875+0000","last_peered":"2024-05-27T12:32:42.375875+0000","last_clean":"2024-05-27T12:32:42.375875+0000","last_became_active":"2024-05-27T12:32:42.370862+0000","last_became_peered":"2024-05-27T12:32:42.370862+0000","last_unstale":"2024-05-27T12:32:42.375875+0000","last_undegraded":"2024-05-27T12:32:42.375875+0000","last_fullsized":"2024-05-27T12:32:42.375875+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:20:05.304417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.368179+0000","last_change":"2024-05-27T12:32:41.368774+0000","last_active":"2024-05-27T12:32:42.368179+0000","last_peered":"2024-05-27T12:32:42.368179+0000","last_clean":"2024-05-27T12:32:42.368179+0000","last_became_active":"2024-05-27T12:32:41.368343+0000","last_became_peered":"2024-05-27T12:32:41.368343+0000","last_unstale":"2024-05-27T12:32:42.368179+0000","last_undegraded":"2024-05-27T12:32:42.368179+0000","last_fullsized":"2024-05-27T12:32:42.368179+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:07:21.253545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.365718+0000","last_change":"2024-05-27T12:32:42.361807+0000","last_active":"2024-05-27T12:32:42.365718+0000","last_peered":"2024-05-27T12:32:42.365718+0000","last_clean":"2024-05-27T12:32:42.365718+0000","last_became_active":"2024-05-27T12:32:42.361508+0000","last_became_peered":"2024-05-27T12:32:42.361508+0000","last_unstale":"2024-05-27T12:32:42.365718+0000","last_undegraded":"2024-05-27T12:32:42.365718+0000","last_fullsized":"2024-05-27T12:32:42.365718+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T23:34:59.101630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.382030+0000","last_change":"2024-05-27T12:32:41.368907+0000","last_active":"2024-05-27T12:32:42.382030+0000","last_peered":"2024-05-27T12:32:42.382030+0000","last_clean":"2024-05-27T12:32:42.382030+0000","last_became_active":"2024-05-27T12:32:41.368392+0000","last_became_peered":"2024-05-27T12:32:41.368392+0000","last_unstale":"2024-05-27T12:32:42.382030+0000","last_undegraded":"2024-05-27T12:32:42.382030+0000","last_fullsized":"2024-05-27T12:32:42.382030+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T23:34:58.092780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-27T12:32:41.355247+0000","last_change":"2024-05-27T12:32:41.355247+0000","last_active":"2024-05-27T12:32:41.333908+0000","last_peered":"2024-05-27T12:32:41.333908+0000","last_clean":"2024-05-27T12:32:41.333908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T12:32:41.355247+0000","last_undegraded":"2024-05-27T12:32:41.355247+0000","last_fullsized":"2024-05-27T12:32:41.355247+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.355748+0000","last_change":"2024-05-27T12:32:41.369723+0000","last_active":"2024-05-27T12:32:42.355748+0000","last_peered":"2024-05-27T12:32:42.355748+0000","last_clean":"2024-05-27T12:32:42.355748+0000","last_became_active":"2024-05-27T12:32:41.369404+0000","last_became_peered":"2024-05-27T12:32:41.369404+0000","last_unstale":"2024-05-27T12:32:42.355748+0000","last_undegraded":"2024-05-27T12:32:42.355748+0000","last_fullsized":"2024-05-27T12:32:42.355748+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T23:33:13.169169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.377750+0000","last_change":"2024-05-27T12:32:42.371958+0000","last_active":"2024-05-27T12:32:42.377750+0000","last_peered":"2024-05-27T12:32:42.377750+0000","last_clean":"2024-05-27T12:32:42.377750+0000","last_became_active":"2024-05-27T12:32:42.371689+0000","last_became_peered":"2024-05-27T12:32:42.371689+0000","last_unstale":"2024-05-27T12:32:42.377750+0000","last_undegraded":"2024-05-27T12:32:42.377750+0000","last_fullsized":"2024-05-27T12:32:42.377750+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:41:36.904875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.367113+0000","last_change":"2024-05-27T12:32:41.367208+0000","last_active":"2024-05-27T12:32:42.367113+0000","last_peered":"2024-05-27T12:32:42.367113+0000","last_clean":"2024-05-27T12:32:42.367113+0000","last_became_active":"2024-05-27T12:32:41.366772+0000","last_became_peered":"2024-05-27T12:32:41.366772+0000","last_unstale":"2024-05-27T12:32:42.367113+0000","last_undegraded":"2024-05-27T12:32:42.367113+0000","last_fullsized":"2024-05-27T12:32:42.367113+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T23:33:13.169169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.373596+0000","last_change":"2024-05-27T12:32:42.371618+0000","last_active":"2024-05-27T12:32:42.373596+0000","last_peered":"2024-05-27T12:32:42.373596+0000","last_clean":"2024-05-27T12:32:42.373596+0000","last_became_active":"2024-05-27T12:32:42.369525+0000","last_became_peered":"2024-05-27T12:32:42.369525+0000","last_unstale":"2024-05-27T12:32:42.373596+0000","last_undegraded":"2024-05-27T12:32:42.373596+0000","last_fullsized":"2024-05-27T12:32:42.373596+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:07:22.262394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.366697+0000","last_change":"2024-05-27T12:32:41.366388+0000","last_active":"2024-05-27T12:32:42.366697+0000","last_peered":"2024-05-27T12:32:42.366697+0000","last_clean":"2024-05-27T12:32:42.366697+0000","last_became_active":"2024-05-27T12:32:41.365881+0000","last_became_peered":"2024-05-27T12:32:41.365881+0000","last_unstale":"2024-05-27T12:32:42.366697+0000","last_undegraded":"2024-05-27T12:32:42.366697+0000","last_fullsized":"2024-05-27T12:32:42.366697+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:24:00.607915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.384844+0000","last_change":"2024-05-27T12:32:42.383798+0000","last_active":"2024-05-27T12:32:42.384844+0000","last_peered":"2024-05-27T12:32:42.384844+0000","last_clean":"2024-05-27T12:32:42.384844+0000","last_became_active":"2024-05-27T12:32:42.383431+0000","last_became_peered":"2024-05-27T12:32:42.383431+0000","last_unstale":"2024-05-27T12:32:42.384844+0000","last_undegraded":"2024-05-27T12:32:42.384844+0000","last_fullsized":"2024-05-27T12:32:42.384844+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:53:37.721445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.386769+0000","last_change":"2024-05-27T12:32:41.373716+0000","last_active":"2024-05-27T12:32:42.386769+0000","last_peered":"2024-05-27T12:32:42.386769+0000","last_clean":"2024-05-27T12:32:42.386769+0000","last_became_active":"2024-05-27T12:32:41.373364+0000","last_became_peered":"2024-05-27T12:32:41.373364+0000","last_unstale":"2024-05-27T12:32:42.386769+0000","last_undegraded":"2024-05-27T12:32:42.386769+0000","last_fullsized":"2024-05-27T12:32:42.386769+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:21:03.909608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.372702+0000","last_change":"2024-05-27T12:32:42.370445+0000","last_active":"2024-05-27T12:32:42.372702+0000","last_peered":"2024-05-27T12:32:42.372702+0000","last_clean":"2024-05-27T12:32:42.372702+0000","last_became_active":"2024-05-27T12:32:42.370164+0000","last_became_peered":"2024-05-27T12:32:42.370164+0000","last_unstale":"2024-05-27T12:32:42.372702+0000","last_undegraded":"2024-05-27T12:32:42.372702+0000","last_fullsized":"2024-05-27T12:32:42.372702+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:10:30.753626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.389983+0000","last_change":"2024-05-27T12:32:42.386589+0000","last_active":"2024-05-27T12:32:42.389983+0000","last_peered":"2024-05-27T12:32:42.389983+0000","last_clean":"2024-05-27T12:32:42.389983+0000","last_became_active":"2024-05-27T12:32:42.386297+0000","last_became_peered":"2024-05-27T12:32:42.386297+0000","last_unstale":"2024-05-27T12:32:42.389983+0000","last_undegraded":"2024-05-27T12:32:42.389983+0000","last_fullsized":"2024-05-27T12:32:42.389983+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:46:59.701728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.384700+0000","last_change":"2024-05-27T12:32:41.374812+0000","last_active":"2024-05-27T12:32:42.384700+0000","last_peered":"2024-05-27T12:32:42.384700+0000","last_clean":"2024-05-27T12:32:42.384700+0000","last_became_active":"2024-05-27T12:32:41.374488+0000","last_became_peered":"2024-05-27T12:32:41.374488+0000","last_unstale":"2024-05-27T12:32:42.384700+0000","last_undegraded":"2024-05-27T12:32:42.384700+0000","last_fullsized":"2024-05-27T12:32:42.384700+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:10:29.744776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.393996+0000","last_change":"2024-05-27T12:32:42.389941+0000","last_active":"2024-05-27T12:32:42.393996+0000","last_peered":"2024-05-27T12:32:42.393996+0000","last_clean":"2024-05-27T12:32:42.393996+0000","last_became_active":"2024-05-27T12:32:42.389630+0000","last_became_peered":"2024-05-27T12:32:42.389630+0000","last_unstale":"2024-05-27T12:32:42.393996+0000","last_undegraded":"2024-05-27T12:32:42.393996+0000","last_fullsized":"2024-05-27T12:32:42.393996+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:17:24.104572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.375424+0000","last_change":"2024-05-27T12:32:41.371373+0000","last_active":"2024-05-27T12:32:42.375424+0000","last_peered":"2024-05-27T12:32:42.375424+0000","last_clean":"2024-05-27T12:32:42.375424+0000","last_became_active":"2024-05-27T12:32:41.371009+0000","last_became_peered":"2024-05-27T12:32:41.371009+0000","last_unstale":"2024-05-27T12:32:42.375424+0000","last_undegraded":"2024-05-27T12:32:42.375424+0000","last_fullsized":"2024-05-27T12:32:42.375424+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:20:04.295568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-27T12:32:41.357214+0000","last_change":"2024-05-27T12:32:41.357214+0000","last_active":"2024-05-27T12:32:41.333908+0000","last_peered":"2024-05-27T12:32:41.333908+0000","last_clean":"2024-05-27T12:32:41.333908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T12:32:41.357214+0000","last_undegraded":"2024-05-27T12:32:41.357214+0000","last_fullsized":"2024-05-27T12:32:41.357214+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.386157+0000","last_change":"2024-05-27T12:32:41.362828+0000","last_active":"2024-05-27T12:32:42.386157+0000","last_peered":"2024-05-27T12:32:42.386157+0000","last_clean":"2024-05-27T12:32:42.386157+0000","last_became_active":"2024-05-27T12:32:41.362526+0000","last_became_peered":"2024-05-27T12:32:41.362526+0000","last_unstale":"2024-05-27T12:32:42.386157+0000","last_undegraded":"2024-05-27T12:32:42.386157+0000","last_fullsized":"2024-05-27T12:32:42.386157+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T23:55:01.390036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.373006+0000","last_change":"2024-05-27T12:32:42.368191+0000","last_active":"2024-05-27T12:32:42.373006+0000","last_peered":"2024-05-27T12:32:42.373006+0000","last_clean":"2024-05-27T12:32:42.373006+0000","last_became_active":"2024-05-27T12:32:42.367914+0000","last_became_peered":"2024-05-27T12:32:42.367914+0000","last_unstale":"2024-05-27T12:32:42.373006+0000","last_undegraded":"2024-05-27T12:32:42.373006+0000","last_fullsized":"2024-05-27T12:32:42.373006+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:31:53.377015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-27T12:32:41.369794+0000","last_change":"2024-05-27T12:32:41.364608+0000","last_active":"2024-05-27T12:32:41.369794+0000","last_peered":"2024-05-27T12:32:41.369794+0000","last_clean":"2024-05-27T12:32:41.369794+0000","last_became_active":"2024-05-27T12:32:41.364245+0000","last_became_peered":"2024-05-27T12:32:41.364245+0000","last_unstale":"2024-05-27T12:32:41.369794+0000","last_undegraded":"2024-05-27T12:32:41.369794+0000","last_fullsized":"2024-05-27T12:32:41.369794+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:20:13.667380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1794,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":4182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32,"ondisk_log_size":32,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509445,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":819200,"data_stored":665605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509445,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":233472,"data_stored":76267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509445,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":225280,"data_stored":74745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509445,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":233472,"data_stored":74781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509445,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":233472,"data_stored":76267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509445,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31396,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340444,"statfs":{"total":96636764160,"available":96604614656,"internally_reserved":0,"allocated":221184,"data_stored":74655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":229376,"data_stored":74815,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542150,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31964,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339876,"statfs":{"total":96636764160,"available":96604033024,"internally_reserved":0,"allocated":802816,"data_stored":658248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-27T12:32:46.103 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3d is not active+clean 2024-05-27T12:32:46.103 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-05-27T12:32:41.357767+0000', 'last_change': '2024-05-27T12:32:41.357767+0000', 'last_active': '2024-05-27T12:32:41.333908+0000', 'last_peered': '2024-05-27T12:32:41.333908+0000', 'last_clean': '2024-05-27T12:32:41.333908+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T12:32:41.357767+0000', 'last_undegraded': '2024-05-27T12:32:41.357767+0000', 'last_fullsized': '2024-05-27T12:32:41.357767+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T12:32:41.333908+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T12:32:41.333908+0000', 'last_clean_scrub_stamp': '2024-05-27T12:32:41.333908+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-27T12:32:46.103 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.32 is not active+clean 2024-05-27T12:32:46.103 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-05-27T12:32:41.356707+0000', 'last_change': '2024-05-27T12:32:41.356707+0000', 'last_active': '2024-05-27T12:32:41.333908+0000', 'last_peered': '2024-05-27T12:32:41.333908+0000', 'last_clean': '2024-05-27T12:32:41.333908+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T12:32:41.356707+0000', 'last_undegraded': '2024-05-27T12:32:41.356707+0000', 'last_fullsized': '2024-05-27T12:32:41.356707+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T12:32:41.333908+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T12:32:41.333908+0000', 'last_clean_scrub_stamp': '2024-05-27T12:32:41.333908+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-27T12:32:46.103 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2b is not active+clean 2024-05-27T12:32:46.103 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-05-27T12:32:41.357829+0000', 'last_change': '2024-05-27T12:32:41.357829+0000', 'last_active': '2024-05-27T12:32:41.333908+0000', 'last_peered': '2024-05-27T12:32:41.333908+0000', 'last_clean': '2024-05-27T12:32:41.333908+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T12:32:41.357829+0000', 'last_undegraded': '2024-05-27T12:32:41.357829+0000', 'last_fullsized': '2024-05-27T12:32:41.357829+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T12:32:41.333908+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T12:32:41.333908+0000', 'last_clean_scrub_stamp': '2024-05-27T12:32:41.333908+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-27T12:32:46.103 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.23 is not active+clean 2024-05-27T12:32:46.104 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-05-27T12:32:41.356437+0000', 'last_change': '2024-05-27T12:32:41.356437+0000', 'last_active': '2024-05-27T12:32:41.333908+0000', 'last_peered': '2024-05-27T12:32:41.333908+0000', 'last_clean': '2024-05-27T12:32:41.333908+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T12:32:41.356437+0000', 'last_undegraded': '2024-05-27T12:32:41.356437+0000', 'last_fullsized': '2024-05-27T12:32:41.356437+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T12:32:41.333908+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T12:32:41.333908+0000', 'last_clean_scrub_stamp': '2024-05-27T12:32:41.333908+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-27T12:32:46.104 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1b is not active+clean 2024-05-27T12:32:46.104 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-05-27T12:32:41.355572+0000', 'last_change': '2024-05-27T12:32:41.355572+0000', 'last_active': '2024-05-27T12:32:41.333908+0000', 'last_peered': '2024-05-27T12:32:41.333908+0000', 'last_clean': '2024-05-27T12:32:41.333908+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T12:32:41.355572+0000', 'last_undegraded': '2024-05-27T12:32:41.355572+0000', 'last_fullsized': '2024-05-27T12:32:41.355572+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T12:32:41.333908+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T12:32:41.333908+0000', 'last_clean_scrub_stamp': '2024-05-27T12:32:41.333908+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-27T12:32:46.104 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.17 is not active+clean 2024-05-27T12:32:46.104 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-05-27T12:32:41.355055+0000', 'last_change': '2024-05-27T12:32:41.355055+0000', 'last_active': '2024-05-27T12:32:41.333908+0000', 'last_peered': '2024-05-27T12:32:41.333908+0000', 'last_clean': '2024-05-27T12:32:41.333908+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T12:32:41.355055+0000', 'last_undegraded': '2024-05-27T12:32:41.355055+0000', 'last_fullsized': '2024-05-27T12:32:41.355055+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T12:32:41.333908+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T12:32:41.333908+0000', 'last_clean_scrub_stamp': '2024-05-27T12:32:41.333908+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-27T12:32:46.104 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.12 is not active+clean 2024-05-27T12:32:46.104 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-05-27T12:32:41.355128+0000', 'last_change': '2024-05-27T12:32:41.355128+0000', 'last_active': '2024-05-27T12:32:41.333908+0000', 'last_peered': '2024-05-27T12:32:41.333908+0000', 'last_clean': '2024-05-27T12:32:41.333908+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T12:32:41.355128+0000', 'last_undegraded': '2024-05-27T12:32:41.355128+0000', 'last_fullsized': '2024-05-27T12:32:41.355128+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T12:32:41.333908+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T12:32:41.333908+0000', 'last_clean_scrub_stamp': '2024-05-27T12:32:41.333908+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-27T12:32:46.104 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1 is not active+clean 2024-05-27T12:32:46.104 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-05-27T12:32:41.355359+0000', 'last_change': '2024-05-27T12:32:41.355359+0000', 'last_active': '2024-05-27T12:32:41.333908+0000', 'last_peered': '2024-05-27T12:32:41.333908+0000', 'last_clean': '2024-05-27T12:32:41.333908+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T12:32:41.355359+0000', 'last_undegraded': '2024-05-27T12:32:41.355359+0000', 'last_fullsized': '2024-05-27T12:32:41.355359+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T12:32:41.333908+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T12:32:41.333908+0000', 'last_clean_scrub_stamp': '2024-05-27T12:32:41.333908+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-27T12:32:46.104 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.6 is not active+clean 2024-05-27T12:32:46.105 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-05-27T12:32:41.355247+0000', 'last_change': '2024-05-27T12:32:41.355247+0000', 'last_active': '2024-05-27T12:32:41.333908+0000', 'last_peered': '2024-05-27T12:32:41.333908+0000', 'last_clean': '2024-05-27T12:32:41.333908+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T12:32:41.355247+0000', 'last_undegraded': '2024-05-27T12:32:41.355247+0000', 'last_fullsized': '2024-05-27T12:32:41.355247+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T12:32:41.333908+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T12:32:41.333908+0000', 'last_clean_scrub_stamp': '2024-05-27T12:32:41.333908+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-27T12:32:46.105 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1f is not active+clean 2024-05-27T12:32:46.105 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-05-27T12:32:41.357214+0000', 'last_change': '2024-05-27T12:32:41.357214+0000', 'last_active': '2024-05-27T12:32:41.333908+0000', 'last_peered': '2024-05-27T12:32:41.333908+0000', 'last_clean': '2024-05-27T12:32:41.333908+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-27T12:32:41.357214+0000', 'last_undegraded': '2024-05-27T12:32:41.357214+0000', 'last_fullsized': '2024-05-27T12:32:41.357214+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-27T12:32:41.333908+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-27T12:32:41.333908+0000', 'last_clean_scrub_stamp': '2024-05-27T12:32:41.333908+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-27T12:32:46.105 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-05-27T12:32:46.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.242+0000 7f8c29f37640 1 Processor -- start 2024-05-27T12:32:46.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.242+0000 7f8c29f37640 1 -- start start 2024-05-27T12:32:46.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.243+0000 7f8c29f37640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8c24072380 0x7f8c240cf750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:46.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.243+0000 7f8c29f37640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c240ce200 con 0x7f8c24071f20 2024-05-27T12:32:46.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.243+0000 7f8c29f37640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c240cdc40 con 0x7f8c24144bb0 2024-05-27T12:32:46.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.243+0000 7f8c29f37640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f8c24144f90 con 0x7f8c24072380 2024-05-27T12:32:46.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.243+0000 7f8c22ffd640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f8c24071f20 0x7f8c240cf040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:60344/0 (socket says 172.21.15.55:60344) 2024-05-27T12:32:46.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.243+0000 7f8c22ffd640 1 -- 172.21.15.55:0/2063952665 learned_addr learned my addr 172.21.15.55:0/2063952665 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-27T12:32:46.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.243+0000 7f8c23fff640 1 --2- 172.21.15.55:0/2063952665 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8c24072380 0x7f8c240cf750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:46.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.243+0000 7f8c227fc640 1 -- 172.21.15.55:0/2063952665 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2470375380 0 0) 0x7f8c240ce200 con 0x7f8c24071f20 2024-05-27T12:32:46.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.243+0000 7f8c227fc640 1 -- 172.21.15.55:0/2063952665 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8c0c003520 con 0x7f8c24071f20 2024-05-27T12:32:46.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.243+0000 7f8c227fc640 1 -- 172.21.15.55:0/2063952665 <== mon.1 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3134075062 0 0) 0x7f8c240cdc40 con 0x7f8c24144bb0 2024-05-27T12:32:46.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.243+0000 7f8c227fc640 1 -- 172.21.15.55:0/2063952665 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8c240ce200 con 0x7f8c24144bb0 2024-05-27T12:32:46.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.243+0000 7f8c227fc640 1 -- 172.21.15.55:0/2063952665 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2063365141 0 0) 0x7f8c0c003520 con 0x7f8c24071f20 2024-05-27T12:32:46.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.243+0000 7f8c227fc640 1 -- 172.21.15.55:0/2063952665 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8c24072380 msgr2=0x7f8c240cf750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:32:46.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.243+0000 7f8c227fc640 1 --2- 172.21.15.55:0/2063952665 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8c24072380 0x7f8c240cf750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:46.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.243+0000 7f8c227fc640 1 -- 172.21.15.55:0/2063952665 >> v1:172.21.15.72:6789/0 conn(0x7f8c24144bb0 legacy=0x7f8c240cd180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:46.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.243+0000 7f8c227fc640 1 -- 172.21.15.55:0/2063952665 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c240cdf20 con 0x7f8c24071f20 2024-05-27T12:32:46.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.243+0000 7f8c227fc640 1 -- 172.21.15.55:0/2063952665 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 793017739 0 0) 0x7f8c18001670 con 0x7f8c24071f20 2024-05-27T12:32:46.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.243+0000 7f8c227fc640 1 -- 172.21.15.55:0/2063952665 >> v1:172.21.15.55:6789/0 conn(0x7f8c24071f20 legacy=0x7f8c240cf040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:46.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.243+0000 7f8c227fc640 1 --2- 172.21.15.55:0/2063952665 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c0c003c50 0x7f8c0c004050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:46.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.243+0000 7f8c227fc640 1 --2- 172.21.15.55:0/2063952665 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8c0c004800 0x7f8c0c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:46.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.244+0000 7f8c227fc640 1 --2- 172.21.15.55:0/2063952665 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c0c0051c0 0x7f8c0c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:46.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.244+0000 7f8c227fc640 1 -- 172.21.15.55:0/2063952665 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f8c24144f90 con 0x7f8c0c0051c0 2024-05-27T12:32:46.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.244+0000 7f8c227fc640 1 -- 172.21.15.55:0/2063952665 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f8c0c00c140 con 0x7f8c0c003c50 2024-05-27T12:32:46.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.244+0000 7f8c227fc640 1 -- 172.21.15.55:0/2063952665 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f8c0c00c340 con 0x7f8c0c004800 2024-05-27T12:32:46.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.244+0000 7f8c23fff640 1 --2- 172.21.15.55:0/2063952665 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8c24072380 0x7f8c240cf750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T12:32:46.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.244+0000 7f8c237fe640 1 --2- 172.21.15.55:0/2063952665 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c0c003c50 0x7f8c0c004050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:46.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.244+0000 7f8c22ffd640 1 --2- 172.21.15.55:0/2063952665 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8c0c004800 0x7f8c0c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:46.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.244+0000 7f8c23fff640 1 --2- 172.21.15.55:0/2063952665 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c0c0051c0 0x7f8c0c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:46.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.244+0000 7f8c23fff640 1 -- 172.21.15.55:0/2063952665 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8c0c004800 msgr2=0x7f8c0c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:32:46.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.244+0000 7f8c23fff640 1 --2- 172.21.15.55:0/2063952665 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8c0c004800 0x7f8c0c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:46.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.244+0000 7f8c23fff640 1 -- 172.21.15.55:0/2063952665 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c0c003c50 msgr2=0x7f8c0c004050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:32:46.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.244+0000 7f8c23fff640 1 --2- 172.21.15.55:0/2063952665 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c0c003c50 0x7f8c0c004050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:46.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.244+0000 7f8c23fff640 1 -- 172.21.15.55:0/2063952665 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c0c003520 con 0x7f8c0c0051c0 2024-05-27T12:32:46.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.244+0000 7f8c237fe640 1 --2- 172.21.15.55:0/2063952665 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c0c003c50 0x7f8c0c004050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T12:32:46.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.245+0000 7f8c23fff640 1 --2- 172.21.15.55:0/2063952665 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c0c0051c0 0x7f8c0c00b9c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8c1c00e1f0 tx=0x7f8c0c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=175c8d7e1d28ba09 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:46.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.245+0000 7f8c227fc640 1 -- 172.21.15.55:0/2063952665 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c1c009d40 con 0x7f8c0c0051c0 2024-05-27T12:32:46.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.245+0000 7f8c227fc640 1 -- 172.21.15.55:0/2063952665 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c1c035070 con 0x7f8c0c0051c0 2024-05-27T12:32:46.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.245+0000 7f8c227fc640 1 -- 172.21.15.55:0/2063952665 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c1c004030 con 0x7f8c0c0051c0 2024-05-27T12:32:46.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.245+0000 7f8c29f37640 1 -- 172.21.15.55:0/2063952665 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c0c0051c0 msgr2=0x7f8c0c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:46.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.245+0000 7f8c29f37640 1 --2- 172.21.15.55:0/2063952665 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c0c0051c0 0x7f8c0c00b9c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8c1c00e1f0 tx=0x7f8c0c005830 comp rx=0 tx=0).stop 2024-05-27T12:32:46.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.245+0000 7f8c23fff640 1 -- 172.21.15.55:0/2063952665 reap_dead start 2024-05-27T12:32:46.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.245+0000 7f8c29f37640 1 -- 172.21.15.55:0/2063952665 shutdown_connections 2024-05-27T12:32:46.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.245+0000 7f8c29f37640 1 -- 172.21.15.55:0/2063952665 >> 172.21.15.55:0/2063952665 conn(0x7f8c240b3830 msgr2=0x7f8c240b3c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:46.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.245+0000 7f8c29f37640 1 -- 172.21.15.55:0/2063952665 shutdown_connections 2024-05-27T12:32:46.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.245+0000 7f8c29f37640 1 -- 172.21.15.55:0/2063952665 wait complete. 2024-05-27T12:32:46.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.247+0000 7f8c29f37640 1 Processor -- start 2024-05-27T12:32:46.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.247+0000 7f8c29f37640 1 -- start start 2024-05-27T12:32:46.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.247+0000 7f8c29f37640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c0c0051c0 0x7f8c241f4920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:46.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.247+0000 7f8c29f37640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c2413af80 0x7f8c240cbd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:46.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.247+0000 7f8c29f37640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8c240cc2b0 0x7f8c241da110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:46.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.247+0000 7f8c29f37640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f8c24072810 con 0x7f8c0c0051c0 2024-05-27T12:32:46.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.247+0000 7f8c29f37640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f8c240ceb20 con 0x7f8c2413af80 2024-05-27T12:32:46.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.247+0000 7f8c29f37640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f8c24145330 con 0x7f8c240cc2b0 2024-05-27T12:32:46.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.248+0000 7f8c237fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c0c0051c0 0x7f8c241f4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:46.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.248+0000 7f8c237fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c0c0051c0 0x7f8c241f4920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55306/0 (socket says 172.21.15.55:55306) 2024-05-27T12:32:46.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.248+0000 7f8c237fe640 1 -- 172.21.15.55:0/1834268797 learned_addr learned my addr 172.21.15.55:0/1834268797 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:32:46.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.248+0000 7f8c22ffd640 1 --2- 172.21.15.55:0/1834268797 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c2413af80 0x7f8c240cbd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:46.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.248+0000 7f8c23fff640 1 --2- 172.21.15.55:0/1834268797 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8c240cc2b0 0x7f8c241da110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:46.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.248+0000 7f8c237fe640 1 -- 172.21.15.55:0/1834268797 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8c240cc2b0 msgr2=0x7f8c241da110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:46.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.248+0000 7f8c237fe640 1 --2- 172.21.15.55:0/1834268797 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8c240cc2b0 0x7f8c241da110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:46.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.248+0000 7f8c237fe640 1 -- 172.21.15.55:0/1834268797 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c2413af80 msgr2=0x7f8c240cbd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:46.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.248+0000 7f8c237fe640 1 --2- 172.21.15.55:0/1834268797 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c2413af80 0x7f8c240cbd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:46.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.248+0000 7f8c237fe640 1 -- 172.21.15.55:0/1834268797 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c241f4e60 con 0x7f8c0c0051c0 2024-05-27T12:32:46.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.248+0000 7f8c22ffd640 1 --2- 172.21.15.55:0/1834268797 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c2413af80 0x7f8c240cbd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T12:32:46.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.248+0000 7f8c23fff640 1 --2- 172.21.15.55:0/1834268797 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8c240cc2b0 0x7f8c241da110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T12:32:46.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.248+0000 7f8c237fe640 1 --2- 172.21.15.55:0/1834268797 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c0c0051c0 0x7f8c241f4920 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f8c1400f930 tx=0x7f8c1400fdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:46.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.248+0000 7f8c0bfff640 1 -- 172.21.15.55:0/1834268797 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c140052e0 con 0x7f8c0c0051c0 2024-05-27T12:32:46.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.248+0000 7f8c0bfff640 1 -- 172.21.15.55:0/1834268797 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c14018070 con 0x7f8c0c0051c0 2024-05-27T12:32:46.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.248+0000 7f8c0bfff640 1 -- 172.21.15.55:0/1834268797 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c1400d9b0 con 0x7f8c0c0051c0 2024-05-27T12:32:46.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.248+0000 7f8c29f37640 1 -- 172.21.15.55:0/1834268797 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c24141e80 con 0x7f8c0c0051c0 2024-05-27T12:32:46.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.248+0000 7f8c29f37640 1 -- 172.21.15.55:0/1834268797 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c24142440 con 0x7f8c0c0051c0 2024-05-27T12:32:46.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.250+0000 7f8c29f37640 1 -- 172.21.15.55:0/1834268797 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c2406c8c0 con 0x7f8c0c0051c0 2024-05-27T12:32:46.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.250+0000 7f8c0bfff640 1 -- 172.21.15.55:0/1834268797 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8c1400db50 con 0x7f8c0c0051c0 2024-05-27T12:32:46.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.250+0000 7f8c0bfff640 1 --2- 172.21.15.55:0/1834268797 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f8c1006c8f0 0x7f8c1006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:46.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.250+0000 7f8c0bfff640 1 -- 172.21.15.55:0/1834268797 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f8c1408bbb0 con 0x7f8c0c0051c0 2024-05-27T12:32:46.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.250+0000 7f8c22ffd640 1 --2- 172.21.15.55:0/1834268797 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f8c1006c8f0 0x7f8c1006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:46.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.251+0000 7f8c22ffd640 1 --2- 172.21.15.55:0/1834268797 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f8c1006c8f0 0x7f8c1006edb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8c241407c0 tx=0x7f8c18009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:46.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.255+0000 7f8c0bfff640 1 -- 172.21.15.55:0/1834268797 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8c1405a130 con 0x7f8c0c0051c0 2024-05-27T12:32:46.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.512+0000 7f8c29f37640 1 -- 172.21.15.55:0/1834268797 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f8c240cf2c0 con 0x7f8c0c0051c0 2024-05-27T12:32:46.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.513+0000 7f8c0bfff640 1 -- 172.21.15.55:0/1834268797 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1097 (secure 0 0 0) 0x7f8c14059a30 con 0x7f8c0c0051c0 2024-05-27T12:32:46.513 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-27T12:32:46.513 INFO:teuthology.orchestra.run.smithi055.stdout:{"fsid":"c3ff4e3b-8dae-4856-9593-e5cc66c59982","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":29,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":23,"num_osds":8,"num_up_osds":8,"osd_up_since":1716813148,"num_in_osds":8,"osd_in_since":1716813139,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":87},{"state_name":"creating+peering","count":10}],"num_pgs":97,"num_pools":3,"num_objects":19,"data_bytes":592162,"bytes_used":241385472,"bytes_avail":772852727808,"bytes_total":773094113280,"inactive_pgs_ratio":0.10309278219938278,"write_bytes_sec":1247,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":6,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"b","status":"up:active","gid":4290}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2024-05-27T12:32:17.020392+0000","services":{}},"progress_events":{}} 2024-05-27T12:32:46.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.514+0000 7f8c29f37640 1 -- 172.21.15.55:0/1834268797 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f8c1006c8f0 msgr2=0x7f8c1006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:46.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.515+0000 7f8c29f37640 1 --2- 172.21.15.55:0/1834268797 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f8c1006c8f0 0x7f8c1006edb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8c241407c0 tx=0x7f8c18009040 comp rx=0 tx=0).stop 2024-05-27T12:32:46.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.515+0000 7f8c29f37640 1 -- 172.21.15.55:0/1834268797 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c0c0051c0 msgr2=0x7f8c241f4920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:46.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.515+0000 7f8c29f37640 1 --2- 172.21.15.55:0/1834268797 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c0c0051c0 0x7f8c241f4920 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f8c1400f930 tx=0x7f8c1400fdf0 comp rx=0 tx=0).stop 2024-05-27T12:32:46.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.515+0000 7f8c29f37640 1 -- 172.21.15.55:0/1834268797 shutdown_connections 2024-05-27T12:32:46.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.515+0000 7f8c29f37640 1 --2- 172.21.15.55:0/1834268797 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8c240cc2b0 0x7f8c241da110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:46.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.515+0000 7f8c29f37640 1 --2- 172.21.15.55:0/1834268797 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f8c1006c8f0 0x7f8c1006edb0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:46.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.515+0000 7f8c29f37640 1 --2- 172.21.15.55:0/1834268797 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c2413af80 0x7f8c240cbd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:46.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.515+0000 7f8c29f37640 1 --2- 172.21.15.55:0/1834268797 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c0c0051c0 0x7f8c241f4920 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:46.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.515+0000 7f8c29f37640 1 -- 172.21.15.55:0/1834268797 >> 172.21.15.55:0/1834268797 conn(0x7f8c240b3830 msgr2=0x7f8c24143d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:46.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.515+0000 7f8c29f37640 1 -- 172.21.15.55:0/1834268797 shutdown_connections 2024-05-27T12:32:46.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.515+0000 7f8c29f37640 1 -- 172.21.15.55:0/1834268797 wait complete. 2024-05-27T12:32:46.526 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-05-27T12:32:46.526 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-27T12:32:46.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.630+0000 7f3d3f17d640 1 Processor -- start 2024-05-27T12:32:46.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.630+0000 7f3d3f17d640 1 -- start start 2024-05-27T12:32:46.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.631+0000 7f3d3f17d640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3d380ba5e0 0x7f3d380d1280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:46.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.631+0000 7f3d3f17d640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3d380d4320 0x7f3d380d17c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:46.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.631+0000 7f3d3f17d640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d380d3280 con 0x7f3d3815eaf0 2024-05-27T12:32:46.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.631+0000 7f3d3f17d640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f3d380b89d0 con 0x7f3d380d4320 2024-05-27T12:32:46.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.631+0000 7f3d3f17d640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f3d380d3e90 con 0x7f3d380ba5e0 2024-05-27T12:32:46.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.631+0000 7f3d3cf19640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f3d3815eaf0 0x7f3d380d2910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:60356/0 (socket says 172.21.15.55:60356) 2024-05-27T12:32:46.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.631+0000 7f3d3cf19640 1 -- 172.21.15.55:0/501440404 learned_addr learned my addr 172.21.15.55:0/501440404 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-27T12:32:46.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.631+0000 7f3d3d71a640 1 --2- 172.21.15.55:0/501440404 >> v2:172.21.15.72:3300/0 conn(0x7f3d380d4320 0x7f3d380d17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:46.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.631+0000 7f3d37fff640 1 --2- 172.21.15.55:0/501440404 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3d380ba5e0 0x7f3d380d1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:46.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.632+0000 7f3d377fe640 1 -- 172.21.15.55:0/501440404 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 912936302 0 0) 0x7f3d380d3280 con 0x7f3d3815eaf0 2024-05-27T12:32:46.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.632+0000 7f3d377fe640 1 -- 172.21.15.55:0/501440404 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3d24003520 con 0x7f3d3815eaf0 2024-05-27T12:32:46.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.632+0000 7f3d37fff640 1 -- 172.21.15.55:0/501440404 >> v2:172.21.15.72:3300/0 conn(0x7f3d380d4320 msgr2=0x7f3d380d17c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:32:46.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.632+0000 7f3d37fff640 1 --2- 172.21.15.55:0/501440404 >> v2:172.21.15.72:3300/0 conn(0x7f3d380d4320 0x7f3d380d17c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:46.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.632+0000 7f3d37fff640 1 -- 172.21.15.55:0/501440404 >> v1:172.21.15.55:6789/0 conn(0x7f3d3815eaf0 legacy=0x7f3d380d2910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:46.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.632+0000 7f3d37fff640 1 -- 172.21.15.55:0/501440404 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d380d3560 con 0x7f3d380ba5e0 2024-05-27T12:32:46.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.632+0000 7f3d3d71a640 1 --2- 172.21.15.55:0/501440404 >> v2:172.21.15.72:3300/0 conn(0x7f3d380d4320 0x7f3d380d17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T12:32:46.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.633+0000 7f3d37fff640 1 --2- 172.21.15.55:0/501440404 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3d380ba5e0 0x7f3d380d1280 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f3d28009d90 tx=0x7f3d2802a6f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bafed19672ee383 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:46.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.633+0000 7f3d377fe640 1 -- 172.21.15.55:0/501440404 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d28007740 con 0x7f3d380ba5e0 2024-05-27T12:32:46.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.633+0000 7f3d377fe640 1 -- 172.21.15.55:0/501440404 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d280078e0 con 0x7f3d380ba5e0 2024-05-27T12:32:46.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.633+0000 7f3d377fe640 1 -- 172.21.15.55:0/501440404 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d28007cb0 con 0x7f3d380ba5e0 2024-05-27T12:32:46.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.633+0000 7f3d3f17d640 1 -- 172.21.15.55:0/501440404 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3d380ba5e0 msgr2=0x7f3d380d1280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:46.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.633+0000 7f3d3f17d640 1 --2- 172.21.15.55:0/501440404 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3d380ba5e0 0x7f3d380d1280 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f3d28009d90 tx=0x7f3d2802a6f0 comp rx=0 tx=0).stop 2024-05-27T12:32:46.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.633+0000 7f3d3f17d640 1 -- 172.21.15.55:0/501440404 shutdown_connections 2024-05-27T12:32:46.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.633+0000 7f3d3f17d640 1 --2- 172.21.15.55:0/501440404 >> v2:172.21.15.72:3300/0 conn(0x7f3d380d4320 0x7f3d380d17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:46.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.633+0000 7f3d3f17d640 1 --2- 172.21.15.55:0/501440404 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3d380ba5e0 0x7f3d380d1280 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:46.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.633+0000 7f3d3f17d640 1 -- 172.21.15.55:0/501440404 >> 172.21.15.55:0/501440404 conn(0x7f3d3806cdb0 msgr2=0x7f3d3806d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:46.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.634+0000 7f3d3f17d640 1 -- 172.21.15.55:0/501440404 shutdown_connections 2024-05-27T12:32:46.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.634+0000 7f3d3f17d640 1 -- 172.21.15.55:0/501440404 wait complete. 2024-05-27T12:32:46.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.636+0000 7f3d3f17d640 1 Processor -- start 2024-05-27T12:32:46.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.636+0000 7f3d3f17d640 1 -- start start 2024-05-27T12:32:46.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.637+0000 7f3d3f17d640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3d380ba5e0 0x7f3d380c8380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:46.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.637+0000 7f3d3f17d640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d380d4320 0x7f3d380c9a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:46.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.637+0000 7f3d3f17d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3d3815eaf0 0x7f3d381508a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:46.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.637+0000 7f3d3f17d640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f3d380d3b20 con 0x7f3d3815eaf0 2024-05-27T12:32:46.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.637+0000 7f3d3f17d640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f3d380d3020 con 0x7f3d380d4320 2024-05-27T12:32:46.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.637+0000 7f3d3f17d640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f3d3815eed0 con 0x7f3d380ba5e0 2024-05-27T12:32:46.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.637+0000 7f3d3d71a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3d3815eaf0 0x7f3d381508a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:46.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.637+0000 7f3d3d71a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3d3815eaf0 0x7f3d381508a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55314/0 (socket says 172.21.15.55:55314) 2024-05-27T12:32:46.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.637+0000 7f3d3d71a640 1 -- 172.21.15.55:0/484428788 learned_addr learned my addr 172.21.15.55:0/484428788 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:32:46.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.637+0000 7f3d37fff640 1 --2- 172.21.15.55:0/484428788 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d380d4320 0x7f3d380c9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:46.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.637+0000 7f3d3cf19640 1 --2- 172.21.15.55:0/484428788 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3d380ba5e0 0x7f3d380c8380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:46.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.637+0000 7f3d3d71a640 1 -- 172.21.15.55:0/484428788 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3d380ba5e0 msgr2=0x7f3d380c8380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:46.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.637+0000 7f3d3d71a640 1 --2- 172.21.15.55:0/484428788 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3d380ba5e0 0x7f3d380c8380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:46.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.637+0000 7f3d3d71a640 1 -- 172.21.15.55:0/484428788 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d380d4320 msgr2=0x7f3d380c9a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:46.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.637+0000 7f3d3d71a640 1 --2- 172.21.15.55:0/484428788 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d380d4320 0x7f3d380c9a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:46.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.637+0000 7f3d3d71a640 1 -- 172.21.15.55:0/484428788 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d38150de0 con 0x7f3d3815eaf0 2024-05-27T12:32:46.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.637+0000 7f3d3cf19640 1 --2- 172.21.15.55:0/484428788 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3d380ba5e0 0x7f3d380c8380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T12:32:46.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.637+0000 7f3d37fff640 1 --2- 172.21.15.55:0/484428788 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d380d4320 0x7f3d380c9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T12:32:46.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.637+0000 7f3d3d71a640 1 --2- 172.21.15.55:0/484428788 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3d3815eaf0 0x7f3d381508a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3d2000e8c0 tx=0x7f3d2000ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:46.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.637+0000 7f3d357fa640 1 -- 172.21.15.55:0/484428788 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d20017070 con 0x7f3d3815eaf0 2024-05-27T12:32:46.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.637+0000 7f3d357fa640 1 -- 172.21.15.55:0/484428788 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d20004020 con 0x7f3d3815eaf0 2024-05-27T12:32:46.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.637+0000 7f3d3f17d640 1 -- 172.21.15.55:0/484428788 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d380c8960 con 0x7f3d3815eaf0 2024-05-27T12:32:46.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.637+0000 7f3d357fa640 1 -- 172.21.15.55:0/484428788 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d200043f0 con 0x7f3d3815eaf0 2024-05-27T12:32:46.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.637+0000 7f3d3f17d640 1 -- 172.21.15.55:0/484428788 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d380c8f20 con 0x7f3d3815eaf0 2024-05-27T12:32:46.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.637+0000 7f3d3f17d640 1 -- 172.21.15.55:0/484428788 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d38075460 con 0x7f3d3815eaf0 2024-05-27T12:32:46.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.638+0000 7f3d357fa640 1 -- 172.21.15.55:0/484428788 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3d2000c940 con 0x7f3d3815eaf0 2024-05-27T12:32:46.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.639+0000 7f3d357fa640 1 --2- 172.21.15.55:0/484428788 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f3d1806c8f0 0x7f3d1806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:46.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.639+0000 7f3d357fa640 1 -- 172.21.15.55:0/484428788 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f3d2008b970 con 0x7f3d3815eaf0 2024-05-27T12:32:46.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.639+0000 7f3d3cf19640 1 --2- 172.21.15.55:0/484428788 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f3d1806c8f0 0x7f3d1806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:46.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.640+0000 7f3d3cf19640 1 --2- 172.21.15.55:0/484428788 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f3d1806c8f0 0x7f3d1806edb0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3d30007fd0 tx=0x7f3d30009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:46.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.643+0000 7f3d357fa640 1 -- 172.21.15.55:0/484428788 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3d20059da0 con 0x7f3d3815eaf0 2024-05-27T12:32:46.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.826+0000 7f3d3f17d640 1 -- 172.21.15.55:0/484428788 --> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3d380ba3c0 con 0x7f3d1806c8f0 2024-05-27T12:32:46.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.834+0000 7f3d357fa640 1 -- 172.21.15.55:0/484428788 <== mgr.4105 v2:172.21.15.72:6832/3152720583 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251063 (secure 0 0 0) 0x7f3d380ba3c0 con 0x7f3d1806c8f0 2024-05-27T12:32:46.835 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-27T12:32:46.837 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2024-05-27T12:32:46.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.836+0000 7f3d3f17d640 1 -- 172.21.15.55:0/484428788 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f3d1806c8f0 msgr2=0x7f3d1806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:46.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.836+0000 7f3d3f17d640 1 --2- 172.21.15.55:0/484428788 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f3d1806c8f0 0x7f3d1806edb0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3d30007fd0 tx=0x7f3d30009040 comp rx=0 tx=0).stop 2024-05-27T12:32:46.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.836+0000 7f3d3f17d640 1 -- 172.21.15.55:0/484428788 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3d3815eaf0 msgr2=0x7f3d381508a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:46.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.836+0000 7f3d3f17d640 1 --2- 172.21.15.55:0/484428788 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3d3815eaf0 0x7f3d381508a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3d2000e8c0 tx=0x7f3d2000ed80 comp rx=0 tx=0).stop 2024-05-27T12:32:46.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.836+0000 7f3d3f17d640 1 -- 172.21.15.55:0/484428788 shutdown_connections 2024-05-27T12:32:46.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.836+0000 7f3d3f17d640 1 --2- 172.21.15.55:0/484428788 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3d3815eaf0 0x7f3d381508a0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:46.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.836+0000 7f3d3f17d640 1 --2- 172.21.15.55:0/484428788 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f3d1806c8f0 0x7f3d1806edb0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:46.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.836+0000 7f3d3f17d640 1 --2- 172.21.15.55:0/484428788 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d380d4320 0x7f3d380c9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:46.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.836+0000 7f3d3f17d640 1 --2- 172.21.15.55:0/484428788 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3d380ba5e0 0x7f3d380c8380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:46.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.836+0000 7f3d3f17d640 1 -- 172.21.15.55:0/484428788 >> 172.21.15.55:0/484428788 conn(0x7f3d3806cdb0 msgr2=0x7f3d3815d270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:46.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.836+0000 7f3d3f17d640 1 -- 172.21.15.55:0/484428788 shutdown_connections 2024-05-27T12:32:46.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:46.836+0000 7f3d3f17d640 1 -- 172.21.15.55:0/484428788 wait complete. 2024-05-27T12:32:46.847 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-05-27T12:32:45.263246+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592162,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":196,"num_write_kb":2422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":149,"ondisk_log_size":149,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":84,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235728,"kb_used_data":2928,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738992,"statfs":{"total":773094113280,"available":772852727808,"internally_reserved":0,"allocated":2998272,"data_stored":1775383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1794,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.925680"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.374797+0000","last_change":"2024-05-27T12:32:42.368378+0000","last_active":"2024-05-27T12:32:42.374797+0000","last_peered":"2024-05-27T12:32:42.374797+0000","last_clean":"2024-05-27T12:32:42.374797+0000","last_became_active":"2024-05-27T12:32:42.367689+0000","last_became_peered":"2024-05-27T12:32:42.367689+0000","last_unstale":"2024-05-27T12:32:42.374797+0000","last_undegraded":"2024-05-27T12:32:42.374797+0000","last_fullsized":"2024-05-27T12:32:42.374797+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:23:59.137419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.381869+0000","last_change":"2024-05-27T12:32:42.380372+0000","last_active":"2024-05-27T12:32:42.381869+0000","last_peered":"2024-05-27T12:32:42.381869+0000","last_clean":"2024-05-27T12:32:42.381869+0000","last_became_active":"2024-05-27T12:32:42.379503+0000","last_became_peered":"2024-05-27T12:32:42.379503+0000","last_unstale":"2024-05-27T12:32:42.381869+0000","last_undegraded":"2024-05-27T12:32:42.381869+0000","last_fullsized":"2024-05-27T12:32:42.381869+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:08:37.481605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-27T12:32:41.357767+0000","last_change":"2024-05-27T12:32:41.357767+0000","last_active":"2024-05-27T12:32:41.333908+0000","last_peered":"2024-05-27T12:32:41.333908+0000","last_clean":"2024-05-27T12:32:41.333908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T12:32:41.357767+0000","last_undegraded":"2024-05-27T12:32:41.357767+0000","last_fullsized":"2024-05-27T12:32:41.357767+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.389251+0000","last_change":"2024-05-27T12:32:42.384566+0000","last_active":"2024-05-27T12:32:42.389251+0000","last_peered":"2024-05-27T12:32:42.389251+0000","last_clean":"2024-05-27T12:32:42.389251+0000","last_became_active":"2024-05-27T12:32:42.384269+0000","last_became_peered":"2024-05-27T12:32:42.384269+0000","last_unstale":"2024-05-27T12:32:42.389251+0000","last_undegraded":"2024-05-27T12:32:42.389251+0000","last_fullsized":"2024-05-27T12:32:42.389251+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:08:37.481605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.374093+0000","last_change":"2024-05-27T12:32:42.367164+0000","last_active":"2024-05-27T12:32:42.374093+0000","last_peered":"2024-05-27T12:32:42.374093+0000","last_clean":"2024-05-27T12:32:42.374093+0000","last_became_active":"2024-05-27T12:32:42.366882+0000","last_became_peered":"2024-05-27T12:32:42.366882+0000","last_unstale":"2024-05-27T12:32:42.374093+0000","last_undegraded":"2024-05-27T12:32:42.374093+0000","last_fullsized":"2024-05-27T12:32:42.374093+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:04:04.818266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.389344+0000","last_change":"2024-05-27T12:32:42.385413+0000","last_active":"2024-05-27T12:32:42.389344+0000","last_peered":"2024-05-27T12:32:42.389344+0000","last_clean":"2024-05-27T12:32:42.389344+0000","last_became_active":"2024-05-27T12:32:42.385163+0000","last_became_peered":"2024-05-27T12:32:42.385163+0000","last_unstale":"2024-05-27T12:32:42.389344+0000","last_undegraded":"2024-05-27T12:32:42.389344+0000","last_fullsized":"2024-05-27T12:32:42.389344+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:23:59.137419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.380885+0000","last_change":"2024-05-27T12:32:42.376081+0000","last_active":"2024-05-27T12:32:42.380885+0000","last_peered":"2024-05-27T12:32:42.380885+0000","last_clean":"2024-05-27T12:32:42.380885+0000","last_became_active":"2024-05-27T12:32:42.375689+0000","last_became_peered":"2024-05-27T12:32:42.375689+0000","last_unstale":"2024-05-27T12:32:42.380885+0000","last_undegraded":"2024-05-27T12:32:42.380885+0000","last_fullsized":"2024-05-27T12:32:42.380885+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:45:06.261408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.386869+0000","last_change":"2024-05-27T12:32:42.385659+0000","last_active":"2024-05-27T12:32:42.386869+0000","last_peered":"2024-05-27T12:32:42.386869+0000","last_clean":"2024-05-27T12:32:42.386869+0000","last_became_active":"2024-05-27T12:32:42.385356+0000","last_became_peered":"2024-05-27T12:32:42.385356+0000","last_unstale":"2024-05-27T12:32:42.386869+0000","last_undegraded":"2024-05-27T12:32:42.386869+0000","last_fullsized":"2024-05-27T12:32:42.386869+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:08:37.481605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.386391+0000","last_change":"2024-05-27T12:32:42.382460+0000","last_active":"2024-05-27T12:32:42.386391+0000","last_peered":"2024-05-27T12:32:42.386391+0000","last_clean":"2024-05-27T12:32:42.386391+0000","last_became_active":"2024-05-27T12:32:42.382093+0000","last_became_peered":"2024-05-27T12:32:42.382093+0000","last_unstale":"2024-05-27T12:32:42.386391+0000","last_undegraded":"2024-05-27T12:32:42.386391+0000","last_fullsized":"2024-05-27T12:32:42.386391+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:44:31.058083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.389163+0000","last_change":"2024-05-27T12:32:42.384546+0000","last_active":"2024-05-27T12:32:42.389163+0000","last_peered":"2024-05-27T12:32:42.389163+0000","last_clean":"2024-05-27T12:32:42.389163+0000","last_became_active":"2024-05-27T12:32:42.384270+0000","last_became_peered":"2024-05-27T12:32:42.384270+0000","last_unstale":"2024-05-27T12:32:42.389163+0000","last_undegraded":"2024-05-27T12:32:42.389163+0000","last_fullsized":"2024-05-27T12:32:42.389163+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:53:37.721445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.389204+0000","last_change":"2024-05-27T12:32:42.385206+0000","last_active":"2024-05-27T12:32:42.389204+0000","last_peered":"2024-05-27T12:32:42.389204+0000","last_clean":"2024-05-27T12:32:42.389204+0000","last_became_active":"2024-05-27T12:32:42.384940+0000","last_became_peered":"2024-05-27T12:32:42.384940+0000","last_unstale":"2024-05-27T12:32:42.389204+0000","last_undegraded":"2024-05-27T12:32:42.389204+0000","last_fullsized":"2024-05-27T12:32:42.389204+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:08:37.481605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.378903+0000","last_change":"2024-05-27T12:32:42.376596+0000","last_active":"2024-05-27T12:32:42.378903+0000","last_peered":"2024-05-27T12:32:42.378903+0000","last_clean":"2024-05-27T12:32:42.378903+0000","last_became_active":"2024-05-27T12:32:42.376147+0000","last_became_peered":"2024-05-27T12:32:42.376147+0000","last_unstale":"2024-05-27T12:32:42.378903+0000","last_undegraded":"2024-05-27T12:32:42.378903+0000","last_fullsized":"2024-05-27T12:32:42.378903+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T23:55:02.398885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.377139+0000","last_change":"2024-05-27T12:32:42.375358+0000","last_active":"2024-05-27T12:32:42.377139+0000","last_peered":"2024-05-27T12:32:42.377139+0000","last_clean":"2024-05-27T12:32:42.377139+0000","last_became_active":"2024-05-27T12:32:42.375096+0000","last_became_peered":"2024-05-27T12:32:42.375096+0000","last_unstale":"2024-05-27T12:32:42.377139+0000","last_undegraded":"2024-05-27T12:32:42.377139+0000","last_fullsized":"2024-05-27T12:32:42.377139+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:20:05.304417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-27T12:32:41.356707+0000","last_change":"2024-05-27T12:32:41.356707+0000","last_active":"2024-05-27T12:32:41.333908+0000","last_peered":"2024-05-27T12:32:41.333908+0000","last_clean":"2024-05-27T12:32:41.333908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T12:32:41.356707+0000","last_undegraded":"2024-05-27T12:32:41.356707+0000","last_fullsized":"2024-05-27T12:32:41.356707+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.378127+0000","last_change":"2024-05-27T12:32:42.376055+0000","last_active":"2024-05-27T12:32:42.378127+0000","last_peered":"2024-05-27T12:32:42.378127+0000","last_clean":"2024-05-27T12:32:42.378127+0000","last_became_active":"2024-05-27T12:32:42.374091+0000","last_became_peered":"2024-05-27T12:32:42.374091+0000","last_unstale":"2024-05-27T12:32:42.378127+0000","last_undegraded":"2024-05-27T12:32:42.378127+0000","last_fullsized":"2024-05-27T12:32:42.378127+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:45:14.026270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.390013+0000","last_change":"2024-05-27T12:32:42.387113+0000","last_active":"2024-05-27T12:32:42.390013+0000","last_peered":"2024-05-27T12:32:42.390013+0000","last_clean":"2024-05-27T12:32:42.390013+0000","last_became_active":"2024-05-27T12:32:42.386810+0000","last_became_peered":"2024-05-27T12:32:42.386810+0000","last_unstale":"2024-05-27T12:32:42.390013+0000","last_undegraded":"2024-05-27T12:32:42.390013+0000","last_fullsized":"2024-05-27T12:32:42.390013+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:41:35.310708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.389296+0000","last_change":"2024-05-27T12:32:42.383993+0000","last_active":"2024-05-27T12:32:42.389296+0000","last_peered":"2024-05-27T12:32:42.389296+0000","last_clean":"2024-05-27T12:32:42.389296+0000","last_became_active":"2024-05-27T12:32:42.383274+0000","last_became_peered":"2024-05-27T12:32:42.383274+0000","last_unstale":"2024-05-27T12:32:42.389296+0000","last_undegraded":"2024-05-27T12:32:42.389296+0000","last_fullsized":"2024-05-27T12:32:42.389296+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:45:14.026270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.381322+0000","last_change":"2024-05-27T12:32:42.376831+0000","last_active":"2024-05-27T12:32:42.381322+0000","last_peered":"2024-05-27T12:32:42.381322+0000","last_clean":"2024-05-27T12:32:42.381322+0000","last_became_active":"2024-05-27T12:32:42.376498+0000","last_became_peered":"2024-05-27T12:32:42.376498+0000","last_unstale":"2024-05-27T12:32:42.381322+0000","last_undegraded":"2024-05-27T12:32:42.381322+0000","last_fullsized":"2024-05-27T12:32:42.381322+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:31:53.377015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.373560+0000","last_change":"2024-05-27T12:32:42.366751+0000","last_active":"2024-05-27T12:32:42.373560+0000","last_peered":"2024-05-27T12:32:42.373560+0000","last_clean":"2024-05-27T12:32:42.373560+0000","last_became_active":"2024-05-27T12:32:42.366438+0000","last_became_peered":"2024-05-27T12:32:42.366438+0000","last_unstale":"2024-05-27T12:32:42.373560+0000","last_undegraded":"2024-05-27T12:32:42.373560+0000","last_fullsized":"2024-05-27T12:32:42.373560+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:08:37.481605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.373449+0000","last_change":"2024-05-27T12:32:42.370650+0000","last_active":"2024-05-27T12:32:42.373449+0000","last_peered":"2024-05-27T12:32:42.373449+0000","last_clean":"2024-05-27T12:32:42.373449+0000","last_became_active":"2024-05-27T12:32:42.370319+0000","last_became_peered":"2024-05-27T12:32:42.370319+0000","last_unstale":"2024-05-27T12:32:42.373449+0000","last_undegraded":"2024-05-27T12:32:42.373449+0000","last_fullsized":"2024-05-27T12:32:42.373449+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:07:22.262394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-27T12:32:41.357829+0000","last_change":"2024-05-27T12:32:41.357829+0000","last_active":"2024-05-27T12:32:41.333908+0000","last_peered":"2024-05-27T12:32:41.333908+0000","last_clean":"2024-05-27T12:32:41.333908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T12:32:41.357829+0000","last_undegraded":"2024-05-27T12:32:41.357829+0000","last_fullsized":"2024-05-27T12:32:41.357829+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.386644+0000","last_change":"2024-05-27T12:32:42.383033+0000","last_active":"2024-05-27T12:32:42.386644+0000","last_peered":"2024-05-27T12:32:42.386644+0000","last_clean":"2024-05-27T12:32:42.386644+0000","last_became_active":"2024-05-27T12:32:42.382745+0000","last_became_peered":"2024-05-27T12:32:42.382745+0000","last_unstale":"2024-05-27T12:32:42.386644+0000","last_undegraded":"2024-05-27T12:32:42.386644+0000","last_fullsized":"2024-05-27T12:32:42.386644+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:21:04.918457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.380985+0000","last_change":"2024-05-27T12:32:42.378742+0000","last_active":"2024-05-27T12:32:42.380985+0000","last_peered":"2024-05-27T12:32:42.380985+0000","last_clean":"2024-05-27T12:32:42.380985+0000","last_became_active":"2024-05-27T12:32:42.378328+0000","last_became_peered":"2024-05-27T12:32:42.378328+0000","last_unstale":"2024-05-27T12:32:42.380985+0000","last_undegraded":"2024-05-27T12:32:42.380985+0000","last_fullsized":"2024-05-27T12:32:42.380985+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:21:04.918457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.386591+0000","last_change":"2024-05-27T12:32:42.381867+0000","last_active":"2024-05-27T12:32:42.386591+0000","last_peered":"2024-05-27T12:32:42.386591+0000","last_clean":"2024-05-27T12:32:42.386591+0000","last_became_active":"2024-05-27T12:32:42.381591+0000","last_became_peered":"2024-05-27T12:32:42.381591+0000","last_unstale":"2024-05-27T12:32:42.386591+0000","last_undegraded":"2024-05-27T12:32:42.386591+0000","last_fullsized":"2024-05-27T12:32:42.386591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:07:22.262394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.373759+0000","last_change":"2024-05-27T12:32:42.372176+0000","last_active":"2024-05-27T12:32:42.373759+0000","last_peered":"2024-05-27T12:32:42.373759+0000","last_clean":"2024-05-27T12:32:42.373759+0000","last_became_active":"2024-05-27T12:32:42.371874+0000","last_became_peered":"2024-05-27T12:32:42.371874+0000","last_unstale":"2024-05-27T12:32:42.373759+0000","last_undegraded":"2024-05-27T12:32:42.373759+0000","last_fullsized":"2024-05-27T12:32:42.373759+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:10:30.753626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.375586+0000","last_change":"2024-05-27T12:32:42.374766+0000","last_active":"2024-05-27T12:32:42.375586+0000","last_peered":"2024-05-27T12:32:42.375586+0000","last_clean":"2024-05-27T12:32:42.375586+0000","last_became_active":"2024-05-27T12:32:42.374450+0000","last_became_peered":"2024-05-27T12:32:42.374450+0000","last_unstale":"2024-05-27T12:32:42.375586+0000","last_undegraded":"2024-05-27T12:32:42.375586+0000","last_fullsized":"2024-05-27T12:32:42.375586+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:20:05.304417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.380262+0000","last_change":"2024-05-27T12:32:42.376636+0000","last_active":"2024-05-27T12:32:42.380262+0000","last_peered":"2024-05-27T12:32:42.380262+0000","last_clean":"2024-05-27T12:32:42.380262+0000","last_became_active":"2024-05-27T12:32:42.376364+0000","last_became_peered":"2024-05-27T12:32:42.376364+0000","last_unstale":"2024-05-27T12:32:42.380262+0000","last_undegraded":"2024-05-27T12:32:42.380262+0000","last_fullsized":"2024-05-27T12:32:42.380262+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:53:37.721445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.373632+0000","last_change":"2024-05-27T12:32:42.371595+0000","last_active":"2024-05-27T12:32:42.373632+0000","last_peered":"2024-05-27T12:32:42.373632+0000","last_clean":"2024-05-27T12:32:42.373632+0000","last_became_active":"2024-05-27T12:32:42.370375+0000","last_became_peered":"2024-05-27T12:32:42.370375+0000","last_unstale":"2024-05-27T12:32:42.373632+0000","last_undegraded":"2024-05-27T12:32:42.373632+0000","last_fullsized":"2024-05-27T12:32:42.373632+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T23:33:14.178019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-27T12:32:41.356437+0000","last_change":"2024-05-27T12:32:41.356437+0000","last_active":"2024-05-27T12:32:41.333908+0000","last_peered":"2024-05-27T12:32:41.333908+0000","last_clean":"2024-05-27T12:32:41.333908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T12:32:41.356437+0000","last_undegraded":"2024-05-27T12:32:41.356437+0000","last_fullsized":"2024-05-27T12:32:41.356437+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.389200+0000","last_change":"2024-05-27T12:32:42.384076+0000","last_active":"2024-05-27T12:32:42.389200+0000","last_peered":"2024-05-27T12:32:42.389200+0000","last_clean":"2024-05-27T12:32:42.389200+0000","last_became_active":"2024-05-27T12:32:42.383738+0000","last_became_peered":"2024-05-27T12:32:42.383738+0000","last_unstale":"2024-05-27T12:32:42.389200+0000","last_undegraded":"2024-05-27T12:32:42.389200+0000","last_fullsized":"2024-05-27T12:32:42.389200+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:53:37.721445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.382747+0000","last_change":"2024-05-27T12:32:42.379700+0000","last_active":"2024-05-27T12:32:42.382747+0000","last_peered":"2024-05-27T12:32:42.382747+0000","last_clean":"2024-05-27T12:32:42.382747+0000","last_became_active":"2024-05-27T12:32:42.379421+0000","last_became_peered":"2024-05-27T12:32:42.379421+0000","last_unstale":"2024-05-27T12:32:42.382747+0000","last_undegraded":"2024-05-27T12:32:42.382747+0000","last_fullsized":"2024-05-27T12:32:42.382747+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T23:33:14.178019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.383554+0000","last_change":"2024-05-27T12:32:42.379719+0000","last_active":"2024-05-27T12:32:42.383554+0000","last_peered":"2024-05-27T12:32:42.383554+0000","last_clean":"2024-05-27T12:32:42.383554+0000","last_became_active":"2024-05-27T12:32:42.379234+0000","last_became_peered":"2024-05-27T12:32:42.379234+0000","last_unstale":"2024-05-27T12:32:42.383554+0000","last_undegraded":"2024-05-27T12:32:42.383554+0000","last_fullsized":"2024-05-27T12:32:42.383554+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:45:14.026270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.375714+0000","last_change":"2024-05-27T12:32:42.371233+0000","last_active":"2024-05-27T12:32:42.375714+0000","last_peered":"2024-05-27T12:32:42.375714+0000","last_clean":"2024-05-27T12:32:42.375714+0000","last_became_active":"2024-05-27T12:32:42.370965+0000","last_became_peered":"2024-05-27T12:32:42.370965+0000","last_unstale":"2024-05-27T12:32:42.375714+0000","last_undegraded":"2024-05-27T12:32:42.375714+0000","last_fullsized":"2024-05-27T12:32:42.375714+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:29:16.389055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.379340+0000","last_change":"2024-05-27T12:32:41.365100+0000","last_active":"2024-05-27T12:32:42.379340+0000","last_peered":"2024-05-27T12:32:42.379340+0000","last_clean":"2024-05-27T12:32:42.379340+0000","last_became_active":"2024-05-27T12:32:41.364795+0000","last_became_peered":"2024-05-27T12:32:41.364795+0000","last_unstale":"2024-05-27T12:32:42.379340+0000","last_undegraded":"2024-05-27T12:32:42.379340+0000","last_fullsized":"2024-05-27T12:32:42.379340+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:24:00.607915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-27T12:32:41.355572+0000","last_change":"2024-05-27T12:32:41.355572+0000","last_active":"2024-05-27T12:32:41.333908+0000","last_peered":"2024-05-27T12:32:41.333908+0000","last_clean":"2024-05-27T12:32:41.333908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T12:32:41.355572+0000","last_undegraded":"2024-05-27T12:32:41.355572+0000","last_fullsized":"2024-05-27T12:32:41.355572+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.381566+0000","last_change":"2024-05-27T12:32:41.370064+0000","last_active":"2024-05-27T12:32:42.381566+0000","last_peered":"2024-05-27T12:32:42.381566+0000","last_clean":"2024-05-27T12:32:42.381566+0000","last_became_active":"2024-05-27T12:32:41.368679+0000","last_became_peered":"2024-05-27T12:32:41.368679+0000","last_unstale":"2024-05-27T12:32:42.381566+0000","last_undegraded":"2024-05-27T12:32:42.381566+0000","last_fullsized":"2024-05-27T12:32:42.381566+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:31:52.368166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.357284+0000","last_change":"2024-05-27T12:32:41.369441+0000","last_active":"2024-05-27T12:32:42.357284+0000","last_peered":"2024-05-27T12:32:42.357284+0000","last_clean":"2024-05-27T12:32:42.357284+0000","last_became_active":"2024-05-27T12:32:41.369164+0000","last_became_peered":"2024-05-27T12:32:41.369164+0000","last_unstale":"2024-05-27T12:32:42.357284+0000","last_undegraded":"2024-05-27T12:32:42.357284+0000","last_fullsized":"2024-05-27T12:32:42.357284+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:10:55.375726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.383508+0000","last_change":"2024-05-27T12:32:42.381264+0000","last_active":"2024-05-27T12:32:42.383508+0000","last_peered":"2024-05-27T12:32:42.383508+0000","last_clean":"2024-05-27T12:32:42.383508+0000","last_became_active":"2024-05-27T12:32:42.380823+0000","last_became_peered":"2024-05-27T12:32:42.380823+0000","last_unstale":"2024-05-27T12:32:42.383508+0000","last_undegraded":"2024-05-27T12:32:42.383508+0000","last_fullsized":"2024-05-27T12:32:42.383508+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:45:14.026270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.378088+0000","last_change":"2024-05-27T12:32:41.371539+0000","last_active":"2024-05-27T12:32:42.378088+0000","last_peered":"2024-05-27T12:32:42.378088+0000","last_clean":"2024-05-27T12:32:42.378088+0000","last_became_active":"2024-05-27T12:32:41.370827+0000","last_became_peered":"2024-05-27T12:32:41.370827+0000","last_unstale":"2024-05-27T12:32:42.378088+0000","last_undegraded":"2024-05-27T12:32:42.378088+0000","last_fullsized":"2024-05-27T12:32:42.378088+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T23:34:58.092780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.376399+0000","last_change":"2024-05-27T12:32:42.371446+0000","last_active":"2024-05-27T12:32:42.376399+0000","last_peered":"2024-05-27T12:32:42.376399+0000","last_clean":"2024-05-27T12:32:42.376399+0000","last_became_active":"2024-05-27T12:32:42.371197+0000","last_became_peered":"2024-05-27T12:32:42.371197+0000","last_unstale":"2024-05-27T12:32:42.376399+0000","last_undegraded":"2024-05-27T12:32:42.376399+0000","last_fullsized":"2024-05-27T12:32:42.376399+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:21:04.918457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.366123+0000","last_change":"2024-05-27T12:32:41.374793+0000","last_active":"2024-05-27T12:32:42.366123+0000","last_peered":"2024-05-27T12:32:42.366123+0000","last_clean":"2024-05-27T12:32:42.366123+0000","last_became_active":"2024-05-27T12:32:41.374503+0000","last_became_peered":"2024-05-27T12:32:41.374503+0000","last_unstale":"2024-05-27T12:32:42.366123+0000","last_undegraded":"2024-05-27T12:32:42.366123+0000","last_fullsized":"2024-05-27T12:32:42.366123+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T23:33:13.169169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.386679+0000","last_change":"2024-05-27T12:32:42.382592+0000","last_active":"2024-05-27T12:32:42.386679+0000","last_peered":"2024-05-27T12:32:42.386679+0000","last_clean":"2024-05-27T12:32:42.386679+0000","last_became_active":"2024-05-27T12:32:42.382289+0000","last_became_peered":"2024-05-27T12:32:42.382289+0000","last_unstale":"2024-05-27T12:32:42.386679+0000","last_undegraded":"2024-05-27T12:32:42.386679+0000","last_fullsized":"2024-05-27T12:32:42.386679+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:20:05.304417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.369228+0000","last_change":"2024-05-27T12:32:41.370517+0000","last_active":"2024-05-27T12:32:42.369228+0000","last_peered":"2024-05-27T12:32:42.369228+0000","last_clean":"2024-05-27T12:32:42.369228+0000","last_became_active":"2024-05-27T12:32:41.370216+0000","last_became_peered":"2024-05-27T12:32:41.370216+0000","last_unstale":"2024-05-27T12:32:42.369228+0000","last_undegraded":"2024-05-27T12:32:42.369228+0000","last_fullsized":"2024-05-27T12:32:42.369228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:24:00.607915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-27T12:32:41.355055+0000","last_change":"2024-05-27T12:32:41.355055+0000","last_active":"2024-05-27T12:32:41.333908+0000","last_peered":"2024-05-27T12:32:41.333908+0000","last_clean":"2024-05-27T12:32:41.333908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T12:32:41.355055+0000","last_undegraded":"2024-05-27T12:32:41.355055+0000","last_fullsized":"2024-05-27T12:32:41.355055+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.385260+0000","last_change":"2024-05-27T12:32:41.373060+0000","last_active":"2024-05-27T12:32:42.385260+0000","last_peered":"2024-05-27T12:32:42.385260+0000","last_clean":"2024-05-27T12:32:42.385260+0000","last_became_active":"2024-05-27T12:32:41.372729+0000","last_became_peered":"2024-05-27T12:32:41.372729+0000","last_unstale":"2024-05-27T12:32:42.385260+0000","last_undegraded":"2024-05-27T12:32:42.385260+0000","last_fullsized":"2024-05-27T12:32:42.385260+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T23:34:58.092780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.369547+0000","last_change":"2024-05-27T12:32:42.368863+0000","last_active":"2024-05-27T12:32:42.369547+0000","last_peered":"2024-05-27T12:32:42.369547+0000","last_clean":"2024-05-27T12:32:42.369547+0000","last_became_active":"2024-05-27T12:32:42.368593+0000","last_became_peered":"2024-05-27T12:32:42.368593+0000","last_unstale":"2024-05-27T12:32:42.369547+0000","last_undegraded":"2024-05-27T12:32:42.369547+0000","last_fullsized":"2024-05-27T12:32:42.369547+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:17:15.780477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"22'6","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.389628+0000","last_change":"2024-05-27T12:32:41.369617+0000","last_active":"2024-05-27T12:32:42.389628+0000","last_peered":"2024-05-27T12:32:42.389628+0000","last_clean":"2024-05-27T12:32:42.389628+0000","last_became_active":"2024-05-27T12:32:41.369371+0000","last_became_peered":"2024-05-27T12:32:41.369371+0000","last_unstale":"2024-05-27T12:32:42.389628+0000","last_undegraded":"2024-05-27T12:32:42.389628+0000","last_fullsized":"2024-05-27T12:32:42.389628+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:24:00.607915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.365054+0000","last_change":"2024-05-27T12:32:42.362804+0000","last_active":"2024-05-27T12:32:42.365054+0000","last_peered":"2024-05-27T12:32:42.365054+0000","last_clean":"2024-05-27T12:32:42.365054+0000","last_became_active":"2024-05-27T12:32:42.362483+0000","last_became_peered":"2024-05-27T12:32:42.362483+0000","last_unstale":"2024-05-27T12:32:42.365054+0000","last_undegraded":"2024-05-27T12:32:42.365054+0000","last_fullsized":"2024-05-27T12:32:42.365054+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:53:37.721445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-27T12:32:41.369052+0000","last_change":"2024-05-27T12:32:41.365663+0000","last_active":"2024-05-27T12:32:41.369052+0000","last_peered":"2024-05-27T12:32:41.369052+0000","last_clean":"2024-05-27T12:32:41.369052+0000","last_became_active":"2024-05-27T12:32:41.365362+0000","last_became_peered":"2024-05-27T12:32:41.365362+0000","last_unstale":"2024-05-27T12:32:41.369052+0000","last_undegraded":"2024-05-27T12:32:41.369052+0000","last_fullsized":"2024-05-27T12:32:41.369052+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:56:40.549127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-27T12:32:41.355128+0000","last_change":"2024-05-27T12:32:41.355128+0000","last_active":"2024-05-27T12:32:41.333908+0000","last_peered":"2024-05-27T12:32:41.333908+0000","last_clean":"2024-05-27T12:32:41.333908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T12:32:41.355128+0000","last_undegraded":"2024-05-27T12:32:41.355128+0000","last_fullsized":"2024-05-27T12:32:41.355128+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.378054+0000","last_change":"2024-05-27T12:32:41.371087+0000","last_active":"2024-05-27T12:32:42.378054+0000","last_peered":"2024-05-27T12:32:42.378054+0000","last_clean":"2024-05-27T12:32:42.378054+0000","last_became_active":"2024-05-27T12:32:41.370237+0000","last_became_peered":"2024-05-27T12:32:41.370237+0000","last_unstale":"2024-05-27T12:32:42.378054+0000","last_undegraded":"2024-05-27T12:32:42.378054+0000","last_fullsized":"2024-05-27T12:32:42.378054+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:31:52.368166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.374122+0000","last_change":"2024-05-27T12:32:42.371339+0000","last_active":"2024-05-27T12:32:42.374122+0000","last_peered":"2024-05-27T12:32:42.374122+0000","last_clean":"2024-05-27T12:32:42.374122+0000","last_became_active":"2024-05-27T12:32:42.370848+0000","last_became_peered":"2024-05-27T12:32:42.370848+0000","last_unstale":"2024-05-27T12:32:42.374122+0000","last_undegraded":"2024-05-27T12:32:42.374122+0000","last_fullsized":"2024-05-27T12:32:42.374122+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:41:35.310708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.360647+0000","last_change":"2024-05-27T12:32:41.368354+0000","last_active":"2024-05-27T12:32:42.360647+0000","last_peered":"2024-05-27T12:32:42.360647+0000","last_clean":"2024-05-27T12:32:42.360647+0000","last_became_active":"2024-05-27T12:32:41.368086+0000","last_became_peered":"2024-05-27T12:32:41.368086+0000","last_unstale":"2024-05-27T12:32:42.360647+0000","last_undegraded":"2024-05-27T12:32:42.360647+0000","last_fullsized":"2024-05-27T12:32:42.360647+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T23:55:01.390036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.383529+0000","last_change":"2024-05-27T12:32:42.379489+0000","last_active":"2024-05-27T12:32:42.383529+0000","last_peered":"2024-05-27T12:32:42.383529+0000","last_clean":"2024-05-27T12:32:42.383529+0000","last_became_active":"2024-05-27T12:32:42.378880+0000","last_became_peered":"2024-05-27T12:32:42.378880+0000","last_unstale":"2024-05-27T12:32:42.383529+0000","last_undegraded":"2024-05-27T12:32:42.383529+0000","last_fullsized":"2024-05-27T12:32:42.383529+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:21:04.918457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.385950+0000","last_change":"2024-05-27T12:32:41.362154+0000","last_active":"2024-05-27T12:32:42.385950+0000","last_peered":"2024-05-27T12:32:42.385950+0000","last_clean":"2024-05-27T12:32:42.385950+0000","last_became_active":"2024-05-27T12:32:41.361845+0000","last_became_peered":"2024-05-27T12:32:41.361845+0000","last_unstale":"2024-05-27T12:32:42.385950+0000","last_undegraded":"2024-05-27T12:32:42.385950+0000","last_fullsized":"2024-05-27T12:32:42.385950+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:10:55.375726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.383492+0000","last_change":"2024-05-27T12:32:42.378975+0000","last_active":"2024-05-27T12:32:42.383492+0000","last_peered":"2024-05-27T12:32:42.383492+0000","last_clean":"2024-05-27T12:32:42.383492+0000","last_became_active":"2024-05-27T12:32:42.378666+0000","last_became_peered":"2024-05-27T12:32:42.378666+0000","last_unstale":"2024-05-27T12:32:42.383492+0000","last_undegraded":"2024-05-27T12:32:42.383492+0000","last_fullsized":"2024-05-27T12:32:42.383492+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:46:07.761461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.386837+0000","last_change":"2024-05-27T12:32:41.363195+0000","last_active":"2024-05-27T12:32:42.386837+0000","last_peered":"2024-05-27T12:32:42.386837+0000","last_clean":"2024-05-27T12:32:42.386837+0000","last_became_active":"2024-05-27T12:32:41.362693+0000","last_became_peered":"2024-05-27T12:32:41.362693+0000","last_unstale":"2024-05-27T12:32:42.386837+0000","last_undegraded":"2024-05-27T12:32:42.386837+0000","last_fullsized":"2024-05-27T12:32:42.386837+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:10:55.375726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.372618+0000","last_change":"2024-05-27T12:32:42.370922+0000","last_active":"2024-05-27T12:32:42.372618+0000","last_peered":"2024-05-27T12:32:42.372618+0000","last_clean":"2024-05-27T12:32:42.372618+0000","last_became_active":"2024-05-27T12:32:42.370170+0000","last_became_peered":"2024-05-27T12:32:42.370170+0000","last_unstale":"2024-05-27T12:32:42.372618+0000","last_undegraded":"2024-05-27T12:32:42.372618+0000","last_fullsized":"2024-05-27T12:32:42.372618+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:46:59.701728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.381265+0000","last_change":"2024-05-27T12:32:41.366108+0000","last_active":"2024-05-27T12:32:42.381265+0000","last_peered":"2024-05-27T12:32:42.381265+0000","last_clean":"2024-05-27T12:32:42.381265+0000","last_became_active":"2024-05-27T12:32:41.365777+0000","last_became_peered":"2024-05-27T12:32:41.365777+0000","last_unstale":"2024-05-27T12:32:42.381265+0000","last_undegraded":"2024-05-27T12:32:42.381265+0000","last_fullsized":"2024-05-27T12:32:42.381265+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:24:00.607915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.378712+0000","last_change":"2024-05-27T12:32:42.374653+0000","last_active":"2024-05-27T12:32:42.378712+0000","last_peered":"2024-05-27T12:32:42.378712+0000","last_clean":"2024-05-27T12:32:42.378712+0000","last_became_active":"2024-05-27T12:32:42.370933+0000","last_became_peered":"2024-05-27T12:32:42.370933+0000","last_unstale":"2024-05-27T12:32:42.378712+0000","last_undegraded":"2024-05-27T12:32:42.378712+0000","last_fullsized":"2024-05-27T12:32:42.378712+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:17:24.104572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.376016+0000","last_change":"2024-05-27T12:32:41.366243+0000","last_active":"2024-05-27T12:32:42.376016+0000","last_peered":"2024-05-27T12:32:42.376016+0000","last_clean":"2024-05-27T12:32:42.376016+0000","last_became_active":"2024-05-27T12:32:41.365843+0000","last_became_peered":"2024-05-27T12:32:41.365843+0000","last_unstale":"2024-05-27T12:32:42.376016+0000","last_undegraded":"2024-05-27T12:32:42.376016+0000","last_fullsized":"2024-05-27T12:32:42.376016+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:31:52.368166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.389274+0000","last_change":"2024-05-27T12:32:42.384741+0000","last_active":"2024-05-27T12:32:42.389274+0000","last_peered":"2024-05-27T12:32:42.389274+0000","last_clean":"2024-05-27T12:32:42.389274+0000","last_became_active":"2024-05-27T12:32:42.383818+0000","last_became_peered":"2024-05-27T12:32:42.383818+0000","last_unstale":"2024-05-27T12:32:42.389274+0000","last_undegraded":"2024-05-27T12:32:42.389274+0000","last_fullsized":"2024-05-27T12:32:42.389274+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:04:04.818266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.358263+0000","last_change":"2024-05-27T12:32:41.374511+0000","last_active":"2024-05-27T12:32:42.358263+0000","last_peered":"2024-05-27T12:32:42.358263+0000","last_clean":"2024-05-27T12:32:42.358263+0000","last_became_active":"2024-05-27T12:32:41.374221+0000","last_became_peered":"2024-05-27T12:32:41.374221+0000","last_unstale":"2024-05-27T12:32:42.358263+0000","last_undegraded":"2024-05-27T12:32:42.358263+0000","last_fullsized":"2024-05-27T12:32:42.358263+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T23:34:58.092780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.389356+0000","last_change":"2024-05-27T12:32:42.384647+0000","last_active":"2024-05-27T12:32:42.389356+0000","last_peered":"2024-05-27T12:32:42.389356+0000","last_clean":"2024-05-27T12:32:42.389356+0000","last_became_active":"2024-05-27T12:32:42.384389+0000","last_became_peered":"2024-05-27T12:32:42.384389+0000","last_unstale":"2024-05-27T12:32:42.389356+0000","last_undegraded":"2024-05-27T12:32:42.389356+0000","last_fullsized":"2024-05-27T12:32:42.389356+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:03:50.593154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":168,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.355803+0000","last_change":"2024-05-27T12:32:31.185664+0000","last_active":"2024-05-27T12:32:42.355803+0000","last_peered":"2024-05-27T12:32:42.355803+0000","last_clean":"2024-05-27T12:32:42.355803+0000","last_became_active":"2024-05-27T12:32:31.184757+0000","last_became_peered":"2024-05-27T12:32:31.184757+0000","last_unstale":"2024-05-27T12:32:42.355803+0000","last_undegraded":"2024-05-27T12:32:42.355803+0000","last_fullsized":"2024-05-27T12:32:42.355803+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:30.136480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:30.136480+0000","last_clean_scrub_stamp":"2024-05-27T12:32:30.136480+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:49:13.241747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.367240+0000","last_change":"2024-05-27T12:32:41.371475+0000","last_active":"2024-05-27T12:32:42.367240+0000","last_peered":"2024-05-27T12:32:42.367240+0000","last_clean":"2024-05-27T12:32:42.367240+0000","last_became_active":"2024-05-27T12:32:41.371198+0000","last_became_peered":"2024-05-27T12:32:41.371198+0000","last_unstale":"2024-05-27T12:32:42.367240+0000","last_undegraded":"2024-05-27T12:32:42.367240+0000","last_fullsized":"2024-05-27T12:32:42.367240+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T23:55:01.390036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.386892+0000","last_change":"2024-05-27T12:32:42.385699+0000","last_active":"2024-05-27T12:32:42.386892+0000","last_peered":"2024-05-27T12:32:42.386892+0000","last_clean":"2024-05-27T12:32:42.386892+0000","last_became_active":"2024-05-27T12:32:42.385464+0000","last_became_peered":"2024-05-27T12:32:42.385464+0000","last_unstale":"2024-05-27T12:32:42.386892+0000","last_undegraded":"2024-05-27T12:32:42.386892+0000","last_fullsized":"2024-05-27T12:32:42.386892+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:04:04.818266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.356248+0000","last_change":"2024-05-27T12:32:41.371263+0000","last_active":"2024-05-27T12:32:42.356248+0000","last_peered":"2024-05-27T12:32:42.356248+0000","last_clean":"2024-05-27T12:32:42.356248+0000","last_became_active":"2024-05-27T12:32:41.370961+0000","last_became_peered":"2024-05-27T12:32:41.370961+0000","last_unstale":"2024-05-27T12:32:42.356248+0000","last_undegraded":"2024-05-27T12:32:42.356248+0000","last_fullsized":"2024-05-27T12:32:42.356248+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:07:21.253545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-27T12:32:41.355359+0000","last_change":"2024-05-27T12:32:41.355359+0000","last_active":"2024-05-27T12:32:41.333908+0000","last_peered":"2024-05-27T12:32:41.333908+0000","last_clean":"2024-05-27T12:32:41.333908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T12:32:41.355359+0000","last_undegraded":"2024-05-27T12:32:41.355359+0000","last_fullsized":"2024-05-27T12:32:41.355359+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.357960+0000","last_change":"2024-05-27T12:32:41.366189+0000","last_active":"2024-05-27T12:32:42.357960+0000","last_peered":"2024-05-27T12:32:42.357960+0000","last_clean":"2024-05-27T12:32:42.357960+0000","last_became_active":"2024-05-27T12:32:41.365860+0000","last_became_peered":"2024-05-27T12:32:41.365860+0000","last_unstale":"2024-05-27T12:32:42.357960+0000","last_undegraded":"2024-05-27T12:32:42.357960+0000","last_fullsized":"2024-05-27T12:32:42.357960+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T23:55:01.390036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.375838+0000","last_change":"2024-05-27T12:32:42.370436+0000","last_active":"2024-05-27T12:32:42.375838+0000","last_peered":"2024-05-27T12:32:42.375838+0000","last_clean":"2024-05-27T12:32:42.375838+0000","last_became_active":"2024-05-27T12:32:42.370051+0000","last_became_peered":"2024-05-27T12:32:42.370051+0000","last_unstale":"2024-05-27T12:32:42.375838+0000","last_undegraded":"2024-05-27T12:32:42.375838+0000","last_fullsized":"2024-05-27T12:32:42.375838+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:10:30.753626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.378150+0000","last_change":"2024-05-27T12:32:41.368242+0000","last_active":"2024-05-27T12:32:42.378150+0000","last_peered":"2024-05-27T12:32:42.378150+0000","last_clean":"2024-05-27T12:32:42.378150+0000","last_became_active":"2024-05-27T12:32:41.366995+0000","last_became_peered":"2024-05-27T12:32:41.366995+0000","last_unstale":"2024-05-27T12:32:42.378150+0000","last_undegraded":"2024-05-27T12:32:42.378150+0000","last_fullsized":"2024-05-27T12:32:42.378150+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T23:33:13.169169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.389268+0000","last_change":"2024-05-27T12:32:42.382859+0000","last_active":"2024-05-27T12:32:42.389268+0000","last_peered":"2024-05-27T12:32:42.389268+0000","last_clean":"2024-05-27T12:32:42.389268+0000","last_became_active":"2024-05-27T12:32:42.382312+0000","last_became_peered":"2024-05-27T12:32:42.382312+0000","last_unstale":"2024-05-27T12:32:42.389268+0000","last_undegraded":"2024-05-27T12:32:42.389268+0000","last_fullsized":"2024-05-27T12:32:42.389268+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:24:01.616764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.366276+0000","last_change":"2024-05-27T12:32:41.362976+0000","last_active":"2024-05-27T12:32:42.366276+0000","last_peered":"2024-05-27T12:32:42.366276+0000","last_clean":"2024-05-27T12:32:42.366276+0000","last_became_active":"2024-05-27T12:32:41.362645+0000","last_became_peered":"2024-05-27T12:32:41.362645+0000","last_unstale":"2024-05-27T12:32:42.366276+0000","last_undegraded":"2024-05-27T12:32:42.366276+0000","last_fullsized":"2024-05-27T12:32:42.366276+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T23:55:01.390036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.386721+0000","last_change":"2024-05-27T12:32:42.382156+0000","last_active":"2024-05-27T12:32:42.386721+0000","last_peered":"2024-05-27T12:32:42.386721+0000","last_clean":"2024-05-27T12:32:42.386721+0000","last_became_active":"2024-05-27T12:32:42.381678+0000","last_became_peered":"2024-05-27T12:32:42.381678+0000","last_unstale":"2024-05-27T12:32:42.386721+0000","last_undegraded":"2024-05-27T12:32:42.386721+0000","last_fullsized":"2024-05-27T12:32:42.386721+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:10:30.753626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.357204+0000","last_change":"2024-05-27T12:32:41.371270+0000","last_active":"2024-05-27T12:32:42.357204+0000","last_peered":"2024-05-27T12:32:42.357204+0000","last_clean":"2024-05-27T12:32:42.357204+0000","last_became_active":"2024-05-27T12:32:41.370665+0000","last_became_peered":"2024-05-27T12:32:41.370665+0000","last_unstale":"2024-05-27T12:32:42.357204+0000","last_undegraded":"2024-05-27T12:32:42.357204+0000","last_fullsized":"2024-05-27T12:32:42.357204+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:45:13.017421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.375875+0000","last_change":"2024-05-27T12:32:42.371153+0000","last_active":"2024-05-27T12:32:42.375875+0000","last_peered":"2024-05-27T12:32:42.375875+0000","last_clean":"2024-05-27T12:32:42.375875+0000","last_became_active":"2024-05-27T12:32:42.370862+0000","last_became_peered":"2024-05-27T12:32:42.370862+0000","last_unstale":"2024-05-27T12:32:42.375875+0000","last_undegraded":"2024-05-27T12:32:42.375875+0000","last_fullsized":"2024-05-27T12:32:42.375875+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:20:05.304417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.368179+0000","last_change":"2024-05-27T12:32:41.368774+0000","last_active":"2024-05-27T12:32:42.368179+0000","last_peered":"2024-05-27T12:32:42.368179+0000","last_clean":"2024-05-27T12:32:42.368179+0000","last_became_active":"2024-05-27T12:32:41.368343+0000","last_became_peered":"2024-05-27T12:32:41.368343+0000","last_unstale":"2024-05-27T12:32:42.368179+0000","last_undegraded":"2024-05-27T12:32:42.368179+0000","last_fullsized":"2024-05-27T12:32:42.368179+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:07:21.253545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.365718+0000","last_change":"2024-05-27T12:32:42.361807+0000","last_active":"2024-05-27T12:32:42.365718+0000","last_peered":"2024-05-27T12:32:42.365718+0000","last_clean":"2024-05-27T12:32:42.365718+0000","last_became_active":"2024-05-27T12:32:42.361508+0000","last_became_peered":"2024-05-27T12:32:42.361508+0000","last_unstale":"2024-05-27T12:32:42.365718+0000","last_undegraded":"2024-05-27T12:32:42.365718+0000","last_fullsized":"2024-05-27T12:32:42.365718+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T23:34:59.101630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.382030+0000","last_change":"2024-05-27T12:32:41.368907+0000","last_active":"2024-05-27T12:32:42.382030+0000","last_peered":"2024-05-27T12:32:42.382030+0000","last_clean":"2024-05-27T12:32:42.382030+0000","last_became_active":"2024-05-27T12:32:41.368392+0000","last_became_peered":"2024-05-27T12:32:41.368392+0000","last_unstale":"2024-05-27T12:32:42.382030+0000","last_undegraded":"2024-05-27T12:32:42.382030+0000","last_fullsized":"2024-05-27T12:32:42.382030+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T23:34:58.092780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-27T12:32:41.355247+0000","last_change":"2024-05-27T12:32:41.355247+0000","last_active":"2024-05-27T12:32:41.333908+0000","last_peered":"2024-05-27T12:32:41.333908+0000","last_clean":"2024-05-27T12:32:41.333908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T12:32:41.355247+0000","last_undegraded":"2024-05-27T12:32:41.355247+0000","last_fullsized":"2024-05-27T12:32:41.355247+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.355748+0000","last_change":"2024-05-27T12:32:41.369723+0000","last_active":"2024-05-27T12:32:42.355748+0000","last_peered":"2024-05-27T12:32:42.355748+0000","last_clean":"2024-05-27T12:32:42.355748+0000","last_became_active":"2024-05-27T12:32:41.369404+0000","last_became_peered":"2024-05-27T12:32:41.369404+0000","last_unstale":"2024-05-27T12:32:42.355748+0000","last_undegraded":"2024-05-27T12:32:42.355748+0000","last_fullsized":"2024-05-27T12:32:42.355748+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T23:33:13.169169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.377750+0000","last_change":"2024-05-27T12:32:42.371958+0000","last_active":"2024-05-27T12:32:42.377750+0000","last_peered":"2024-05-27T12:32:42.377750+0000","last_clean":"2024-05-27T12:32:42.377750+0000","last_became_active":"2024-05-27T12:32:42.371689+0000","last_became_peered":"2024-05-27T12:32:42.371689+0000","last_unstale":"2024-05-27T12:32:42.377750+0000","last_undegraded":"2024-05-27T12:32:42.377750+0000","last_fullsized":"2024-05-27T12:32:42.377750+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:41:36.904875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.367113+0000","last_change":"2024-05-27T12:32:41.367208+0000","last_active":"2024-05-27T12:32:42.367113+0000","last_peered":"2024-05-27T12:32:42.367113+0000","last_clean":"2024-05-27T12:32:42.367113+0000","last_became_active":"2024-05-27T12:32:41.366772+0000","last_became_peered":"2024-05-27T12:32:41.366772+0000","last_unstale":"2024-05-27T12:32:42.367113+0000","last_undegraded":"2024-05-27T12:32:42.367113+0000","last_fullsized":"2024-05-27T12:32:42.367113+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T23:33:13.169169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.373596+0000","last_change":"2024-05-27T12:32:42.371618+0000","last_active":"2024-05-27T12:32:42.373596+0000","last_peered":"2024-05-27T12:32:42.373596+0000","last_clean":"2024-05-27T12:32:42.373596+0000","last_became_active":"2024-05-27T12:32:42.369525+0000","last_became_peered":"2024-05-27T12:32:42.369525+0000","last_unstale":"2024-05-27T12:32:42.373596+0000","last_undegraded":"2024-05-27T12:32:42.373596+0000","last_fullsized":"2024-05-27T12:32:42.373596+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:07:22.262394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.366697+0000","last_change":"2024-05-27T12:32:41.366388+0000","last_active":"2024-05-27T12:32:42.366697+0000","last_peered":"2024-05-27T12:32:42.366697+0000","last_clean":"2024-05-27T12:32:42.366697+0000","last_became_active":"2024-05-27T12:32:41.365881+0000","last_became_peered":"2024-05-27T12:32:41.365881+0000","last_unstale":"2024-05-27T12:32:42.366697+0000","last_undegraded":"2024-05-27T12:32:42.366697+0000","last_fullsized":"2024-05-27T12:32:42.366697+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:24:00.607915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.384844+0000","last_change":"2024-05-27T12:32:42.383798+0000","last_active":"2024-05-27T12:32:42.384844+0000","last_peered":"2024-05-27T12:32:42.384844+0000","last_clean":"2024-05-27T12:32:42.384844+0000","last_became_active":"2024-05-27T12:32:42.383431+0000","last_became_peered":"2024-05-27T12:32:42.383431+0000","last_unstale":"2024-05-27T12:32:42.384844+0000","last_undegraded":"2024-05-27T12:32:42.384844+0000","last_fullsized":"2024-05-27T12:32:42.384844+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:53:37.721445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.386769+0000","last_change":"2024-05-27T12:32:41.373716+0000","last_active":"2024-05-27T12:32:42.386769+0000","last_peered":"2024-05-27T12:32:42.386769+0000","last_clean":"2024-05-27T12:32:42.386769+0000","last_became_active":"2024-05-27T12:32:41.373364+0000","last_became_peered":"2024-05-27T12:32:41.373364+0000","last_unstale":"2024-05-27T12:32:42.386769+0000","last_undegraded":"2024-05-27T12:32:42.386769+0000","last_fullsized":"2024-05-27T12:32:42.386769+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:21:03.909608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.372702+0000","last_change":"2024-05-27T12:32:42.370445+0000","last_active":"2024-05-27T12:32:42.372702+0000","last_peered":"2024-05-27T12:32:42.372702+0000","last_clean":"2024-05-27T12:32:42.372702+0000","last_became_active":"2024-05-27T12:32:42.370164+0000","last_became_peered":"2024-05-27T12:32:42.370164+0000","last_unstale":"2024-05-27T12:32:42.372702+0000","last_undegraded":"2024-05-27T12:32:42.372702+0000","last_fullsized":"2024-05-27T12:32:42.372702+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:10:30.753626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.389983+0000","last_change":"2024-05-27T12:32:42.386589+0000","last_active":"2024-05-27T12:32:42.389983+0000","last_peered":"2024-05-27T12:32:42.389983+0000","last_clean":"2024-05-27T12:32:42.389983+0000","last_became_active":"2024-05-27T12:32:42.386297+0000","last_became_peered":"2024-05-27T12:32:42.386297+0000","last_unstale":"2024-05-27T12:32:42.389983+0000","last_undegraded":"2024-05-27T12:32:42.389983+0000","last_fullsized":"2024-05-27T12:32:42.389983+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:46:59.701728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.384700+0000","last_change":"2024-05-27T12:32:41.374812+0000","last_active":"2024-05-27T12:32:42.384700+0000","last_peered":"2024-05-27T12:32:42.384700+0000","last_clean":"2024-05-27T12:32:42.384700+0000","last_became_active":"2024-05-27T12:32:41.374488+0000","last_became_peered":"2024-05-27T12:32:41.374488+0000","last_unstale":"2024-05-27T12:32:42.384700+0000","last_undegraded":"2024-05-27T12:32:42.384700+0000","last_fullsized":"2024-05-27T12:32:42.384700+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:10:29.744776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.393996+0000","last_change":"2024-05-27T12:32:42.389941+0000","last_active":"2024-05-27T12:32:42.393996+0000","last_peered":"2024-05-27T12:32:42.393996+0000","last_clean":"2024-05-27T12:32:42.393996+0000","last_became_active":"2024-05-27T12:32:42.389630+0000","last_became_peered":"2024-05-27T12:32:42.389630+0000","last_unstale":"2024-05-27T12:32:42.393996+0000","last_undegraded":"2024-05-27T12:32:42.393996+0000","last_fullsized":"2024-05-27T12:32:42.393996+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:17:24.104572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.375424+0000","last_change":"2024-05-27T12:32:41.371373+0000","last_active":"2024-05-27T12:32:42.375424+0000","last_peered":"2024-05-27T12:32:42.375424+0000","last_clean":"2024-05-27T12:32:42.375424+0000","last_became_active":"2024-05-27T12:32:41.371009+0000","last_became_peered":"2024-05-27T12:32:41.371009+0000","last_unstale":"2024-05-27T12:32:42.375424+0000","last_undegraded":"2024-05-27T12:32:42.375424+0000","last_fullsized":"2024-05-27T12:32:42.375424+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:20:04.295568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-05-27T12:32:41.357214+0000","last_change":"2024-05-27T12:32:41.357214+0000","last_active":"2024-05-27T12:32:41.333908+0000","last_peered":"2024-05-27T12:32:41.333908+0000","last_clean":"2024-05-27T12:32:41.333908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-27T12:32:41.357214+0000","last_undegraded":"2024-05-27T12:32:41.357214+0000","last_fullsized":"2024-05-27T12:32:41.357214+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.386157+0000","last_change":"2024-05-27T12:32:41.362828+0000","last_active":"2024-05-27T12:32:42.386157+0000","last_peered":"2024-05-27T12:32:42.386157+0000","last_clean":"2024-05-27T12:32:42.386157+0000","last_became_active":"2024-05-27T12:32:41.362526+0000","last_became_peered":"2024-05-27T12:32:41.362526+0000","last_unstale":"2024-05-27T12:32:42.386157+0000","last_undegraded":"2024-05-27T12:32:42.386157+0000","last_fullsized":"2024-05-27T12:32:42.386157+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T23:55:01.390036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-27T12:32:42.373006+0000","last_change":"2024-05-27T12:32:42.368191+0000","last_active":"2024-05-27T12:32:42.373006+0000","last_peered":"2024-05-27T12:32:42.373006+0000","last_clean":"2024-05-27T12:32:42.373006+0000","last_became_active":"2024-05-27T12:32:42.367914+0000","last_became_peered":"2024-05-27T12:32:42.367914+0000","last_unstale":"2024-05-27T12:32:42.373006+0000","last_undegraded":"2024-05-27T12:32:42.373006+0000","last_fullsized":"2024-05-27T12:32:42.373006+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:31:53.377015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-27T12:32:41.369794+0000","last_change":"2024-05-27T12:32:41.364608+0000","last_active":"2024-05-27T12:32:41.369794+0000","last_peered":"2024-05-27T12:32:41.369794+0000","last_clean":"2024-05-27T12:32:41.369794+0000","last_became_active":"2024-05-27T12:32:41.364245+0000","last_became_peered":"2024-05-27T12:32:41.364245+0000","last_unstale":"2024-05-27T12:32:41.369794+0000","last_undegraded":"2024-05-27T12:32:41.369794+0000","last_fullsized":"2024-05-27T12:32:41.369794+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:20:13.667380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1794,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":4182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32,"ondisk_log_size":32,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509445,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":819200,"data_stored":665605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509445,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":233472,"data_stored":76267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509445,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":225280,"data_stored":74745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509445,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":233472,"data_stored":74781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509445,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":233472,"data_stored":76267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509445,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31396,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340444,"statfs":{"total":96636764160,"available":96604614656,"internally_reserved":0,"allocated":221184,"data_stored":74655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":229376,"data_stored":74815,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542150,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31964,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339876,"statfs":{"total":96636764160,"available":96604033024,"internally_reserved":0,"allocated":802816,"data_stored":658248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-27T12:32:49.851 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-27T12:32:49.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:49.968+0000 7fc374b5c640 1 Processor -- start 2024-05-27T12:32:49.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:49.968+0000 7fc374b5c640 1 -- start start 2024-05-27T12:32:49.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:49.969+0000 7fc374b5c640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc37015eb00 0x7fc37015f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:49.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:49.969+0000 7fc374b5c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc37009b140 0x7fc3701684f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:49.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:49.969+0000 7fc374b5c640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3700d08b0 con 0x7fc3700d1630 2024-05-27T12:32:49.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:49.969+0000 7fc374b5c640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7fc3700d1a50 con 0x7fc37009b140 2024-05-27T12:32:49.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:49.969+0000 7fc374b5c640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fc3700d0b50 con 0x7fc37015eb00 2024-05-27T12:32:49.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:49.969+0000 7fc36ed9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc37009b140 0x7fc3701684f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:49.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:49.969+0000 7fc36dd9b640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fc3700d1630 0x7fc37009aa30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:60370/0 (socket says 172.21.15.55:60370) 2024-05-27T12:32:49.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:49.969+0000 7fc36dd9b640 1 -- 172.21.15.55:0/3344513576 learned_addr learned my addr 172.21.15.55:0/3344513576 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-27T12:32:49.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:49.970+0000 7fc36e59c640 1 --2- 172.21.15.55:0/3344513576 >> v2:172.21.15.72:3300/0 conn(0x7fc37015eb00 0x7fc37015f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:49.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:49.970+0000 7fc36ed9d640 1 -- 172.21.15.55:0/3344513576 >> v2:172.21.15.72:3300/0 conn(0x7fc37015eb00 msgr2=0x7fc37015f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:32:49.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:49.970+0000 7fc36ed9d640 1 --2- 172.21.15.55:0/3344513576 >> v2:172.21.15.72:3300/0 conn(0x7fc37015eb00 0x7fc37015f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:49.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:49.970+0000 7fc36ed9d640 1 -- 172.21.15.55:0/3344513576 >> v1:172.21.15.55:6789/0 conn(0x7fc3700d1630 legacy=0x7fc37009aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:49.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:49.970+0000 7fc36ed9d640 1 -- 172.21.15.55:0/3344513576 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3700d0e30 con 0x7fc37009b140 2024-05-27T12:32:49.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:49.970+0000 7fc36d59a640 1 -- 172.21.15.55:0/3344513576 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3838569773 0 0) 0x7fc3700d08b0 con 0x7fc3700d1630 2024-05-27T12:32:49.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:49.971+0000 7fc36ed9d640 1 --2- 172.21.15.55:0/3344513576 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc37009b140 0x7fc3701684f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc370073d80 tx=0x7fc36802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41ae55633217a196 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:49.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:49.971+0000 7fc36d59a640 1 -- 172.21.15.55:0/3344513576 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc368037070 con 0x7fc37009b140 2024-05-27T12:32:49.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:49.971+0000 7fc36d59a640 1 -- 172.21.15.55:0/3344513576 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc368032440 con 0x7fc37009b140 2024-05-27T12:32:49.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:49.971+0000 7fc36d59a640 1 -- 172.21.15.55:0/3344513576 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc368032810 con 0x7fc37009b140 2024-05-27T12:32:49.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:49.971+0000 7fc374b5c640 1 -- 172.21.15.55:0/3344513576 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc37009b140 msgr2=0x7fc3701684f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:49.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:49.971+0000 7fc374b5c640 1 --2- 172.21.15.55:0/3344513576 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc37009b140 0x7fc3701684f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc370073d80 tx=0x7fc36802a230 comp rx=0 tx=0).stop 2024-05-27T12:32:49.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:49.971+0000 7fc374b5c640 1 -- 172.21.15.55:0/3344513576 shutdown_connections 2024-05-27T12:32:49.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:49.971+0000 7fc374b5c640 1 --2- 172.21.15.55:0/3344513576 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc37009b140 0x7fc3701684f0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:49.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:49.971+0000 7fc374b5c640 1 --2- 172.21.15.55:0/3344513576 >> v2:172.21.15.72:3300/0 conn(0x7fc37015eb00 0x7fc37015f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:49.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:49.971+0000 7fc374b5c640 1 -- 172.21.15.55:0/3344513576 >> 172.21.15.55:0/3344513576 conn(0x7fc3700b4100 msgr2=0x7fc3700b4510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:49.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:49.971+0000 7fc374b5c640 1 -- 172.21.15.55:0/3344513576 shutdown_connections 2024-05-27T12:32:49.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:49.971+0000 7fc374b5c640 1 -- 172.21.15.55:0/3344513576 wait complete. 2024-05-27T12:32:49.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:49.973+0000 7fc374b5c640 1 Processor -- start 2024-05-27T12:32:49.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:49.973+0000 7fc374b5c640 1 -- start start 2024-05-27T12:32:49.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:49.974+0000 7fc374b5c640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc37009b140 0x7fc370152bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:49.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:49.974+0000 7fc374b5c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc3700d1630 0x7fc3700ca0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:49.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:49.974+0000 7fc374b5c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc37015eb00 0x7fc3700cd6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:49.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:49.974+0000 7fc374b5c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7fc37009b590 con 0x7fc37015eb00 2024-05-27T12:32:49.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:49.974+0000 7fc374b5c640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fc370160040 con 0x7fc3700d1630 2024-05-27T12:32:49.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:49.974+0000 7fc374b5c640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fc37009b710 con 0x7fc37009b140 2024-05-27T12:32:49.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:49.974+0000 7fc36ed9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc37015eb00 0x7fc3700cd6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:49.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:49.974+0000 7fc36ed9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc37015eb00 0x7fc3700cd6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55326/0 (socket says 172.21.15.55:55326) 2024-05-27T12:32:49.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:49.974+0000 7fc36ed9d640 1 -- 172.21.15.55:0/1338074582 learned_addr learned my addr 172.21.15.55:0/1338074582 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:32:49.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:49.974+0000 7fc36dd9b640 1 --2- 172.21.15.55:0/1338074582 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc3700d1630 0x7fc3700ca0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:49.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:49.974+0000 7fc36e59c640 1 --2- 172.21.15.55:0/1338074582 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc37009b140 0x7fc370152bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:49.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:49.974+0000 7fc36ed9d640 1 -- 172.21.15.55:0/1338074582 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc37009b140 msgr2=0x7fc370152bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:49.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:49.974+0000 7fc36ed9d640 1 --2- 172.21.15.55:0/1338074582 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc37009b140 0x7fc370152bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:49.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:49.974+0000 7fc36ed9d640 1 -- 172.21.15.55:0/1338074582 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc3700d1630 msgr2=0x7fc3700ca0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:49.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:49.974+0000 7fc36ed9d640 1 --2- 172.21.15.55:0/1338074582 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc3700d1630 0x7fc3700ca0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:49.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:49.974+0000 7fc36ed9d640 1 -- 172.21.15.55:0/1338074582 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3700ca600 con 0x7fc37015eb00 2024-05-27T12:32:49.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:49.974+0000 7fc36ed9d640 1 --2- 172.21.15.55:0/1338074582 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc37015eb00 0x7fc3700cd6c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc36802a270 tx=0x7fc3680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:49.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:49.974+0000 7fc35effd640 1 -- 172.21.15.55:0/1338074582 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc368037040 con 0x7fc37015eb00 2024-05-27T12:32:49.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:49.974+0000 7fc35effd640 1 -- 172.21.15.55:0/1338074582 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc368042070 con 0x7fc37015eb00 2024-05-27T12:32:49.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:49.974+0000 7fc374b5c640 1 -- 172.21.15.55:0/1338074582 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3700b56b0 con 0x7fc37015eb00 2024-05-27T12:32:49.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:49.975+0000 7fc35effd640 1 -- 172.21.15.55:0/1338074582 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc368030880 con 0x7fc37015eb00 2024-05-27T12:32:49.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:49.975+0000 7fc374b5c640 1 -- 172.21.15.55:0/1338074582 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3700b5c70 con 0x7fc37015eb00 2024-05-27T12:32:49.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:49.976+0000 7fc374b5c640 1 -- 172.21.15.55:0/1338074582 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc370075460 con 0x7fc37015eb00 2024-05-27T12:32:49.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:49.976+0000 7fc35effd640 1 -- 172.21.15.55:0/1338074582 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc368030a20 con 0x7fc37015eb00 2024-05-27T12:32:49.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:49.976+0000 7fc35effd640 1 --2- 172.21.15.55:0/1338074582 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fc35006c920 0x7fc35006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:49.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:49.977+0000 7fc35effd640 1 -- 172.21.15.55:0/1338074582 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fc3680ac440 con 0x7fc37015eb00 2024-05-27T12:32:49.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:49.977+0000 7fc36e59c640 1 --2- 172.21.15.55:0/1338074582 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fc35006c920 0x7fc35006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:49.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:49.977+0000 7fc36e59c640 1 --2- 172.21.15.55:0/1338074582 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fc35006c920 0x7fc35006ede0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc3600074a0 tx=0x7fc36000b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:49.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:49.981+0000 7fc35effd640 1 -- 172.21.15.55:0/1338074582 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc36807a900 con 0x7fc37015eb00 2024-05-27T12:32:50.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.162+0000 7fc374b5c640 1 -- 172.21.15.55:0/1338074582 --> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc370068a00 con 0x7fc35006c920 2024-05-27T12:32:50.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.169+0000 7fc35effd640 1 -- 172.21.15.55:0/1338074582 <== mgr.4105 v2:172.21.15.72:6832/3152720583 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251912 (secure 0 0 0) 0x7fc370068a00 con 0x7fc35006c920 2024-05-27T12:32:50.170 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-27T12:32:50.171 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2024-05-27T12:32:50.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.172+0000 7fc374b5c640 1 -- 172.21.15.55:0/1338074582 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fc35006c920 msgr2=0x7fc35006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:50.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.172+0000 7fc374b5c640 1 --2- 172.21.15.55:0/1338074582 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fc35006c920 0x7fc35006ede0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc3600074a0 tx=0x7fc36000b040 comp rx=0 tx=0).stop 2024-05-27T12:32:50.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.172+0000 7fc374b5c640 1 -- 172.21.15.55:0/1338074582 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc37015eb00 msgr2=0x7fc3700cd6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:50.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.172+0000 7fc374b5c640 1 --2- 172.21.15.55:0/1338074582 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc37015eb00 0x7fc3700cd6c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc36802a270 tx=0x7fc3680046c0 comp rx=0 tx=0).stop 2024-05-27T12:32:50.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.172+0000 7fc374b5c640 1 -- 172.21.15.55:0/1338074582 shutdown_connections 2024-05-27T12:32:50.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.172+0000 7fc374b5c640 1 --2- 172.21.15.55:0/1338074582 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc37015eb00 0x7fc3700cd6c0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:50.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.172+0000 7fc374b5c640 1 --2- 172.21.15.55:0/1338074582 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fc35006c920 0x7fc35006ede0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:50.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.172+0000 7fc374b5c640 1 --2- 172.21.15.55:0/1338074582 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc3700d1630 0x7fc3700ca0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:50.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.172+0000 7fc374b5c640 1 --2- 172.21.15.55:0/1338074582 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc37009b140 0x7fc370152bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:50.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.172+0000 7fc374b5c640 1 -- 172.21.15.55:0/1338074582 >> 172.21.15.55:0/1338074582 conn(0x7fc3700b4100 msgr2=0x7fc37009aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:50.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.172+0000 7fc374b5c640 1 -- 172.21.15.55:0/1338074582 shutdown_connections 2024-05-27T12:32:50.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.172+0000 7fc374b5c640 1 -- 172.21.15.55:0/1338074582 wait complete. 2024-05-27T12:32:50.182 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2024-05-27T12:32:49.264164+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235884,"kb_used_data":3048,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738836,"statfs":{"total":773094113280,"available":772852568064,"internally_reserved":0,"allocated":3121152,"data_stored":1833196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.918364"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.371081+0000","last_change":"2024-05-27T12:32:42.368378+0000","last_active":"2024-05-27T12:32:43.371081+0000","last_peered":"2024-05-27T12:32:43.371081+0000","last_clean":"2024-05-27T12:32:43.371081+0000","last_became_active":"2024-05-27T12:32:42.367689+0000","last_became_peered":"2024-05-27T12:32:42.367689+0000","last_unstale":"2024-05-27T12:32:43.371081+0000","last_undegraded":"2024-05-27T12:32:43.371081+0000","last_fullsized":"2024-05-27T12:32:43.371081+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:45:54.226012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.789170+0000","last_change":"2024-05-27T12:32:42.380372+0000","last_active":"2024-05-27T12:32:43.789170+0000","last_peered":"2024-05-27T12:32:43.789170+0000","last_clean":"2024-05-27T12:32:43.789170+0000","last_became_active":"2024-05-27T12:32:42.379503+0000","last_became_peered":"2024-05-27T12:32:42.379503+0000","last_unstale":"2024-05-27T12:32:43.789170+0000","last_undegraded":"2024-05-27T12:32:43.789170+0000","last_fullsized":"2024-05-27T12:32:43.789170+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:45:06.261408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.789354+0000","last_change":"2024-05-27T12:32:42.374630+0000","last_active":"2024-05-27T12:32:43.789354+0000","last_peered":"2024-05-27T12:32:43.789354+0000","last_clean":"2024-05-27T12:32:43.789354+0000","last_became_active":"2024-05-27T12:32:42.374368+0000","last_became_peered":"2024-05-27T12:32:42.374368+0000","last_unstale":"2024-05-27T12:32:43.789354+0000","last_undegraded":"2024-05-27T12:32:43.789354+0000","last_fullsized":"2024-05-27T12:32:43.789354+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:08:10.051388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.790169+0000","last_change":"2024-05-27T12:32:42.384566+0000","last_active":"2024-05-27T12:32:43.790169+0000","last_peered":"2024-05-27T12:32:43.790169+0000","last_clean":"2024-05-27T12:32:43.790169+0000","last_became_active":"2024-05-27T12:32:42.384269+0000","last_became_peered":"2024-05-27T12:32:42.384269+0000","last_unstale":"2024-05-27T12:32:43.790169+0000","last_undegraded":"2024-05-27T12:32:43.790169+0000","last_fullsized":"2024-05-27T12:32:43.790169+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:39:46.806156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.370806+0000","last_change":"2024-05-27T12:32:42.367164+0000","last_active":"2024-05-27T12:32:43.370806+0000","last_peered":"2024-05-27T12:32:43.370806+0000","last_clean":"2024-05-27T12:32:43.370806+0000","last_became_active":"2024-05-27T12:32:42.366882+0000","last_became_peered":"2024-05-27T12:32:42.366882+0000","last_unstale":"2024-05-27T12:32:43.370806+0000","last_undegraded":"2024-05-27T12:32:43.370806+0000","last_fullsized":"2024-05-27T12:32:43.370806+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:49:19.170865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.790649+0000","last_change":"2024-05-27T12:32:42.385413+0000","last_active":"2024-05-27T12:32:43.790649+0000","last_peered":"2024-05-27T12:32:43.790649+0000","last_clean":"2024-05-27T12:32:43.790649+0000","last_became_active":"2024-05-27T12:32:42.385163+0000","last_became_peered":"2024-05-27T12:32:42.385163+0000","last_unstale":"2024-05-27T12:32:43.790649+0000","last_undegraded":"2024-05-27T12:32:43.790649+0000","last_fullsized":"2024-05-27T12:32:43.790649+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:01:15.130683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.370657+0000","last_change":"2024-05-27T12:32:42.376081+0000","last_active":"2024-05-27T12:32:43.370657+0000","last_peered":"2024-05-27T12:32:43.370657+0000","last_clean":"2024-05-27T12:32:43.370657+0000","last_became_active":"2024-05-27T12:32:42.375689+0000","last_became_peered":"2024-05-27T12:32:42.375689+0000","last_unstale":"2024-05-27T12:32:43.370657+0000","last_undegraded":"2024-05-27T12:32:43.370657+0000","last_fullsized":"2024-05-27T12:32:43.370657+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:45:58.205716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.371027+0000","last_change":"2024-05-27T12:32:42.385659+0000","last_active":"2024-05-27T12:32:43.371027+0000","last_peered":"2024-05-27T12:32:43.371027+0000","last_clean":"2024-05-27T12:32:43.371027+0000","last_became_active":"2024-05-27T12:32:42.385356+0000","last_became_peered":"2024-05-27T12:32:42.385356+0000","last_unstale":"2024-05-27T12:32:43.371027+0000","last_undegraded":"2024-05-27T12:32:43.371027+0000","last_fullsized":"2024-05-27T12:32:43.371027+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:44:31.058083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.371221+0000","last_change":"2024-05-27T12:32:42.382460+0000","last_active":"2024-05-27T12:32:43.371221+0000","last_peered":"2024-05-27T12:32:43.371221+0000","last_clean":"2024-05-27T12:32:43.371221+0000","last_became_active":"2024-05-27T12:32:42.382093+0000","last_became_peered":"2024-05-27T12:32:42.382093+0000","last_unstale":"2024-05-27T12:32:43.371221+0000","last_undegraded":"2024-05-27T12:32:43.371221+0000","last_fullsized":"2024-05-27T12:32:43.371221+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:09:27.419514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.789639+0000","last_change":"2024-05-27T12:32:42.384546+0000","last_active":"2024-05-27T12:32:43.789639+0000","last_peered":"2024-05-27T12:32:43.789639+0000","last_clean":"2024-05-27T12:32:43.789639+0000","last_became_active":"2024-05-27T12:32:42.384270+0000","last_became_peered":"2024-05-27T12:32:42.384270+0000","last_unstale":"2024-05-27T12:32:43.789639+0000","last_undegraded":"2024-05-27T12:32:43.789639+0000","last_fullsized":"2024-05-27T12:32:43.789639+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:17:24.104572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.789963+0000","last_change":"2024-05-27T12:32:42.385206+0000","last_active":"2024-05-27T12:32:43.789963+0000","last_peered":"2024-05-27T12:32:43.789963+0000","last_clean":"2024-05-27T12:32:43.789963+0000","last_became_active":"2024-05-27T12:32:42.384940+0000","last_became_peered":"2024-05-27T12:32:42.384940+0000","last_unstale":"2024-05-27T12:32:43.789963+0000","last_undegraded":"2024-05-27T12:32:43.789963+0000","last_fullsized":"2024-05-27T12:32:43.789963+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:46:07.761461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.790813+0000","last_change":"2024-05-27T12:32:42.376596+0000","last_active":"2024-05-27T12:32:43.790813+0000","last_peered":"2024-05-27T12:32:43.790813+0000","last_clean":"2024-05-27T12:32:43.790813+0000","last_became_active":"2024-05-27T12:32:42.376147+0000","last_became_peered":"2024-05-27T12:32:42.376147+0000","last_unstale":"2024-05-27T12:32:43.790813+0000","last_undegraded":"2024-05-27T12:32:43.790813+0000","last_fullsized":"2024-05-27T12:32:43.790813+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:07:22.262394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.371230+0000","last_change":"2024-05-27T12:32:42.375358+0000","last_active":"2024-05-27T12:32:43.371230+0000","last_peered":"2024-05-27T12:32:43.371230+0000","last_clean":"2024-05-27T12:32:43.371230+0000","last_became_active":"2024-05-27T12:32:42.375096+0000","last_became_peered":"2024-05-27T12:32:42.375096+0000","last_unstale":"2024-05-27T12:32:43.371230+0000","last_undegraded":"2024-05-27T12:32:43.371230+0000","last_fullsized":"2024-05-27T12:32:43.371230+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:17:24.104572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.789171+0000","last_change":"2024-05-27T12:32:42.375413+0000","last_active":"2024-05-27T12:32:43.789171+0000","last_peered":"2024-05-27T12:32:43.789171+0000","last_clean":"2024-05-27T12:32:43.789171+0000","last_became_active":"2024-05-27T12:32:42.374741+0000","last_became_peered":"2024-05-27T12:32:42.374741+0000","last_unstale":"2024-05-27T12:32:43.789171+0000","last_undegraded":"2024-05-27T12:32:43.789171+0000","last_fullsized":"2024-05-27T12:32:43.789171+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:59:07.890771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.789046+0000","last_change":"2024-05-27T12:32:42.376055+0000","last_active":"2024-05-27T12:32:43.789046+0000","last_peered":"2024-05-27T12:32:43.789046+0000","last_clean":"2024-05-27T12:32:43.789046+0000","last_became_active":"2024-05-27T12:32:42.374091+0000","last_became_peered":"2024-05-27T12:32:42.374091+0000","last_unstale":"2024-05-27T12:32:43.789046+0000","last_undegraded":"2024-05-27T12:32:43.789046+0000","last_fullsized":"2024-05-27T12:32:43.789046+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:41:35.310708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.789858+0000","last_change":"2024-05-27T12:32:42.387113+0000","last_active":"2024-05-27T12:32:43.789858+0000","last_peered":"2024-05-27T12:32:43.789858+0000","last_clean":"2024-05-27T12:32:43.789858+0000","last_became_active":"2024-05-27T12:32:42.386810+0000","last_became_peered":"2024-05-27T12:32:42.386810+0000","last_unstale":"2024-05-27T12:32:43.789858+0000","last_undegraded":"2024-05-27T12:32:43.789858+0000","last_fullsized":"2024-05-27T12:32:43.789858+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:44:31.058083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.790040+0000","last_change":"2024-05-27T12:32:42.383993+0000","last_active":"2024-05-27T12:32:43.790040+0000","last_peered":"2024-05-27T12:32:43.790040+0000","last_clean":"2024-05-27T12:32:43.790040+0000","last_became_active":"2024-05-27T12:32:42.383274+0000","last_became_peered":"2024-05-27T12:32:42.383274+0000","last_unstale":"2024-05-27T12:32:43.790040+0000","last_undegraded":"2024-05-27T12:32:43.790040+0000","last_fullsized":"2024-05-27T12:32:43.790040+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:03:50.593154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.371618+0000","last_change":"2024-05-27T12:32:42.376831+0000","last_active":"2024-05-27T12:32:43.371618+0000","last_peered":"2024-05-27T12:32:43.371618+0000","last_clean":"2024-05-27T12:32:43.371618+0000","last_became_active":"2024-05-27T12:32:42.376498+0000","last_became_peered":"2024-05-27T12:32:42.376498+0000","last_unstale":"2024-05-27T12:32:43.371618+0000","last_undegraded":"2024-05-27T12:32:43.371618+0000","last_fullsized":"2024-05-27T12:32:43.371618+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:10:30.753626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.370953+0000","last_change":"2024-05-27T12:32:42.366751+0000","last_active":"2024-05-27T12:32:43.370953+0000","last_peered":"2024-05-27T12:32:43.370953+0000","last_clean":"2024-05-27T12:32:43.370953+0000","last_became_active":"2024-05-27T12:32:42.366438+0000","last_became_peered":"2024-05-27T12:32:42.366438+0000","last_unstale":"2024-05-27T12:32:43.370953+0000","last_undegraded":"2024-05-27T12:32:43.370953+0000","last_fullsized":"2024-05-27T12:32:43.370953+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:31:12.368847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.789791+0000","last_change":"2024-05-27T12:32:42.370650+0000","last_active":"2024-05-27T12:32:43.789791+0000","last_peered":"2024-05-27T12:32:43.789791+0000","last_clean":"2024-05-27T12:32:43.789791+0000","last_became_active":"2024-05-27T12:32:42.370319+0000","last_became_peered":"2024-05-27T12:32:42.370319+0000","last_unstale":"2024-05-27T12:32:43.789791+0000","last_undegraded":"2024-05-27T12:32:43.789791+0000","last_fullsized":"2024-05-27T12:32:43.789791+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:41:35.310708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.789324+0000","last_change":"2024-05-27T12:32:42.382051+0000","last_active":"2024-05-27T12:32:43.789324+0000","last_peered":"2024-05-27T12:32:43.789324+0000","last_clean":"2024-05-27T12:32:43.789324+0000","last_became_active":"2024-05-27T12:32:42.380690+0000","last_became_peered":"2024-05-27T12:32:42.380690+0000","last_unstale":"2024-05-27T12:32:43.789324+0000","last_undegraded":"2024-05-27T12:32:43.789324+0000","last_fullsized":"2024-05-27T12:32:43.789324+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:33:45.178199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.790674+0000","last_change":"2024-05-27T12:32:42.383033+0000","last_active":"2024-05-27T12:32:43.790674+0000","last_peered":"2024-05-27T12:32:43.790674+0000","last_clean":"2024-05-27T12:32:43.790674+0000","last_became_active":"2024-05-27T12:32:42.382745+0000","last_became_peered":"2024-05-27T12:32:42.382745+0000","last_unstale":"2024-05-27T12:32:43.790674+0000","last_undegraded":"2024-05-27T12:32:43.790674+0000","last_fullsized":"2024-05-27T12:32:43.790674+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:31:12.368847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.371383+0000","last_change":"2024-05-27T12:32:42.378742+0000","last_active":"2024-05-27T12:32:43.371383+0000","last_peered":"2024-05-27T12:32:43.371383+0000","last_clean":"2024-05-27T12:32:43.371383+0000","last_became_active":"2024-05-27T12:32:42.378328+0000","last_became_peered":"2024-05-27T12:32:42.378328+0000","last_unstale":"2024-05-27T12:32:43.371383+0000","last_undegraded":"2024-05-27T12:32:43.371383+0000","last_fullsized":"2024-05-27T12:32:43.371383+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:46:07.761461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.789508+0000","last_change":"2024-05-27T12:32:42.381867+0000","last_active":"2024-05-27T12:32:43.789508+0000","last_peered":"2024-05-27T12:32:43.789508+0000","last_clean":"2024-05-27T12:32:43.789508+0000","last_became_active":"2024-05-27T12:32:42.381591+0000","last_became_peered":"2024-05-27T12:32:42.381591+0000","last_unstale":"2024-05-27T12:32:43.789508+0000","last_undegraded":"2024-05-27T12:32:43.789508+0000","last_fullsized":"2024-05-27T12:32:43.789508+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:45:06.261408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.371545+0000","last_change":"2024-05-27T12:32:42.372176+0000","last_active":"2024-05-27T12:32:43.371545+0000","last_peered":"2024-05-27T12:32:43.371545+0000","last_clean":"2024-05-27T12:32:43.371545+0000","last_became_active":"2024-05-27T12:32:42.371874+0000","last_became_peered":"2024-05-27T12:32:42.371874+0000","last_unstale":"2024-05-27T12:32:43.371545+0000","last_undegraded":"2024-05-27T12:32:43.371545+0000","last_fullsized":"2024-05-27T12:32:43.371545+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:03:50.593154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.790461+0000","last_change":"2024-05-27T12:32:42.374766+0000","last_active":"2024-05-27T12:32:43.790461+0000","last_peered":"2024-05-27T12:32:43.790461+0000","last_clean":"2024-05-27T12:32:43.790461+0000","last_became_active":"2024-05-27T12:32:42.374450+0000","last_became_peered":"2024-05-27T12:32:42.374450+0000","last_unstale":"2024-05-27T12:32:43.790461+0000","last_undegraded":"2024-05-27T12:32:43.790461+0000","last_fullsized":"2024-05-27T12:32:43.790461+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:44:31.058083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.789330+0000","last_change":"2024-05-27T12:32:42.376636+0000","last_active":"2024-05-27T12:32:43.789330+0000","last_peered":"2024-05-27T12:32:43.789330+0000","last_clean":"2024-05-27T12:32:43.789330+0000","last_became_active":"2024-05-27T12:32:42.376364+0000","last_became_peered":"2024-05-27T12:32:42.376364+0000","last_unstale":"2024-05-27T12:32:43.789330+0000","last_undegraded":"2024-05-27T12:32:43.789330+0000","last_fullsized":"2024-05-27T12:32:43.789330+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:46:07.761461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.372306+0000","last_change":"2024-05-27T12:32:42.371595+0000","last_active":"2024-05-27T12:32:43.372306+0000","last_peered":"2024-05-27T12:32:43.372306+0000","last_clean":"2024-05-27T12:32:43.372306+0000","last_became_active":"2024-05-27T12:32:42.370375+0000","last_became_peered":"2024-05-27T12:32:42.370375+0000","last_unstale":"2024-05-27T12:32:43.372306+0000","last_undegraded":"2024-05-27T12:32:43.372306+0000","last_fullsized":"2024-05-27T12:32:43.372306+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:45:58.205716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.789405+0000","last_change":"2024-05-27T12:32:42.381462+0000","last_active":"2024-05-27T12:32:43.789405+0000","last_peered":"2024-05-27T12:32:43.789405+0000","last_clean":"2024-05-27T12:32:43.789405+0000","last_became_active":"2024-05-27T12:32:42.380574+0000","last_became_peered":"2024-05-27T12:32:42.380574+0000","last_unstale":"2024-05-27T12:32:43.789405+0000","last_undegraded":"2024-05-27T12:32:43.789405+0000","last_fullsized":"2024-05-27T12:32:43.789405+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:39:15.319359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.790845+0000","last_change":"2024-05-27T12:32:42.384076+0000","last_active":"2024-05-27T12:32:43.790845+0000","last_peered":"2024-05-27T12:32:43.790845+0000","last_clean":"2024-05-27T12:32:43.790845+0000","last_became_active":"2024-05-27T12:32:42.383738+0000","last_became_peered":"2024-05-27T12:32:42.383738+0000","last_unstale":"2024-05-27T12:32:43.790845+0000","last_undegraded":"2024-05-27T12:32:43.790845+0000","last_fullsized":"2024-05-27T12:32:43.790845+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:45:54.226012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.372374+0000","last_change":"2024-05-27T12:32:42.379700+0000","last_active":"2024-05-27T12:32:43.372374+0000","last_peered":"2024-05-27T12:32:43.372374+0000","last_clean":"2024-05-27T12:32:43.372374+0000","last_became_active":"2024-05-27T12:32:42.379421+0000","last_became_peered":"2024-05-27T12:32:42.379421+0000","last_unstale":"2024-05-27T12:32:43.372374+0000","last_undegraded":"2024-05-27T12:32:43.372374+0000","last_fullsized":"2024-05-27T12:32:43.372374+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:20:05.304417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.789328+0000","last_change":"2024-05-27T12:32:42.379719+0000","last_active":"2024-05-27T12:32:43.789328+0000","last_peered":"2024-05-27T12:32:43.789328+0000","last_clean":"2024-05-27T12:32:43.789328+0000","last_became_active":"2024-05-27T12:32:42.379234+0000","last_became_peered":"2024-05-27T12:32:42.379234+0000","last_unstale":"2024-05-27T12:32:43.789328+0000","last_undegraded":"2024-05-27T12:32:43.789328+0000","last_fullsized":"2024-05-27T12:32:43.789328+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:23:59.137419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.790076+0000","last_change":"2024-05-27T12:32:42.371233+0000","last_active":"2024-05-27T12:32:43.790076+0000","last_peered":"2024-05-27T12:32:43.790076+0000","last_clean":"2024-05-27T12:32:43.790076+0000","last_became_active":"2024-05-27T12:32:42.370965+0000","last_became_peered":"2024-05-27T12:32:42.370965+0000","last_unstale":"2024-05-27T12:32:43.790076+0000","last_undegraded":"2024-05-27T12:32:43.790076+0000","last_fullsized":"2024-05-27T12:32:43.790076+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T23:34:59.101630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.371329+0000","last_change":"2024-05-27T12:32:41.365100+0000","last_active":"2024-05-27T12:32:43.371329+0000","last_peered":"2024-05-27T12:32:43.371329+0000","last_clean":"2024-05-27T12:32:43.371329+0000","last_became_active":"2024-05-27T12:32:41.364795+0000","last_became_peered":"2024-05-27T12:32:41.364795+0000","last_unstale":"2024-05-27T12:32:43.371329+0000","last_undegraded":"2024-05-27T12:32:43.371329+0000","last_fullsized":"2024-05-27T12:32:43.371329+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:24:00.607915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.789475+0000","last_change":"2024-05-27T12:32:42.375571+0000","last_active":"2024-05-27T12:32:43.789475+0000","last_peered":"2024-05-27T12:32:43.789475+0000","last_clean":"2024-05-27T12:32:43.789475+0000","last_became_active":"2024-05-27T12:32:42.375317+0000","last_became_peered":"2024-05-27T12:32:42.375317+0000","last_unstale":"2024-05-27T12:32:43.789475+0000","last_undegraded":"2024-05-27T12:32:43.789475+0000","last_fullsized":"2024-05-27T12:32:43.789475+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:52:18.747481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.790038+0000","last_change":"2024-05-27T12:32:41.370064+0000","last_active":"2024-05-27T12:32:43.790038+0000","last_peered":"2024-05-27T12:32:43.790038+0000","last_clean":"2024-05-27T12:32:43.790038+0000","last_became_active":"2024-05-27T12:32:41.368679+0000","last_became_peered":"2024-05-27T12:32:41.368679+0000","last_unstale":"2024-05-27T12:32:43.790038+0000","last_undegraded":"2024-05-27T12:32:43.790038+0000","last_fullsized":"2024-05-27T12:32:43.790038+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:31:52.368166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.371463+0000","last_change":"2024-05-27T12:32:41.369441+0000","last_active":"2024-05-27T12:32:43.371463+0000","last_peered":"2024-05-27T12:32:43.371463+0000","last_clean":"2024-05-27T12:32:43.371463+0000","last_became_active":"2024-05-27T12:32:41.369164+0000","last_became_peered":"2024-05-27T12:32:41.369164+0000","last_unstale":"2024-05-27T12:32:43.371463+0000","last_undegraded":"2024-05-27T12:32:43.371463+0000","last_fullsized":"2024-05-27T12:32:43.371463+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:10:55.375726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.371049+0000","last_change":"2024-05-27T12:32:42.381264+0000","last_active":"2024-05-27T12:32:43.371049+0000","last_peered":"2024-05-27T12:32:43.371049+0000","last_clean":"2024-05-27T12:32:43.371049+0000","last_became_active":"2024-05-27T12:32:42.380823+0000","last_became_peered":"2024-05-27T12:32:42.380823+0000","last_unstale":"2024-05-27T12:32:43.371049+0000","last_undegraded":"2024-05-27T12:32:43.371049+0000","last_fullsized":"2024-05-27T12:32:43.371049+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:23:59.137419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.789618+0000","last_change":"2024-05-27T12:32:41.371539+0000","last_active":"2024-05-27T12:32:43.789618+0000","last_peered":"2024-05-27T12:32:43.789618+0000","last_clean":"2024-05-27T12:32:43.789618+0000","last_became_active":"2024-05-27T12:32:41.370827+0000","last_became_peered":"2024-05-27T12:32:41.370827+0000","last_unstale":"2024-05-27T12:32:43.789618+0000","last_undegraded":"2024-05-27T12:32:43.789618+0000","last_fullsized":"2024-05-27T12:32:43.789618+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T23:34:58.092780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.788872+0000","last_change":"2024-05-27T12:32:42.371446+0000","last_active":"2024-05-27T12:32:43.788872+0000","last_peered":"2024-05-27T12:32:43.788872+0000","last_clean":"2024-05-27T12:32:43.788872+0000","last_became_active":"2024-05-27T12:32:42.371197+0000","last_became_peered":"2024-05-27T12:32:42.371197+0000","last_unstale":"2024-05-27T12:32:43.788872+0000","last_undegraded":"2024-05-27T12:32:43.788872+0000","last_fullsized":"2024-05-27T12:32:43.788872+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:23:59.137419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.789638+0000","last_change":"2024-05-27T12:32:41.374793+0000","last_active":"2024-05-27T12:32:43.789638+0000","last_peered":"2024-05-27T12:32:43.789638+0000","last_clean":"2024-05-27T12:32:43.789638+0000","last_became_active":"2024-05-27T12:32:41.374503+0000","last_became_peered":"2024-05-27T12:32:41.374503+0000","last_unstale":"2024-05-27T12:32:43.789638+0000","last_undegraded":"2024-05-27T12:32:43.789638+0000","last_fullsized":"2024-05-27T12:32:43.789638+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T23:33:13.169169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.789772+0000","last_change":"2024-05-27T12:32:42.382592+0000","last_active":"2024-05-27T12:32:43.789772+0000","last_peered":"2024-05-27T12:32:43.789772+0000","last_clean":"2024-05-27T12:32:43.789772+0000","last_became_active":"2024-05-27T12:32:42.382289+0000","last_became_peered":"2024-05-27T12:32:42.382289+0000","last_unstale":"2024-05-27T12:32:43.789772+0000","last_undegraded":"2024-05-27T12:32:43.789772+0000","last_fullsized":"2024-05-27T12:32:43.789772+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:46:07.761461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.789819+0000","last_change":"2024-05-27T12:32:41.370517+0000","last_active":"2024-05-27T12:32:43.789819+0000","last_peered":"2024-05-27T12:32:43.789819+0000","last_clean":"2024-05-27T12:32:43.789819+0000","last_became_active":"2024-05-27T12:32:41.370216+0000","last_became_peered":"2024-05-27T12:32:41.370216+0000","last_unstale":"2024-05-27T12:32:43.789819+0000","last_undegraded":"2024-05-27T12:32:43.789819+0000","last_fullsized":"2024-05-27T12:32:43.789819+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:24:00.607915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.789709+0000","last_change":"2024-05-27T12:32:42.384361+0000","last_active":"2024-05-27T12:32:43.789709+0000","last_peered":"2024-05-27T12:32:43.789709+0000","last_clean":"2024-05-27T12:32:43.789709+0000","last_became_active":"2024-05-27T12:32:42.384083+0000","last_became_peered":"2024-05-27T12:32:42.384083+0000","last_unstale":"2024-05-27T12:32:43.789709+0000","last_undegraded":"2024-05-27T12:32:43.789709+0000","last_fullsized":"2024-05-27T12:32:43.789709+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:34:54.979924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.789374+0000","last_change":"2024-05-27T12:32:41.373060+0000","last_active":"2024-05-27T12:32:43.789374+0000","last_peered":"2024-05-27T12:32:43.789374+0000","last_clean":"2024-05-27T12:32:43.789374+0000","last_became_active":"2024-05-27T12:32:41.372729+0000","last_became_peered":"2024-05-27T12:32:41.372729+0000","last_unstale":"2024-05-27T12:32:43.789374+0000","last_undegraded":"2024-05-27T12:32:43.789374+0000","last_fullsized":"2024-05-27T12:32:43.789374+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T23:34:58.092780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.790835+0000","last_change":"2024-05-27T12:32:42.368863+0000","last_active":"2024-05-27T12:32:43.790835+0000","last_peered":"2024-05-27T12:32:43.790835+0000","last_clean":"2024-05-27T12:32:43.790835+0000","last_became_active":"2024-05-27T12:32:42.368593+0000","last_became_peered":"2024-05-27T12:32:42.368593+0000","last_unstale":"2024-05-27T12:32:43.790835+0000","last_undegraded":"2024-05-27T12:32:43.790835+0000","last_fullsized":"2024-05-27T12:32:43.790835+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:10:30.753626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"22'6","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.790164+0000","last_change":"2024-05-27T12:32:41.369617+0000","last_active":"2024-05-27T12:32:43.790164+0000","last_peered":"2024-05-27T12:32:43.790164+0000","last_clean":"2024-05-27T12:32:43.790164+0000","last_became_active":"2024-05-27T12:32:41.369371+0000","last_became_peered":"2024-05-27T12:32:41.369371+0000","last_unstale":"2024-05-27T12:32:43.790164+0000","last_undegraded":"2024-05-27T12:32:43.790164+0000","last_fullsized":"2024-05-27T12:32:43.790164+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:24:00.607915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.370555+0000","last_change":"2024-05-27T12:32:42.362804+0000","last_active":"2024-05-27T12:32:43.370555+0000","last_peered":"2024-05-27T12:32:43.370555+0000","last_clean":"2024-05-27T12:32:43.370555+0000","last_became_active":"2024-05-27T12:32:42.362483+0000","last_became_peered":"2024-05-27T12:32:42.362483+0000","last_unstale":"2024-05-27T12:32:43.370555+0000","last_undegraded":"2024-05-27T12:32:43.370555+0000","last_fullsized":"2024-05-27T12:32:43.370555+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:29:54.817031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.789520+0000","last_change":"2024-05-27T12:32:41.365663+0000","last_active":"2024-05-27T12:32:43.789520+0000","last_peered":"2024-05-27T12:32:43.789520+0000","last_clean":"2024-05-27T12:32:43.789520+0000","last_became_active":"2024-05-27T12:32:41.365362+0000","last_became_peered":"2024-05-27T12:32:41.365362+0000","last_unstale":"2024-05-27T12:32:43.789520+0000","last_undegraded":"2024-05-27T12:32:43.789520+0000","last_fullsized":"2024-05-27T12:32:43.789520+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:34:40.641559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.789225+0000","last_change":"2024-05-27T12:32:42.374786+0000","last_active":"2024-05-27T12:32:43.789225+0000","last_peered":"2024-05-27T12:32:43.789225+0000","last_clean":"2024-05-27T12:32:43.789225+0000","last_became_active":"2024-05-27T12:32:42.374527+0000","last_became_peered":"2024-05-27T12:32:42.374527+0000","last_unstale":"2024-05-27T12:32:43.789225+0000","last_undegraded":"2024-05-27T12:32:43.789225+0000","last_fullsized":"2024-05-27T12:32:43.789225+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:21:44.592343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.790766+0000","last_change":"2024-05-27T12:32:41.371087+0000","last_active":"2024-05-27T12:32:43.790766+0000","last_peered":"2024-05-27T12:32:43.790766+0000","last_clean":"2024-05-27T12:32:43.790766+0000","last_became_active":"2024-05-27T12:32:41.370237+0000","last_became_peered":"2024-05-27T12:32:41.370237+0000","last_unstale":"2024-05-27T12:32:43.790766+0000","last_undegraded":"2024-05-27T12:32:43.790766+0000","last_fullsized":"2024-05-27T12:32:43.790766+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:31:52.368166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.370939+0000","last_change":"2024-05-27T12:32:42.371339+0000","last_active":"2024-05-27T12:32:43.370939+0000","last_peered":"2024-05-27T12:32:43.370939+0000","last_clean":"2024-05-27T12:32:43.370939+0000","last_became_active":"2024-05-27T12:32:42.370848+0000","last_became_peered":"2024-05-27T12:32:42.370848+0000","last_unstale":"2024-05-27T12:32:43.370939+0000","last_undegraded":"2024-05-27T12:32:43.370939+0000","last_fullsized":"2024-05-27T12:32:43.370939+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:01:15.130683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.789256+0000","last_change":"2024-05-27T12:32:41.368354+0000","last_active":"2024-05-27T12:32:43.789256+0000","last_peered":"2024-05-27T12:32:43.789256+0000","last_clean":"2024-05-27T12:32:43.789256+0000","last_became_active":"2024-05-27T12:32:41.368086+0000","last_became_peered":"2024-05-27T12:32:41.368086+0000","last_unstale":"2024-05-27T12:32:43.789256+0000","last_undegraded":"2024-05-27T12:32:43.789256+0000","last_fullsized":"2024-05-27T12:32:43.789256+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T23:55:01.390036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.789345+0000","last_change":"2024-05-27T12:32:42.379489+0000","last_active":"2024-05-27T12:32:43.789345+0000","last_peered":"2024-05-27T12:32:43.789345+0000","last_clean":"2024-05-27T12:32:43.789345+0000","last_became_active":"2024-05-27T12:32:42.378880+0000","last_became_peered":"2024-05-27T12:32:42.378880+0000","last_unstale":"2024-05-27T12:32:43.789345+0000","last_undegraded":"2024-05-27T12:32:43.789345+0000","last_fullsized":"2024-05-27T12:32:43.789345+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:45:06.261408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.371422+0000","last_change":"2024-05-27T12:32:41.362154+0000","last_active":"2024-05-27T12:32:43.371422+0000","last_peered":"2024-05-27T12:32:43.371422+0000","last_clean":"2024-05-27T12:32:43.371422+0000","last_became_active":"2024-05-27T12:32:41.361845+0000","last_became_peered":"2024-05-27T12:32:41.361845+0000","last_unstale":"2024-05-27T12:32:43.371422+0000","last_undegraded":"2024-05-27T12:32:43.371422+0000","last_fullsized":"2024-05-27T12:32:43.371422+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:10:55.375726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.370584+0000","last_change":"2024-05-27T12:32:42.378975+0000","last_active":"2024-05-27T12:32:43.370584+0000","last_peered":"2024-05-27T12:32:43.370584+0000","last_clean":"2024-05-27T12:32:43.370584+0000","last_became_active":"2024-05-27T12:32:42.378666+0000","last_became_peered":"2024-05-27T12:32:42.378666+0000","last_unstale":"2024-05-27T12:32:43.370584+0000","last_undegraded":"2024-05-27T12:32:43.370584+0000","last_fullsized":"2024-05-27T12:32:43.370584+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:39:46.806156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.790090+0000","last_change":"2024-05-27T12:32:41.363195+0000","last_active":"2024-05-27T12:32:43.790090+0000","last_peered":"2024-05-27T12:32:43.790090+0000","last_clean":"2024-05-27T12:32:43.790090+0000","last_became_active":"2024-05-27T12:32:41.362693+0000","last_became_peered":"2024-05-27T12:32:41.362693+0000","last_unstale":"2024-05-27T12:32:43.790090+0000","last_undegraded":"2024-05-27T12:32:43.790090+0000","last_fullsized":"2024-05-27T12:32:43.790090+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:10:55.375726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.371196+0000","last_change":"2024-05-27T12:32:42.370922+0000","last_active":"2024-05-27T12:32:43.371196+0000","last_peered":"2024-05-27T12:32:43.371196+0000","last_clean":"2024-05-27T12:32:43.371196+0000","last_became_active":"2024-05-27T12:32:42.370170+0000","last_became_peered":"2024-05-27T12:32:42.370170+0000","last_unstale":"2024-05-27T12:32:43.371196+0000","last_undegraded":"2024-05-27T12:32:43.371196+0000","last_fullsized":"2024-05-27T12:32:43.371196+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:10:10.701630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.371717+0000","last_change":"2024-05-27T12:32:41.366108+0000","last_active":"2024-05-27T12:32:43.371717+0000","last_peered":"2024-05-27T12:32:43.371717+0000","last_clean":"2024-05-27T12:32:43.371717+0000","last_became_active":"2024-05-27T12:32:41.365777+0000","last_became_peered":"2024-05-27T12:32:41.365777+0000","last_unstale":"2024-05-27T12:32:43.371717+0000","last_undegraded":"2024-05-27T12:32:43.371717+0000","last_fullsized":"2024-05-27T12:32:43.371717+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:24:00.607915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.371292+0000","last_change":"2024-05-27T12:32:42.374653+0000","last_active":"2024-05-27T12:32:43.371292+0000","last_peered":"2024-05-27T12:32:43.371292+0000","last_clean":"2024-05-27T12:32:43.371292+0000","last_became_active":"2024-05-27T12:32:42.370933+0000","last_became_peered":"2024-05-27T12:32:42.370933+0000","last_unstale":"2024-05-27T12:32:43.371292+0000","last_undegraded":"2024-05-27T12:32:43.371292+0000","last_fullsized":"2024-05-27T12:32:43.371292+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:08:15.290969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.789475+0000","last_change":"2024-05-27T12:32:41.366243+0000","last_active":"2024-05-27T12:32:43.789475+0000","last_peered":"2024-05-27T12:32:43.789475+0000","last_clean":"2024-05-27T12:32:43.789475+0000","last_became_active":"2024-05-27T12:32:41.365843+0000","last_became_peered":"2024-05-27T12:32:41.365843+0000","last_unstale":"2024-05-27T12:32:43.789475+0000","last_undegraded":"2024-05-27T12:32:43.789475+0000","last_fullsized":"2024-05-27T12:32:43.789475+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:31:52.368166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.790495+0000","last_change":"2024-05-27T12:32:42.384741+0000","last_active":"2024-05-27T12:32:43.790495+0000","last_peered":"2024-05-27T12:32:43.790495+0000","last_clean":"2024-05-27T12:32:43.790495+0000","last_became_active":"2024-05-27T12:32:42.383818+0000","last_became_peered":"2024-05-27T12:32:42.383818+0000","last_unstale":"2024-05-27T12:32:43.790495+0000","last_undegraded":"2024-05-27T12:32:43.790495+0000","last_fullsized":"2024-05-27T12:32:43.790495+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:49:19.170865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.371621+0000","last_change":"2024-05-27T12:32:41.374511+0000","last_active":"2024-05-27T12:32:43.371621+0000","last_peered":"2024-05-27T12:32:43.371621+0000","last_clean":"2024-05-27T12:32:43.371621+0000","last_became_active":"2024-05-27T12:32:41.374221+0000","last_became_peered":"2024-05-27T12:32:41.374221+0000","last_unstale":"2024-05-27T12:32:43.371621+0000","last_undegraded":"2024-05-27T12:32:43.371621+0000","last_fullsized":"2024-05-27T12:32:43.371621+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T23:34:58.092780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.370723+0000","last_change":"2024-05-27T12:32:42.384647+0000","last_active":"2024-05-27T12:32:43.370723+0000","last_peered":"2024-05-27T12:32:43.370723+0000","last_clean":"2024-05-27T12:32:43.370723+0000","last_became_active":"2024-05-27T12:32:42.384389+0000","last_became_peered":"2024-05-27T12:32:42.384389+0000","last_unstale":"2024-05-27T12:32:43.370723+0000","last_undegraded":"2024-05-27T12:32:43.370723+0000","last_fullsized":"2024-05-27T12:32:43.370723+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:46:37.922278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":170,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.370450+0000","last_change":"2024-05-27T12:32:31.185664+0000","last_active":"2024-05-27T12:32:43.370450+0000","last_peered":"2024-05-27T12:32:43.370450+0000","last_clean":"2024-05-27T12:32:43.370450+0000","last_became_active":"2024-05-27T12:32:31.184757+0000","last_became_peered":"2024-05-27T12:32:31.184757+0000","last_unstale":"2024-05-27T12:32:43.370450+0000","last_undegraded":"2024-05-27T12:32:43.370450+0000","last_fullsized":"2024-05-27T12:32:43.370450+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:30.136480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:30.136480+0000","last_clean_scrub_stamp":"2024-05-27T12:32:30.136480+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:49:13.241747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.789668+0000","last_change":"2024-05-27T12:32:41.371475+0000","last_active":"2024-05-27T12:32:43.789668+0000","last_peered":"2024-05-27T12:32:43.789668+0000","last_clean":"2024-05-27T12:32:43.789668+0000","last_became_active":"2024-05-27T12:32:41.371198+0000","last_became_peered":"2024-05-27T12:32:41.371198+0000","last_unstale":"2024-05-27T12:32:43.789668+0000","last_undegraded":"2024-05-27T12:32:43.789668+0000","last_fullsized":"2024-05-27T12:32:43.789668+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T23:55:01.390036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.371225+0000","last_change":"2024-05-27T12:32:42.385699+0000","last_active":"2024-05-27T12:32:43.371225+0000","last_peered":"2024-05-27T12:32:43.371225+0000","last_clean":"2024-05-27T12:32:43.371225+0000","last_became_active":"2024-05-27T12:32:42.385464+0000","last_became_peered":"2024-05-27T12:32:42.385464+0000","last_unstale":"2024-05-27T12:32:43.371225+0000","last_undegraded":"2024-05-27T12:32:43.371225+0000","last_fullsized":"2024-05-27T12:32:43.371225+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:41:35.310708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.370292+0000","last_change":"2024-05-27T12:32:41.371263+0000","last_active":"2024-05-27T12:32:43.370292+0000","last_peered":"2024-05-27T12:32:43.370292+0000","last_clean":"2024-05-27T12:32:43.370292+0000","last_became_active":"2024-05-27T12:32:41.370961+0000","last_became_peered":"2024-05-27T12:32:41.370961+0000","last_unstale":"2024-05-27T12:32:43.370292+0000","last_undegraded":"2024-05-27T12:32:43.370292+0000","last_fullsized":"2024-05-27T12:32:43.370292+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:07:21.253545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.789059+0000","last_change":"2024-05-27T12:32:42.375057+0000","last_active":"2024-05-27T12:32:43.789059+0000","last_peered":"2024-05-27T12:32:43.789059+0000","last_clean":"2024-05-27T12:32:43.789059+0000","last_became_active":"2024-05-27T12:32:42.374593+0000","last_became_peered":"2024-05-27T12:32:42.374593+0000","last_unstale":"2024-05-27T12:32:43.789059+0000","last_undegraded":"2024-05-27T12:32:43.789059+0000","last_fullsized":"2024-05-27T12:32:43.789059+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:31:57.042894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.372424+0000","last_change":"2024-05-27T12:32:41.366189+0000","last_active":"2024-05-27T12:32:43.372424+0000","last_peered":"2024-05-27T12:32:43.372424+0000","last_clean":"2024-05-27T12:32:43.372424+0000","last_became_active":"2024-05-27T12:32:41.365860+0000","last_became_peered":"2024-05-27T12:32:41.365860+0000","last_unstale":"2024-05-27T12:32:43.372424+0000","last_undegraded":"2024-05-27T12:32:43.372424+0000","last_fullsized":"2024-05-27T12:32:43.372424+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T23:55:01.390036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.789114+0000","last_change":"2024-05-27T12:32:42.370436+0000","last_active":"2024-05-27T12:32:43.789114+0000","last_peered":"2024-05-27T12:32:43.789114+0000","last_clean":"2024-05-27T12:32:43.789114+0000","last_became_active":"2024-05-27T12:32:42.370051+0000","last_became_peered":"2024-05-27T12:32:42.370051+0000","last_unstale":"2024-05-27T12:32:43.789114+0000","last_undegraded":"2024-05-27T12:32:43.789114+0000","last_fullsized":"2024-05-27T12:32:43.789114+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:17:24.104572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.790865+0000","last_change":"2024-05-27T12:32:41.368242+0000","last_active":"2024-05-27T12:32:43.790865+0000","last_peered":"2024-05-27T12:32:43.790865+0000","last_clean":"2024-05-27T12:32:43.790865+0000","last_became_active":"2024-05-27T12:32:41.366995+0000","last_became_peered":"2024-05-27T12:32:41.366995+0000","last_unstale":"2024-05-27T12:32:43.790865+0000","last_undegraded":"2024-05-27T12:32:43.790865+0000","last_fullsized":"2024-05-27T12:32:43.790865+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T23:33:13.169169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.790572+0000","last_change":"2024-05-27T12:32:42.382859+0000","last_active":"2024-05-27T12:32:43.790572+0000","last_peered":"2024-05-27T12:32:43.790572+0000","last_clean":"2024-05-27T12:32:43.790572+0000","last_became_active":"2024-05-27T12:32:42.382312+0000","last_became_peered":"2024-05-27T12:32:42.382312+0000","last_unstale":"2024-05-27T12:32:43.790572+0000","last_undegraded":"2024-05-27T12:32:43.790572+0000","last_fullsized":"2024-05-27T12:32:43.790572+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T23:33:14.178019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.788938+0000","last_change":"2024-05-27T12:32:41.362976+0000","last_active":"2024-05-27T12:32:43.788938+0000","last_peered":"2024-05-27T12:32:43.788938+0000","last_clean":"2024-05-27T12:32:43.788938+0000","last_became_active":"2024-05-27T12:32:41.362645+0000","last_became_peered":"2024-05-27T12:32:41.362645+0000","last_unstale":"2024-05-27T12:32:43.788938+0000","last_undegraded":"2024-05-27T12:32:43.788938+0000","last_fullsized":"2024-05-27T12:32:43.788938+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T23:55:01.390036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.790293+0000","last_change":"2024-05-27T12:32:42.382156+0000","last_active":"2024-05-27T12:32:43.790293+0000","last_peered":"2024-05-27T12:32:43.790293+0000","last_clean":"2024-05-27T12:32:43.790293+0000","last_became_active":"2024-05-27T12:32:42.381678+0000","last_became_peered":"2024-05-27T12:32:42.381678+0000","last_unstale":"2024-05-27T12:32:43.790293+0000","last_undegraded":"2024-05-27T12:32:43.790293+0000","last_fullsized":"2024-05-27T12:32:43.790293+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:45:58.205716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.371082+0000","last_change":"2024-05-27T12:32:41.371270+0000","last_active":"2024-05-27T12:32:43.371082+0000","last_peered":"2024-05-27T12:32:43.371082+0000","last_clean":"2024-05-27T12:32:43.371082+0000","last_became_active":"2024-05-27T12:32:41.370665+0000","last_became_peered":"2024-05-27T12:32:41.370665+0000","last_unstale":"2024-05-27T12:32:43.371082+0000","last_undegraded":"2024-05-27T12:32:43.371082+0000","last_fullsized":"2024-05-27T12:32:43.371082+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:45:13.017421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.788973+0000","last_change":"2024-05-27T12:32:42.371153+0000","last_active":"2024-05-27T12:32:43.788973+0000","last_peered":"2024-05-27T12:32:43.788973+0000","last_clean":"2024-05-27T12:32:43.788973+0000","last_became_active":"2024-05-27T12:32:42.370862+0000","last_became_peered":"2024-05-27T12:32:42.370862+0000","last_unstale":"2024-05-27T12:32:43.788973+0000","last_undegraded":"2024-05-27T12:32:43.788973+0000","last_fullsized":"2024-05-27T12:32:43.788973+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:46:59.701728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.789282+0000","last_change":"2024-05-27T12:32:41.368774+0000","last_active":"2024-05-27T12:32:43.789282+0000","last_peered":"2024-05-27T12:32:43.789282+0000","last_clean":"2024-05-27T12:32:43.789282+0000","last_became_active":"2024-05-27T12:32:41.368343+0000","last_became_peered":"2024-05-27T12:32:41.368343+0000","last_unstale":"2024-05-27T12:32:43.789282+0000","last_undegraded":"2024-05-27T12:32:43.789282+0000","last_fullsized":"2024-05-27T12:32:43.789282+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:07:21.253545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.371690+0000","last_change":"2024-05-27T12:32:42.361807+0000","last_active":"2024-05-27T12:32:43.371690+0000","last_peered":"2024-05-27T12:32:43.371690+0000","last_clean":"2024-05-27T12:32:43.371690+0000","last_became_active":"2024-05-27T12:32:42.361508+0000","last_became_peered":"2024-05-27T12:32:42.361508+0000","last_unstale":"2024-05-27T12:32:43.371690+0000","last_undegraded":"2024-05-27T12:32:43.371690+0000","last_fullsized":"2024-05-27T12:32:43.371690+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:29:54.817031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.789737+0000","last_change":"2024-05-27T12:32:41.368907+0000","last_active":"2024-05-27T12:32:43.789737+0000","last_peered":"2024-05-27T12:32:43.789737+0000","last_clean":"2024-05-27T12:32:43.789737+0000","last_became_active":"2024-05-27T12:32:41.368392+0000","last_became_peered":"2024-05-27T12:32:41.368392+0000","last_unstale":"2024-05-27T12:32:43.789737+0000","last_undegraded":"2024-05-27T12:32:43.789737+0000","last_fullsized":"2024-05-27T12:32:43.789737+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T23:34:58.092780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.789583+0000","last_change":"2024-05-27T12:32:42.378690+0000","last_active":"2024-05-27T12:32:43.789583+0000","last_peered":"2024-05-27T12:32:43.789583+0000","last_clean":"2024-05-27T12:32:43.789583+0000","last_became_active":"2024-05-27T12:32:42.378367+0000","last_became_peered":"2024-05-27T12:32:42.378367+0000","last_unstale":"2024-05-27T12:32:43.789583+0000","last_undegraded":"2024-05-27T12:32:43.789583+0000","last_fullsized":"2024-05-27T12:32:43.789583+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:20:51.752584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.370292+0000","last_change":"2024-05-27T12:32:41.369723+0000","last_active":"2024-05-27T12:32:43.370292+0000","last_peered":"2024-05-27T12:32:43.370292+0000","last_clean":"2024-05-27T12:32:43.370292+0000","last_became_active":"2024-05-27T12:32:41.369404+0000","last_became_peered":"2024-05-27T12:32:41.369404+0000","last_unstale":"2024-05-27T12:32:43.370292+0000","last_undegraded":"2024-05-27T12:32:43.370292+0000","last_fullsized":"2024-05-27T12:32:43.370292+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T23:33:13.169169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.790391+0000","last_change":"2024-05-27T12:32:42.371958+0000","last_active":"2024-05-27T12:32:43.790391+0000","last_peered":"2024-05-27T12:32:43.790391+0000","last_clean":"2024-05-27T12:32:43.790391+0000","last_became_active":"2024-05-27T12:32:42.371689+0000","last_became_peered":"2024-05-27T12:32:42.371689+0000","last_unstale":"2024-05-27T12:32:43.790391+0000","last_undegraded":"2024-05-27T12:32:43.790391+0000","last_fullsized":"2024-05-27T12:32:43.790391+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:31:53.377015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.789137+0000","last_change":"2024-05-27T12:32:41.367208+0000","last_active":"2024-05-27T12:32:43.789137+0000","last_peered":"2024-05-27T12:32:43.789137+0000","last_clean":"2024-05-27T12:32:43.789137+0000","last_became_active":"2024-05-27T12:32:41.366772+0000","last_became_peered":"2024-05-27T12:32:41.366772+0000","last_unstale":"2024-05-27T12:32:43.789137+0000","last_undegraded":"2024-05-27T12:32:43.789137+0000","last_fullsized":"2024-05-27T12:32:43.789137+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T23:33:13.169169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.371204+0000","last_change":"2024-05-27T12:32:42.371618+0000","last_active":"2024-05-27T12:32:43.371204+0000","last_peered":"2024-05-27T12:32:43.371204+0000","last_clean":"2024-05-27T12:32:43.371204+0000","last_became_active":"2024-05-27T12:32:42.369525+0000","last_became_peered":"2024-05-27T12:32:42.369525+0000","last_unstale":"2024-05-27T12:32:43.371204+0000","last_undegraded":"2024-05-27T12:32:43.371204+0000","last_fullsized":"2024-05-27T12:32:43.371204+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:46:59.701728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.788977+0000","last_change":"2024-05-27T12:32:41.366388+0000","last_active":"2024-05-27T12:32:43.788977+0000","last_peered":"2024-05-27T12:32:43.788977+0000","last_clean":"2024-05-27T12:32:43.788977+0000","last_became_active":"2024-05-27T12:32:41.365881+0000","last_became_peered":"2024-05-27T12:32:41.365881+0000","last_unstale":"2024-05-27T12:32:43.788977+0000","last_undegraded":"2024-05-27T12:32:43.788977+0000","last_fullsized":"2024-05-27T12:32:43.788977+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:24:00.607915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.371263+0000","last_change":"2024-05-27T12:32:42.383798+0000","last_active":"2024-05-27T12:32:43.371263+0000","last_peered":"2024-05-27T12:32:43.371263+0000","last_clean":"2024-05-27T12:32:43.371263+0000","last_became_active":"2024-05-27T12:32:42.383431+0000","last_became_peered":"2024-05-27T12:32:42.383431+0000","last_unstale":"2024-05-27T12:32:43.371263+0000","last_undegraded":"2024-05-27T12:32:43.371263+0000","last_fullsized":"2024-05-27T12:32:43.371263+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:45:06.261408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.371165+0000","last_change":"2024-05-27T12:32:41.373716+0000","last_active":"2024-05-27T12:32:43.371165+0000","last_peered":"2024-05-27T12:32:43.371165+0000","last_clean":"2024-05-27T12:32:43.371165+0000","last_became_active":"2024-05-27T12:32:41.373364+0000","last_became_peered":"2024-05-27T12:32:41.373364+0000","last_unstale":"2024-05-27T12:32:43.371165+0000","last_undegraded":"2024-05-27T12:32:43.371165+0000","last_fullsized":"2024-05-27T12:32:43.371165+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:21:03.909608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.789527+0000","last_change":"2024-05-27T12:32:42.370445+0000","last_active":"2024-05-27T12:32:43.789527+0000","last_peered":"2024-05-27T12:32:43.789527+0000","last_clean":"2024-05-27T12:32:43.789527+0000","last_became_active":"2024-05-27T12:32:42.370164+0000","last_became_peered":"2024-05-27T12:32:42.370164+0000","last_unstale":"2024-05-27T12:32:43.789527+0000","last_undegraded":"2024-05-27T12:32:43.789527+0000","last_fullsized":"2024-05-27T12:32:43.789527+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:46:59.701728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.790143+0000","last_change":"2024-05-27T12:32:42.386589+0000","last_active":"2024-05-27T12:32:43.790143+0000","last_peered":"2024-05-27T12:32:43.790143+0000","last_clean":"2024-05-27T12:32:43.790143+0000","last_became_active":"2024-05-27T12:32:42.386297+0000","last_became_peered":"2024-05-27T12:32:42.386297+0000","last_unstale":"2024-05-27T12:32:43.790143+0000","last_undegraded":"2024-05-27T12:32:43.790143+0000","last_fullsized":"2024-05-27T12:32:43.790143+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:29:54.817031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.370575+0000","last_change":"2024-05-27T12:32:41.374812+0000","last_active":"2024-05-27T12:32:43.370575+0000","last_peered":"2024-05-27T12:32:43.370575+0000","last_clean":"2024-05-27T12:32:43.370575+0000","last_became_active":"2024-05-27T12:32:41.374488+0000","last_became_peered":"2024-05-27T12:32:41.374488+0000","last_unstale":"2024-05-27T12:32:43.370575+0000","last_undegraded":"2024-05-27T12:32:43.370575+0000","last_fullsized":"2024-05-27T12:32:43.370575+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:10:29.744776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.790329+0000","last_change":"2024-05-27T12:32:42.389941+0000","last_active":"2024-05-27T12:32:43.790329+0000","last_peered":"2024-05-27T12:32:43.790329+0000","last_clean":"2024-05-27T12:32:43.790329+0000","last_became_active":"2024-05-27T12:32:42.389630+0000","last_became_peered":"2024-05-27T12:32:42.389630+0000","last_unstale":"2024-05-27T12:32:43.790329+0000","last_undegraded":"2024-05-27T12:32:43.790329+0000","last_fullsized":"2024-05-27T12:32:43.790329+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:46:37.922278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.370730+0000","last_change":"2024-05-27T12:32:41.371373+0000","last_active":"2024-05-27T12:32:43.370730+0000","last_peered":"2024-05-27T12:32:43.370730+0000","last_clean":"2024-05-27T12:32:43.370730+0000","last_became_active":"2024-05-27T12:32:41.371009+0000","last_became_peered":"2024-05-27T12:32:41.371009+0000","last_unstale":"2024-05-27T12:32:43.370730+0000","last_undegraded":"2024-05-27T12:32:43.370730+0000","last_fullsized":"2024-05-27T12:32:43.370730+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:20:04.295568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.789661+0000","last_change":"2024-05-27T12:32:42.382123+0000","last_active":"2024-05-27T12:32:43.789661+0000","last_peered":"2024-05-27T12:32:43.789661+0000","last_clean":"2024-05-27T12:32:43.789661+0000","last_became_active":"2024-05-27T12:32:42.381762+0000","last_became_peered":"2024-05-27T12:32:42.381762+0000","last_unstale":"2024-05-27T12:32:43.789661+0000","last_undegraded":"2024-05-27T12:32:43.789661+0000","last_fullsized":"2024-05-27T12:32:43.789661+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:37:15.902329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.372004+0000","last_change":"2024-05-27T12:32:41.362828+0000","last_active":"2024-05-27T12:32:43.372004+0000","last_peered":"2024-05-27T12:32:43.372004+0000","last_clean":"2024-05-27T12:32:43.372004+0000","last_became_active":"2024-05-27T12:32:41.362526+0000","last_became_peered":"2024-05-27T12:32:41.362526+0000","last_unstale":"2024-05-27T12:32:43.372004+0000","last_undegraded":"2024-05-27T12:32:43.372004+0000","last_fullsized":"2024-05-27T12:32:43.372004+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T23:55:01.390036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.371918+0000","last_change":"2024-05-27T12:32:42.368191+0000","last_active":"2024-05-27T12:32:43.371918+0000","last_peered":"2024-05-27T12:32:43.371918+0000","last_clean":"2024-05-27T12:32:43.371918+0000","last_became_active":"2024-05-27T12:32:42.367914+0000","last_became_peered":"2024-05-27T12:32:42.367914+0000","last_unstale":"2024-05-27T12:32:43.371918+0000","last_undegraded":"2024-05-27T12:32:43.371918+0000","last_fullsized":"2024-05-27T12:32:43.371918+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:39:46.806156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"22'4","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.789749+0000","last_change":"2024-05-27T12:32:41.364608+0000","last_active":"2024-05-27T12:32:43.789749+0000","last_peered":"2024-05-27T12:32:43.789749+0000","last_clean":"2024-05-27T12:32:43.789749+0000","last_became_active":"2024-05-27T12:32:41.364245+0000","last_became_peered":"2024-05-27T12:32:41.364245+0000","last_unstale":"2024-05-27T12:32:43.789749+0000","last_undegraded":"2024-05-27T12:32:43.789749+0000","last_fullsized":"2024-05-27T12:32:43.789749+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:56:45.451315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509446,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27836,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344004,"statfs":{"total":96636764160,"available":96608260096,"internally_reserved":0,"allocated":831488,"data_stored":671905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509446,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":245760,"data_stored":82567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509446,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":237568,"data_stored":81045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509446,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":245760,"data_stored":81081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509446,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31424,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340416,"statfs":{"total":96636764160,"available":96604585984,"internally_reserved":0,"allocated":245760,"data_stored":82567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509446,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31412,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340428,"statfs":{"total":96636764160,"available":96604598272,"internally_reserved":0,"allocated":233472,"data_stored":80955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509446,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31420,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340420,"statfs":{"total":96636764160,"available":96604590080,"internally_reserved":0,"allocated":241664,"data_stored":81115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542151,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32008,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339832,"statfs":{"total":96636764160,"available":96603987968,"internally_reserved":0,"allocated":839680,"data_stored":671961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-27T12:32:50.186 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-05-27T12:32:50.186 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-05-27T12:32:50.186 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-05-27T12:32:50.186 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-05-27T12:32:50.187 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-05-27T12:32:50.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.327+0000 7f0888c13640 1 Processor -- start 2024-05-27T12:32:50.330 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.327+0000 7f0888c13640 1 -- start start 2024-05-27T12:32:50.330 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.328+0000 7f0888c13640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f088406cb20 0x7f088406cf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:50.330 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.328+0000 7f0888c13640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f088406d850 con 0x7f088409aa30 2024-05-27T12:32:50.330 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.328+0000 7f0888c13640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f088406db30 con 0x7f08840d1280 2024-05-27T12:32:50.330 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.328+0000 7f0888c13640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f08840d0df0 con 0x7f088406cb20 2024-05-27T12:32:50.330 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.328+0000 7f088259c640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f088409aa30 0x7f088409ae10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:60372/0 (socket says 172.21.15.55:60372) 2024-05-27T12:32:50.330 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.328+0000 7f088259c640 1 -- 172.21.15.55:0/3481352539 learned_addr learned my addr 172.21.15.55:0/3481352539 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-27T12:32:50.330 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.328+0000 7f0879d9b640 1 --2- 172.21.15.55:0/3481352539 >> v2:172.21.15.72:3300/0 conn(0x7f088406cb20 0x7f088406cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:50.330 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.328+0000 7f0881d9b640 1 -- 172.21.15.55:0/3481352539 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 415771997 0 0) 0x7f088406d850 con 0x7f088409aa30 2024-05-27T12:32:50.330 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.328+0000 7f0881d9b640 1 -- 172.21.15.55:0/3481352539 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0870003520 con 0x7f088409aa30 2024-05-27T12:32:50.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.328+0000 7f0881d9b640 1 -- 172.21.15.55:0/3481352539 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 410258451 0 0) 0x7f0870003520 con 0x7f088409aa30 2024-05-27T12:32:50.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.328+0000 7f0881d9b640 1 -- 172.21.15.55:0/3481352539 >> v2:172.21.15.72:3300/0 conn(0x7f088406cb20 msgr2=0x7f088406cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:32:50.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.328+0000 7f0881d9b640 1 --2- 172.21.15.55:0/3481352539 >> v2:172.21.15.72:3300/0 conn(0x7f088406cb20 0x7f088406cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:50.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.328+0000 7f0881d9b640 1 -- 172.21.15.55:0/3481352539 >> v1:172.21.15.72:6789/0 conn(0x7f08840d1280 legacy=0x7f08840d1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:50.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.328+0000 7f0881d9b640 1 -- 172.21.15.55:0/3481352539 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08840d0a80 con 0x7f088409aa30 2024-05-27T12:32:50.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.328+0000 7f0881d9b640 1 -- 172.21.15.55:0/3481352539 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 793017739 0 0) 0x7f0874001670 con 0x7f088409aa30 2024-05-27T12:32:50.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.328+0000 7f0881d9b640 1 -- 172.21.15.55:0/3481352539 >> v1:172.21.15.55:6789/0 conn(0x7f088409aa30 legacy=0x7f088409ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:50.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.328+0000 7f0881d9b640 1 --2- 172.21.15.55:0/3481352539 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0870003a90 0x7f0870003eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:50.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.328+0000 7f0881d9b640 1 --2- 172.21.15.55:0/3481352539 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0870004800 0x7f0870004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:50.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.328+0000 7f0881d9b640 1 --2- 172.21.15.55:0/3481352539 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0870005210 0x7f087000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:50.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.328+0000 7f0881d9b640 1 -- 172.21.15.55:0/3481352539 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f08840d0df0 con 0x7f0870005210 2024-05-27T12:32:50.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.328+0000 7f0881d9b640 1 -- 172.21.15.55:0/3481352539 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f087000c140 con 0x7f0870003a90 2024-05-27T12:32:50.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.328+0000 7f0881d9b640 1 -- 172.21.15.55:0/3481352539 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f087000c340 con 0x7f0870004800 2024-05-27T12:32:50.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.329+0000 7f088259c640 1 --2- 172.21.15.55:0/3481352539 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0870003a90 0x7f0870003eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:50.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.329+0000 7f0882d9d640 1 --2- 172.21.15.55:0/3481352539 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0870005210 0x7f087000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:50.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.329+0000 7f0879d9b640 1 --2- 172.21.15.55:0/3481352539 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0870004800 0x7f0870004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:50.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.329+0000 7f0882d9d640 1 -- 172.21.15.55:0/3481352539 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0870004800 msgr2=0x7f0870004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:32:50.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.329+0000 7f0882d9d640 1 --2- 172.21.15.55:0/3481352539 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0870004800 0x7f0870004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:50.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.329+0000 7f0882d9d640 1 -- 172.21.15.55:0/3481352539 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0870003a90 msgr2=0x7f0870003eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:32:50.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.329+0000 7f0882d9d640 1 --2- 172.21.15.55:0/3481352539 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0870003a90 0x7f0870003eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:50.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.329+0000 7f0882d9d640 1 -- 172.21.15.55:0/3481352539 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0870003520 con 0x7f0870005210 2024-05-27T12:32:50.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.329+0000 7f0882d9d640 1 -- 172.21.15.55:0/3481352539 reap_dead start 2024-05-27T12:32:50.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.330+0000 7f0882d9d640 1 --2- 172.21.15.55:0/3481352539 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0870005210 0x7f087000b9c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f087c001e20 tx=0x7f0870005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ab2bfe4cfde14a5 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:50.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.330+0000 7f0881d9b640 1 -- 172.21.15.55:0/3481352539 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f087c001a70 con 0x7f0870005210 2024-05-27T12:32:50.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.330+0000 7f0881d9b640 1 -- 172.21.15.55:0/3481352539 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f087c02ae40 con 0x7f0870005210 2024-05-27T12:32:50.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.330+0000 7f0881d9b640 1 -- 172.21.15.55:0/3481352539 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f087c003b90 con 0x7f0870005210 2024-05-27T12:32:50.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.330+0000 7f0888c13640 1 -- 172.21.15.55:0/3481352539 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0870005210 msgr2=0x7f087000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:50.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.330+0000 7f0888c13640 1 --2- 172.21.15.55:0/3481352539 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0870005210 0x7f087000b9c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f087c001e20 tx=0x7f0870005830 comp rx=0 tx=0).stop 2024-05-27T12:32:50.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.330+0000 7f0888c13640 1 -- 172.21.15.55:0/3481352539 shutdown_connections 2024-05-27T12:32:50.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.330+0000 7f0888c13640 1 --2- 172.21.15.55:0/3481352539 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0870005210 0x7f087000b9c0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:50.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.330+0000 7f0888c13640 1 -- 172.21.15.55:0/3481352539 >> 172.21.15.55:0/3481352539 conn(0x7f08840b4190 msgr2=0x7f08840b45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:50.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.330+0000 7f0888c13640 1 -- 172.21.15.55:0/3481352539 shutdown_connections 2024-05-27T12:32:50.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.330+0000 7f0888c13640 1 -- 172.21.15.55:0/3481352539 wait complete. 2024-05-27T12:32:50.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.332+0000 7f0888c13640 1 Processor -- start 2024-05-27T12:32:50.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.332+0000 7f0888c13640 1 -- start start 2024-05-27T12:32:50.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.332+0000 7f0888c13640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0870005210 0x7f08840c6df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:50.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.332+0000 7f0888c13640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0884157780 0x7f0884156fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:50.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.332+0000 7f0888c13640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f08840700f0 0x7f0884070570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:50.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.332+0000 7f0888c13640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f088406df90 con 0x7f0884157780 2024-05-27T12:32:50.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.332+0000 7f0888c13640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f088406de10 con 0x7f0870005210 2024-05-27T12:32:50.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.332+0000 7f0888c13640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f088409ae10 con 0x7f08840700f0 2024-05-27T12:32:50.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.333+0000 7f0879d9b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0884157780 0x7f0884156fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:50.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.333+0000 7f0879d9b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0884157780 0x7f0884156fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55346/0 (socket says 172.21.15.55:55346) 2024-05-27T12:32:50.337 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.333+0000 7f0879d9b640 1 -- 172.21.15.55:0/2946261769 learned_addr learned my addr 172.21.15.55:0/2946261769 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:32:50.337 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.333+0000 7f0882d9d640 1 --2- 172.21.15.55:0/2946261769 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f08840700f0 0x7f0884070570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:50.337 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.333+0000 7f088259c640 1 --2- 172.21.15.55:0/2946261769 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0870005210 0x7f08840c6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:50.337 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.333+0000 7f0879d9b640 1 -- 172.21.15.55:0/2946261769 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f08840700f0 msgr2=0x7f0884070570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:50.337 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.333+0000 7f0879d9b640 1 --2- 172.21.15.55:0/2946261769 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f08840700f0 0x7f0884070570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:50.337 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.333+0000 7f0879d9b640 1 -- 172.21.15.55:0/2946261769 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0870005210 msgr2=0x7f08840c6df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:50.337 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.333+0000 7f0879d9b640 1 --2- 172.21.15.55:0/2946261769 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0870005210 0x7f08840c6df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:50.337 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.333+0000 7f0879d9b640 1 -- 172.21.15.55:0/2946261769 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08840c7590 con 0x7f0884157780 2024-05-27T12:32:50.337 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.333+0000 7f0879d9b640 1 --2- 172.21.15.55:0/2946261769 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0884157780 0x7f0884156fa0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f086c011910 tx=0x7f086c011dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:50.337 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.333+0000 7f087b7fe640 1 -- 172.21.15.55:0/2946261769 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f086c00faf0 con 0x7f0884157780 2024-05-27T12:32:50.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.333+0000 7f087b7fe640 1 -- 172.21.15.55:0/2946261769 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f086c00fc90 con 0x7f0884157780 2024-05-27T12:32:50.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.333+0000 7f0888c13640 1 -- 172.21.15.55:0/2946261769 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08840c7870 con 0x7f0884157780 2024-05-27T12:32:50.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.333+0000 7f087b7fe640 1 -- 172.21.15.55:0/2946261769 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f086c014440 con 0x7f0884157780 2024-05-27T12:32:50.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.333+0000 7f0888c13640 1 -- 172.21.15.55:0/2946261769 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08841574e0 con 0x7f0884157780 2024-05-27T12:32:50.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.334+0000 7f0888c13640 1 -- 172.21.15.55:0/2946261769 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0884075460 con 0x7f0884157780 2024-05-27T12:32:50.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.335+0000 7f087b7fe640 1 -- 172.21.15.55:0/2946261769 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f086c012040 con 0x7f0884157780 2024-05-27T12:32:50.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.335+0000 7f087b7fe640 1 --2- 172.21.15.55:0/2946261769 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f086406c8f0 0x7f086406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:50.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.335+0000 7f087b7fe640 1 -- 172.21.15.55:0/2946261769 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f086c08c1d0 con 0x7f0884157780 2024-05-27T12:32:50.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.335+0000 7f088259c640 1 --2- 172.21.15.55:0/2946261769 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f086406c8f0 0x7f086406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:50.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.336+0000 7f088259c640 1 --2- 172.21.15.55:0/2946261769 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f086406c8f0 0x7f086406edb0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0874001eb0 tx=0x7f0874009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:50.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.339+0000 7f087b7fe640 1 -- 172.21.15.55:0/2946261769 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f086c019030 con 0x7f0884157780 2024-05-27T12:32:50.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.578+0000 7f0888c13640 1 -- 172.21.15.55:0/2946261769 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f08840b50a0 con 0x7f0884157780 2024-05-27T12:32:50.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.581+0000 7f087b7fe640 1 -- 172.21.15.55:0/2946261769 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+174134 (secure 0 0 0) 0x7f086c05a690 con 0x7f0884157780 2024-05-27T12:32:50.583 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-27T12:32:50.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.584+0000 7f0888c13640 1 -- 172.21.15.55:0/2946261769 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f086406c8f0 msgr2=0x7f086406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:50.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.584+0000 7f0888c13640 1 --2- 172.21.15.55:0/2946261769 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f086406c8f0 0x7f086406edb0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0874001eb0 tx=0x7f0874009040 comp rx=0 tx=0).stop 2024-05-27T12:32:50.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.584+0000 7f0888c13640 1 -- 172.21.15.55:0/2946261769 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0884157780 msgr2=0x7f0884156fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:50.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.584+0000 7f0888c13640 1 --2- 172.21.15.55:0/2946261769 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0884157780 0x7f0884156fa0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f086c011910 tx=0x7f086c011dd0 comp rx=0 tx=0).stop 2024-05-27T12:32:50.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.584+0000 7f0888c13640 1 -- 172.21.15.55:0/2946261769 shutdown_connections 2024-05-27T12:32:50.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.584+0000 7f0888c13640 1 --2- 172.21.15.55:0/2946261769 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f08840700f0 0x7f0884070570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:50.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.584+0000 7f0888c13640 1 --2- 172.21.15.55:0/2946261769 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0884157780 0x7f0884156fa0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:50.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.584+0000 7f0888c13640 1 --2- 172.21.15.55:0/2946261769 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f086406c8f0 0x7f086406edb0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:50.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.584+0000 7f0888c13640 1 --2- 172.21.15.55:0/2946261769 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0870005210 0x7f08840c6df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:50.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.584+0000 7f0888c13640 1 -- 172.21.15.55:0/2946261769 >> 172.21.15.55:0/2946261769 conn(0x7f08840b4190 msgr2=0x7f088415b510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:50.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.584+0000 7f0888c13640 1 -- 172.21.15.55:0/2946261769 shutdown_connections 2024-05-27T12:32:50.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.584+0000 7f0888c13640 1 -- 172.21.15.55:0/2946261769 wait complete. 2024-05-27T12:32:50.594 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":5,"flags":0,"active_gid":4105,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":3152720583},{"type":"v1","addr":"172.21.15.72:6833","nonce":3152720583}]},"active_addr":"172.21.15.72:6833/3152720583","active_change":"2024-05-27T12:32:21.251402+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4104,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.72:0","nonce":1115692742}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.72:0","nonce":87592282}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.72:0","nonce":1567474144}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.72:0","nonce":141227099}]}]} 2024-05-27T12:32:50.598 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-05-27T12:32:50.598 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-05-27T12:32:50.599 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-27T12:32:50.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.703+0000 7f7d695bb640 1 Processor -- start 2024-05-27T12:32:50.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.703+0000 7f7d695bb640 1 -- start start 2024-05-27T12:32:50.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.704+0000 7f7d695bb640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7d640b79c0 0x7f7d6406ce80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:50.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.704+0000 7f7d695bb640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7d6406d3c0 0x7f7d640d3950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:50.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.704+0000 7f7d695bb640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d6406d7d0 con 0x7f7d641620b0 2024-05-27T12:32:50.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.704+0000 7f7d695bb640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f7d640d56d0 con 0x7f7d6406d3c0 2024-05-27T12:32:50.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.704+0000 7f7d695bb640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f7d640cffe0 con 0x7f7d640b79c0 2024-05-27T12:32:50.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.704+0000 7f7d637fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7d6406d3c0 0x7f7d640d3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:50.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.704+0000 7f7d62ffd640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f7d641620b0 0x7f7d640cf8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:60388/0 (socket says 172.21.15.55:60388) 2024-05-27T12:32:50.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.704+0000 7f7d62ffd640 1 -- 172.21.15.55:0/273973896 learned_addr learned my addr 172.21.15.55:0/273973896 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-27T12:32:50.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.704+0000 7f7d627fc640 1 --2- 172.21.15.55:0/273973896 >> v2:172.21.15.72:3300/0 conn(0x7f7d640b79c0 0x7f7d6406ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:50.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.704+0000 7f7d637fe640 1 -- 172.21.15.55:0/273973896 >> v2:172.21.15.72:3300/0 conn(0x7f7d640b79c0 msgr2=0x7f7d6406ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:32:50.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.704+0000 7f7d637fe640 1 --2- 172.21.15.55:0/273973896 >> v2:172.21.15.72:3300/0 conn(0x7f7d640b79c0 0x7f7d6406ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:50.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.704+0000 7f7d637fe640 1 -- 172.21.15.55:0/273973896 >> v1:172.21.15.55:6789/0 conn(0x7f7d641620b0 legacy=0x7f7d640cf8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:50.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.704+0000 7f7d637fe640 1 -- 172.21.15.55:0/273973896 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d640b39a0 con 0x7f7d6406d3c0 2024-05-27T12:32:50.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.705+0000 7f7d637fe640 1 --2- 172.21.15.55:0/273973896 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7d6406d3c0 0x7f7d640d3950 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f7d6406cd10 tx=0x7f7d5c02a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c90372c1debbd0c2 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:50.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.705+0000 7f7d61ffb640 1 -- 172.21.15.55:0/273973896 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d5c007740 con 0x7f7d6406d3c0 2024-05-27T12:32:50.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.705+0000 7f7d61ffb640 1 -- 172.21.15.55:0/273973896 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d5c0078e0 con 0x7f7d6406d3c0 2024-05-27T12:32:50.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.705+0000 7f7d61ffb640 1 -- 172.21.15.55:0/273973896 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d5c007cb0 con 0x7f7d6406d3c0 2024-05-27T12:32:50.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.706+0000 7f7d695bb640 1 -- 172.21.15.55:0/273973896 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7d6406d3c0 msgr2=0x7f7d640d3950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:50.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.706+0000 7f7d695bb640 1 --2- 172.21.15.55:0/273973896 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7d6406d3c0 0x7f7d640d3950 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f7d6406cd10 tx=0x7f7d5c02a680 comp rx=0 tx=0).stop 2024-05-27T12:32:50.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.706+0000 7f7d695bb640 1 -- 172.21.15.55:0/273973896 shutdown_connections 2024-05-27T12:32:50.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.706+0000 7f7d695bb640 1 --2- 172.21.15.55:0/273973896 >> v2:172.21.15.72:3300/0 conn(0x7f7d640b79c0 0x7f7d6406ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:50.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.706+0000 7f7d695bb640 1 --2- 172.21.15.55:0/273973896 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7d6406d3c0 0x7f7d640d3950 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:50.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.706+0000 7f7d695bb640 1 -- 172.21.15.55:0/273973896 >> 172.21.15.55:0/273973896 conn(0x7f7d640d1940 msgr2=0x7f7d640d4890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:50.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.706+0000 7f7d695bb640 1 -- 172.21.15.55:0/273973896 shutdown_connections 2024-05-27T12:32:50.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.706+0000 7f7d695bb640 1 -- 172.21.15.55:0/273973896 wait complete. 2024-05-27T12:32:50.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.707+0000 7f7d695bb640 1 Processor -- start 2024-05-27T12:32:50.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.707+0000 7f7d695bb640 1 -- start start 2024-05-27T12:32:50.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.708+0000 7f7d695bb640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7d6406d3c0 0x7f7d64150d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:50.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.708+0000 7f7d695bb640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7d640b79c0 0x7f7d640ce170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:50.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.708+0000 7f7d695bb640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7d641620b0 0x7f7d640b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:50.710 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.708+0000 7f7d695bb640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f7d640d3150 con 0x7f7d6406d3c0 2024-05-27T12:32:50.710 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.708+0000 7f7d695bb640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f7d640d2e70 con 0x7f7d641620b0 2024-05-27T12:32:50.710 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.708+0000 7f7d695bb640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f7d640d3430 con 0x7f7d640b79c0 2024-05-27T12:32:50.710 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.708+0000 7f7d62ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7d6406d3c0 0x7f7d64150d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:50.710 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.708+0000 7f7d62ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7d6406d3c0 0x7f7d64150d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55354/0 (socket says 172.21.15.55:55354) 2024-05-27T12:32:50.710 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.708+0000 7f7d62ffd640 1 -- 172.21.15.55:0/342868588 learned_addr learned my addr 172.21.15.55:0/342868588 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:32:50.710 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.708+0000 7f7d637fe640 1 --2- 172.21.15.55:0/342868588 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7d641620b0 0x7f7d640b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:50.710 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.708+0000 7f7d627fc640 1 --2- 172.21.15.55:0/342868588 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7d640b79c0 0x7f7d640ce170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:50.710 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.708+0000 7f7d62ffd640 1 -- 172.21.15.55:0/342868588 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7d640b79c0 msgr2=0x7f7d640ce170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:50.710 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.708+0000 7f7d62ffd640 1 --2- 172.21.15.55:0/342868588 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7d640b79c0 0x7f7d640ce170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:50.710 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.708+0000 7f7d62ffd640 1 -- 172.21.15.55:0/342868588 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7d641620b0 msgr2=0x7f7d640b8bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:50.710 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.708+0000 7f7d62ffd640 1 --2- 172.21.15.55:0/342868588 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7d641620b0 0x7f7d640b8bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:50.711 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.708+0000 7f7d62ffd640 1 -- 172.21.15.55:0/342868588 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d640cd0d0 con 0x7f7d6406d3c0 2024-05-27T12:32:50.711 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.709+0000 7f7d62ffd640 1 --2- 172.21.15.55:0/342868588 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7d6406d3c0 0x7f7d64150d80 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f7d5400c3c0 tx=0x7f7d5400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:50.711 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.709+0000 7f7d4b7fe640 1 -- 172.21.15.55:0/342868588 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d54017070 con 0x7f7d6406d3c0 2024-05-27T12:32:50.711 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.709+0000 7f7d4b7fe640 1 -- 172.21.15.55:0/342868588 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d54005ce0 con 0x7f7d6406d3c0 2024-05-27T12:32:50.711 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.709+0000 7f7d695bb640 1 -- 172.21.15.55:0/342868588 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d640cd3b0 con 0x7f7d6406d3c0 2024-05-27T12:32:50.711 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.709+0000 7f7d4b7fe640 1 -- 172.21.15.55:0/342868588 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d540072f0 con 0x7f7d6406d3c0 2024-05-27T12:32:50.711 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.709+0000 7f7d695bb640 1 -- 172.21.15.55:0/342868588 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d640cd970 con 0x7f7d6406d3c0 2024-05-27T12:32:50.711 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.710+0000 7f7d695bb640 1 -- 172.21.15.55:0/342868588 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d64075460 con 0x7f7d6406d3c0 2024-05-27T12:32:50.711 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.710+0000 7f7d4b7fe640 1 -- 172.21.15.55:0/342868588 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7d5401a070 con 0x7f7d6406d3c0 2024-05-27T12:32:50.712 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.711+0000 7f7d4b7fe640 1 --2- 172.21.15.55:0/342868588 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f7d5006c8f0 0x7f7d5006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:50.712 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.711+0000 7f7d4b7fe640 1 -- 172.21.15.55:0/342868588 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f7d5408af40 con 0x7f7d6406d3c0 2024-05-27T12:32:50.712 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.711+0000 7f7d627fc640 1 --2- 172.21.15.55:0/342868588 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f7d5006c8f0 0x7f7d5006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:50.712 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.711+0000 7f7d627fc640 1 --2- 172.21.15.55:0/342868588 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f7d5006c8f0 0x7f7d5006edb0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7d6415b3c0 tx=0x7f7d58008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:50.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.715+0000 7f7d4b7fe640 1 -- 172.21.15.55:0/342868588 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7d6406d7d0 con 0x7f7d6406d3c0 2024-05-27T12:32:50.901 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.902+0000 7f7d695bb640 1 -- 172.21.15.55:0/342868588 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7d640cfdc0 con 0x7f7d6406d3c0 2024-05-27T12:32:50.902 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.903+0000 7f7d4b7fe640 1 -- 172.21.15.55:0/342868588 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16557 (secure 0 0 0) 0x7f7d540592d0 con 0x7f7d6406d3c0 2024-05-27T12:32:50.903 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-27T12:32:50.903 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":23,"fsid":"c3ff4e3b-8dae-4856-9593-e5cc66c59982","created":"2024-05-27T12:32:17.019097+0000","modified":"2024-05-27T12:32:43.361598+0000","last_up_change":"2024-05-27T12:32:28.109744+0000","last_in_change":"2024-05-27T12:32:19.309872+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-27T12:32:29.277895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-27T12:32:39.442745+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-27T12:32:40.672118+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e607b598-061b-4b6f-92ff-95c20b330599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":807572567},{"type":"v1","addr":"172.21.15.55:6801","nonce":807572567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":807572567},{"type":"v1","addr":"172.21.15.55:6803","nonce":807572567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":807572567},{"type":"v1","addr":"172.21.15.55:6807","nonce":807572567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":807572567},{"type":"v1","addr":"172.21.15.55:6805","nonce":807572567}]},"public_addr":"172.21.15.55:6801/807572567","cluster_addr":"172.21.15.55:6803/807572567","heartbeat_back_addr":"172.21.15.55:6807/807572567","heartbeat_front_addr":"172.21.15.55:6805/807572567","state":["exists","up"]},{"osd":1,"uuid":"ba2b5b1d-71a9-4ecc-9a48-55aa7fe54261","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":3426897300},{"type":"v1","addr":"172.21.15.55:6825","nonce":3426897300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":3426897300},{"type":"v1","addr":"172.21.15.55:6827","nonce":3426897300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":3426897300},{"type":"v1","addr":"172.21.15.55:6831","nonce":3426897300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":3426897300},{"type":"v1","addr":"172.21.15.55:6829","nonce":3426897300}]},"public_addr":"172.21.15.55:6825/3426897300","cluster_addr":"172.21.15.55:6827/3426897300","heartbeat_back_addr":"172.21.15.55:6831/3426897300","heartbeat_front_addr":"172.21.15.55:6829/3426897300","state":["exists","up"]},{"osd":2,"uuid":"e6b81cc6-4ff1-45d0-87eb-9f04ccf986a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3510271725},{"type":"v1","addr":"172.21.15.55:6809","nonce":3510271725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3510271725},{"type":"v1","addr":"172.21.15.55:6811","nonce":3510271725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3510271725},{"type":"v1","addr":"172.21.15.55:6815","nonce":3510271725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3510271725},{"type":"v1","addr":"172.21.15.55:6813","nonce":3510271725}]},"public_addr":"172.21.15.55:6809/3510271725","cluster_addr":"172.21.15.55:6811/3510271725","heartbeat_back_addr":"172.21.15.55:6815/3510271725","heartbeat_front_addr":"172.21.15.55:6813/3510271725","state":["exists","up"]},{"osd":3,"uuid":"b6a34b75-807d-4693-b1c3-903cb4c618d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":1066693520},{"type":"v1","addr":"172.21.15.55:6817","nonce":1066693520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":1066693520},{"type":"v1","addr":"172.21.15.55:6819","nonce":1066693520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":1066693520},{"type":"v1","addr":"172.21.15.55:6823","nonce":1066693520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":1066693520},{"type":"v1","addr":"172.21.15.55:6821","nonce":1066693520}]},"public_addr":"172.21.15.55:6817/1066693520","cluster_addr":"172.21.15.55:6819/1066693520","heartbeat_back_addr":"172.21.15.55:6823/1066693520","heartbeat_front_addr":"172.21.15.55:6821/1066693520","state":["exists","up"]},{"osd":4,"uuid":"272ec937-56b4-4f0a-b2e1-b0bc189c9d79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":4190771237},{"type":"v1","addr":"172.21.15.72:6820","nonce":4190771237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":4190771237},{"type":"v1","addr":"172.21.15.72:6824","nonce":4190771237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":4190771237},{"type":"v1","addr":"172.21.15.72:6831","nonce":4190771237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":4190771237},{"type":"v1","addr":"172.21.15.72:6828","nonce":4190771237}]},"public_addr":"172.21.15.72:6820/4190771237","cluster_addr":"172.21.15.72:6824/4190771237","heartbeat_back_addr":"172.21.15.72:6831/4190771237","heartbeat_front_addr":"172.21.15.72:6828/4190771237","state":["exists","up"]},{"osd":5,"uuid":"56439854-72a0-4ef4-81ff-184a3d924a5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":2421889184},{"type":"v1","addr":"172.21.15.72:6801","nonce":2421889184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6803","nonce":2421889184},{"type":"v1","addr":"172.21.15.72:6805","nonce":2421889184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":2421889184},{"type":"v1","addr":"172.21.15.72:6813","nonce":2421889184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6807","nonce":2421889184},{"type":"v1","addr":"172.21.15.72:6809","nonce":2421889184}]},"public_addr":"172.21.15.72:6801/2421889184","cluster_addr":"172.21.15.72:6805/2421889184","heartbeat_back_addr":"172.21.15.72:6813/2421889184","heartbeat_front_addr":"172.21.15.72:6809/2421889184","state":["exists","up"]},{"osd":6,"uuid":"e248e2be-3b6e-49cf-8c8a-1a4152827582","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3796994599},{"type":"v1","addr":"172.21.15.72:6804","nonce":3796994599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":3796994599},{"type":"v1","addr":"172.21.15.72:6808","nonce":3796994599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":3796994599},{"type":"v1","addr":"172.21.15.72:6815","nonce":3796994599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":3796994599},{"type":"v1","addr":"172.21.15.72:6812","nonce":3796994599}]},"public_addr":"172.21.15.72:6804/3796994599","cluster_addr":"172.21.15.72:6808/3796994599","heartbeat_back_addr":"172.21.15.72:6815/3796994599","heartbeat_front_addr":"172.21.15.72:6812/3796994599","state":["exists","up"]},{"osd":7,"uuid":"505a62d3-322b-4629-b4fd-187a55563709","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":3024877895},{"type":"v1","addr":"172.21.15.72:6817","nonce":3024877895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":3024877895},{"type":"v1","addr":"172.21.15.72:6821","nonce":3024877895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6827","nonce":3024877895},{"type":"v1","addr":"172.21.15.72:6829","nonce":3024877895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6823","nonce":3024877895},{"type":"v1","addr":"172.21.15.72:6825","nonce":3024877895}]},"public_addr":"172.21.15.72:6817/3024877895","cluster_addr":"172.21.15.72:6821/3024877895","heartbeat_back_addr":"172.21.15.72:6829/3024877895","heartbeat_front_addr":"172.21.15.72:6825/3024877895","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.241014+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.450799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.465018+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.507647+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.534763+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.495895+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.427110+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.547466+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-27T12:32:50.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.905+0000 7f7d695bb640 1 -- 172.21.15.55:0/342868588 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f7d5006c8f0 msgr2=0x7f7d5006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:50.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.905+0000 7f7d695bb640 1 --2- 172.21.15.55:0/342868588 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f7d5006c8f0 0x7f7d5006edb0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7d6415b3c0 tx=0x7f7d58008040 comp rx=0 tx=0).stop 2024-05-27T12:32:50.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.905+0000 7f7d695bb640 1 -- 172.21.15.55:0/342868588 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7d6406d3c0 msgr2=0x7f7d64150d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:50.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.905+0000 7f7d695bb640 1 --2- 172.21.15.55:0/342868588 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7d6406d3c0 0x7f7d64150d80 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f7d5400c3c0 tx=0x7f7d5400c880 comp rx=0 tx=0).stop 2024-05-27T12:32:50.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.905+0000 7f7d695bb640 1 -- 172.21.15.55:0/342868588 shutdown_connections 2024-05-27T12:32:50.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.905+0000 7f7d695bb640 1 --2- 172.21.15.55:0/342868588 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f7d5006c8f0 0x7f7d5006edb0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:50.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.905+0000 7f7d695bb640 1 --2- 172.21.15.55:0/342868588 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7d641620b0 0x7f7d640b8bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:50.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.905+0000 7f7d695bb640 1 --2- 172.21.15.55:0/342868588 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7d640b79c0 0x7f7d640ce170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:50.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.905+0000 7f7d695bb640 1 --2- 172.21.15.55:0/342868588 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7d6406d3c0 0x7f7d64150d80 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:50.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.905+0000 7f7d695bb640 1 -- 172.21.15.55:0/342868588 >> 172.21.15.55:0/342868588 conn(0x7f7d640d1940 msgr2=0x7f7d640d4a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:50.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.905+0000 7f7d695bb640 1 -- 172.21.15.55:0/342868588 shutdown_connections 2024-05-27T12:32:50.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:50.905+0000 7f7d695bb640 1 -- 172.21.15.55:0/342868588 wait complete. 2024-05-27T12:32:50.916 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-05-27T12:32:50.916 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-27T12:32:51.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.020+0000 7f4ff23a1640 1 Processor -- start 2024-05-27T12:32:51.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.020+0000 7f4ff23a1640 1 -- start start 2024-05-27T12:32:51.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.021+0000 7f4ff23a1640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4fec0733a0 0x7f4fec0b6480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:51.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.021+0000 7f4ff23a1640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4fec073f50 con 0x7f4fec0b3280 2024-05-27T12:32:51.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.021+0000 7f4ff23a1640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4fec0d2160 con 0x7f4fec15b9b0 2024-05-27T12:32:51.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.021+0000 7f4ff23a1640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f4fec073990 con 0x7f4fec0733a0 2024-05-27T12:32:51.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.021+0000 7f4febfff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f4fec0b3280 0x7f4fec0b3660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:60402/0 (socket says 172.21.15.55:60402) 2024-05-27T12:32:51.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.021+0000 7f4febfff640 1 -- 172.21.15.55:0/2560530685 learned_addr learned my addr 172.21.15.55:0/2560530685 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-27T12:32:51.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.021+0000 7f4ff093e640 1 --2- 172.21.15.55:0/2560530685 >> v2:172.21.15.72:3300/0 conn(0x7f4fec0733a0 0x7f4fec0b6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:51.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.022+0000 7f4feaffd640 1 -- 172.21.15.55:0/2560530685 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3235370441 0 0) 0x7f4fec073f50 con 0x7f4fec0b3280 2024-05-27T12:32:51.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.022+0000 7f4feaffd640 1 -- 172.21.15.55:0/2560530685 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4fd4003520 con 0x7f4fec0b3280 2024-05-27T12:32:51.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.022+0000 7f4ff093e640 1 -- 172.21.15.55:0/2560530685 >> v1:172.21.15.72:6789/0 conn(0x7f4fec15b9b0 legacy=0x7f4fec0b4e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:51.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.022+0000 7f4ff093e640 1 -- 172.21.15.55:0/2560530685 >> v1:172.21.15.55:6789/0 conn(0x7f4fec0b3280 legacy=0x7f4fec0b3660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:51.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.022+0000 7f4feaffd640 1 -- 172.21.15.55:0/2560530685 <== mon.1 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 568318027 0 0) 0x7f4fec0d2160 con 0x7f4fec15b9b0 2024-05-27T12:32:51.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.022+0000 7f4ff093e640 1 -- 172.21.15.55:0/2560530685 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fec073c70 con 0x7f4fec0733a0 2024-05-27T12:32:51.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.022+0000 7f4ff093e640 1 --2- 172.21.15.55:0/2560530685 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4fec0733a0 0x7f4fec0b6480 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4fe4009d90 tx=0x7f4fe402a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aea4adc9c08b1913 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:51.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.023+0000 7f4feaffd640 1 -- 172.21.15.55:0/2560530685 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fe4007740 con 0x7f4fec0733a0 2024-05-27T12:32:51.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.023+0000 7f4feaffd640 1 -- 172.21.15.55:0/2560530685 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fe40078e0 con 0x7f4fec0733a0 2024-05-27T12:32:51.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.023+0000 7f4feaffd640 1 -- 172.21.15.55:0/2560530685 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fe4007c90 con 0x7f4fec0733a0 2024-05-27T12:32:51.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.023+0000 7f4ff23a1640 1 -- 172.21.15.55:0/2560530685 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4fec0733a0 msgr2=0x7f4fec0b6480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:51.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.023+0000 7f4ff23a1640 1 --2- 172.21.15.55:0/2560530685 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4fec0733a0 0x7f4fec0b6480 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4fe4009d90 tx=0x7f4fe402a660 comp rx=0 tx=0).stop 2024-05-27T12:32:51.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.023+0000 7f4ff23a1640 1 -- 172.21.15.55:0/2560530685 shutdown_connections 2024-05-27T12:32:51.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.023+0000 7f4ff23a1640 1 --2- 172.21.15.55:0/2560530685 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4fec0733a0 0x7f4fec0b6480 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:51.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.023+0000 7f4ff23a1640 1 -- 172.21.15.55:0/2560530685 >> 172.21.15.55:0/2560530685 conn(0x7f4fec0b6b10 msgr2=0x7f4fec0b6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:51.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.023+0000 7f4ff23a1640 1 -- 172.21.15.55:0/2560530685 shutdown_connections 2024-05-27T12:32:51.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.023+0000 7f4ff23a1640 1 -- 172.21.15.55:0/2560530685 wait complete. 2024-05-27T12:32:51.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.024+0000 7f4ff23a1640 1 Processor -- start 2024-05-27T12:32:51.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.025+0000 7f4ff23a1640 1 -- start start 2024-05-27T12:32:51.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.025+0000 7f4ff23a1640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4fec0733a0 0x7f4fec15cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:51.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.025+0000 7f4ff23a1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4fec0b3280 0x7f4fec0ca970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:51.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.025+0000 7f4ff23a1640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4fec15b9b0 0x7f4fec14ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:51.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.025+0000 7f4ff23a1640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f4fec0b56f0 con 0x7f4fec0b3280 2024-05-27T12:32:51.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.025+0000 7f4ff23a1640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f4fec0b5570 con 0x7f4fec15b9b0 2024-05-27T12:32:51.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.025+0000 7f4ff23a1640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f4fec0b5870 con 0x7f4fec0733a0 2024-05-27T12:32:51.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.025+0000 7f4feb7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4fec0b3280 0x7f4fec0ca970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:51.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.025+0000 7f4feb7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4fec0b3280 0x7f4fec0ca970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55356/0 (socket says 172.21.15.55:55356) 2024-05-27T12:32:51.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.025+0000 7f4feb7fe640 1 -- 172.21.15.55:0/1398483491 learned_addr learned my addr 172.21.15.55:0/1398483491 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:32:51.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.026+0000 7f4febfff640 1 --2- 172.21.15.55:0/1398483491 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4fec0733a0 0x7f4fec15cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:51.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.026+0000 7f4ff093e640 1 --2- 172.21.15.55:0/1398483491 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4fec15b9b0 0x7f4fec14ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:51.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.026+0000 7f4feb7fe640 1 -- 172.21.15.55:0/1398483491 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4fec0733a0 msgr2=0x7f4fec15cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:51.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.026+0000 7f4feb7fe640 1 --2- 172.21.15.55:0/1398483491 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4fec0733a0 0x7f4fec15cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:51.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.026+0000 7f4feb7fe640 1 -- 172.21.15.55:0/1398483491 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4fec15b9b0 msgr2=0x7f4fec14ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:51.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.026+0000 7f4feb7fe640 1 --2- 172.21.15.55:0/1398483491 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4fec15b9b0 0x7f4fec14ae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:51.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.026+0000 7f4feb7fe640 1 -- 172.21.15.55:0/1398483491 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fec0cb410 con 0x7f4fec0b3280 2024-05-27T12:32:51.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.026+0000 7f4febfff640 1 --2- 172.21.15.55:0/1398483491 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4fec0733a0 0x7f4fec15cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T12:32:51.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.026+0000 7f4feb7fe640 1 --2- 172.21.15.55:0/1398483491 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4fec0b3280 0x7f4fec0ca970 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4fe000c3c0 tx=0x7f4fe000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:51.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.026+0000 7f4fe8ff9640 1 -- 172.21.15.55:0/1398483491 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fe0017070 con 0x7f4fec0b3280 2024-05-27T12:32:51.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.026+0000 7f4fe8ff9640 1 -- 172.21.15.55:0/1398483491 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fe00035f0 con 0x7f4fec0b3280 2024-05-27T12:32:51.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.026+0000 7f4ff23a1640 1 -- 172.21.15.55:0/1398483491 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fec0b1600 con 0x7f4fec0b3280 2024-05-27T12:32:51.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.026+0000 7f4fe8ff9640 1 -- 172.21.15.55:0/1398483491 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fe00039e0 con 0x7f4fec0b3280 2024-05-27T12:32:51.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.026+0000 7f4ff23a1640 1 -- 172.21.15.55:0/1398483491 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fec0b1bc0 con 0x7f4fec0b3280 2024-05-27T12:32:51.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.027+0000 7f4ff23a1640 1 -- 172.21.15.55:0/1398483491 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4fec075460 con 0x7f4fec0b3280 2024-05-27T12:32:51.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.028+0000 7f4fe8ff9640 1 -- 172.21.15.55:0/1398483491 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4fe001a070 con 0x7f4fec0b3280 2024-05-27T12:32:51.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.028+0000 7f4fe8ff9640 1 --2- 172.21.15.55:0/1398483491 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f4fd806c8f0 0x7f4fd806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:51.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.028+0000 7f4fe8ff9640 1 -- 172.21.15.55:0/1398483491 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f4fe008aed0 con 0x7f4fec0b3280 2024-05-27T12:32:51.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.028+0000 7f4febfff640 1 --2- 172.21.15.55:0/1398483491 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f4fd806c8f0 0x7f4fd806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:51.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.029+0000 7f4febfff640 1 --2- 172.21.15.55:0/1398483491 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f4fd806c8f0 0x7f4fd806edb0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4fdc005880 tx=0x7f4fdc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:51.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.032+0000 7f4fe8ff9640 1 -- 172.21.15.55:0/1398483491 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4fe0059300 con 0x7f4fec0b3280 2024-05-27T12:32:51.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.217+0000 7f4ff23a1640 1 -- 172.21.15.55:0/1398483491 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4fec15d4b0 con 0x7f4fec0b3280 2024-05-27T12:32:51.217 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.218+0000 7f4fe8ff9640 1 -- 172.21.15.55:0/1398483491 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16557 (secure 0 0 0) 0x7f4fe0058c00 con 0x7f4fec0b3280 2024-05-27T12:32:51.218 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-27T12:32:51.218 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":23,"fsid":"c3ff4e3b-8dae-4856-9593-e5cc66c59982","created":"2024-05-27T12:32:17.019097+0000","modified":"2024-05-27T12:32:43.361598+0000","last_up_change":"2024-05-27T12:32:28.109744+0000","last_in_change":"2024-05-27T12:32:19.309872+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-27T12:32:29.277895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-27T12:32:39.442745+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-27T12:32:40.672118+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e607b598-061b-4b6f-92ff-95c20b330599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":807572567},{"type":"v1","addr":"172.21.15.55:6801","nonce":807572567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":807572567},{"type":"v1","addr":"172.21.15.55:6803","nonce":807572567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":807572567},{"type":"v1","addr":"172.21.15.55:6807","nonce":807572567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":807572567},{"type":"v1","addr":"172.21.15.55:6805","nonce":807572567}]},"public_addr":"172.21.15.55:6801/807572567","cluster_addr":"172.21.15.55:6803/807572567","heartbeat_back_addr":"172.21.15.55:6807/807572567","heartbeat_front_addr":"172.21.15.55:6805/807572567","state":["exists","up"]},{"osd":1,"uuid":"ba2b5b1d-71a9-4ecc-9a48-55aa7fe54261","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":3426897300},{"type":"v1","addr":"172.21.15.55:6825","nonce":3426897300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":3426897300},{"type":"v1","addr":"172.21.15.55:6827","nonce":3426897300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":3426897300},{"type":"v1","addr":"172.21.15.55:6831","nonce":3426897300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":3426897300},{"type":"v1","addr":"172.21.15.55:6829","nonce":3426897300}]},"public_addr":"172.21.15.55:6825/3426897300","cluster_addr":"172.21.15.55:6827/3426897300","heartbeat_back_addr":"172.21.15.55:6831/3426897300","heartbeat_front_addr":"172.21.15.55:6829/3426897300","state":["exists","up"]},{"osd":2,"uuid":"e6b81cc6-4ff1-45d0-87eb-9f04ccf986a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3510271725},{"type":"v1","addr":"172.21.15.55:6809","nonce":3510271725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3510271725},{"type":"v1","addr":"172.21.15.55:6811","nonce":3510271725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3510271725},{"type":"v1","addr":"172.21.15.55:6815","nonce":3510271725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3510271725},{"type":"v1","addr":"172.21.15.55:6813","nonce":3510271725}]},"public_addr":"172.21.15.55:6809/3510271725","cluster_addr":"172.21.15.55:6811/3510271725","heartbeat_back_addr":"172.21.15.55:6815/3510271725","heartbeat_front_addr":"172.21.15.55:6813/3510271725","state":["exists","up"]},{"osd":3,"uuid":"b6a34b75-807d-4693-b1c3-903cb4c618d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":1066693520},{"type":"v1","addr":"172.21.15.55:6817","nonce":1066693520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":1066693520},{"type":"v1","addr":"172.21.15.55:6819","nonce":1066693520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":1066693520},{"type":"v1","addr":"172.21.15.55:6823","nonce":1066693520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":1066693520},{"type":"v1","addr":"172.21.15.55:6821","nonce":1066693520}]},"public_addr":"172.21.15.55:6817/1066693520","cluster_addr":"172.21.15.55:6819/1066693520","heartbeat_back_addr":"172.21.15.55:6823/1066693520","heartbeat_front_addr":"172.21.15.55:6821/1066693520","state":["exists","up"]},{"osd":4,"uuid":"272ec937-56b4-4f0a-b2e1-b0bc189c9d79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":4190771237},{"type":"v1","addr":"172.21.15.72:6820","nonce":4190771237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":4190771237},{"type":"v1","addr":"172.21.15.72:6824","nonce":4190771237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":4190771237},{"type":"v1","addr":"172.21.15.72:6831","nonce":4190771237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":4190771237},{"type":"v1","addr":"172.21.15.72:6828","nonce":4190771237}]},"public_addr":"172.21.15.72:6820/4190771237","cluster_addr":"172.21.15.72:6824/4190771237","heartbeat_back_addr":"172.21.15.72:6831/4190771237","heartbeat_front_addr":"172.21.15.72:6828/4190771237","state":["exists","up"]},{"osd":5,"uuid":"56439854-72a0-4ef4-81ff-184a3d924a5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":2421889184},{"type":"v1","addr":"172.21.15.72:6801","nonce":2421889184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6803","nonce":2421889184},{"type":"v1","addr":"172.21.15.72:6805","nonce":2421889184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":2421889184},{"type":"v1","addr":"172.21.15.72:6813","nonce":2421889184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6807","nonce":2421889184},{"type":"v1","addr":"172.21.15.72:6809","nonce":2421889184}]},"public_addr":"172.21.15.72:6801/2421889184","cluster_addr":"172.21.15.72:6805/2421889184","heartbeat_back_addr":"172.21.15.72:6813/2421889184","heartbeat_front_addr":"172.21.15.72:6809/2421889184","state":["exists","up"]},{"osd":6,"uuid":"e248e2be-3b6e-49cf-8c8a-1a4152827582","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3796994599},{"type":"v1","addr":"172.21.15.72:6804","nonce":3796994599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":3796994599},{"type":"v1","addr":"172.21.15.72:6808","nonce":3796994599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":3796994599},{"type":"v1","addr":"172.21.15.72:6815","nonce":3796994599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":3796994599},{"type":"v1","addr":"172.21.15.72:6812","nonce":3796994599}]},"public_addr":"172.21.15.72:6804/3796994599","cluster_addr":"172.21.15.72:6808/3796994599","heartbeat_back_addr":"172.21.15.72:6815/3796994599","heartbeat_front_addr":"172.21.15.72:6812/3796994599","state":["exists","up"]},{"osd":7,"uuid":"505a62d3-322b-4629-b4fd-187a55563709","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":3024877895},{"type":"v1","addr":"172.21.15.72:6817","nonce":3024877895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":3024877895},{"type":"v1","addr":"172.21.15.72:6821","nonce":3024877895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6827","nonce":3024877895},{"type":"v1","addr":"172.21.15.72:6829","nonce":3024877895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6823","nonce":3024877895},{"type":"v1","addr":"172.21.15.72:6825","nonce":3024877895}]},"public_addr":"172.21.15.72:6817/3024877895","cluster_addr":"172.21.15.72:6821/3024877895","heartbeat_back_addr":"172.21.15.72:6829/3024877895","heartbeat_front_addr":"172.21.15.72:6825/3024877895","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.241014+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.450799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.465018+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.507647+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.534763+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.495895+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.427110+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.547466+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-27T12:32:51.220 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.220+0000 7f4ff23a1640 1 -- 172.21.15.55:0/1398483491 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f4fd806c8f0 msgr2=0x7f4fd806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:51.220 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.220+0000 7f4ff23a1640 1 --2- 172.21.15.55:0/1398483491 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f4fd806c8f0 0x7f4fd806edb0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4fdc005880 tx=0x7f4fdc009040 comp rx=0 tx=0).stop 2024-05-27T12:32:51.220 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.220+0000 7f4ff23a1640 1 -- 172.21.15.55:0/1398483491 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4fec0b3280 msgr2=0x7f4fec0ca970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:51.220 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.220+0000 7f4ff23a1640 1 --2- 172.21.15.55:0/1398483491 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4fec0b3280 0x7f4fec0ca970 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4fe000c3c0 tx=0x7f4fe000c880 comp rx=0 tx=0).stop 2024-05-27T12:32:51.220 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.220+0000 7f4ff23a1640 1 -- 172.21.15.55:0/1398483491 shutdown_connections 2024-05-27T12:32:51.220 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.220+0000 7f4ff23a1640 1 --2- 172.21.15.55:0/1398483491 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f4fd806c8f0 0x7f4fd806edb0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:51.220 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.220+0000 7f4ff23a1640 1 --2- 172.21.15.55:0/1398483491 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4fec15b9b0 0x7f4fec14ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:51.220 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.220+0000 7f4ff23a1640 1 --2- 172.21.15.55:0/1398483491 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4fec0b3280 0x7f4fec0ca970 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:51.220 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.220+0000 7f4ff23a1640 1 --2- 172.21.15.55:0/1398483491 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4fec0733a0 0x7f4fec15cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:51.220 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.220+0000 7f4ff23a1640 1 -- 172.21.15.55:0/1398483491 >> 172.21.15.55:0/1398483491 conn(0x7f4fec0b6b10 msgr2=0x7f4fec1561c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:51.221 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.220+0000 7f4ff23a1640 1 -- 172.21.15.55:0/1398483491 shutdown_connections 2024-05-27T12:32:51.221 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.220+0000 7f4ff23a1640 1 -- 172.21.15.55:0/1398483491 wait complete. 2024-05-27T12:32:51.231 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-05-27T12:32:51.231 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-05-27T12:32:51.232 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-05-27T12:32:51.232 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-05-27T12:32:51.233 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-05-27T12:32:51.233 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-05-27T12:32:51.233 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-05-27T12:32:51.234 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-05-27T12:32:51.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.413+0000 7fa91f4e1640 1 Processor -- start 2024-05-27T12:32:51.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.414+0000 7f521359e640 1 Processor -- start 2024-05-27T12:32:51.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.414+0000 7f521359e640 1 -- start start 2024-05-27T12:32:51.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.414+0000 7fa91f4e1640 1 -- start start 2024-05-27T12:32:51.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.415+0000 7f521359e640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5214166030 0x7f52140b7560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:51.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.415+0000 7f521359e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f52140cf490 0x7f52140d2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:51.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.415+0000 7f521359e640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52140d2300 con 0x7f5214167180 2024-05-27T12:32:51.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.415+0000 7f521359e640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f52140d1820 con 0x7f52140cf490 2024-05-27T12:32:51.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.415+0000 7f521359e640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f52140d1b00 con 0x7f5214166030 2024-05-27T12:32:51.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.416+0000 7f5212d9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f52140cf490 0x7f52140d2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:51.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.415+0000 7fa91f4e1640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa918162b40 0x7fa9180cd200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:51.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.415+0000 7fa91f4e1640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa918166c80 con 0x7fa9180b46d0 2024-05-27T12:32:51.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.415+0000 7fa91f4e1640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa918166f60 con 0x7fa918162f20 2024-05-27T12:32:51.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.415+0000 7fa91f4e1640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fa918167800 con 0x7fa918162b40 2024-05-27T12:32:51.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.417+0000 7f27bf400640 1 Processor -- start 2024-05-27T12:32:51.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.417+0000 7ffa13aa0640 1 Processor -- start 2024-05-27T12:32:51.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.417+0000 7f27bf400640 1 -- start start 2024-05-27T12:32:51.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.416+0000 7f5212d9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f52140cf490 0x7f52140d2aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55360/0 (socket says 172.21.15.55:55360) 2024-05-27T12:32:51.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.416+0000 7f5212d9d640 1 -- 172.21.15.55:0/108719319 learned_addr learned my addr 172.21.15.55:0/108719319 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:32:51.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.416+0000 7f521259c640 1 --2- 172.21.15.55:0/108719319 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5214166030 0x7f52140b7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:51.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.417+0000 7f5212d9d640 1 -- 172.21.15.55:0/108719319 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5214166030 msgr2=0x7f52140b7560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:32:51.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.417+0000 7f5212d9d640 1 --2- 172.21.15.55:0/108719319 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5214166030 0x7f52140b7560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:51.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.417+0000 7f5212d9d640 1 -- 172.21.15.55:0/108719319 >> v1:172.21.15.55:6789/0 conn(0x7f5214167180 legacy=0x7f52140ced80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:51.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.417+0000 7f5212d9d640 1 -- 172.21.15.55:0/108719319 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52140d1de0 con 0x7f52140cf490 2024-05-27T12:32:51.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.417+0000 7fa91da7e640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fa9180b46d0 0x7fa91806ee70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:60408/0 (socket says 172.21.15.55:60408) 2024-05-27T12:32:51.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.417+0000 7fa91d27d640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa918162b40 0x7fa9180cd200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:51.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.417+0000 7fa91da7e640 1 -- 172.21.15.55:0/1174765388 learned_addr learned my addr 172.21.15.55:0/1174765388 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-27T12:32:51.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.417+0000 7fa91ca7c640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fa918162f20 0x7fa9180b3fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.55:55574/0 (socket says 172.21.15.55:55574) 2024-05-27T12:32:51.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.417+0000 7faa7c543640 1 Processor -- start 2024-05-27T12:32:51.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.417+0000 7fa90ffff640 1 -- 172.21.15.55:0/1174765388 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1570202226 0 0) 0x7fa918166c80 con 0x7fa9180b46d0 2024-05-27T12:32:51.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.417+0000 7fa90ffff640 1 -- 172.21.15.55:0/1174765388 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa904003520 con 0x7fa9180b46d0 2024-05-27T12:32:51.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.418+0000 7fa91d27d640 1 -- 172.21.15.55:0/1174765388 >> v1:172.21.15.72:6789/0 conn(0x7fa918162f20 legacy=0x7fa9180b3fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:51.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.418+0000 7fa9d359e640 1 Processor -- start 2024-05-27T12:32:51.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.418+0000 7fa91d27d640 1 -- 172.21.15.55:0/1174765388 >> v1:172.21.15.55:6789/0 conn(0x7fa9180b46d0 legacy=0x7fa91806ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:51.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.418+0000 7fa91d27d640 1 -- 172.21.15.55:0/1174765388 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa918167240 con 0x7fa918162b40 2024-05-27T12:32:51.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.418+0000 7fb640995640 1 Processor -- start 2024-05-27T12:32:51.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.417+0000 7ffa13aa0640 1 -- start start 2024-05-27T12:32:51.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.418+0000 7fb640995640 1 -- start start 2024-05-27T12:32:51.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.418+0000 7fa9d359e640 1 -- start start 2024-05-27T12:32:51.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.418+0000 7f27bf400640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f27b00e10f0 0x7f27b0038620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:51.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.418+0000 7f27bf400640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f27b003a550 0x7f27b0006730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:51.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.418+0000 7f27bf400640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27b0005f70 con 0x7f27b00335e0 2024-05-27T12:32:51.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.418+0000 7f27bf400640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f27b00e14d0 con 0x7f27b00e10f0 2024-05-27T12:32:51.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.418+0000 7f27bf400640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f27b0033e80 con 0x7f27b003a550 2024-05-27T12:32:51.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.419+0000 7f27bc99b640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f27b00335e0 0x7f27b0039e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.55:55580/0 (socket says 172.21.15.55:55580) 2024-05-27T12:32:51.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.419+0000 7f27bc99b640 1 -- 172.21.15.55:0/3415294082 learned_addr learned my addr 172.21.15.55:0/3415294082 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-27T12:32:51.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.419+0000 7f27bd19c640 1 --2- 172.21.15.55:0/3415294082 >> v2:172.21.15.72:3300/0 conn(0x7f27b00e10f0 0x7f27b0038620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:51.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.418+0000 7f5212d9d640 1 --2- 172.21.15.55:0/108719319 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52140cf490 0x7f52140d2aa0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f5208009870 tx=0x7f520802a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ed3cf684c5ccefb server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:51.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.419+0000 7f521159a640 1 -- 172.21.15.55:0/108719319 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5208037070 con 0x7f52140cf490 2024-05-27T12:32:51.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.419+0000 7fa91d27d640 1 --2- 172.21.15.55:0/1174765388 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa918162b40 0x7fa9180cd200 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa914009750 tx=0x7fa91402a010 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c2b75d5e9dcbb109 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:51.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.419+0000 7f521159a640 1 -- 172.21.15.55:0/108719319 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5208032440 con 0x7f52140cf490 2024-05-27T12:32:51.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.419+0000 7f521159a640 1 -- 172.21.15.55:0/108719319 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5208032810 con 0x7f52140cf490 2024-05-27T12:32:51.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.419+0000 7ffa13aa0640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffa0c06c400 0x7ffa0c15ff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:51.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.419+0000 7f27affff640 1 -- 172.21.15.55:0/3415294082 <== mon.1 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3653928050 0 0) 0x7f27b0005f70 con 0x7f27b00335e0 2024-05-27T12:32:51.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.419+0000 7f27bd99d640 1 --2- 172.21.15.55:0/3415294082 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f27b003a550 0x7f27b0006730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:51.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.419+0000 7fa90ffff640 1 -- 172.21.15.55:0/1174765388 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa914037070 con 0x7fa918162b40 2024-05-27T12:32:51.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.419+0000 7f27affff640 1 -- 172.21.15.55:0/3415294082 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f27a4003520 con 0x7f27b00335e0 2024-05-27T12:32:51.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.417+0000 7faa7c543640 1 -- start start 2024-05-27T12:32:51.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.419+0000 7faa7c543640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faa74162b40 0x7faa740cd200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:51.430 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.419+0000 7faa7c543640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa74166c80 con 0x7faa740b46d0 2024-05-27T12:32:51.430 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.419+0000 7faa7c543640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa74166f60 con 0x7faa74162f20 2024-05-27T12:32:51.430 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.419+0000 7faa7c543640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7faa74167800 con 0x7faa74162b40 2024-05-27T12:32:51.430 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.419+0000 7faa79ade640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7faa74162f20 0x7faa740b3fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.55:55602/0 (socket says 172.21.15.55:55602) 2024-05-27T12:32:51.430 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.419+0000 7faa79ade640 1 -- 172.21.15.55:0/964749205 learned_addr learned my addr 172.21.15.55:0/964749205 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-27T12:32:51.430 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.419+0000 7faa7a2df640 1 --2- 172.21.15.55:0/964749205 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faa74162b40 0x7faa740cd200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:51.430 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.419+0000 7faa792dd640 1 -- 172.21.15.55:0/964749205 <== mon.1 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1349137675 0 0) 0x7faa74166f60 con 0x7faa74162f20 2024-05-27T12:32:51.430 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.420+0000 7faa792dd640 1 -- 172.21.15.55:0/964749205 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faa60003520 con 0x7faa74162f20 2024-05-27T12:32:51.430 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.420+0000 7faa7a2df640 1 -- 172.21.15.55:0/964749205 >> v1:172.21.15.72:6789/0 conn(0x7faa74162f20 legacy=0x7faa740b3fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:51.430 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.420+0000 7faa7a2df640 1 -- 172.21.15.55:0/964749205 >> v1:172.21.15.55:6789/0 conn(0x7faa740b46d0 legacy=0x7faa7406ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:32:51.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.420+0000 7fa90ffff640 1 -- 172.21.15.55:0/1174765388 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa91402ad20 con 0x7fa918162b40 2024-05-27T12:32:51.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.420+0000 7f27bd19c640 1 -- 172.21.15.55:0/3415294082 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f27b003a550 msgr2=0x7f27b0006730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:32:51.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.420+0000 7f27bd19c640 1 --2- 172.21.15.55:0/3415294082 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f27b003a550 0x7f27b0006730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:51.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.420+0000 7f27bd19c640 1 -- 172.21.15.55:0/3415294082 >> v1:172.21.15.72:6789/0 conn(0x7f27b00335e0 legacy=0x7f27b0039e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:51.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.420+0000 7fb640995640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb6340537a0 0x7fb634053b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:51.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.420+0000 7f27bd19c640 1 -- 172.21.15.55:0/3415294082 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27b004bb80 con 0x7f27b00e10f0 2024-05-27T12:32:51.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.419+0000 7ffa13aa0640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa0c163800 con 0x7ffa0c164470 2024-05-27T12:32:51.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.419+0000 7ffa13aa0640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa0c163ae0 con 0x7ffa0c1662e0 2024-05-27T12:32:51.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.419+0000 7ffa13aa0640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7ffa0c0b38e0 con 0x7ffa0c06c400 2024-05-27T12:32:51.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.419+0000 7ffa1103b640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7ffa0c164470 0x7ffa0c06bcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:60424/0 (socket says 172.21.15.55:60424) 2024-05-27T12:32:51.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.419+0000 7ffa1103b640 1 -- 172.21.15.55:0/441798080 learned_addr learned my addr 172.21.15.55:0/441798080 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-27T12:32:51.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.420+0000 7ffa1083a640 1 -- 172.21.15.55:0/441798080 <== mon.1 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3231731192 0 0) 0x7ffa0c163ae0 con 0x7ffa0c1662e0 2024-05-27T12:32:51.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.420+0000 7ffa1083a640 1 -- 172.21.15.55:0/441798080 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff9f8003520 con 0x7ffa0c1662e0 2024-05-27T12:32:51.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.420+0000 7ffa1083a640 1 -- 172.21.15.55:0/441798080 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3408021011 0 0) 0x7ffa0c163800 con 0x7ffa0c164470 2024-05-27T12:32:51.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.420+0000 7ffa1083a640 1 -- 172.21.15.55:0/441798080 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffa0c163ae0 con 0x7ffa0c164470 2024-05-27T12:32:51.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.419+0000 7f18fe87c640 1 Processor -- start 2024-05-27T12:32:51.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.420+0000 7f18fe87c640 1 -- start start 2024-05-27T12:32:51.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.420+0000 7f521359e640 1 -- 172.21.15.55:0/108719319 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52140cf490 msgr2=0x7f52140d2aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:51.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.420+0000 7f521359e640 1 --2- 172.21.15.55:0/108719319 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52140cf490 0x7f52140d2aa0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f5208009870 tx=0x7f520802a250 comp rx=0 tx=0).stop 2024-05-27T12:32:51.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.420+0000 7fb640995640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb634006200 0x7fb634006660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:51.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.420+0000 7fa9d359e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa9d413f6f0 0x7fa9d40ce750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:51.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.420+0000 7fa9d359e640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa9d40cec90 0x7fa9d4071d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:51.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.420+0000 7f521359e640 1 -- 172.21.15.55:0/108719319 shutdown_connections 2024-05-27T12:32:51.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.420+0000 7f521359e640 1 --2- 172.21.15.55:0/108719319 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52140cf490 0x7f52140d2aa0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:51.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.420+0000 7f521359e640 1 --2- 172.21.15.55:0/108719319 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5214166030 0x7f52140b7560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:51.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.420+0000 7f521359e640 1 -- 172.21.15.55:0/108719319 >> 172.21.15.55:0/108719319 conn(0x7f521406cf90 msgr2=0x7f521406d3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:51.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.420+0000 7f521359e640 1 -- 172.21.15.55:0/108719319 shutdown_connections 2024-05-27T12:32:51.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.420+0000 7f521359e640 1 -- 172.21.15.55:0/108719319 wait complete. 2024-05-27T12:32:51.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.420+0000 7fa90ffff640 1 -- 172.21.15.55:0/1174765388 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa914032660 con 0x7fa918162b40 2024-05-27T12:32:51.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.420+0000 7ffa1203d640 1 --2- 172.21.15.55:0/441798080 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffa0c06c400 0x7ffa0c15ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:51.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.420+0000 7ffa1083a640 1 -- 172.21.15.55:0/441798080 <== mon.1 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 332914973 0 0) 0x7ff9f8003520 con 0x7ffa0c1662e0 2024-05-27T12:32:51.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.420+0000 7ffa1083a640 1 -- 172.21.15.55:0/441798080 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffa0c06c400 msgr2=0x7ffa0c15ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:32:51.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.420+0000 7ffa1083a640 1 --2- 172.21.15.55:0/441798080 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffa0c06c400 0x7ffa0c15ff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:51.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.420+0000 7ffa1083a640 1 -- 172.21.15.55:0/441798080 >> v1:172.21.15.55:6789/0 conn(0x7ffa0c164470 legacy=0x7ffa0c06bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:51.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.420+0000 7fb63b7fe640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb6340537a0 0x7fb634053b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:51.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.420+0000 7ffa1083a640 1 -- 172.21.15.55:0/441798080 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa0c163dc0 con 0x7ffa0c1662e0 2024-05-27T12:32:51.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.420+0000 7fa9d359e640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9d415ccf0 con 0x7fa9d4072260 2024-05-27T12:32:51.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.420+0000 7fa9d259c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa9d413f6f0 0x7fa9d40ce750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:51.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.421+0000 7fa9d359e640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7fa9d40ce090 con 0x7fa9d413f6f0 2024-05-27T12:32:51.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.421+0000 7fa9d259c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa9d413f6f0 0x7fa9d40ce750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55368/0 (socket says 172.21.15.55:55368) 2024-05-27T12:32:51.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.421+0000 7fa9d259c640 1 -- 172.21.15.55:0/100160057 learned_addr learned my addr 172.21.15.55:0/100160057 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:32:51.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.421+0000 7ffa1083a640 1 -- 172.21.15.55:0/441798080 <== mon.1 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 793017739 0 0) 0x7ffa08001670 con 0x7ffa0c1662e0 2024-05-27T12:32:51.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.421+0000 7ffa1083a640 1 -- 172.21.15.55:0/441798080 >> v1:172.21.15.72:6789/0 conn(0x7ffa0c1662e0 legacy=0x7ffa0c06e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:51.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.421+0000 7fa9d359e640 1 -- 172.21.15.55:0/100160057 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fa9d415cfd0 con 0x7fa9d40cec90 2024-05-27T12:32:51.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.421+0000 7ffa1083a640 1 --2- 172.21.15.55:0/441798080 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9f8003b70 0x7ff9f8003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:51.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.420+0000 7fb63b7fe640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb6340537a0 0x7fb634053b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.55:45860/0 (socket says 172.21.15.55:45860) 2024-05-27T12:32:51.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.421+0000 7ffa1083a640 1 --2- 172.21.15.55:0/441798080 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff9f8004800 0x7ff9f8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:51.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.421+0000 7fb63b7fe640 1 -- 172.21.15.55:0/339940371 learned_addr learned my addr 172.21.15.55:0/339940371 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:32:51.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.421+0000 7fa9d1d9b640 1 --2- 172.21.15.55:0/100160057 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa9d40cec90 0x7fa9d4071d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:51.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.421+0000 7fa91f4e1640 1 -- 172.21.15.55:0/1174765388 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa918162b40 msgr2=0x7fa9180cd200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:51.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.421+0000 7fa91f4e1640 1 --2- 172.21.15.55:0/1174765388 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa918162b40 0x7fa9180cd200 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa914009750 tx=0x7fa91402a010 comp rx=0 tx=0).stop 2024-05-27T12:32:51.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.421+0000 7fb640995640 1 -- 172.21.15.55:0/339940371 --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6340540c0 con 0x7fb634057380 2024-05-27T12:32:51.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.421+0000 7fb63affd640 1 --2- 172.21.15.55:0/339940371 >> v2:172.21.15.72:3300/0 conn(0x7fb634006200 0x7fb634006660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:51.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.421+0000 7fb640995640 1 -- 172.21.15.55:0/339940371 --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fb634007890 con 0x7fb634006200 2024-05-27T12:32:51.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.421+0000 7ffa1183c640 1 --2- 172.21.15.55:0/441798080 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9f8003b70 0x7ff9f8003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:51.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.421+0000 7faa7a2df640 1 -- 172.21.15.55:0/964749205 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa74167240 con 0x7faa74162b40 2024-05-27T12:32:51.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.421+0000 7fb640995640 1 -- 172.21.15.55:0/339940371 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fb634006c80 con 0x7fb6340537a0 2024-05-27T12:32:51.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.421+0000 7ffa1083a640 1 --2- 172.21.15.55:0/441798080 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9f80052e0 0x7ff9f800ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:51.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.421+0000 7ffa1083a640 1 -- 172.21.15.55:0/441798080 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7ffa0c0b38e0 con 0x7ff9f80052e0 2024-05-27T12:32:51.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.421+0000 7ffa1103b640 1 --2- 172.21.15.55:0/441798080 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff9f8004800 0x7ff9f8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:51.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.421+0000 7f27bd19c640 1 --2- 172.21.15.55:0/3415294082 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27b00e10f0 0x7f27b0038620 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f27a80097a0 tx=0x7f27a802a060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3e5633402128eae server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:51.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.421+0000 7ffa1083a640 1 -- 172.21.15.55:0/441798080 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7ff9f800c1e0 con 0x7ff9f8003b70 2024-05-27T12:32:51.443 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.421+0000 7fa91f4e1640 1 -- 172.21.15.55:0/1174765388 shutdown_connections 2024-05-27T12:32:51.443 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.421+0000 7ffa1083a640 1 -- 172.21.15.55:0/441798080 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7ff9f800c3e0 con 0x7ff9f8004800 2024-05-27T12:32:51.443 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.421+0000 7ffa1203d640 1 --2- 172.21.15.55:0/441798080 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffa0c06c400 0x7ffa0c15ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T12:32:51.443 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.421+0000 7fa91f4e1640 1 --2- 172.21.15.55:0/1174765388 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa918162b40 0x7fa9180cd200 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:51.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.421+0000 7fa91f4e1640 1 -- 172.21.15.55:0/1174765388 >> 172.21.15.55:0/1174765388 conn(0x7fa9180b2240 msgr2=0x7fa9180b2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:51.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.421+0000 7f27affff640 1 -- 172.21.15.55:0/3415294082 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27a8037070 con 0x7f27b00e10f0 2024-05-27T12:32:51.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.422+0000 7fa91f4e1640 1 -- 172.21.15.55:0/1174765388 shutdown_connections 2024-05-27T12:32:51.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.421+0000 7fa9d1d9b640 1 -- 172.21.15.55:0/100160057 >> v2:172.21.15.55:3300/0 conn(0x7fa9d413f6f0 msgr2=0x7fa9d40ce750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:32:51.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.421+0000 7fa9d1d9b640 1 --2- 172.21.15.55:0/100160057 >> v2:172.21.15.55:3300/0 conn(0x7fa9d413f6f0 0x7fa9d40ce750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:51.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.421+0000 7fa9d1d9b640 1 -- 172.21.15.55:0/100160057 >> v1:172.21.15.55:6789/0 conn(0x7fa9d4072260 legacy=0x7fa9d4141d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:51.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.422+0000 7fa9d1d9b640 1 -- 172.21.15.55:0/100160057 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9d415d2b0 con 0x7fa9d40cec90 2024-05-27T12:32:51.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.422+0000 7faa7a2df640 1 --2- 172.21.15.55:0/964749205 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faa74162b40 0x7faa740cd200 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7faa700097d0 tx=0x7faa7002a130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=66357beb69e105a9 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:51.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.422+0000 7fb63b7fe640 1 -- 172.21.15.55:0/339940371 >> v2:172.21.15.72:3300/0 conn(0x7fb634006200 msgr2=0x7fb634006660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:32:51.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.422+0000 7f18fe87c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f18f8162e80 0x7f18f80d30c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:51.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.422+0000 7fb63b7fe640 1 --2- 172.21.15.55:0/339940371 >> v2:172.21.15.72:3300/0 conn(0x7fb634006200 0x7fb634006660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:51.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.422+0000 7f18fe87c640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f18f8073910 0x7f18f80d0610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:51.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.422+0000 7f18fe87c640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f18f8163260 0x7f18f80d0b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:51.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.422+0000 7f18fe87c640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f18f80b3c60 con 0x7f18f8162e80 2024-05-27T12:32:51.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.422+0000 7f18fe87c640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f18f80b3eb0 con 0x7f18f8073910 2024-05-27T12:32:51.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.422+0000 7f18fe87c640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f18f80d25e0 con 0x7f18f8163260 2024-05-27T12:32:51.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.422+0000 7f18f7fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f18f8162e80 0x7f18f80d30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:51.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.422+0000 7fb63b7fe640 1 -- 172.21.15.55:0/339940371 >> v1:172.21.15.72:6789/0 conn(0x7fb634057380 legacy=0x7fb634057810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:32:51.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.422+0000 7fb63b7fe640 1 -- 172.21.15.55:0/339940371 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb634006f60 con 0x7fb6340537a0 2024-05-27T12:32:51.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.422+0000 7faa792dd640 1 -- 172.21.15.55:0/964749205 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa70037070 con 0x7faa74162b40 2024-05-27T12:32:51.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.423+0000 7faa792dd640 1 -- 172.21.15.55:0/964749205 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa7002ae40 con 0x7faa74162b40 2024-05-27T12:32:51.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.423+0000 7faa792dd640 1 -- 172.21.15.55:0/964749205 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa70032660 con 0x7faa74162b40 2024-05-27T12:32:51.448 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.422+0000 7ffa1183c640 1 -- 172.21.15.55:0/441798080 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff9f8004800 msgr2=0x7ff9f8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:32:51.448 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.422+0000 7ffa1183c640 1 --2- 172.21.15.55:0/441798080 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff9f8004800 0x7ff9f8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:51.448 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.423+0000 7f18f7fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f18f8162e80 0x7f18f80d30c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55380/0 (socket says 172.21.15.55:55380) 2024-05-27T12:32:51.448 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.423+0000 7f18f7fff640 1 -- 172.21.15.55:0/1444029452 learned_addr learned my addr 172.21.15.55:0/1444029452 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:32:51.448 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.421+0000 7f27affff640 1 -- 172.21.15.55:0/3415294082 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27a802adb0 con 0x7f27b00e10f0 2024-05-27T12:32:51.448 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.422+0000 7f27affff640 1 -- 172.21.15.55:0/3415294082 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27a8032660 con 0x7f27b00e10f0 2024-05-27T12:32:51.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.422+0000 7f27bf400640 1 -- 172.21.15.55:0/3415294082 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27b00e10f0 msgr2=0x7f27b0038620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:51.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.422+0000 7f27bf400640 1 --2- 172.21.15.55:0/3415294082 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27b00e10f0 0x7f27b0038620 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f27a80097a0 tx=0x7f27a802a060 comp rx=0 tx=0).stop 2024-05-27T12:32:51.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.423+0000 7f18f77fe640 1 --2- 172.21.15.55:0/1444029452 >> v2:172.21.15.72:3300/0 conn(0x7f18f8073910 0x7f18f80d0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:51.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.422+0000 7f521359e640 1 Processor -- start 2024-05-27T12:32:51.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.422+0000 7f521359e640 1 -- start start 2024-05-27T12:32:51.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.423+0000 7f18fce19640 1 --2- 172.21.15.55:0/1444029452 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f18f8163260 0x7f18f80d0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:51.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.423+0000 7f18f7fff640 1 -- 172.21.15.55:0/1444029452 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f18f8163260 msgr2=0x7f18f80d0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:32:51.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.423+0000 7f18f7fff640 1 --2- 172.21.15.55:0/1444029452 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f18f8163260 0x7f18f80d0b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:51.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.423+0000 7f18f7fff640 1 -- 172.21.15.55:0/1444029452 >> v2:172.21.15.72:3300/0 conn(0x7f18f8073910 msgr2=0x7f18f80d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:32:51.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.423+0000 7f18f7fff640 1 --2- 172.21.15.55:0/1444029452 >> v2:172.21.15.72:3300/0 conn(0x7f18f8073910 0x7f18f80d0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:51.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.423+0000 7f18f7fff640 1 -- 172.21.15.55:0/1444029452 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18f80d28c0 con 0x7f18f8162e80 2024-05-27T12:32:51.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.423+0000 7fa9d1d9b640 1 --2- 172.21.15.55:0/100160057 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa9d40cec90 0x7fa9d4071d20 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fa9c80097a0 tx=0x7fa9c802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c93482d0082328f server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:51.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.422+0000 7ffa1183c640 1 -- 172.21.15.55:0/441798080 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9f80052e0 msgr2=0x7ff9f800ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:32:51.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.422+0000 7ffa1183c640 1 --2- 172.21.15.55:0/441798080 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9f80052e0 0x7ff9f800ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:51.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.422+0000 7ffa1183c640 1 -- 172.21.15.55:0/441798080 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9f8003520 con 0x7ff9f8003b70 2024-05-27T12:32:51.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.423+0000 7ffa1183c640 1 --2- 172.21.15.55:0/441798080 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9f8003b70 0x7ff9f8003f50 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ffa08007ef0 tx=0x7ff9f8005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=30b4725a6aae12eb server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:51.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.423+0000 7f18fce19640 1 --2- 172.21.15.55:0/1444029452 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f18f8163260 0x7f18f80d0b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T12:32:51.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.422+0000 7fa91f4e1640 1 -- 172.21.15.55:0/1174765388 wait complete. 2024-05-27T12:32:51.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.423+0000 7ffa1083a640 1 -- 172.21.15.55:0/441798080 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa08036070 con 0x7ff9f8003b70 2024-05-27T12:32:51.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.423+0000 7ffa1083a640 1 -- 172.21.15.55:0/441798080 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa0802ae50 con 0x7ff9f8003b70 2024-05-27T12:32:51.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.423+0000 7ffa1083a640 1 -- 172.21.15.55:0/441798080 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa08007b10 con 0x7ff9f8003b70 2024-05-27T12:32:51.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.423+0000 7fa9d159a640 1 -- 172.21.15.55:0/100160057 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9c8037070 con 0x7fa9d40cec90 2024-05-27T12:32:51.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.423+0000 7fa9d159a640 1 -- 172.21.15.55:0/100160057 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9c8032440 con 0x7fa9d40cec90 2024-05-27T12:32:51.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.423+0000 7fa91f4e1640 1 Processor -- start 2024-05-27T12:32:51.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.423+0000 7f27bf400640 1 -- 172.21.15.55:0/3415294082 shutdown_connections 2024-05-27T12:32:51.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.423+0000 7f27bf400640 1 --2- 172.21.15.55:0/3415294082 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f27b003a550 0x7f27b0006730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:51.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.423+0000 7f27bf400640 1 --2- 172.21.15.55:0/3415294082 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27b00e10f0 0x7f27b0038620 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:51.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.423+0000 7f27bf400640 1 -- 172.21.15.55:0/3415294082 >> 172.21.15.55:0/3415294082 conn(0x7f27b0009fa0 msgr2=0x7f27b000a3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:51.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.423+0000 7faa7c543640 1 -- 172.21.15.55:0/964749205 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faa74162b40 msgr2=0x7faa740cd200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:51.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.423+0000 7faa7c543640 1 --2- 172.21.15.55:0/964749205 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faa74162b40 0x7faa740cd200 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7faa700097d0 tx=0x7faa7002a130 comp rx=0 tx=0).stop 2024-05-27T12:32:51.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.424+0000 7fa91f4e1640 1 -- start start 2024-05-27T12:32:51.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.424+0000 7fb63b7fe640 1 --2- 172.21.15.55:0/339940371 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb6340537a0 0x7fb634053b80 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fb63c076a30 tx=0x7fb63c0a5d40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8ec7d89c899f10bd server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:51.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.424+0000 7faa7c543640 1 -- 172.21.15.55:0/964749205 shutdown_connections 2024-05-27T12:32:51.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.424+0000 7faa7c543640 1 --2- 172.21.15.55:0/964749205 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faa74162b40 0x7faa740cd200 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:51.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.424+0000 7faa7c543640 1 -- 172.21.15.55:0/964749205 >> 172.21.15.55:0/964749205 conn(0x7faa740b2240 msgr2=0x7faa740b2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:51.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.424+0000 7ffa13aa0640 1 -- 172.21.15.55:0/441798080 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9f8003b70 msgr2=0x7ff9f8003f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:51.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.424+0000 7ffa13aa0640 1 --2- 172.21.15.55:0/441798080 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9f8003b70 0x7ff9f8003f50 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ffa08007ef0 tx=0x7ff9f8005830 comp rx=0 tx=0).stop 2024-05-27T12:32:51.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.424+0000 7ffa1203d640 1 -- 172.21.15.55:0/441798080 reap_dead start 2024-05-27T12:32:51.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.424+0000 7f27bf400640 1 -- 172.21.15.55:0/3415294082 shutdown_connections 2024-05-27T12:32:51.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.424+0000 7f18f7fff640 1 --2- 172.21.15.55:0/1444029452 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f18f8162e80 0x7f18f80d30c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f18f8166bc0 tx=0x7f18e802a690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=725e5824d6622741 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:51.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.424+0000 7f521359e640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f52140cf490 0x7f521414ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:51.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.424+0000 7f521359e640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5214166030 0x7f52141501c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:51.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.424+0000 7f521259c640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f52140cf490 0x7f521414ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:51.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.424+0000 7fa9d359e640 1 -- 172.21.15.55:0/100160057 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa9d40cec90 msgr2=0x7fa9d4071d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:51.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.425+0000 7fb63a7fc640 1 -- 172.21.15.55:0/339940371 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb63c0b3070 con 0x7fb6340537a0 2024-05-27T12:32:51.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.424+0000 7f521259c640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f52140cf490 0x7f521414ea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.55:45890/0 (socket says 172.21.15.55:45890) 2024-05-27T12:32:51.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.424+0000 7f521359e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5214167180 0x7f5214163870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:51.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.424+0000 7f521259c640 1 -- 172.21.15.55:0/2805073807 learned_addr learned my addr 172.21.15.55:0/2805073807 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:32:51.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.424+0000 7f521359e640 1 -- 172.21.15.55:0/2805073807 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f52141675e0 con 0x7f5214167180 2024-05-27T12:32:51.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.424+0000 7f521359e640 1 -- 172.21.15.55:0/2805073807 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f52140d0ef0 con 0x7f5214166030 2024-05-27T12:32:51.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.424+0000 7f521359e640 1 -- 172.21.15.55:0/2805073807 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f5214166410 con 0x7f52140cf490 2024-05-27T12:32:51.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.424+0000 7f5212d9d640 1 --2- 172.21.15.55:0/2805073807 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5214167180 0x7f5214163870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:51.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.424+0000 7f5211d9b640 1 --2- 172.21.15.55:0/2805073807 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5214166030 0x7f52141501c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:51.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.424+0000 7f521259c640 1 -- 172.21.15.55:0/2805073807 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5214166030 msgr2=0x7f52141501c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:51.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.424+0000 7f521259c640 1 --2- 172.21.15.55:0/2805073807 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5214166030 0x7f52141501c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:51.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.424+0000 7f521259c640 1 -- 172.21.15.55:0/2805073807 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5214167180 msgr2=0x7f5214163870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:51.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.424+0000 7f521259c640 1 --2- 172.21.15.55:0/2805073807 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5214167180 0x7f5214163870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:51.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.424+0000 7f521259c640 1 -- 172.21.15.55:0/2805073807 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f521414f120 con 0x7f52140cf490 2024-05-27T12:32:51.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.424+0000 7f5211d9b640 1 --2- 172.21.15.55:0/2805073807 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5214166030 0x7f52141501c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T12:32:51.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.425+0000 7f521259c640 1 --2- 172.21.15.55:0/2805073807 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f52140cf490 0x7f521414ea20 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f520400e9b0 tx=0x7f520400ee70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:51.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.425+0000 7fb63a7fc640 1 -- 172.21.15.55:0/339940371 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb63c0a6b10 con 0x7fb6340537a0 2024-05-27T12:32:51.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.425+0000 7fb63a7fc640 1 -- 172.21.15.55:0/339940371 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb63c0ae440 con 0x7fb6340537a0 2024-05-27T12:32:51.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.425+0000 7ffa13aa0640 1 -- 172.21.15.55:0/441798080 shutdown_connections 2024-05-27T12:32:51.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.425+0000 7ffa13aa0640 1 -- 172.21.15.55:0/441798080 >> 172.21.15.55:0/441798080 conn(0x7ffa0c0b2660 msgr2=0x7ffa0c0b2a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:51.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.425+0000 7fa9d159a640 1 -- 172.21.15.55:0/100160057 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9c8037070 con 0x7fa9d40cec90 2024-05-27T12:32:51.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.425+0000 7fa9d359e640 1 --2- 172.21.15.55:0/100160057 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa9d40cec90 0x7fa9d4071d20 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fa9c80097a0 tx=0x7fa9c802a180 comp rx=0 tx=0).stop 2024-05-27T12:32:51.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.425+0000 7f5202ffd640 1 -- 172.21.15.55:0/2805073807 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5204017070 con 0x7f52140cf490 2024-05-27T12:32:51.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.425+0000 7f521359e640 1 -- 172.21.15.55:0/2805073807 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f521414f400 con 0x7f52140cf490 2024-05-27T12:32:51.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.425+0000 7f18f6ffd640 1 -- 172.21.15.55:0/1444029452 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18e8036070 con 0x7f18f8162e80 2024-05-27T12:32:51.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.425+0000 7f521359e640 1 -- 172.21.15.55:0/2805073807 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f521414f9c0 con 0x7f52140cf490 2024-05-27T12:32:51.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.425+0000 7f5202ffd640 1 -- 172.21.15.55:0/2805073807 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f520400c9a0 con 0x7f52140cf490 2024-05-27T12:32:51.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.425+0000 7fa91f4e1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9180b46d0 0x7fa9180aefe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:51.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.425+0000 7ffa13aa0640 1 -- 172.21.15.55:0/441798080 shutdown_connections 2024-05-27T12:32:51.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.425+0000 7ffa13aa0640 1 -- 172.21.15.55:0/441798080 wait complete. 2024-05-27T12:32:51.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.425+0000 7f5202ffd640 1 -- 172.21.15.55:0/2805073807 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f520400cd90 con 0x7f52140cf490 2024-05-27T12:32:51.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.424+0000 7faa7c543640 1 -- 172.21.15.55:0/964749205 shutdown_connections 2024-05-27T12:32:51.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.424+0000 7faa7c543640 1 -- 172.21.15.55:0/964749205 wait complete. 2024-05-27T12:32:51.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.425+0000 7f18f6ffd640 1 -- 172.21.15.55:0/1444029452 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18e8031600 con 0x7f18f8162e80 2024-05-27T12:32:51.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.425+0000 7f18f6ffd640 1 -- 172.21.15.55:0/1444029452 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18e80319d0 con 0x7f18f8162e80 2024-05-27T12:32:51.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.425+0000 7fa9d359e640 1 -- 172.21.15.55:0/100160057 shutdown_connections 2024-05-27T12:32:51.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.425+0000 7fa91d27d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9180b46d0 0x7fa9180aefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:51.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.425+0000 7fa9d359e640 1 --2- 172.21.15.55:0/100160057 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa9d40cec90 0x7fa9d4071d20 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:51.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.425+0000 7fa9d359e640 1 --2- 172.21.15.55:0/100160057 >> v2:172.21.15.55:3300/0 conn(0x7fa9d413f6f0 0x7fa9d40ce750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:51.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.425+0000 7fa9d359e640 1 -- 172.21.15.55:0/100160057 >> 172.21.15.55:0/100160057 conn(0x7fa9d40b6230 msgr2=0x7fa9d40b2240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:51.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.425+0000 7fa9d359e640 1 -- 172.21.15.55:0/100160057 shutdown_connections 2024-05-27T12:32:51.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.425+0000 7fa91d27d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9180b46d0 0x7fa9180aefe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55404/0 (socket says 172.21.15.55:55404) 2024-05-27T12:32:51.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.425+0000 7fa91d27d640 1 -- 172.21.15.55:0/2130524074 learned_addr learned my addr 172.21.15.55:0/2130524074 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:32:51.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.425+0000 7fa9d359e640 1 -- 172.21.15.55:0/100160057 wait complete. 2024-05-27T12:32:51.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.426+0000 7fa91f4e1640 1 --2- 172.21.15.55:0/2130524074 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa918162b40 0x7fa91814ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:51.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.426+0000 7fa91f4e1640 1 --2- 172.21.15.55:0/2130524074 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa918162f20 0x7fa9180cf390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:51.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.426+0000 7faa7c543640 1 Processor -- start 2024-05-27T12:32:51.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.426+0000 7fb640995640 1 -- 172.21.15.55:0/339940371 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb6340537a0 msgr2=0x7fb634053b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:51.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.426+0000 7fb640995640 1 --2- 172.21.15.55:0/339940371 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb6340537a0 0x7fb634053b80 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fb63c076a30 tx=0x7fb63c0a5d40 comp rx=0 tx=0).stop 2024-05-27T12:32:51.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.426+0000 7fa91f4e1640 1 -- 172.21.15.55:0/2130524074 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7fa918166a40 con 0x7fa9180b46d0 2024-05-27T12:32:51.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.424+0000 7f27bf400640 1 -- 172.21.15.55:0/3415294082 wait complete. 2024-05-27T12:32:51.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.426+0000 7f27bf400640 1 Processor -- start 2024-05-27T12:32:51.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.426+0000 7fa91da7e640 1 --2- 172.21.15.55:0/2130524074 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa918162f20 0x7fa9180cf390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:51.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.426+0000 7fa91f4e1640 1 -- 172.21.15.55:0/2130524074 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fa9181668c0 con 0x7fa918162b40 2024-05-27T12:32:51.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.426+0000 7f18fe87c640 1 -- 172.21.15.55:0/1444029452 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f18f8162e80 msgr2=0x7f18f80d30c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:51.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.426+0000 7f18fe87c640 1 --2- 172.21.15.55:0/1444029452 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f18f8162e80 0x7f18f80d30c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f18f8166bc0 tx=0x7f18e802a690 comp rx=0 tx=0).stop 2024-05-27T12:32:51.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.426+0000 7fa91f4e1640 1 -- 172.21.15.55:0/2130524074 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fa9180afce0 con 0x7fa918162f20 2024-05-27T12:32:51.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.427+0000 7fa91ca7c640 1 --2- 172.21.15.55:0/2130524074 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa918162b40 0x7fa91814ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:51.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.427+0000 7f18fe87c640 1 -- 172.21.15.55:0/1444029452 shutdown_connections 2024-05-27T12:32:51.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.427+0000 7f18fe87c640 1 --2- 172.21.15.55:0/1444029452 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f18f8163260 0x7f18f80d0b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:51.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.427+0000 7f18fe87c640 1 --2- 172.21.15.55:0/1444029452 >> v2:172.21.15.72:3300/0 conn(0x7f18f8073910 0x7f18f80d0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:51.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.427+0000 7f18fe87c640 1 --2- 172.21.15.55:0/1444029452 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f18f8162e80 0x7f18f80d30c0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:51.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.427+0000 7ffa13aa0640 1 Processor -- start 2024-05-27T12:32:51.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.427+0000 7f18fe87c640 1 -- 172.21.15.55:0/1444029452 >> 172.21.15.55:0/1444029452 conn(0x7f18f80d14d0 msgr2=0x7f18f80d18e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:51.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.426+0000 7faa7c543640 1 -- start start 2024-05-27T12:32:51.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.427+0000 7faa7c543640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa740b46d0 0x7faa7414cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:51.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.427+0000 7faa7c543640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faa74162b40 0x7faa7414d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:51.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.427+0000 7faa7c543640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faa74162f20 0x7faa741473a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:51.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.427+0000 7faa7c543640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7faa74166a40 con 0x7faa740b46d0 2024-05-27T12:32:51.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.427+0000 7faa7c543640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7faa741668c0 con 0x7faa74162f20 2024-05-27T12:32:51.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.427+0000 7faa7c543640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7faa740afce0 con 0x7faa74162b40 2024-05-27T12:32:51.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.427+0000 7fa91d27d640 1 -- 172.21.15.55:0/2130524074 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa918162f20 msgr2=0x7fa9180cf390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:51.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.427+0000 7fa91d27d640 1 --2- 172.21.15.55:0/2130524074 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa918162f20 0x7fa9180cf390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:51.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.426+0000 7f27bf400640 1 -- start start 2024-05-27T12:32:51.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.427+0000 7fa91d27d640 1 -- 172.21.15.55:0/2130524074 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa918162b40 msgr2=0x7fa91814ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:51.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.427+0000 7fa91d27d640 1 --2- 172.21.15.55:0/2130524074 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa918162b40 0x7fa91814ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:51.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.427+0000 7f5202ffd640 1 -- 172.21.15.55:0/2805073807 <== mon.2 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f520401a070 con 0x7f52140cf490 2024-05-27T12:32:51.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.427+0000 7faa79ade640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faa74162b40 0x7faa7414d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:51.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.427+0000 7faa7a2df640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa740b46d0 0x7faa7414cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:51.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.427+0000 7faa7a2df640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa740b46d0 0x7faa7414cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55416/0 (socket says 172.21.15.55:55416) 2024-05-27T12:32:51.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.427+0000 7faa7a2df640 1 -- 172.21.15.55:0/2942517572 learned_addr learned my addr 172.21.15.55:0/2942517572 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:32:51.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.428+0000 7fa91d27d640 1 -- 172.21.15.55:0/2130524074 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9180a9790 con 0x7fa9180b46d0 2024-05-27T12:32:51.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.428+0000 7fa91da7e640 1 --2- 172.21.15.55:0/2130524074 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa918162f20 0x7fa9180cf390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T12:32:51.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.428+0000 7fa91ca7c640 1 --2- 172.21.15.55:0/2130524074 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa918162b40 0x7fa91814ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T12:32:51.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.427+0000 7f27bf400640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27b00335e0 0x7f27b004e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:51.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.427+0000 7f27bf400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f27b003a550 0x7f27b01781c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:51.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.428+0000 7fb640995640 1 -- 172.21.15.55:0/339940371 shutdown_connections 2024-05-27T12:32:51.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.427+0000 7ffa13aa0640 1 -- start start 2024-05-27T12:32:51.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.428+0000 7fb640995640 1 --2- 172.21.15.55:0/339940371 >> v2:172.21.15.72:3300/0 conn(0x7fb634006200 0x7fb634006660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:51.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.428+0000 7fb640995640 1 --2- 172.21.15.55:0/339940371 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb6340537a0 0x7fb634053b80 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:51.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.428+0000 7fb640995640 1 -- 172.21.15.55:0/339940371 >> 172.21.15.55:0/339940371 conn(0x7fb63403aa30 msgr2=0x7fb63403ae40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:51.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.427+0000 7fa9d359e640 1 Processor -- start 2024-05-27T12:32:51.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.427+0000 7fa9d359e640 1 -- start start 2024-05-27T12:32:51.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.428+0000 7faa7aae0640 1 --2- 172.21.15.55:0/2942517572 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faa74162f20 0x7faa741473a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:51.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.428+0000 7f27bd19c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27b00335e0 0x7f27b004e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:51.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.428+0000 7f27bd19c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27b00335e0 0x7f27b004e9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.55:49042/0 (socket says 172.21.15.55:49042) 2024-05-27T12:32:51.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.428+0000 7f521359e640 1 -- 172.21.15.55:0/2805073807 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f51f8001030 con 0x7f52140cf490 2024-05-27T12:32:51.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.428+0000 7f27bc99b640 1 --2- 172.21.15.55:0/2047806619 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f27b003a550 0x7f27b01781c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:51.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.428+0000 7f27bd19c640 1 -- 172.21.15.55:0/2047806619 learned_addr learned my addr 172.21.15.55:0/2047806619 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:32:51.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.428+0000 7f27bf400640 1 --2- 172.21.15.55:0/2047806619 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f27b00e10f0 0x7f27b004bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:51.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.428+0000 7fb640995640 1 -- 172.21.15.55:0/339940371 shutdown_connections 2024-05-27T12:32:51.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.428+0000 7faa79ade640 1 -- 172.21.15.55:0/2942517572 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faa74162f20 msgr2=0x7faa741473a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:51.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.428+0000 7faa79ade640 1 --2- 172.21.15.55:0/2942517572 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faa74162f20 0x7faa741473a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:51.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.428+0000 7f27bf400640 1 -- 172.21.15.55:0/2047806619 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f27b00512d0 con 0x7f27b003a550 2024-05-27T12:32:51.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.428+0000 7f27bf400640 1 -- 172.21.15.55:0/2047806619 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f27b00062a0 con 0x7f27b00335e0 2024-05-27T12:32:51.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.428+0000 7f27bf400640 1 -- 172.21.15.55:0/2047806619 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f27b0033b30 con 0x7f27b00e10f0 2024-05-27T12:32:51.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.428+0000 7faa79ade640 1 -- 172.21.15.55:0/2942517572 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa740b46d0 msgr2=0x7faa7414cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:51.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.428+0000 7faa79ade640 1 --2- 172.21.15.55:0/2942517572 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa740b46d0 0x7faa7414cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:51.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.428+0000 7faa79ade640 1 -- 172.21.15.55:0/2942517572 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa741480f0 con 0x7faa74162b40 2024-05-27T12:32:51.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.428+0000 7faa7a2df640 1 --2- 172.21.15.55:0/2942517572 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa740b46d0 0x7faa7414cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T12:32:51.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.428+0000 7fb640995640 1 -- 172.21.15.55:0/339940371 wait complete. 2024-05-27T12:32:51.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.428+0000 7ffa13aa0640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9f8003b70 0x7ffa0c1f9850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:51.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.428+0000 7f27bd99d640 1 --2- 172.21.15.55:0/2047806619 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f27b00e10f0 0x7f27b004bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:51.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.428+0000 7faa7aae0640 1 --2- 172.21.15.55:0/2942517572 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faa74162f20 0x7faa741473a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T12:32:51.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.428+0000 7ffa13aa0640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffa0c1fb580 0x7ffa0c06eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:51.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.429+0000 7ffa1183c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9f8003b70 0x7ffa0c1f9850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:51.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.429+0000 7ffa1183c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9f8003b70 0x7ffa0c1f9850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.55:49058/0 (socket says 172.21.15.55:49058) 2024-05-27T12:32:51.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.429+0000 7ffa1183c640 1 -- 172.21.15.55:0/4246216888 learned_addr learned my addr 172.21.15.55:0/4246216888 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:32:51.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.429+0000 7ffa13aa0640 1 --2- 172.21.15.55:0/4246216888 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffa0c06f0c0 0x7ffa0c15d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:51.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.429+0000 7ffa13aa0640 1 -- 172.21.15.55:0/4246216888 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7ffa0c163430 con 0x7ffa0c1fb580 2024-05-27T12:32:51.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.429+0000 7ffa13aa0640 1 -- 172.21.15.55:0/4246216888 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7ffa0c1632b0 con 0x7ff9f8003b70 2024-05-27T12:32:51.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.429+0000 7ffa13aa0640 1 -- 172.21.15.55:0/4246216888 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7ffa0c1635b0 con 0x7ffa0c06f0c0 2024-05-27T12:32:51.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.429+0000 7f27bd99d640 1 -- 172.21.15.55:0/2047806619 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27b00335e0 msgr2=0x7f27b004e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:51.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.429+0000 7f27bd99d640 1 --2- 172.21.15.55:0/2047806619 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27b00335e0 0x7f27b004e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:51.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.429+0000 7f27bd99d640 1 -- 172.21.15.55:0/2047806619 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f27b003a550 msgr2=0x7f27b01781c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:51.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.428+0000 7fa91d27d640 1 --2- 172.21.15.55:0/2130524074 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9180b46d0 0x7fa9180aefe0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa914009840 tx=0x7fa9140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:51.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.428+0000 7faa79ade640 1 --2- 172.21.15.55:0/2942517572 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faa74162b40 0x7faa7414d2c0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7faa6c01d9f0 tx=0x7faa6c01deb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:51.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.429+0000 7fa9d359e640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa9d4072260 0x7fa9d413d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:51.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.429+0000 7fa9d359e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9d40cec90 0x7fa9d413da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:51.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.429+0000 7fa9d359e640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa9d413f6f0 0x7fa9d413a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:51.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.429+0000 7fa9d359e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7fa9d40aff70 con 0x7fa9d40cec90 2024-05-27T12:32:51.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.429+0000 7fa9d359e640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fa9d40afdf0 con 0x7fa9d413f6f0 2024-05-27T12:32:51.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.429+0000 7fa9d359e640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fa9d4140ce0 con 0x7fa9d4072260 2024-05-27T12:32:51.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.429+0000 7f27bd99d640 1 --2- 172.21.15.55:0/2047806619 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f27b003a550 0x7f27b01781c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:51.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.429+0000 7f27bd99d640 1 -- 172.21.15.55:0/2047806619 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27b0178700 con 0x7f27b00e10f0 2024-05-27T12:32:51.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.429+0000 7f27bc99b640 1 --2- 172.21.15.55:0/2047806619 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f27b003a550 0x7f27b01781c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T12:32:51.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.429+0000 7f18fe87c640 1 -- 172.21.15.55:0/1444029452 shutdown_connections 2024-05-27T12:32:51.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.429+0000 7fa9d259c640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa9d4072260 0x7fa9d413d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:51.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.429+0000 7fa9d259c640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa9d4072260 0x7fa9d413d500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.55:45922/0 (socket says 172.21.15.55:45922) 2024-05-27T12:32:51.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.429+0000 7fa9d259c640 1 -- 172.21.15.55:0/3305542187 learned_addr learned my addr 172.21.15.55:0/3305542187 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:32:51.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.429+0000 7fa90dffb640 1 -- 172.21.15.55:0/2130524074 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa914037050 con 0x7fa9180b46d0 2024-05-27T12:32:51.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.429+0000 7fa9d2d9d640 1 --2- 172.21.15.55:0/3305542187 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa9d413f6f0 0x7fa9d413a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:51.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.429+0000 7f27bd99d640 1 --2- 172.21.15.55:0/2047806619 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f27b00e10f0 0x7f27b004bda0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f27b802db50 tx=0x7f27b80694e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:51.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.429+0000 7f18fe87c640 1 -- 172.21.15.55:0/1444029452 wait complete. 2024-05-27T12:32:51.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.429+0000 7fa9d1d9b640 1 --2- 172.21.15.55:0/3305542187 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9d40cec90 0x7fa9d413da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:51.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.429+0000 7fa9d2d9d640 1 -- 172.21.15.55:0/3305542187 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa9d4072260 msgr2=0x7fa9d413d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:51.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.429+0000 7fa9d2d9d640 1 --2- 172.21.15.55:0/3305542187 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa9d4072260 0x7fa9d413d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:51.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.429+0000 7fa9d2d9d640 1 -- 172.21.15.55:0/3305542187 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9d40cec90 msgr2=0x7fa9d413da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:51.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.430+0000 7f27adffb640 1 -- 172.21.15.55:0/2047806619 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27b8075320 con 0x7f27b00e10f0 2024-05-27T12:32:51.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.430+0000 7f27adffb640 1 -- 172.21.15.55:0/2047806619 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27b80754c0 con 0x7f27b00e10f0 2024-05-27T12:32:51.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.430+0000 7f27adffb640 1 -- 172.21.15.55:0/2047806619 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27b8095440 con 0x7f27b00e10f0 2024-05-27T12:32:51.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.429+0000 7faa6affd640 1 -- 172.21.15.55:0/2942517572 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa6c028070 con 0x7faa74162b40 2024-05-27T12:32:51.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.429+0000 7faa6affd640 1 -- 172.21.15.55:0/2942517572 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa6c01bb70 con 0x7faa74162b40 2024-05-27T12:32:51.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.429+0000 7faa6affd640 1 -- 172.21.15.55:0/2942517572 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa6c023400 con 0x7faa74162b40 2024-05-27T12:32:51.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.429+0000 7faa7c543640 1 -- 172.21.15.55:0/2942517572 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa741483d0 con 0x7faa74162b40 2024-05-27T12:32:51.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.429+0000 7faa7c543640 1 -- 172.21.15.55:0/2942517572 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7faa74148990 con 0x7faa74162b40 2024-05-27T12:32:51.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.430+0000 7fa9d2d9d640 1 --2- 172.21.15.55:0/3305542187 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9d40cec90 0x7fa9d413da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:51.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.430+0000 7fa9d2d9d640 1 -- 172.21.15.55:0/3305542187 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9d413c8e0 con 0x7fa9d413f6f0 2024-05-27T12:32:51.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.429+0000 7ffa1103b640 1 --2- 172.21.15.55:0/4246216888 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffa0c1fb580 0x7ffa0c06eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:51.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.429+0000 7fa90dffb640 1 -- 172.21.15.55:0/2130524074 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa914038040 con 0x7fa9180b46d0 2024-05-27T12:32:51.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.429+0000 7fa91f4e1640 1 -- 172.21.15.55:0/2130524074 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa91814f440 con 0x7fa9180b46d0 2024-05-27T12:32:51.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.429+0000 7fa91f4e1640 1 -- 172.21.15.55:0/2130524074 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9181f8f80 con 0x7fa9180b46d0 2024-05-27T12:32:51.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.430+0000 7faa7c543640 1 -- 172.21.15.55:0/2942517572 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7faa74148d70 con 0x7faa74162b40 2024-05-27T12:32:51.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.430+0000 7fa9d1d9b640 1 --2- 172.21.15.55:0/3305542187 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9d40cec90 0x7fa9d413da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T12:32:51.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.430+0000 7ffa1103b640 1 -- 172.21.15.55:0/4246216888 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffa0c06f0c0 msgr2=0x7ffa0c15d490 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-27T12:32:51.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.430+0000 7ffa1103b640 1 --2- 172.21.15.55:0/4246216888 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffa0c06f0c0 0x7ffa0c15d490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:51.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.430+0000 7ffa1103b640 1 -- 172.21.15.55:0/4246216888 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9f8003b70 msgr2=0x7ffa0c1f9850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:51.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.430+0000 7ffa1103b640 1 --2- 172.21.15.55:0/4246216888 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9f8003b70 0x7ffa0c1f9850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:51.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.430+0000 7ffa1103b640 1 -- 172.21.15.55:0/4246216888 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa0c1fba00 con 0x7ffa0c1fb580 2024-05-27T12:32:51.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.430+0000 7ffa1103b640 1 --2- 172.21.15.55:0/4246216888 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffa0c1fb580 0x7ffa0c06eb80 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ffa04001a50 tx=0x7ffa0400f5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:51.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.431+0000 7fb640995640 1 Processor -- start 2024-05-27T12:32:51.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.431+0000 7fa90dffb640 1 -- 172.21.15.55:0/2130524074 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa914037050 con 0x7fa9180b46d0 2024-05-27T12:32:51.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.431+0000 7ffa1183c640 1 --2- 172.21.15.55:0/4246216888 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9f8003b70 0x7ffa0c1f9850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T12:32:51.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.430+0000 7f27bf400640 1 -- 172.21.15.55:0/2047806619 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27b0037050 con 0x7f27b00e10f0 2024-05-27T12:32:51.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.431+0000 7fb640995640 1 -- start start 2024-05-27T12:32:51.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.431+0000 7f27bf400640 1 -- 172.21.15.55:0/2047806619 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f27b00e2720 con 0x7f27b00e10f0 2024-05-27T12:32:51.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.431+0000 7fa8fb7fe640 1 -- 172.21.15.55:0/2130524074 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa918068a70 con 0x7fa9180b46d0 2024-05-27T12:32:51.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.431+0000 7fa9d2d9d640 1 --2- 172.21.15.55:0/3305542187 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa9d413f6f0 0x7fa9d413a070 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa9c400c340 tx=0x7fa9c400c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:51.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.431+0000 7faa6affd640 1 -- 172.21.15.55:0/2942517572 <== mon.2 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7faa6c02b070 con 0x7faa74162b40 2024-05-27T12:32:51.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.431+0000 7ffa027fc640 1 -- 172.21.15.55:0/4246216888 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa04007a80 con 0x7ffa0c1fb580 2024-05-27T12:32:51.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.431+0000 7ffa027fc640 1 -- 172.21.15.55:0/4246216888 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa0400fe30 con 0x7ffa0c1fb580 2024-05-27T12:32:51.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.431+0000 7ffa027fc640 1 -- 172.21.15.55:0/4246216888 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa040135f0 con 0x7ffa0c1fb580 2024-05-27T12:32:51.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.432+0000 7ffa13aa0640 1 -- 172.21.15.55:0/4246216888 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa0c15a510 con 0x7ffa0c1fb580 2024-05-27T12:32:51.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.432+0000 7ffa13aa0640 1 -- 172.21.15.55:0/4246216888 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa0c15aad0 con 0x7ffa0c1fb580 2024-05-27T12:32:51.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.432+0000 7f27adffb640 1 -- 172.21.15.55:0/2047806619 <== mon.2 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f27b80955e0 con 0x7f27b00e10f0 2024-05-27T12:32:51.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.433+0000 7f27adffb640 1 --2- 172.21.15.55:0/2047806619 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f279c06c9f0 0x7f279c06eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:51.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.432+0000 7fa90dffb640 1 -- 172.21.15.55:0/2130524074 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa914004250 con 0x7fa9180b46d0 2024-05-27T12:32:51.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.432+0000 7f18fe87c640 1 Processor -- start 2024-05-27T12:32:51.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.432+0000 7f18fe87c640 1 -- start start 2024-05-27T12:32:51.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.432+0000 7faa6affd640 1 --2- 172.21.15.55:0/2942517572 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7faa5806c9c0 0x7faa5806ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:51.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.432+0000 7faa6affd640 1 -- 172.21.15.55:0/2942517572 <== mon.2 v2:172.21.15.72:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7faa6c09c740 con 0x7faa74162b40 2024-05-27T12:32:51.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.432+0000 7faa6affd640 1 --2- 172.21.15.55:0/2942517572 >> [v2:172.21.15.72:6802/3796994599,v1:172.21.15.72:6804/3796994599] conn(0x7faa58074be0 0x7faa58077000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:51.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.432+0000 7faa6affd640 1 -- 172.21.15.55:0/2942517572 --> [v2:172.21.15.72:6802/3796994599,v1:172.21.15.72:6804/3796994599] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7faa580776b0 con 0x7faa58074be0 2024-05-27T12:32:51.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.432+0000 7faa6affd640 1 -- 172.21.15.55:0/2942517572 <== mon.2 v2:172.21.15.72:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7faa6c0a3050 con 0x7faa74162b40 2024-05-27T12:32:51.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.433+0000 7faa7a2df640 1 --2- 172.21.15.55:0/2942517572 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7faa5806c9c0 0x7faa5806ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:51.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.432+0000 7fb640995640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb634006200 0x7fb63404dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:51.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.433+0000 7fb640995640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6340537a0 0x7fb6340ce3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:51.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.433+0000 7fb640995640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb634057380 0x7fb6340e5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:51.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.433+0000 7fb63affd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6340537a0 0x7fb6340ce3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:51.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.433+0000 7fb63affd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6340537a0 0x7fb6340ce3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.55:49074/0 (socket says 172.21.15.55:49074) 2024-05-27T12:32:51.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.433+0000 7f27adffb640 1 -- 172.21.15.55:0/2047806619 <== mon.2 v2:172.21.15.72:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f27b8106d50 con 0x7f27b00e10f0 2024-05-27T12:32:51.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.433+0000 7f27bd19c640 1 --2- 172.21.15.55:0/2047806619 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f279c06c9f0 0x7f279c06eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:51.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.433+0000 7fa90dffb640 1 --2- 172.21.15.55:0/2130524074 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fa8fc06caf0 0x7fa8fc06efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:51.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.433+0000 7faa7aae0640 1 --2- 172.21.15.55:0/2942517572 >> [v2:172.21.15.72:6802/3796994599,v1:172.21.15.72:6804/3796994599] conn(0x7faa58074be0 0x7faa58077000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:51.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.433+0000 7f18fe87c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f18f8073910 0x7f18f80727a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:51.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.433+0000 7f5202ffd640 1 --2- 172.21.15.55:0/2805073807 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f51f406c9c0 0x7f51f406ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:51.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.433+0000 7fa9c2ffd640 1 -- 172.21.15.55:0/3305542187 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9c4017070 con 0x7fa9d413f6f0 2024-05-27T12:32:51.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.433+0000 7faa7a2df640 1 --2- 172.21.15.55:0/2942517572 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7faa5806c9c0 0x7faa5806ee80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7faa70000c00 tx=0x7faa7002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:51.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.434+0000 7fa9c2ffd640 1 -- 172.21.15.55:0/3305542187 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9c40052d0 con 0x7fa9d413f6f0 2024-05-27T12:32:51.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.434+0000 7fa9d359e640 1 -- 172.21.15.55:0/3305542187 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9d4137c80 con 0x7fa9d413f6f0 2024-05-27T12:32:51.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.434+0000 7f27bf400640 1 --2- 172.21.15.55:0/2047806619 >> [v2:172.21.15.55:6824/3426897300,v1:172.21.15.55:6825/3426897300] conn(0x7f27b00df250 0x7f27b00e28f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:51.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.434+0000 7f5202ffd640 1 -- 172.21.15.55:0/2805073807 <== mon.2 v2:172.21.15.72:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f520408bdd0 con 0x7f52140cf490 2024-05-27T12:32:51.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.434+0000 7fa9c2ffd640 1 -- 172.21.15.55:0/3305542187 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9c4003830 con 0x7fa9d413f6f0 2024-05-27T12:32:51.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.434+0000 7f27bd19c640 1 --2- 172.21.15.55:0/2047806619 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f279c06c9f0 0x7f279c06eeb0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f27a802a0a0 tx=0x7f27a802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:51.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.434+0000 7f27bf400640 1 -- 172.21.15.55:0/2047806619 --> [v2:172.21.15.55:6824/3426897300,v1:172.21.15.55:6825/3426897300] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f27b0053310 con 0x7f27b00df250 2024-05-27T12:32:51.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.434+0000 7f5211d9b640 1 --2- 172.21.15.55:0/2805073807 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f51f406c9c0 0x7f51f406ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:51.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.434+0000 7fa90dffb640 1 -- 172.21.15.55:0/2130524074 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fa9140abd60 con 0x7fa9180b46d0 2024-05-27T12:32:51.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.434+0000 7fa90dffb640 1 --2- 172.21.15.55:0/2130524074 >> [v2:172.21.15.55:6816/1066693520,v1:172.21.15.55:6817/1066693520] conn(0x7fa8fc074c90 0x7fa8fc0770b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:51.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.434+0000 7fa90dffb640 1 -- 172.21.15.55:0/2130524074 --> [v2:172.21.15.55:6816/1066693520,v1:172.21.15.55:6817/1066693520] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa9140067f0 con 0x7fa8fc074c90 2024-05-27T12:32:51.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.434+0000 7f18fe87c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18f8162e80 0x7f18f80d00e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:51.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.434+0000 7fa91da7e640 1 --2- 172.21.15.55:0/2130524074 >> [v2:172.21.15.55:6816/1066693520,v1:172.21.15.55:6817/1066693520] conn(0x7fa8fc074c90 0x7fa8fc0770b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:51.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.433+0000 7fb63b7fe640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb634006200 0x7fb63404dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:51.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.433+0000 7fb63b7fe640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb634006200 0x7fb63404dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.55:45944/0 (socket says 172.21.15.55:45944) 2024-05-27T12:32:51.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.434+0000 7fb640995640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7fb6340544f0 con 0x7fb634057380 2024-05-27T12:32:51.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.434+0000 7fb640995640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fb634007520 con 0x7fb6340537a0 2024-05-27T12:32:51.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.434+0000 7fb640995640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fb6340e34f0 con 0x7fb634006200 2024-05-27T12:32:51.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.434+0000 7fb63bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb634057380 0x7fb6340e5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:51.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.434+0000 7fb63bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb634057380 0x7fb6340e5850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55456/0 (socket says 172.21.15.55:55456) 2024-05-27T12:32:51.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.434+0000 7fb63bfff640 1 -- 172.21.15.55:0/3819358764 learned_addr learned my addr 172.21.15.55:0/3819358764 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:32:51.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.434+0000 7f18fe87c640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f18f8163260 0x7f18f81fbed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:51.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.434+0000 7f18fe87c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f18f80b3890 con 0x7f18f8073910 2024-05-27T12:32:51.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.434+0000 7f18fe87c640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f18f80b3710 con 0x7f18f8162e80 2024-05-27T12:32:51.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.434+0000 7f18fe87c640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f18f80b3a10 con 0x7f18f8163260 2024-05-27T12:32:51.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.434+0000 7f18f7fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f18f8073910 0x7f18f80727a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:51.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.434+0000 7f18f7fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f18f8073910 0x7f18f80727a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55464/0 (socket says 172.21.15.55:55464) 2024-05-27T12:32:51.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.434+0000 7f18f7fff640 1 -- 172.21.15.55:0/103809393 learned_addr learned my addr 172.21.15.55:0/103809393 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:32:51.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.434+0000 7f18f77fe640 1 --2- 172.21.15.55:0/103809393 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18f8162e80 0x7f18f80d00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:51.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.434+0000 7f18fce19640 1 --2- 172.21.15.55:0/103809393 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f18f8163260 0x7f18f81fbed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:51.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.434+0000 7f5202ffd640 1 --2- 172.21.15.55:0/2805073807 >> [v2:172.21.15.72:6800/2421889184,v1:172.21.15.72:6801/2421889184] conn(0x7f51f4074be0 0x7f51f4077000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:51.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.434+0000 7f5202ffd640 1 -- 172.21.15.55:0/2805073807 --> [v2:172.21.15.72:6800/2421889184,v1:172.21.15.72:6801/2421889184] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5204016ec0 con 0x7f51f4074be0 2024-05-27T12:32:51.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.434+0000 7f5202ffd640 1 -- 172.21.15.55:0/2805073807 <== mon.2 v2:172.21.15.72:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f52040913c0 con 0x7f52140cf490 2024-05-27T12:32:51.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.435+0000 7f5212d9d640 1 --2- 172.21.15.55:0/2805073807 >> [v2:172.21.15.72:6800/2421889184,v1:172.21.15.72:6801/2421889184] conn(0x7f51f4074be0 0x7f51f4077000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:51.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.435+0000 7fa9d359e640 1 -- 172.21.15.55:0/3305542187 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9d4138240 con 0x7fa9d413f6f0 2024-05-27T12:32:51.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.434+0000 7fa91ca7c640 1 --2- 172.21.15.55:0/2130524074 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fa8fc06caf0 0x7fa8fc06efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:51.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.434+0000 7fa91da7e640 1 --2- 172.21.15.55:0/2130524074 >> [v2:172.21.15.55:6816/1066693520,v1:172.21.15.55:6817/1066693520] conn(0x7fa8fc074c90 0x7fa8fc0770b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:51.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.435+0000 7faa7aae0640 1 --2- 172.21.15.55:0/2942517572 >> [v2:172.21.15.72:6802/3796994599,v1:172.21.15.72:6804/3796994599] conn(0x7faa58074be0 0x7faa58077000 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:51.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.435+0000 7ffa027fc640 1 -- 172.21.15.55:0/4246216888 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ffa04013790 con 0x7ffa0c1fb580 2024-05-27T12:32:51.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.435+0000 7f27bc99b640 1 --2- 172.21.15.55:0/2047806619 >> [v2:172.21.15.55:6824/3426897300,v1:172.21.15.55:6825/3426897300] conn(0x7f27b00df250 0x7f27b00e28f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:51.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.435+0000 7f18f7fff640 1 -- 172.21.15.55:0/103809393 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f18f8163260 msgr2=0x7f18f81fbed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:51.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.435+0000 7f18f7fff640 1 --2- 172.21.15.55:0/103809393 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f18f8163260 0x7f18f81fbed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:51.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.435+0000 7f18f7fff640 1 -- 172.21.15.55:0/103809393 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18f8162e80 msgr2=0x7f18f80d00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:51.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.435+0000 7f18f7fff640 1 --2- 172.21.15.55:0/103809393 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18f8162e80 0x7f18f80d00e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:51.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.435+0000 7f18f7fff640 1 -- 172.21.15.55:0/103809393 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18f8071480 con 0x7f18f8073910 2024-05-27T12:32:51.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.435+0000 7fb63bfff640 1 -- 172.21.15.55:0/3819358764 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb634006200 msgr2=0x7fb63404dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:51.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.435+0000 7fb63bfff640 1 --2- 172.21.15.55:0/3819358764 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb634006200 0x7fb63404dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:51.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.435+0000 7fa90dffb640 1 -- 172.21.15.55:0/2130524074 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fa914075cb0 con 0x7fa9180b46d0 2024-05-27T12:32:51.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.435+0000 7f27bc99b640 1 --2- 172.21.15.55:0/2047806619 >> [v2:172.21.15.55:6824/3426897300,v1:172.21.15.55:6825/3426897300] conn(0x7f27b00df250 0x7f27b00e28f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:51.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.436+0000 7fa9d359e640 1 -- 172.21.15.55:0/3305542187 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa9d4075460 con 0x7fa9d413f6f0 2024-05-27T12:32:51.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.436+0000 7f18f7fff640 1 --2- 172.21.15.55:0/103809393 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f18f8073910 0x7f18f80727a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f18e8009f40 tx=0x7f18e8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:51.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.436+0000 7faa6affd640 1 -- 172.21.15.55:0/2942517572 <== osd.6 v2:172.21.15.72:6802/3796994599 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7faa580776b0 con 0x7faa58074be0 2024-05-27T12:32:51.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.436+0000 7ffa027fc640 1 --2- 172.21.15.55:0/4246216888 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7ff9f006c9f0 0x7ff9f006eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:51.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.436+0000 7f5211d9b640 1 --2- 172.21.15.55:0/2805073807 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f51f406c9c0 0x7f51f406ee80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f52140cb2e0 tx=0x7f520c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:51.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.436+0000 7fa9c2ffd640 1 -- 172.21.15.55:0/3305542187 <== mon.1 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa9c401a070 con 0x7fa9d413f6f0 2024-05-27T12:32:51.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.436+0000 7ffa027fc640 1 -- 172.21.15.55:0/4246216888 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7ffa0408c2b0 con 0x7ffa0c1fb580 2024-05-27T12:32:51.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.436+0000 7ffa1183c640 1 --2- 172.21.15.55:0/4246216888 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7ff9f006c9f0 0x7ff9f006eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:51.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.436+0000 7f5212d9d640 1 --2- 172.21.15.55:0/2805073807 >> [v2:172.21.15.72:6800/2421889184,v1:172.21.15.72:6801/2421889184] conn(0x7f51f4074be0 0x7f51f4077000 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:51.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.436+0000 7f18f4ff9640 1 -- 172.21.15.55:0/103809393 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18e8041020 con 0x7f18f8073910 2024-05-27T12:32:51.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.436+0000 7f18f77fe640 1 --2- 172.21.15.55:0/103809393 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18f8162e80 0x7f18f80d00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T12:32:51.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.436+0000 7f18f4ff9640 1 -- 172.21.15.55:0/103809393 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18e8031e40 con 0x7f18f8073910 2024-05-27T12:32:51.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.436+0000 7f18f4ff9640 1 -- 172.21.15.55:0/103809393 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18e8036040 con 0x7f18f8073910 2024-05-27T12:32:51.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.436+0000 7ff9effff640 1 --2- 172.21.15.55:0/4246216888 >> [v2:172.21.15.55:6800/807572567,v1:172.21.15.55:6801/807572567] conn(0x7ff9e8001650 0x7ff9e8003b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:51.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.436+0000 7ff9effff640 1 -- 172.21.15.55:0/4246216888 --> [v2:172.21.15.55:6800/807572567,v1:172.21.15.55:6801/807572567] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff9e8006bb0 con 0x7ff9e8001650 2024-05-27T12:32:51.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.436+0000 7fa91ca7c640 1 --2- 172.21.15.55:0/2130524074 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fa8fc06caf0 0x7fa8fc06efb0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa91815e720 tx=0x7fa910005bf0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:51.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.436+0000 7fa90dffb640 1 -- 172.21.15.55:0/2130524074 <== osd.3 v2:172.21.15.55:6816/1066693520 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa9140067f0 con 0x7fa8fc074c90 2024-05-27T12:32:51.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.435+0000 7fb63bfff640 1 -- 172.21.15.55:0/3819358764 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6340537a0 msgr2=0x7fb6340ce3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:51.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.436+0000 7fb63bfff640 1 --2- 172.21.15.55:0/3819358764 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6340537a0 0x7fb6340ce3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:51.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.436+0000 7fb63bfff640 1 -- 172.21.15.55:0/3819358764 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb63404d500 con 0x7fb634057380 2024-05-27T12:32:51.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.436+0000 7fb63affd640 1 --2- 172.21.15.55:0/3819358764 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6340537a0 0x7fb6340ce3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T12:32:51.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.436+0000 7f27adffb640 1 -- 172.21.15.55:0/2047806619 <== osd.1 v2:172.21.15.55:6824/3426897300 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f27b0053310 con 0x7f27b00df250 2024-05-27T12:32:51.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.436+0000 7f18fe87c640 1 -- 172.21.15.55:0/103809393 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18f8071700 con 0x7f18f8073910 2024-05-27T12:32:51.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.436+0000 7f18fe87c640 1 -- 172.21.15.55:0/103809393 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18f8071cc0 con 0x7f18f8073910 2024-05-27T12:32:51.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.437+0000 7ffa1203d640 1 --2- 172.21.15.55:0/4246216888 >> [v2:172.21.15.55:6800/807572567,v1:172.21.15.55:6801/807572567] conn(0x7ff9e8001650 0x7ff9e8003b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:51.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.437+0000 7f5202ffd640 1 -- 172.21.15.55:0/2805073807 <== osd.5 v2:172.21.15.72:6800/2421889184 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5204016ec0 con 0x7f51f4074be0 2024-05-27T12:32:51.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.437+0000 7ffa1183c640 1 --2- 172.21.15.55:0/4246216888 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7ff9f006c9f0 0x7ff9f006eeb0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ffa0802afd0 tx=0x7ffa08005040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:51.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.437+0000 7fb63bfff640 1 --2- 172.21.15.55:0/3819358764 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb634057380 0x7fb6340e5850 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb62800c410 tx=0x7fb62800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:51.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.437+0000 7ffa1203d640 1 --2- 172.21.15.55:0/4246216888 >> [v2:172.21.15.55:6800/807572567,v1:172.21.15.55:6801/807572567] conn(0x7ff9e8001650 0x7ff9e8003b10 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:51.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.437+0000 7fb627fff640 1 -- 172.21.15.55:0/3819358764 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb628011790 con 0x7fb634057380 2024-05-27T12:32:51.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.438+0000 7fb640995640 1 -- 172.21.15.55:0/3819358764 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb63404f580 con 0x7fb634057380 2024-05-27T12:32:51.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.438+0000 7ffa027fc640 1 -- 172.21.15.55:0/4246216888 <== osd.0 v2:172.21.15.55:6800/807572567 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff9e8006bb0 con 0x7ff9e8001650 2024-05-27T12:32:51.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.438+0000 7fb640995640 1 -- 172.21.15.55:0/3819358764 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb63404f860 con 0x7fb634057380 2024-05-27T12:32:51.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.437+0000 7f18fe87c640 1 -- 172.21.15.55:0/103809393 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f18f8075460 con 0x7f18f8073910 2024-05-27T12:32:51.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.439+0000 7fb640995640 1 -- 172.21.15.55:0/3819358764 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb6340052b0 con 0x7fb634057380 2024-05-27T12:32:51.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.439+0000 7fa9c2ffd640 1 --2- 172.21.15.55:0/3305542187 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fa9b406c940 0x7fa9b406ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:51.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.439+0000 7fa9d259c640 1 --2- 172.21.15.55:0/3305542187 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fa9b406c940 0x7fa9b406ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:51.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.439+0000 7fb627fff640 1 -- 172.21.15.55:0/3819358764 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb628017070 con 0x7fb634057380 2024-05-27T12:32:51.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.439+0000 7fb627fff640 1 -- 172.21.15.55:0/3819358764 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb628011b70 con 0x7fb634057380 2024-05-27T12:32:51.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.440+0000 7f18f4ff9640 1 -- 172.21.15.55:0/103809393 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f18e8044020 con 0x7f18f8073910 2024-05-27T12:32:51.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.440+0000 7fa9d259c640 1 --2- 172.21.15.55:0/3305542187 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fa9b406c940 0x7fa9b406ee00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa9cc0093e0 tx=0x7fa9cc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:51.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.441+0000 7fa9c2ffd640 1 -- 172.21.15.55:0/3305542187 <== mon.1 v2:172.21.15.72:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fa9c4089130 con 0x7fa9d413f6f0 2024-05-27T12:32:51.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.441+0000 7fa9c2ffd640 1 --2- 172.21.15.55:0/3305542187 >> [v2:172.21.15.55:6808/3510271725,v1:172.21.15.55:6809/3510271725] conn(0x7fa9b4074ae0 0x7fa9b4076f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:51.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.441+0000 7fa9c2ffd640 1 -- 172.21.15.55:0/3305542187 --> [v2:172.21.15.55:6808/3510271725,v1:172.21.15.55:6809/3510271725] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa9b40775b0 con 0x7fa9b4074ae0 2024-05-27T12:32:51.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.441+0000 7fa9c2ffd640 1 -- 172.21.15.55:0/3305542187 <== mon.1 v2:172.21.15.72:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fa9c4090060 con 0x7fa9d413f6f0 2024-05-27T12:32:51.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.441+0000 7f18f4ff9640 1 --2- 172.21.15.55:0/103809393 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f18e406c9c0 0x7f18e406ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:51.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.441+0000 7f18f4ff9640 1 -- 172.21.15.55:0/103809393 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f18e80acc60 con 0x7f18f8073910 2024-05-27T12:32:51.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.441+0000 7f18f4ff9640 1 --2- 172.21.15.55:0/103809393 >> [v2:172.21.15.72:6818/4190771237,v1:172.21.15.72:6820/4190771237] conn(0x7f18e4074be0 0x7f18e4077000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:51.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.441+0000 7f18f4ff9640 1 -- 172.21.15.55:0/103809393 --> [v2:172.21.15.72:6818/4190771237,v1:172.21.15.72:6820/4190771237] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f18e8034e70 con 0x7f18e4074be0 2024-05-27T12:32:51.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.441+0000 7f18f4ff9640 1 -- 172.21.15.55:0/103809393 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f18e80af2c0 con 0x7f18f8073910 2024-05-27T12:32:51.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.441+0000 7f18f77fe640 1 --2- 172.21.15.55:0/103809393 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f18e406c9c0 0x7f18e406ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:51.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.441+0000 7fa9d1d9b640 1 --2- 172.21.15.55:0/3305542187 >> [v2:172.21.15.55:6808/3510271725,v1:172.21.15.55:6809/3510271725] conn(0x7fa9b4074ae0 0x7fa9b4076f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:51.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.441+0000 7f18fce19640 1 --2- 172.21.15.55:0/103809393 >> [v2:172.21.15.72:6818/4190771237,v1:172.21.15.72:6820/4190771237] conn(0x7f18e4074be0 0x7f18e4077000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:51.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.442+0000 7f18f77fe640 1 --2- 172.21.15.55:0/103809393 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f18e406c9c0 0x7f18e406ee80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f18f815f900 tx=0x7f18ec008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:51.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.442+0000 7fa9d1d9b640 1 --2- 172.21.15.55:0/3305542187 >> [v2:172.21.15.55:6808/3510271725,v1:172.21.15.55:6809/3510271725] conn(0x7fa9b4074ae0 0x7fa9b4076f00 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:51.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.442+0000 7f18fce19640 1 --2- 172.21.15.55:0/103809393 >> [v2:172.21.15.72:6818/4190771237,v1:172.21.15.72:6820/4190771237] conn(0x7f18e4074be0 0x7f18e4077000 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:51.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.442+0000 7fb627fff640 1 -- 172.21.15.55:0/3819358764 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb628011d10 con 0x7fb634057380 2024-05-27T12:32:51.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.443+0000 7f18f4ff9640 1 -- 172.21.15.55:0/103809393 <== osd.4 v2:172.21.15.72:6818/4190771237 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f18e8034e70 con 0x7f18e4074be0 2024-05-27T12:32:51.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.443+0000 7fb627fff640 1 --2- 172.21.15.55:0/3819358764 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fb62006c8f0 0x7fb62006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:51.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.443+0000 7fa9c2ffd640 1 -- 172.21.15.55:0/3305542187 <== osd.2 v2:172.21.15.55:6808/3510271725 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa9b40775b0 con 0x7fa9b4074ae0 2024-05-27T12:32:51.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.443+0000 7fb627fff640 1 -- 172.21.15.55:0/3819358764 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fb62808c2f0 con 0x7fb634057380 2024-05-27T12:32:51.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.443+0000 7fb627fff640 1 --2- 172.21.15.55:0/3819358764 >> [v2:172.21.15.72:6816/3024877895,v1:172.21.15.72:6817/3024877895] conn(0x7fb620074af0 0x7fb620076f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:51.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.444+0000 7fb627fff640 1 -- 172.21.15.55:0/3819358764 --> [v2:172.21.15.72:6816/3024877895,v1:172.21.15.72:6817/3024877895] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb6200775c0 con 0x7fb620074af0 2024-05-27T12:32:51.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.444+0000 7fb627fff640 1 -- 172.21.15.55:0/3819358764 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fb62808c6e0 con 0x7fb634057380 2024-05-27T12:32:51.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.444+0000 7fb63b7fe640 1 --2- 172.21.15.55:0/3819358764 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fb62006c8f0 0x7fb62006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:51.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.444+0000 7fb63affd640 1 --2- 172.21.15.55:0/3819358764 >> [v2:172.21.15.72:6816/3024877895,v1:172.21.15.72:6817/3024877895] conn(0x7fb620074af0 0x7fb620076f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:51.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.444+0000 7fb63b7fe640 1 --2- 172.21.15.55:0/3819358764 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fb62006c8f0 0x7fb62006edb0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb634007a10 tx=0x7fb63c06f030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:51.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.445+0000 7fb63affd640 1 --2- 172.21.15.55:0/3819358764 >> [v2:172.21.15.72:6816/3024877895,v1:172.21.15.72:6817/3024877895] conn(0x7fb620074af0 0x7fb620076f10 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:51.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.445+0000 7fb627fff640 1 -- 172.21.15.55:0/3819358764 <== osd.7 v2:172.21.15.72:6816/3024877895 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb6200775c0 con 0x7fb620074af0 2024-05-27T12:32:51.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.468+0000 7fa8fb7fe640 1 -- 172.21.15.55:0/2130524074 --> [v2:172.21.15.55:6816/1066693520,v1:172.21.15.55:6817/1066693520] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa91806e5d0 con 0x7fa8fc074c90 2024-05-27T12:32:51.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.469+0000 7fa90dffb640 1 -- 172.21.15.55:0/2130524074 <== osd.3 v2:172.21.15.55:6816/1066693520 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fa91806e5d0 con 0x7fa8fc074c90 2024-05-27T12:32:51.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.470+0000 7fa8fb7fe640 1 -- 172.21.15.55:0/2130524074 >> [v2:172.21.15.55:6816/1066693520,v1:172.21.15.55:6817/1066693520] conn(0x7fa8fc074c90 msgr2=0x7fa8fc0770b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:51.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.470+0000 7fa8fb7fe640 1 --2- 172.21.15.55:0/2130524074 >> [v2:172.21.15.55:6816/1066693520,v1:172.21.15.55:6817/1066693520] conn(0x7fa8fc074c90 0x7fa8fc0770b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:51.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.470+0000 7fa8fb7fe640 1 -- 172.21.15.55:0/2130524074 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fa8fc06caf0 msgr2=0x7fa8fc06efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:51.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.470+0000 7fa8fb7fe640 1 --2- 172.21.15.55:0/2130524074 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fa8fc06caf0 0x7fa8fc06efb0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa91815e720 tx=0x7fa910005bf0 comp rx=0 tx=0).stop 2024-05-27T12:32:51.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.470+0000 7fa8fb7fe640 1 -- 172.21.15.55:0/2130524074 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9180b46d0 msgr2=0x7fa9180aefe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:51.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.470+0000 7fa8fb7fe640 1 --2- 172.21.15.55:0/2130524074 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9180b46d0 0x7fa9180aefe0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa914009840 tx=0x7fa9140046c0 comp rx=0 tx=0).stop 2024-05-27T12:32:51.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.470+0000 7faa7c543640 1 -- 172.21.15.55:0/2942517572 --> [v2:172.21.15.72:6802/3796994599,v1:172.21.15.72:6804/3796994599] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7faa74068a70 con 0x7faa58074be0 2024-05-27T12:32:51.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.470+0000 7fa91da7e640 1 -- 172.21.15.55:0/2130524074 reap_dead start 2024-05-27T12:32:51.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.470+0000 7fa8fb7fe640 1 -- 172.21.15.55:0/2130524074 shutdown_connections 2024-05-27T12:32:51.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.470+0000 7fa8fb7fe640 1 -- 172.21.15.55:0/2130524074 >> 172.21.15.55:0/2130524074 conn(0x7fa9180b2240 msgr2=0x7fa9180d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:51.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.470+0000 7faa6affd640 1 -- 172.21.15.55:0/2942517572 <== osd.6 v2:172.21.15.72:6802/3796994599 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7faa74068a70 con 0x7faa58074be0 2024-05-27T12:32:51.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.471+0000 7fa8fb7fe640 1 -- 172.21.15.55:0/2130524074 shutdown_connections 2024-05-27T12:32:51.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.471+0000 7fa8fb7fe640 1 -- 172.21.15.55:0/2130524074 wait complete. 2024-05-27T12:32:51.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.471+0000 7f521359e640 1 -- 172.21.15.55:0/2805073807 --> [v2:172.21.15.72:6800/2421889184,v1:172.21.15.72:6801/2421889184] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f51f8002dd0 con 0x7f51f4074be0 2024-05-27T12:32:51.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.471+0000 7f27bf400640 1 -- 172.21.15.55:0/2047806619 --> [v2:172.21.15.55:6824/3426897300,v1:172.21.15.55:6825/3426897300] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f27b0053030 con 0x7f27b00df250 2024-05-27T12:32:51.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.471+0000 7faa7c543640 1 -- 172.21.15.55:0/2942517572 >> [v2:172.21.15.72:6802/3796994599,v1:172.21.15.72:6804/3796994599] conn(0x7faa58074be0 msgr2=0x7faa58077000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:51.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.471+0000 7faa7c543640 1 --2- 172.21.15.55:0/2942517572 >> [v2:172.21.15.72:6802/3796994599,v1:172.21.15.72:6804/3796994599] conn(0x7faa58074be0 0x7faa58077000 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:51.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.471+0000 7faa7c543640 1 -- 172.21.15.55:0/2942517572 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7faa5806c9c0 msgr2=0x7faa5806ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:51.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.471+0000 7faa7c543640 1 --2- 172.21.15.55:0/2942517572 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7faa5806c9c0 0x7faa5806ee80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7faa70000c00 tx=0x7faa7002e000 comp rx=0 tx=0).stop 2024-05-27T12:32:51.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.471+0000 7faa7c543640 1 -- 172.21.15.55:0/2942517572 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faa74162b40 msgr2=0x7faa7414d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:51.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.471+0000 7faa7c543640 1 --2- 172.21.15.55:0/2942517572 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faa74162b40 0x7faa7414d2c0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7faa6c01d9f0 tx=0x7faa6c01deb0 comp rx=0 tx=0).stop 2024-05-27T12:32:51.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.471+0000 7faa7aae0640 1 -- 172.21.15.55:0/2942517572 reap_dead start 2024-05-27T12:32:51.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.471+0000 7faa7c543640 1 -- 172.21.15.55:0/2942517572 shutdown_connections 2024-05-27T12:32:51.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.471+0000 7faa7c543640 1 -- 172.21.15.55:0/2942517572 >> 172.21.15.55:0/2942517572 conn(0x7faa740b2240 msgr2=0x7faa74163850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:51.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.471+0000 7f27adffb640 1 -- 172.21.15.55:0/2047806619 <== osd.1 v2:172.21.15.55:6824/3426897300 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f27b0053030 con 0x7f27b00df250 2024-05-27T12:32:51.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.472+0000 7f5202ffd640 1 -- 172.21.15.55:0/2805073807 <== osd.5 v2:172.21.15.72:6800/2421889184 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f51f8002dd0 con 0x7f51f4074be0 2024-05-27T12:32:51.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.472+0000 7faa7c543640 1 -- 172.21.15.55:0/2942517572 shutdown_connections 2024-05-27T12:32:51.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.472+0000 7faa7c543640 1 -- 172.21.15.55:0/2942517572 wait complete. 2024-05-27T12:32:51.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.472+0000 7f27bf400640 1 -- 172.21.15.55:0/2047806619 >> [v2:172.21.15.55:6824/3426897300,v1:172.21.15.55:6825/3426897300] conn(0x7f27b00df250 msgr2=0x7f27b00e28f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:51.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.472+0000 7f27bf400640 1 --2- 172.21.15.55:0/2047806619 >> [v2:172.21.15.55:6824/3426897300,v1:172.21.15.55:6825/3426897300] conn(0x7f27b00df250 0x7f27b00e28f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:51.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.472+0000 7f5200ff9640 1 -- 172.21.15.55:0/2805073807 >> [v2:172.21.15.72:6800/2421889184,v1:172.21.15.72:6801/2421889184] conn(0x7f51f4074be0 msgr2=0x7f51f4077000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:51.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.472+0000 7f5200ff9640 1 --2- 172.21.15.55:0/2805073807 >> [v2:172.21.15.72:6800/2421889184,v1:172.21.15.72:6801/2421889184] conn(0x7f51f4074be0 0x7f51f4077000 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:51.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.472+0000 7ff9effff640 1 -- 172.21.15.55:0/4246216888 --> [v2:172.21.15.55:6800/807572567,v1:172.21.15.55:6801/807572567] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff9e8005c40 con 0x7ff9e8001650 2024-05-27T12:32:51.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.473+0000 7f27bf400640 1 -- 172.21.15.55:0/2047806619 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f279c06c9f0 msgr2=0x7f279c06eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:51.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.473+0000 7f27bf400640 1 --2- 172.21.15.55:0/2047806619 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f279c06c9f0 0x7f279c06eeb0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f27a802a0a0 tx=0x7f27a802e000 comp rx=0 tx=0).stop 2024-05-27T12:32:51.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.473+0000 7f27bf400640 1 -- 172.21.15.55:0/2047806619 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f27b00e10f0 msgr2=0x7f27b004bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:51.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.473+0000 7f27bf400640 1 --2- 172.21.15.55:0/2047806619 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f27b00e10f0 0x7f27b004bda0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f27b802db50 tx=0x7f27b80694e0 comp rx=0 tx=0).stop 2024-05-27T12:32:51.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.473+0000 7f5200ff9640 1 -- 172.21.15.55:0/2805073807 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f51f406c9c0 msgr2=0x7f51f406ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:51.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.473+0000 7f5200ff9640 1 --2- 172.21.15.55:0/2805073807 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f51f406c9c0 0x7f51f406ee80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f52140cb2e0 tx=0x7f520c009040 comp rx=0 tx=0).stop 2024-05-27T12:32:51.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.473+0000 7f5200ff9640 1 -- 172.21.15.55:0/2805073807 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f52140cf490 msgr2=0x7f521414ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:51.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.473+0000 7f5200ff9640 1 --2- 172.21.15.55:0/2805073807 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f52140cf490 0x7f521414ea20 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f520400e9b0 tx=0x7f520400ee70 comp rx=0 tx=0).stop 2024-05-27T12:32:51.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.473+0000 7f5212d9d640 1 -- 172.21.15.55:0/2805073807 reap_dead start 2024-05-27T12:32:51.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.473+0000 7ffa027fc640 1 -- 172.21.15.55:0/4246216888 <== osd.0 v2:172.21.15.55:6800/807572567 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7ff9e8005c40 con 0x7ff9e8001650 2024-05-27T12:32:51.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.473+0000 7f5200ff9640 1 -- 172.21.15.55:0/2805073807 shutdown_connections 2024-05-27T12:32:51.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.473+0000 7f5200ff9640 1 -- 172.21.15.55:0/2805073807 >> 172.21.15.55:0/2805073807 conn(0x7f521406cf90 msgr2=0x7f52140b41e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:51.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.473+0000 7f27bd99d640 1 -- 172.21.15.55:0/2047806619 reap_dead start 2024-05-27T12:32:51.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.473+0000 7f27bf400640 1 -- 172.21.15.55:0/2047806619 shutdown_connections 2024-05-27T12:32:51.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.473+0000 7f27bf400640 1 -- 172.21.15.55:0/2047806619 >> 172.21.15.55:0/2047806619 conn(0x7f27b0009fa0 msgr2=0x7f27b0004b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:51.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.473+0000 7f27bf400640 1 -- 172.21.15.55:0/2047806619 shutdown_connections 2024-05-27T12:32:51.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.473+0000 7f5200ff9640 1 -- 172.21.15.55:0/2805073807 shutdown_connections 2024-05-27T12:32:51.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.473+0000 7f5200ff9640 1 -- 172.21.15.55:0/2805073807 wait complete. 2024-05-27T12:32:51.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.473+0000 7ff9effff640 1 -- 172.21.15.55:0/4246216888 >> [v2:172.21.15.55:6800/807572567,v1:172.21.15.55:6801/807572567] conn(0x7ff9e8001650 msgr2=0x7ff9e8003b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:51.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.473+0000 7ff9effff640 1 --2- 172.21.15.55:0/4246216888 >> [v2:172.21.15.55:6800/807572567,v1:172.21.15.55:6801/807572567] conn(0x7ff9e8001650 0x7ff9e8003b10 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:51.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.474+0000 7ff9effff640 1 -- 172.21.15.55:0/4246216888 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7ff9f006c9f0 msgr2=0x7ff9f006eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:51.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.474+0000 7ff9effff640 1 --2- 172.21.15.55:0/4246216888 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7ff9f006c9f0 0x7ff9f006eeb0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ffa0802afd0 tx=0x7ffa08005040 comp rx=0 tx=0).stop 2024-05-27T12:32:51.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.474+0000 7f27bf400640 1 -- 172.21.15.55:0/2047806619 wait complete. 2024-05-27T12:32:51.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.474+0000 7ff9effff640 1 -- 172.21.15.55:0/4246216888 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffa0c1fb580 msgr2=0x7ffa0c06eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:51.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.474+0000 7ff9effff640 1 --2- 172.21.15.55:0/4246216888 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffa0c1fb580 0x7ffa0c06eb80 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ffa04001a50 tx=0x7ffa0400f5a0 comp rx=0 tx=0).stop 2024-05-27T12:32:51.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.474+0000 7ffa1203d640 1 -- 172.21.15.55:0/4246216888 reap_dead start 2024-05-27T12:32:51.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.475+0000 7ff9effff640 1 -- 172.21.15.55:0/4246216888 shutdown_connections 2024-05-27T12:32:51.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.475+0000 7ff9effff640 1 -- 172.21.15.55:0/4246216888 >> 172.21.15.55:0/4246216888 conn(0x7ffa0c0b2660 msgr2=0x7ffa0c0d0d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:51.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.475+0000 7ff9effff640 1 -- 172.21.15.55:0/4246216888 shutdown_connections 2024-05-27T12:32:51.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.475+0000 7ff9effff640 1 -- 172.21.15.55:0/4246216888 wait complete. 2024-05-27T12:32:51.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.475+0000 7fa9d359e640 1 -- 172.21.15.55:0/3305542187 --> [v2:172.21.15.55:6808/3510271725,v1:172.21.15.55:6809/3510271725] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa9d4072f30 con 0x7fa9b4074ae0 2024-05-27T12:32:51.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.476+0000 7fa9c2ffd640 1 -- 172.21.15.55:0/3305542187 <== osd.2 v2:172.21.15.55:6808/3510271725 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fa9d4072f30 con 0x7fa9b4074ae0 2024-05-27T12:32:51.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.476+0000 7f18fe87c640 1 -- 172.21.15.55:0/103809393 --> [v2:172.21.15.72:6818/4190771237,v1:172.21.15.72:6820/4190771237] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f18f80d38f0 con 0x7f18e4074be0 2024-05-27T12:32:51.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.477+0000 7fa9d359e640 1 -- 172.21.15.55:0/3305542187 >> [v2:172.21.15.55:6808/3510271725,v1:172.21.15.55:6809/3510271725] conn(0x7fa9b4074ae0 msgr2=0x7fa9b4076f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:51.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.477+0000 7fa9d359e640 1 --2- 172.21.15.55:0/3305542187 >> [v2:172.21.15.55:6808/3510271725,v1:172.21.15.55:6809/3510271725] conn(0x7fa9b4074ae0 0x7fa9b4076f00 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:51.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.477+0000 7f18f4ff9640 1 -- 172.21.15.55:0/103809393 <== osd.4 v2:172.21.15.72:6818/4190771237 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f18f80d38f0 con 0x7f18e4074be0 2024-05-27T12:32:51.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.477+0000 7fa9d359e640 1 -- 172.21.15.55:0/3305542187 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fa9b406c940 msgr2=0x7fa9b406ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:51.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.477+0000 7fa9d359e640 1 --2- 172.21.15.55:0/3305542187 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fa9b406c940 0x7fa9b406ee00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa9cc0093e0 tx=0x7fa9cc009040 comp rx=0 tx=0).stop 2024-05-27T12:32:51.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.477+0000 7fa9d359e640 1 -- 172.21.15.55:0/3305542187 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa9d413f6f0 msgr2=0x7fa9d413a070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:51.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.477+0000 7fa9d359e640 1 --2- 172.21.15.55:0/3305542187 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa9d413f6f0 0x7fa9d413a070 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa9c400c340 tx=0x7fa9c400c800 comp rx=0 tx=0).stop 2024-05-27T12:32:51.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.477+0000 7fa9d2d9d640 1 -- 172.21.15.55:0/3305542187 reap_dead start 2024-05-27T12:32:51.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.478+0000 7f18de7fc640 1 -- 172.21.15.55:0/103809393 >> [v2:172.21.15.72:6818/4190771237,v1:172.21.15.72:6820/4190771237] conn(0x7f18e4074be0 msgr2=0x7f18e4077000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:51.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.478+0000 7f18de7fc640 1 --2- 172.21.15.55:0/103809393 >> [v2:172.21.15.72:6818/4190771237,v1:172.21.15.72:6820/4190771237] conn(0x7f18e4074be0 0x7f18e4077000 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:51.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.478+0000 7f18de7fc640 1 -- 172.21.15.55:0/103809393 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f18e406c9c0 msgr2=0x7f18e406ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:51.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.478+0000 7f18de7fc640 1 --2- 172.21.15.55:0/103809393 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f18e406c9c0 0x7f18e406ee80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f18f815f900 tx=0x7f18ec008040 comp rx=0 tx=0).stop 2024-05-27T12:32:51.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.478+0000 7f18de7fc640 1 -- 172.21.15.55:0/103809393 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f18f8073910 msgr2=0x7f18f80727a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:51.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.478+0000 7f18de7fc640 1 --2- 172.21.15.55:0/103809393 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f18f8073910 0x7f18f80727a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f18e8009f40 tx=0x7f18e8004a40 comp rx=0 tx=0).stop 2024-05-27T12:32:51.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.478+0000 7f18fce19640 1 -- 172.21.15.55:0/103809393 reap_dead start 2024-05-27T12:32:51.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.478+0000 7f18de7fc640 1 -- 172.21.15.55:0/103809393 shutdown_connections 2024-05-27T12:32:51.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.478+0000 7f18de7fc640 1 -- 172.21.15.55:0/103809393 >> 172.21.15.55:0/103809393 conn(0x7f18f80d14d0 msgr2=0x7f18f80b4150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:51.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.478+0000 7fa9d359e640 1 -- 172.21.15.55:0/3305542187 shutdown_connections 2024-05-27T12:32:51.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.478+0000 7fb640995640 1 -- 172.21.15.55:0/3819358764 --> [v2:172.21.15.72:6816/3024877895,v1:172.21.15.72:6817/3024877895] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb6340e2b10 con 0x7fb620074af0 2024-05-27T12:32:51.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.478+0000 7fa9d359e640 1 -- 172.21.15.55:0/3305542187 >> 172.21.15.55:0/3305542187 conn(0x7fa9d40b6230 msgr2=0x7fa9d415e830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:51.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.479+0000 7f18de7fc640 1 -- 172.21.15.55:0/103809393 shutdown_connections 2024-05-27T12:32:51.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.479+0000 7f18de7fc640 1 -- 172.21.15.55:0/103809393 wait complete. 2024-05-27T12:32:51.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.479+0000 7fa9d359e640 1 -- 172.21.15.55:0/3305542187 shutdown_connections 2024-05-27T12:32:51.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.479+0000 7fa9d359e640 1 -- 172.21.15.55:0/3305542187 wait complete. 2024-05-27T12:32:51.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.479+0000 7fb627fff640 1 -- 172.21.15.55:0/3819358764 <== osd.7 v2:172.21.15.72:6816/3024877895 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fb6340e2b10 con 0x7fb620074af0 2024-05-27T12:32:51.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.480+0000 7fb640995640 1 -- 172.21.15.55:0/3819358764 >> [v2:172.21.15.72:6816/3024877895,v1:172.21.15.72:6817/3024877895] conn(0x7fb620074af0 msgr2=0x7fb620076f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:51.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.480+0000 7fb640995640 1 --2- 172.21.15.55:0/3819358764 >> [v2:172.21.15.72:6816/3024877895,v1:172.21.15.72:6817/3024877895] conn(0x7fb620074af0 0x7fb620076f10 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:51.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.480+0000 7fb640995640 1 -- 172.21.15.55:0/3819358764 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fb62006c8f0 msgr2=0x7fb62006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:51.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.480+0000 7fb640995640 1 --2- 172.21.15.55:0/3819358764 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fb62006c8f0 0x7fb62006edb0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb634007a10 tx=0x7fb63c06f030 comp rx=0 tx=0).stop 2024-05-27T12:32:51.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.480+0000 7fb640995640 1 -- 172.21.15.55:0/3819358764 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb634057380 msgr2=0x7fb6340e5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:51.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.480+0000 7fb640995640 1 --2- 172.21.15.55:0/3819358764 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb634057380 0x7fb6340e5850 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb62800c410 tx=0x7fb62800c8d0 comp rx=0 tx=0).stop 2024-05-27T12:32:51.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.480+0000 7fb63bfff640 1 -- 172.21.15.55:0/3819358764 reap_dead start 2024-05-27T12:32:51.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.480+0000 7fb640995640 1 -- 172.21.15.55:0/3819358764 shutdown_connections 2024-05-27T12:32:51.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.480+0000 7fb640995640 1 -- 172.21.15.55:0/3819358764 >> 172.21.15.55:0/3819358764 conn(0x7fb63403aa30 msgr2=0x7fb63403c560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:51.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.480+0000 7fb640995640 1 -- 172.21.15.55:0/3819358764 shutdown_connections 2024-05-27T12:32:51.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.480+0000 7fb640995640 1 -- 172.21.15.55:0/3819358764 wait complete. 2024-05-27T12:32:51.539 INFO:teuthology.orchestra.run.smithi055.stdout:64424509447 2024-05-27T12:32:51.539 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-27T12:32:51.540 INFO:teuthology.orchestra.run.smithi055.stdout:64424509447 2024-05-27T12:32:51.540 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-05-27T12:32:51.541 INFO:teuthology.orchestra.run.smithi055.stdout:64424509447 2024-05-27T12:32:51.542 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-05-27T12:32:51.542 INFO:teuthology.orchestra.run.smithi055.stdout:60129542152 2024-05-27T12:32:51.542 INFO:teuthology.orchestra.run.smithi055.stdout:64424509447 2024-05-27T12:32:51.543 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-27T12:32:51.543 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-27T12:32:51.544 INFO:teuthology.orchestra.run.smithi055.stdout:64424509447 2024-05-27T12:32:51.544 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-05-27T12:32:51.545 INFO:teuthology.orchestra.run.smithi055.stdout:64424509447 2024-05-27T12:32:51.545 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-27T12:32:51.546 INFO:teuthology.orchestra.run.smithi055.stdout:64424509447 2024-05-27T12:32:51.547 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-05-27T12:32:51.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.758+0000 7fcaa3691640 1 Processor -- start 2024-05-27T12:32:51.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.759+0000 7fcaa3691640 1 -- start start 2024-05-27T12:32:51.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.759+0000 7f5572abe640 1 Processor -- start 2024-05-27T12:32:51.759 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.760+0000 7f5572abe640 1 -- start start 2024-05-27T12:32:51.760 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.760+0000 7fcaa3691640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fca94058b40 0x7fca940e7b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:51.760 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.760+0000 7fcaa3691640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fca94006240 0x7fca940066d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:51.760 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.760+0000 7fcaa3691640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca94056f10 con 0x7fca940535d0 2024-05-27T12:32:51.760 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.760+0000 7fcaa3691640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fca94057b20 con 0x7fca94058b40 2024-05-27T12:32:51.760 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.760+0000 7fcaa3691640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fca940571f0 con 0x7fca94006240 2024-05-27T12:32:51.760 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.761+0000 7fcaa1c2e640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fca94006240 0x7fca940066d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:51.760 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.761+0000 7fcaa142d640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fca940535d0 0x7fca940539b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.55:55608/0 (socket says 172.21.15.55:55608) 2024-05-27T12:32:51.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.761+0000 7f602208a640 1 Processor -- start 2024-05-27T12:32:51.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.761+0000 7fcaa142d640 1 -- 172.21.15.55:0/3261310685 learned_addr learned my addr 172.21.15.55:0/3261310685 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-27T12:32:51.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.761+0000 7f602208a640 1 -- start start 2024-05-27T12:32:51.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.761+0000 7fcaa0c2c640 1 --2- 172.21.15.55:0/3261310685 >> v2:172.21.15.72:3300/0 conn(0x7fca94058b40 0x7fca940e7b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:51.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.761+0000 7fca93fff640 1 -- 172.21.15.55:0/3261310685 <== mon.1 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 443517207 0 0) 0x7fca94056f10 con 0x7fca940535d0 2024-05-27T12:32:51.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.761+0000 7fca93fff640 1 -- 172.21.15.55:0/3261310685 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fca88003520 con 0x7fca940535d0 2024-05-27T12:32:51.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.761+0000 7f5572abe640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f556400aad0 0x7f55640df070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:51.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.761+0000 7f5572abe640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55640535f0 con 0x7f5564050180 2024-05-27T12:32:51.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.761+0000 7f5572abe640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55640538d0 con 0x7f55640530a0 2024-05-27T12:32:51.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.761+0000 7f5572abe640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f5564053bb0 con 0x7f556400aad0 2024-05-27T12:32:51.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.761+0000 7f55712bb640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f55640530a0 0x7f556404fa70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.55:55616/0 (socket says 172.21.15.55:55616) 2024-05-27T12:32:51.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.761+0000 7f55712bb640 1 -- 172.21.15.55:0/2357035546 learned_addr learned my addr 172.21.15.55:0/2357035546 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-27T12:32:51.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.761+0000 7f5571abc640 1 --2- 172.21.15.55:0/2357035546 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f556400aad0 0x7f55640df070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:51.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.762+0000 7f5570aba640 1 -- 172.21.15.55:0/2357035546 <== mon.1 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3608423148 0 0) 0x7f55640538d0 con 0x7f55640530a0 2024-05-27T12:32:51.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.762+0000 7f5570aba640 1 -- 172.21.15.55:0/2357035546 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5558003520 con 0x7f55640530a0 2024-05-27T12:32:51.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.761+0000 7fcaa1c2e640 1 -- 172.21.15.55:0/3261310685 >> v2:172.21.15.72:3300/0 conn(0x7fca94058b40 msgr2=0x7fca940e7b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:32:51.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.761+0000 7fcaa1c2e640 1 --2- 172.21.15.55:0/3261310685 >> v2:172.21.15.72:3300/0 conn(0x7fca94058b40 0x7fca940e7b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:51.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.761+0000 7fcaa1c2e640 1 -- 172.21.15.55:0/3261310685 >> v1:172.21.15.72:6789/0 conn(0x7fca940535d0 legacy=0x7fca940539b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:51.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.761+0000 7fcaa1c2e640 1 -- 172.21.15.55:0/3261310685 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca940574d0 con 0x7fca94006240 2024-05-27T12:32:51.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.762+0000 7fcaa1c2e640 1 --2- 172.21.15.55:0/3261310685 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fca94006240 0x7fca940066d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fca9c06aa50 tx=0x7fca9c0a5d00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=58e6c4e4c9777afc server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:51.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.762+0000 7f5570aba640 1 -- 172.21.15.55:0/2357035546 <== mon.1 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4288227020 0 0) 0x7f5558003520 con 0x7f55640530a0 2024-05-27T12:32:51.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.762+0000 7f5570aba640 1 -- 172.21.15.55:0/2357035546 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f556400aad0 msgr2=0x7f55640df070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:32:51.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.762+0000 7f5570aba640 1 --2- 172.21.15.55:0/2357035546 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f556400aad0 0x7f55640df070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:51.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.762+0000 7f5570aba640 1 -- 172.21.15.55:0/2357035546 >> v1:172.21.15.55:6789/0 conn(0x7f5564050180 legacy=0x7f5564005fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:51.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.762+0000 7f5570aba640 1 -- 172.21.15.55:0/2357035546 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5564053e90 con 0x7f55640530a0 2024-05-27T12:32:51.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.762+0000 7f5570aba640 1 -- 172.21.15.55:0/2357035546 <== mon.1 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 793017739 0 0) 0x7f5568001670 con 0x7f55640530a0 2024-05-27T12:32:51.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.762+0000 7f5571abc640 1 --2- 172.21.15.55:0/2357035546 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f556400aad0 0x7f55640df070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T12:32:51.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.763+0000 7f260e107640 1 Processor -- start 2024-05-27T12:32:51.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.763+0000 7f260e107640 1 -- start start 2024-05-27T12:32:51.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.763+0000 7f601b7fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f60140df210 0x7f601404fa80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:60462/0 (socket says 172.21.15.55:60462) 2024-05-27T12:32:51.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.763+0000 7f601b7fe640 1 -- 172.21.15.55:0/2069847164 learned_addr learned my addr 172.21.15.55:0/2069847164 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-27T12:32:51.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.763+0000 7f2e5af20640 1 Processor -- start 2024-05-27T12:32:51.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.763+0000 7f5570aba640 1 -- 172.21.15.55:0/2357035546 >> v1:172.21.15.72:6789/0 conn(0x7f55640530a0 legacy=0x7f556404fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:51.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.763+0000 7f5570aba640 1 --2- 172.21.15.55:0/2357035546 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55580039b0 0x7f5558003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:51.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.763+0000 7fca93fff640 1 -- 172.21.15.55:0/3261310685 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca9c0b3070 con 0x7fca94006240 2024-05-27T12:32:51.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.763+0000 7fca93fff640 1 -- 172.21.15.55:0/3261310685 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca9c0a6ad0 con 0x7fca94006240 2024-05-27T12:32:51.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.763+0000 7fca93fff640 1 -- 172.21.15.55:0/3261310685 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca9c0ae440 con 0x7fca94006240 2024-05-27T12:32:51.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.763+0000 7f602208a640 1 --2- 172.21.15.55:0/2069847164 >> v2:172.21.15.55:3300/0 conn(0x7f6014050190 0x7f6014038070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:51.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.763+0000 7f2e5af20640 1 -- start start 2024-05-27T12:32:51.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.763+0000 7f5570aba640 1 --2- 172.21.15.55:0/2357035546 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f556400aad0 0x7f5558004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:51.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.763+0000 7f5571abc640 1 --2- 172.21.15.55:0/2357035546 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55580039b0 0x7f5558003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:51.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.763+0000 7f5570aba640 1 --2- 172.21.15.55:0/2357035546 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5558004d40 0x7f55580051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:51.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.763+0000 7f601affd640 1 --2- 172.21.15.55:0/2069847164 >> v2:172.21.15.55:3300/0 conn(0x7f6014050190 0x7f6014038070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:51.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.763+0000 7f5570aba640 1 -- 172.21.15.55:0/2357035546 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f5564053bb0 con 0x7f55580039b0 2024-05-27T12:32:51.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.763+0000 7f5570aba640 1 -- 172.21.15.55:0/2357035546 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f555800ba50 con 0x7f5558004d40 2024-05-27T12:32:51.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.763+0000 7f5570aba640 1 -- 172.21.15.55:0/2357035546 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f555800bc50 con 0x7f556400aad0 2024-05-27T12:32:51.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.763+0000 7f602208a640 1 -- 172.21.15.55:0/2069847164 --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60140544b0 con 0x7f60140df210 2024-05-27T12:32:51.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.764+0000 7f602208a640 1 -- 172.21.15.55:0/2069847164 --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60140541d0 con 0x7f6014053c60 2024-05-27T12:32:51.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.764+0000 7f602208a640 1 -- 172.21.15.55:0/2069847164 --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f6014005f70 con 0x7f6014050190 2024-05-27T12:32:51.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.764+0000 7fcaa3691640 1 -- 172.21.15.55:0/3261310685 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fca94006240 msgr2=0x7fca940066d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:51.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.764+0000 7fcaa3691640 1 --2- 172.21.15.55:0/3261310685 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fca94006240 0x7fca940066d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fca9c06aa50 tx=0x7fca9c0a5d00 comp rx=0 tx=0).stop 2024-05-27T12:32:51.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.764+0000 7f601a7fc640 1 -- 172.21.15.55:0/2069847164 <== mon.1 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 819365592 0 0) 0x7f60140541d0 con 0x7f6014053c60 2024-05-27T12:32:51.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.764+0000 7f601a7fc640 1 -- 172.21.15.55:0/2069847164 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f600c003520 con 0x7f6014053c60 2024-05-27T12:32:51.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.764+0000 7f601a7fc640 1 -- 172.21.15.55:0/2069847164 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1069238196 0 0) 0x7f60140544b0 con 0x7f60140df210 2024-05-27T12:32:51.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.764+0000 7f601a7fc640 1 -- 172.21.15.55:0/2069847164 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f60140541d0 con 0x7f60140df210 2024-05-27T12:32:51.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.764+0000 7f5571abc640 1 -- 172.21.15.55:0/2357035546 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f556400aad0 msgr2=0x7f5558004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:32:51.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.764+0000 7f5571abc640 1 --2- 172.21.15.55:0/2357035546 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f556400aad0 0x7f5558004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:51.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.764+0000 7f5571abc640 1 -- 172.21.15.55:0/2357035546 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5558004d40 msgr2=0x7f55580051c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-27T12:32:51.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.764+0000 7f5571abc640 1 --2- 172.21.15.55:0/2357035546 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5558004d40 0x7f55580051c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:51.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.764+0000 7f5571abc640 1 -- 172.21.15.55:0/2357035546 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5558003520 con 0x7f55580039b0 2024-05-27T12:32:51.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.764+0000 7f2e5af20640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2e4c053e50 0x7f2e4c0542e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:51.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.764+0000 7f2e5af20640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2e4c04f930 0x7f2e4c04fd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:51.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.764+0000 7f2e5af20640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e4c050280 con 0x7f2e4c048100 2024-05-27T12:32:51.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.764+0000 7f2e5af20640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f2e4c0e7b90 con 0x7f2e4c04f930 2024-05-27T12:32:51.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.764+0000 7f2e5af20640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f2e4c006ae0 con 0x7f2e4c053e50 2024-05-27T12:32:51.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.764+0000 7f260e107640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f26000eacf0 0x7f260004fa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:51.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.764+0000 7f260e107640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f260004ffc0 0x7f2600037bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:51.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.764+0000 7f260e107640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2600038100 0x7f2600038590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:51.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.764+0000 7f260e107640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f2600054320 con 0x7f26000eacf0 2024-05-27T12:32:51.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.764+0000 7f260e107640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f2600053710 con 0x7f2600038100 2024-05-27T12:32:51.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.764+0000 7f260e107640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f26000539f0 con 0x7f260004ffc0 2024-05-27T12:32:51.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.764+0000 7f601a7fc640 1 -- 172.21.15.55:0/2069847164 <== mon.1 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 123527165 0 0) 0x7f600c003520 con 0x7f6014053c60 2024-05-27T12:32:51.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.764+0000 7f601a7fc640 1 -- 172.21.15.55:0/2069847164 >> v2:172.21.15.55:3300/0 conn(0x7f6014050190 msgr2=0x7f6014038070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:32:51.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.764+0000 7f601a7fc640 1 --2- 172.21.15.55:0/2069847164 >> v2:172.21.15.55:3300/0 conn(0x7f6014050190 0x7f6014038070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:51.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.764+0000 7f601a7fc640 1 -- 172.21.15.55:0/2069847164 >> v1:172.21.15.55:6789/0 conn(0x7f60140df210 legacy=0x7f601404fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:51.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.764+0000 7f601a7fc640 1 -- 172.21.15.55:0/2069847164 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6014006250 con 0x7f6014053c60 2024-05-27T12:32:51.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.764+0000 7f601a7fc640 1 -- 172.21.15.55:0/2069847164 <== mon.1 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 793017739 0 0) 0x7f601c0635b0 con 0x7f6014053c60 2024-05-27T12:32:51.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.765+0000 7f2607fff640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2600038100 0x7f2600038590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:51.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.765+0000 7f2607fff640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2600038100 0x7f2600038590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.55:49116/0 (socket says 172.21.15.55:49116) 2024-05-27T12:32:51.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.765+0000 7f2607fff640 1 -- 172.21.15.55:0/638334903 learned_addr learned my addr 172.21.15.55:0/638334903 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:32:51.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.765+0000 7f2606ffd640 1 --2- 172.21.15.55:0/638334903 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f260004ffc0 0x7f2600037bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:51.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.765+0000 7f26077fe640 1 --2- 172.21.15.55:0/638334903 >> v2:172.21.15.55:3300/0 conn(0x7f26000eacf0 0x7f260004fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:51.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.764+0000 7f601a7fc640 1 -- 172.21.15.55:0/2069847164 >> v1:172.21.15.72:6789/0 conn(0x7f6014053c60 legacy=0x7f6014006a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:51.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.764+0000 7f601a7fc640 1 --2- 172.21.15.55:0/2069847164 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f600c003b40 0x7f600c003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:51.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.764+0000 7f601a7fc640 1 --2- 172.21.15.55:0/2069847164 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f600c004800 0x7f600c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:51.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.764+0000 7f601a7fc640 1 --2- 172.21.15.55:0/2069847164 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f600c005230 0x7f600c005990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:51.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.764+0000 7f601a7fc640 1 -- 172.21.15.55:0/2069847164 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f6014005f70 con 0x7f600c004800 2024-05-27T12:32:51.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.764+0000 7f601a7fc640 1 -- 172.21.15.55:0/2069847164 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f600c006180 con 0x7f600c003b40 2024-05-27T12:32:51.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.764+0000 7f601a7fc640 1 -- 172.21.15.55:0/2069847164 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f600c006380 con 0x7f600c005230 2024-05-27T12:32:51.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.764+0000 7f601affd640 1 --2- 172.21.15.55:0/2069847164 >> v2:172.21.15.55:3300/0 conn(0x7f6014050190 0x7f6014038070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T12:32:51.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.765+0000 7f601affd640 1 --2- 172.21.15.55:0/2069847164 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f600c004800 0x7f600c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:51.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.765+0000 7f2e53fff640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2e4c053e50 0x7f2e4c0542e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:51.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.765+0000 7f2e53fff640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2e4c053e50 0x7f2e4c0542e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.55:49112/0 (socket says 172.21.15.55:49112) 2024-05-27T12:32:51.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.765+0000 7f2e53fff640 1 -- 172.21.15.55:0/2365099380 learned_addr learned my addr 172.21.15.55:0/2365099380 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:32:51.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.765+0000 7f2e594bd640 1 --2- 172.21.15.55:0/2365099380 >> v2:172.21.15.55:3300/0 conn(0x7f2e4c04f930 0x7f2e4c04fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:51.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.765+0000 7fcaa3691640 1 -- 172.21.15.55:0/3261310685 shutdown_connections 2024-05-27T12:32:51.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.765+0000 7fcaa3691640 1 --2- 172.21.15.55:0/3261310685 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fca94006240 0x7fca940066d0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:51.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.765+0000 7fcaa3691640 1 --2- 172.21.15.55:0/3261310685 >> v2:172.21.15.72:3300/0 conn(0x7fca94058b40 0x7fca940e7b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:51.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.765+0000 7fcaa3691640 1 -- 172.21.15.55:0/3261310685 >> 172.21.15.55:0/3261310685 conn(0x7fca9403aa70 msgr2=0x7fca9403ae50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:51.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.766+0000 7fcaa3691640 1 -- 172.21.15.55:0/3261310685 shutdown_connections 2024-05-27T12:32:51.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.765+0000 7f601bfff640 1 --2- 172.21.15.55:0/2069847164 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f600c005230 0x7f600c005990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:51.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.765+0000 7f601b7fe640 1 --2- 172.21.15.55:0/2069847164 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f600c003b40 0x7f600c003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:51.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.765+0000 7f2e53fff640 1 -- 172.21.15.55:0/2365099380 >> v2:172.21.15.55:3300/0 conn(0x7f2e4c04f930 msgr2=0x7f2e4c04fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:32:51.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.766+0000 7f2e537fe640 1 -- 172.21.15.55:0/2365099380 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2528906989 0 0) 0x7f2e48001110 con 0x7f2e4c048100 2024-05-27T12:32:51.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.766+0000 7f2e53fff640 1 --2- 172.21.15.55:0/2365099380 >> v2:172.21.15.55:3300/0 conn(0x7f2e4c04f930 0x7f2e4c04fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:51.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.766+0000 7f2e53fff640 1 -- 172.21.15.55:0/2365099380 >> v1:172.21.15.55:6789/0 conn(0x7f2e4c048100 legacy=0x7f2e4c006f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:51.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.766+0000 7f5571abc640 1 --2- 172.21.15.55:0/2357035546 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55580039b0 0x7f5558003d90 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f555c009c60 tx=0x7f5558005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a0f6592696fbd6b server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:51.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.766+0000 7f5570aba640 1 -- 172.21.15.55:0/2357035546 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f555c036070 con 0x7f55580039b0 2024-05-27T12:32:51.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.766+0000 7f5570aba640 1 -- 172.21.15.55:0/2357035546 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f555c031400 con 0x7f55580039b0 2024-05-27T12:32:51.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.765+0000 7f446424e640 1 Processor -- start 2024-05-27T12:32:51.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.765+0000 7f2606ffd640 1 -- 172.21.15.55:0/638334903 >> v2:172.21.15.72:3300/0 conn(0x7f2600038100 msgr2=0x7f2600038590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:32:51.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.764+0000 7f4ddd16f640 1 Processor -- start 2024-05-27T12:32:51.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.765+0000 7f4ddd16f640 1 -- start start 2024-05-27T12:32:51.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.766+0000 7f5570aba640 1 -- 172.21.15.55:0/2357035546 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f555c009860 con 0x7f55580039b0 2024-05-27T12:32:51.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.766+0000 7f4ddd16f640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4dd806e690 0x7f4dd806bd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:51.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.766+0000 7f4ddd16f640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4dd806c290 0x7f4dd806eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:51.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.766+0000 7f4ddd16f640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4dd80b4280 con 0x7f4dd806f0c0 2024-05-27T12:32:51.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.766+0000 7f4ddd16f640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f4dd806f510 con 0x7f4dd806c290 2024-05-27T12:32:51.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.766+0000 7f4ddd16f640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f4dd80b5770 con 0x7f4dd806e690 2024-05-27T12:32:51.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.765+0000 7f2606ffd640 1 --2- 172.21.15.55:0/638334903 >> v2:172.21.15.72:3300/0 conn(0x7f2600038100 0x7f2600038590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:51.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.765+0000 7f2606ffd640 1 -- 172.21.15.55:0/638334903 >> v2:172.21.15.55:3300/0 conn(0x7f26000eacf0 msgr2=0x7f260004fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:32:51.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.765+0000 7f2606ffd640 1 --2- 172.21.15.55:0/638334903 >> v2:172.21.15.55:3300/0 conn(0x7f26000eacf0 0x7f260004fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:51.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.765+0000 7f2606ffd640 1 -- 172.21.15.55:0/638334903 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2600053cd0 con 0x7f260004ffc0 2024-05-27T12:32:51.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.765+0000 7f601bfff640 1 -- 172.21.15.55:0/2069847164 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f600c003b40 msgr2=0x7f600c003f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:32:51.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.765+0000 7f601bfff640 1 --2- 172.21.15.55:0/2069847164 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f600c003b40 0x7f600c003f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:51.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.765+0000 7f601bfff640 1 -- 172.21.15.55:0/2069847164 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f600c004800 msgr2=0x7f600c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:32:51.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.765+0000 7f601bfff640 1 --2- 172.21.15.55:0/2069847164 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f600c004800 0x7f600c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:51.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.765+0000 7f601bfff640 1 -- 172.21.15.55:0/2069847164 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6014006250 con 0x7f600c005230 2024-05-27T12:32:51.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.766+0000 7f601affd640 1 --2- 172.21.15.55:0/2069847164 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f600c004800 0x7f600c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T12:32:51.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.766+0000 7f601bfff640 1 -- 172.21.15.55:0/2069847164 reap_dead start 2024-05-27T12:32:51.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.766+0000 7f4dd6d9d640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4dd806e690 0x7f4dd806bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:51.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.766+0000 7f4dd659c640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4dd806c290 0x7f4dd806eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:51.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.766+0000 7f4dd6d9d640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4dd806e690 0x7f4dd806bd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.55:45996/0 (socket says 172.21.15.55:45996) 2024-05-27T12:32:51.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.766+0000 7f4dd6d9d640 1 -- 172.21.15.55:0/2778414927 learned_addr learned my addr 172.21.15.55:0/2778414927 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:32:51.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.766+0000 7f601bfff640 1 --2- 172.21.15.55:0/2069847164 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f600c005230 0x7f600c005990 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f601c0690b0 tx=0x7f600c005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=84382f46f87152b1 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:51.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.766+0000 7fcaa3691640 1 -- 172.21.15.55:0/3261310685 wait complete. 2024-05-27T12:32:51.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.767+0000 7f2606ffd640 1 --2- 172.21.15.55:0/638334903 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f260004ffc0 0x7f2600037bc0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f260000bcf0 tx=0x7f25f402a130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=56463aaee05979d server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:51.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.765+0000 7f446424e640 1 -- start start 2024-05-27T12:32:51.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.767+0000 7f601a7fc640 1 -- 172.21.15.55:0/2069847164 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f600800a640 con 0x7f600c005230 2024-05-27T12:32:51.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.766+0000 7f2e53fff640 1 -- 172.21.15.55:0/2365099380 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e4c005f10 con 0x7f2e4c053e50 2024-05-27T12:32:51.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.766+0000 7f2e594bd640 1 --2- 172.21.15.55:0/2365099380 >> v2:172.21.15.55:3300/0 conn(0x7f2e4c04f930 0x7f2e4c04fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T12:32:51.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.767+0000 7f4dd6d9d640 1 -- 172.21.15.55:0/2778414927 >> v2:172.21.15.72:3300/0 conn(0x7f4dd806c290 msgr2=0x7f4dd806eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:32:51.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.767+0000 7f4dd6d9d640 1 --2- 172.21.15.55:0/2778414927 >> v2:172.21.15.72:3300/0 conn(0x7f4dd806c290 0x7f4dd806eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:51.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.767+0000 7f4dd6d9d640 1 -- 172.21.15.55:0/2778414927 >> v1:172.21.15.72:6789/0 conn(0x7f4dd806f0c0 legacy=0x7f4dd8071e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:51.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.767+0000 7f446424e640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f445c151910 0x7f445c15ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:51.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.767+0000 7f601a7fc640 1 -- 172.21.15.55:0/2069847164 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f601c0b0450 con 0x7f600c005230 2024-05-27T12:32:51.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.767+0000 7f446424e640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f445c15b840 con 0x7f445c0b4fb0 2024-05-27T12:32:51.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.767+0000 7f446424e640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f445c15bb20 con 0x7f445c071e60 2024-05-27T12:32:51.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.767+0000 7f446424e640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f445c15e980 con 0x7f445c151910 2024-05-27T12:32:51.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.767+0000 7f4461fea640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f445c151910 0x7f445c15ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:51.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.767+0000 7f4461fea640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f445c151910 0x7f445c15ee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.55:46004/0 (socket says 172.21.15.55:46004) 2024-05-27T12:32:51.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.767+0000 7f4461fea640 1 -- 172.21.15.55:0/441229749 learned_addr learned my addr 172.21.15.55:0/441229749 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:32:51.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.767+0000 7f601a7fc640 1 -- 172.21.15.55:0/2069847164 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f600800a640 con 0x7f600c005230 2024-05-27T12:32:51.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.767+0000 7f5572abe640 1 -- 172.21.15.55:0/2357035546 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55580039b0 msgr2=0x7f5558003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:51.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.767+0000 7f5572abe640 1 --2- 172.21.15.55:0/2357035546 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55580039b0 0x7f5558003d90 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f555c009c60 tx=0x7f5558005830 comp rx=0 tx=0).stop 2024-05-27T12:32:51.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.767+0000 7f55722bd640 1 -- 172.21.15.55:0/2357035546 reap_dead start 2024-05-27T12:32:51.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.767+0000 7f4dd6d9d640 1 -- 172.21.15.55:0/2778414927 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4dd816ba80 con 0x7f4dd806e690 2024-05-27T12:32:51.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.767+0000 7f5572abe640 1 -- 172.21.15.55:0/2357035546 shutdown_connections 2024-05-27T12:32:51.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.768+0000 7f5572abe640 1 -- 172.21.15.55:0/2357035546 >> 172.21.15.55:0/2357035546 conn(0x7f5564009fb0 msgr2=0x7f556400a3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:51.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.768+0000 7f4461fea640 1 -- 172.21.15.55:0/441229749 >> v1:172.21.15.72:6789/0 conn(0x7f445c071e60 legacy=0x7f445c0b3540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:51.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.768+0000 7f26067fc640 1 -- 172.21.15.55:0/638334903 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25f4037070 con 0x7f260004ffc0 2024-05-27T12:32:51.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.768+0000 7f4460fe8640 1 -- 172.21.15.55:0/441229749 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1724779233 0 0) 0x7f445c15b840 con 0x7f445c0b4fb0 2024-05-27T12:32:51.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.768+0000 7f4461fea640 1 -- 172.21.15.55:0/441229749 >> v1:172.21.15.55:6789/0 conn(0x7f445c0b4fb0 legacy=0x7f445c15af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:51.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.768+0000 7f4461fea640 1 -- 172.21.15.55:0/441229749 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f445c15e610 con 0x7f445c151910 2024-05-27T12:32:51.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.768+0000 7fcaa3691640 1 Processor -- start 2024-05-27T12:32:51.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.768+0000 7f26067fc640 1 -- 172.21.15.55:0/638334903 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25f4032440 con 0x7f260004ffc0 2024-05-27T12:32:51.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.768+0000 7fcaa3691640 1 -- start start 2024-05-27T12:32:51.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.768+0000 7f26067fc640 1 -- 172.21.15.55:0/638334903 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25f40327f0 con 0x7f260004ffc0 2024-05-27T12:32:51.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.768+0000 7f5572abe640 1 -- 172.21.15.55:0/2357035546 shutdown_connections 2024-05-27T12:32:51.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.768+0000 7f4dd6d9d640 1 --2- 172.21.15.55:0/2778414927 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4dd806e690 0x7f4dd806bd50 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f4dc800bb00 tx=0x7f4dc802a950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c5a2138910dc1bd0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:51.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.768+0000 7f602208a640 1 -- 172.21.15.55:0/2069847164 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f600c005230 msgr2=0x7f600c005990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:51.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.768+0000 7f602208a640 1 --2- 172.21.15.55:0/2069847164 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f600c005230 0x7f600c005990 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f601c0690b0 tx=0x7f600c005830 comp rx=0 tx=0).stop 2024-05-27T12:32:51.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.768+0000 7f2e53fff640 1 --2- 172.21.15.55:0/2365099380 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e4c053e50 0x7f2e4c0542e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2e4c052e70 tx=0x7f2e4002a300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6b5d327939c63859 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:51.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.768+0000 7f2e537fe640 1 -- 172.21.15.55:0/2365099380 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e40037070 con 0x7f2e4c053e50 2024-05-27T12:32:51.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.768+0000 7f2e537fe640 1 -- 172.21.15.55:0/2365099380 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e4002ae50 con 0x7f2e4c053e50 2024-05-27T12:32:51.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.768+0000 7f2e537fe640 1 -- 172.21.15.55:0/2365099380 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e40032860 con 0x7f2e4c053e50 2024-05-27T12:32:51.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.768+0000 7f4dd5d9b640 1 -- 172.21.15.55:0/2778414927 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dc800a570 con 0x7f4dd806e690 2024-05-27T12:32:51.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.769+0000 7f602208a640 1 -- 172.21.15.55:0/2069847164 shutdown_connections 2024-05-27T12:32:51.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.769+0000 7f602208a640 1 --2- 172.21.15.55:0/2069847164 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f600c005230 0x7f600c005990 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:51.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.769+0000 7f602208a640 1 -- 172.21.15.55:0/2069847164 >> 172.21.15.55:0/2069847164 conn(0x7f6014009fa0 msgr2=0x7f601400a380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:51.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.769+0000 7f4dd5d9b640 1 -- 172.21.15.55:0/2778414927 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4dc800a710 con 0x7f4dd806e690 2024-05-27T12:32:51.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.769+0000 7f260e107640 1 -- 172.21.15.55:0/638334903 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f260004ffc0 msgr2=0x7f2600037bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:51.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.769+0000 7f260e107640 1 --2- 172.21.15.55:0/638334903 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f260004ffc0 0x7f2600037bc0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f260000bcf0 tx=0x7f25f402a130 comp rx=0 tx=0).stop 2024-05-27T12:32:51.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.768+0000 7f5572abe640 1 -- 172.21.15.55:0/2357035546 wait complete. 2024-05-27T12:32:51.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.769+0000 7f260e107640 1 -- 172.21.15.55:0/638334903 shutdown_connections 2024-05-27T12:32:51.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.769+0000 7f260e107640 1 --2- 172.21.15.55:0/638334903 >> v2:172.21.15.72:3300/0 conn(0x7f2600038100 0x7f2600038590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:51.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.769+0000 7f260e107640 1 --2- 172.21.15.55:0/638334903 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f260004ffc0 0x7f2600037bc0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:51.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.769+0000 7f260e107640 1 --2- 172.21.15.55:0/638334903 >> v2:172.21.15.55:3300/0 conn(0x7f26000eacf0 0x7f260004fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:51.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.769+0000 7f260e107640 1 -- 172.21.15.55:0/638334903 >> 172.21.15.55:0/638334903 conn(0x7f2600009fa0 msgr2=0x7f260000a380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:51.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.769+0000 7f2e5af20640 1 -- 172.21.15.55:0/2365099380 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e4c053e50 msgr2=0x7f2e4c0542e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:51.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.769+0000 7f2e5af20640 1 --2- 172.21.15.55:0/2365099380 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e4c053e50 0x7f2e4c0542e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2e4c052e70 tx=0x7f2e4002a300 comp rx=0 tx=0).stop 2024-05-27T12:32:51.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.769+0000 7f4461fea640 1 --2- 172.21.15.55:0/441229749 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f445c151910 0x7f445c15ee10 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f445800de80 tx=0x7f445802e710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=da92f833e381cbb9 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:51.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.769+0000 7faa86144640 1 Processor -- start 2024-05-27T12:32:51.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.769+0000 7faa86144640 1 -- start start 2024-05-27T12:32:51.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.769+0000 7f4dd5d9b640 1 -- 172.21.15.55:0/2778414927 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dc800ab00 con 0x7f4dd806e690 2024-05-27T12:32:51.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.769+0000 7fcaa3691640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca94006240 0x7fca940d5570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:51.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.769+0000 7f260e107640 1 -- 172.21.15.55:0/638334903 shutdown_connections 2024-05-27T12:32:51.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.769+0000 7f602208a640 1 -- 172.21.15.55:0/2069847164 shutdown_connections 2024-05-27T12:32:51.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.769+0000 7f2e5af20640 1 -- 172.21.15.55:0/2365099380 shutdown_connections 2024-05-27T12:32:51.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.769+0000 7f2e5af20640 1 --2- 172.21.15.55:0/2365099380 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e4c053e50 0x7f2e4c0542e0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:51.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.769+0000 7f2e5af20640 1 --2- 172.21.15.55:0/2365099380 >> v2:172.21.15.55:3300/0 conn(0x7f2e4c04f930 0x7f2e4c04fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:51.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.769+0000 7f2e5af20640 1 -- 172.21.15.55:0/2365099380 >> 172.21.15.55:0/2365099380 conn(0x7f2e4c009fe0 msgr2=0x7f2e4c00a3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:51.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.769+0000 7f602208a640 1 -- 172.21.15.55:0/2069847164 wait complete. 2024-05-27T12:32:51.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.769+0000 7f4460fe8640 1 -- 172.21.15.55:0/441229749 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f445803a070 con 0x7f445c151910 2024-05-27T12:32:51.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.769+0000 7f4460fe8640 1 -- 172.21.15.55:0/441229749 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4458035600 con 0x7f445c151910 2024-05-27T12:32:51.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.769+0000 7f4460fe8640 1 -- 172.21.15.55:0/441229749 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44580359d0 con 0x7f445c151910 2024-05-27T12:32:51.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.769+0000 7fcaa3691640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fca940535d0 0x7fca9417d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:51.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.770+0000 7fcaa142d640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca94006240 0x7fca940d5570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:51.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.770+0000 7fcaa142d640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca94006240 0x7fca940d5570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.55:49134/0 (socket says 172.21.15.55:49134) 2024-05-27T12:32:51.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.770+0000 7fcaa142d640 1 -- 172.21.15.55:0/4069713935 learned_addr learned my addr 172.21.15.55:0/4069713935 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:32:51.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.770+0000 7f4ddd16f640 1 -- 172.21.15.55:0/2778414927 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4dd806e690 msgr2=0x7f4dd806bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:51.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.770+0000 7f4ddd16f640 1 --2- 172.21.15.55:0/2778414927 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4dd806e690 0x7f4dd806bd50 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f4dc800bb00 tx=0x7f4dc802a950 comp rx=0 tx=0).stop 2024-05-27T12:32:51.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.770+0000 7fcaa3691640 1 --2- 172.21.15.55:0/4069713935 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca94058b40 0x7fca9404f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:51.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.770+0000 7f4ddd16f640 1 -- 172.21.15.55:0/2778414927 shutdown_connections 2024-05-27T12:32:51.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.770+0000 7f4ddd16f640 1 --2- 172.21.15.55:0/2778414927 >> v2:172.21.15.72:3300/0 conn(0x7f4dd806c290 0x7f4dd806eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:51.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.770+0000 7f4ddd16f640 1 --2- 172.21.15.55:0/2778414927 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4dd806e690 0x7f4dd806bd50 secure :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f4dc800bb00 tx=0x7f4dc802a950 comp rx=0 tx=0).stop 2024-05-27T12:32:51.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.770+0000 7f4ddd16f640 1 -- 172.21.15.55:0/2778414927 >> 172.21.15.55:0/2778414927 conn(0x7f4dd80b2660 msgr2=0x7f4dd80b2a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:51.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.770+0000 7fcaa3691640 1 -- 172.21.15.55:0/4069713935 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7fca94057fb0 con 0x7fca94058b40 2024-05-27T12:32:51.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.770+0000 7f4ddd16f640 1 -- 172.21.15.55:0/2778414927 shutdown_connections 2024-05-27T12:32:51.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.770+0000 7f4ddd16f640 1 -- 172.21.15.55:0/2778414927 wait complete. 2024-05-27T12:32:51.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.769+0000 7f260e107640 1 -- 172.21.15.55:0/638334903 wait complete. 2024-05-27T12:32:51.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.770+0000 7fcaa1c2e640 1 --2- 172.21.15.55:0/4069713935 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca94058b40 0x7fca9404f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:51.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.770+0000 7fcaa3691640 1 -- 172.21.15.55:0/4069713935 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fca940e1fd0 con 0x7fca94006240 2024-05-27T12:32:51.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.770+0000 7fcaa3691640 1 -- 172.21.15.55:0/4069713935 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fca94056b50 con 0x7fca940535d0 2024-05-27T12:32:51.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.770+0000 7f5572abe640 1 Processor -- start 2024-05-27T12:32:51.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.770+0000 7faa86144640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7faa800d5290 0x7faa800d3050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:51.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.770+0000 7faa86144640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7faa80163ce0 0x7faa800d1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:51.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.770+0000 7faa7f7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7faa800d5290 0x7faa800d3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:51.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.770+0000 7faa86144640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa80164530 con 0x7faa800d1710 2024-05-27T12:32:51.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.770+0000 7faa86144640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7faa800d5670 con 0x7faa800d5290 2024-05-27T12:32:51.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.770+0000 7faa86144640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7faa80164250 con 0x7faa80163ce0 2024-05-27T12:32:51.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.770+0000 7faa7ffff640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7faa80163ce0 0x7faa800d1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:51.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.770+0000 7faa7f7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7faa800d5290 0x7faa800d3050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55542/0 (socket says 172.21.15.55:55542) 2024-05-27T12:32:51.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.770+0000 7faa7f7fe640 1 -- 172.21.15.55:0/1695934645 learned_addr learned my addr 172.21.15.55:0/1695934645 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:32:51.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.770+0000 7f446424e640 1 -- 172.21.15.55:0/441229749 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f445c151910 msgr2=0x7f445c15ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:51.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.770+0000 7f446424e640 1 --2- 172.21.15.55:0/441229749 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f445c151910 0x7f445c15ee10 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f445800de80 tx=0x7f445802e710 comp rx=0 tx=0).stop 2024-05-27T12:32:51.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.771+0000 7fcaa0c2c640 1 --2- 172.21.15.55:0/4069713935 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fca940535d0 0x7fca9417d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:51.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.770+0000 7f446424e640 1 -- 172.21.15.55:0/441229749 shutdown_connections 2024-05-27T12:32:51.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.770+0000 7f446424e640 1 --2- 172.21.15.55:0/441229749 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f445c151910 0x7f445c15ee10 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:51.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.770+0000 7f446424e640 1 -- 172.21.15.55:0/441229749 >> 172.21.15.55:0/441229749 conn(0x7f445c0b2660 msgr2=0x7f445c0b2a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:51.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.771+0000 7fcaa142d640 1 -- 172.21.15.55:0/4069713935 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fca940535d0 msgr2=0x7fca9417d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:51.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.771+0000 7f446424e640 1 -- 172.21.15.55:0/441229749 shutdown_connections 2024-05-27T12:32:51.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.771+0000 7fcaa142d640 1 --2- 172.21.15.55:0/4069713935 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fca940535d0 0x7fca9417d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:51.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.771+0000 7fcaa142d640 1 -- 172.21.15.55:0/4069713935 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca94058b40 msgr2=0x7fca9404f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:51.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.771+0000 7fcaa142d640 1 --2- 172.21.15.55:0/4069713935 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca94058b40 0x7fca9404f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:51.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.771+0000 7fcaa142d640 1 -- 172.21.15.55:0/4069713935 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca940d5ab0 con 0x7fca94006240 2024-05-27T12:32:51.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.771+0000 7fcaa0c2c640 1 --2- 172.21.15.55:0/4069713935 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fca940535d0 0x7fca9417d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T12:32:51.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.771+0000 7faa7ffff640 1 -- 172.21.15.55:0/1695934645 >> v2:172.21.15.55:3300/0 conn(0x7faa800d5290 msgr2=0x7faa800d3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:32:51.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.771+0000 7faa7ffff640 1 --2- 172.21.15.55:0/1695934645 >> v2:172.21.15.55:3300/0 conn(0x7faa800d5290 0x7faa800d3050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:51.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.771+0000 7faa7ffff640 1 -- 172.21.15.55:0/1695934645 >> v1:172.21.15.72:6789/0 conn(0x7faa800d1710 legacy=0x7faa801635d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:51.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.771+0000 7faa7ffff640 1 -- 172.21.15.55:0/1695934645 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa800d2570 con 0x7faa80163ce0 2024-05-27T12:32:51.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.771+0000 7fcaa142d640 1 --2- 172.21.15.55:0/4069713935 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca94006240 0x7fca940d5570 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fca9800c500 tx=0x7fca9800c9c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:51.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.770+0000 7f5572abe640 1 -- start start 2024-05-27T12:32:51.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.771+0000 7f5572abe640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f55580039b0 0x7f55640479f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:51.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.771+0000 7f5572abe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5564047f30 0x7f556404dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:51.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.771+0000 7f602208a640 1 Processor -- start 2024-05-27T12:32:51.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.771+0000 7f5572abe640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f556404e2a0 0x7f55640493a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:51.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.771+0000 7f5572abe640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f55640df1f0 con 0x7f5564047f30 2024-05-27T12:32:51.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.771+0000 7f5572abe640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f55640df070 con 0x7f556404e2a0 2024-05-27T12:32:51.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.771+0000 7f5572abe640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f55640df370 con 0x7f55580039b0 2024-05-27T12:32:51.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.772+0000 7f55712bb640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5564047f30 0x7f556404dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:51.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.772+0000 7f260e107640 1 Processor -- start 2024-05-27T12:32:51.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.772+0000 7f55712bb640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5564047f30 0x7f556404dd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55550/0 (socket says 172.21.15.55:55550) 2024-05-27T12:32:51.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.772+0000 7f2e5af20640 1 -- 172.21.15.55:0/2365099380 shutdown_connections 2024-05-27T12:32:51.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.772+0000 7f55712bb640 1 -- 172.21.15.55:0/3541770527 learned_addr learned my addr 172.21.15.55:0/3541770527 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:32:51.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.772+0000 7f602208a640 1 -- start start 2024-05-27T12:32:51.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.772+0000 7faa7ffff640 1 --2- 172.21.15.55:0/1695934645 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faa80163ce0 0x7faa800d1bc0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7faa8015db90 tx=0x7faa6802a080 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9915e9aaf6ea7500 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:51.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.772+0000 7f260e107640 1 -- start start 2024-05-27T12:32:51.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.772+0000 7f2e5af20640 1 -- 172.21.15.55:0/2365099380 wait complete. 2024-05-27T12:32:51.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.772+0000 7f55712bb640 1 -- 172.21.15.55:0/3541770527 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f55580039b0 msgr2=0x7f55640479f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-27T12:32:51.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.772+0000 7f55712bb640 1 --2- 172.21.15.55:0/3541770527 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f55580039b0 0x7f55640479f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:51.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.772+0000 7f55712bb640 1 -- 172.21.15.55:0/3541770527 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f556404e2a0 msgr2=0x7f55640493a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:51.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.772+0000 7f4ddd16f640 1 Processor -- start 2024-05-27T12:32:51.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.773+0000 7f4ddd16f640 1 -- start start 2024-05-27T12:32:51.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.772+0000 7faa7e7fc640 1 -- 172.21.15.55:0/1695934645 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa68037070 con 0x7faa80163ce0 2024-05-27T12:32:51.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.772+0000 7faa7e7fc640 1 -- 172.21.15.55:0/1695934645 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa6802add0 con 0x7faa80163ce0 2024-05-27T12:32:51.811 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.772+0000 7faa7e7fc640 1 -- 172.21.15.55:0/1695934645 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa68032660 con 0x7faa80163ce0 2024-05-27T12:32:51.811 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.772+0000 7f55722bd640 1 --2- 172.21.15.55:0/3541770527 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f556404e2a0 0x7f55640493a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:51.811 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.772+0000 7f55712bb640 1 --2- 172.21.15.55:0/3541770527 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f556404e2a0 0x7f55640493a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:51.811 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.772+0000 7f55712bb640 1 -- 172.21.15.55:0/3541770527 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55640d3d70 con 0x7f5564047f30 2024-05-27T12:32:51.812 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.771+0000 7f446424e640 1 -- 172.21.15.55:0/441229749 wait complete. 2024-05-27T12:32:51.812 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.773+0000 7f446424e640 1 Processor -- start 2024-05-27T12:32:51.812 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.773+0000 7f55712bb640 1 --2- 172.21.15.55:0/3541770527 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5564047f30 0x7f556404dd60 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f556800c840 tx=0x7f556800cd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:51.812 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.773+0000 7f602208a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f600c005230 0x7f60141744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:51.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.773+0000 7f55627fc640 1 -- 172.21.15.55:0/3541770527 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5568018070 con 0x7f5564047f30 2024-05-27T12:32:51.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.773+0000 7f55627fc640 1 -- 172.21.15.55:0/3541770527 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5568004dd0 con 0x7f5564047f30 2024-05-27T12:32:51.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.773+0000 7f260e107640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2600038100 0x7f26000495d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:51.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.774+0000 7f260e107640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f260004ffc0 0x7f2600049b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:51.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.773+0000 7f55627fc640 1 -- 172.21.15.55:0/3541770527 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55680072d0 con 0x7f5564047f30 2024-05-27T12:32:51.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.774+0000 7f260e107640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f26000eacf0 0x7f26001807a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:51.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.774+0000 7f55722bd640 1 --2- 172.21.15.55:0/3541770527 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f556404e2a0 0x7f55640493a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T12:32:51.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.774+0000 7f5572abe640 1 -- 172.21.15.55:0/3541770527 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5564048650 con 0x7f5564047f30 2024-05-27T12:32:51.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.774+0000 7f4ddd16f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4dd806c290 0x7f4dd808aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:51.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.774+0000 7f2606ffd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f260004ffc0 0x7f2600049b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:51.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.774+0000 7f2606ffd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f260004ffc0 0x7f2600049b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.55:49150/0 (socket says 172.21.15.55:49150) 2024-05-27T12:32:51.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.773+0000 7faa86144640 1 -- 172.21.15.55:0/1695934645 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faa80163ce0 msgr2=0x7faa800d1bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:51.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.774+0000 7f2606ffd640 1 -- 172.21.15.55:0/3303773966 learned_addr learned my addr 172.21.15.55:0/3303773966 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:32:51.816 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.773+0000 7faa86144640 1 --2- 172.21.15.55:0/1695934645 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faa80163ce0 0x7faa800d1bc0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7faa8015db90 tx=0x7faa6802a080 comp rx=0 tx=0).stop 2024-05-27T12:32:51.816 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.773+0000 7faa86144640 1 -- 172.21.15.55:0/1695934645 shutdown_connections 2024-05-27T12:32:51.816 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.773+0000 7faa86144640 1 --2- 172.21.15.55:0/1695934645 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faa80163ce0 0x7faa800d1bc0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:51.816 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.773+0000 7faa86144640 1 --2- 172.21.15.55:0/1695934645 >> v2:172.21.15.55:3300/0 conn(0x7faa800d5290 0x7faa800d3050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:51.816 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.773+0000 7faa86144640 1 -- 172.21.15.55:0/1695934645 >> 172.21.15.55:0/1695934645 conn(0x7faa80067a50 msgr2=0x7faa80067e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:51.816 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.774+0000 7faa86144640 1 -- 172.21.15.55:0/1695934645 shutdown_connections 2024-05-27T12:32:51.816 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.774+0000 7faa86144640 1 -- 172.21.15.55:0/1695934645 wait complete. 2024-05-27T12:32:51.817 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.774+0000 7f4ddd16f640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4dd806f0c0 0x7f4dd8074bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:51.817 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.774+0000 7f4ddd16f640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4dd8075110 0x7f4dd80c6830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:51.817 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.774+0000 7f4ddd16f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f4dd80b4f70 con 0x7f4dd806c290 2024-05-27T12:32:51.817 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.774+0000 7f4ddd16f640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f4dd80b4c90 con 0x7f4dd8075110 2024-05-27T12:32:51.817 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.774+0000 7f4dd6d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4dd806c290 0x7f4dd808aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:51.817 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.774+0000 7f4ddd16f640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f4dd80b5250 con 0x7f4dd806f0c0 2024-05-27T12:32:51.817 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.774+0000 7f4dd6d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4dd806c290 0x7f4dd808aa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55556/0 (socket says 172.21.15.55:55556) 2024-05-27T12:32:51.817 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.774+0000 7f4dd6d9d640 1 -- 172.21.15.55:0/1183846541 learned_addr learned my addr 172.21.15.55:0/1183846541 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:32:51.817 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.774+0000 7f2e5af20640 1 Processor -- start 2024-05-27T12:32:51.818 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.774+0000 7f2607fff640 1 --2- 172.21.15.55:0/3303773966 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f26000eacf0 0x7f26001807a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:51.818 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.774+0000 7f4dd6d9d640 1 -- 172.21.15.55:0/1183846541 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4dd806f0c0 msgr2=0x7f4dd8074bd0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-27T12:32:51.818 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.774+0000 7f4dd6d9d640 1 --2- 172.21.15.55:0/1183846541 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4dd806f0c0 0x7f4dd8074bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:51.818 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.774+0000 7f4dd6d9d640 1 -- 172.21.15.55:0/1183846541 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4dd8075110 msgr2=0x7f4dd80c6830 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-27T12:32:51.818 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.774+0000 7f4dd6d9d640 1 --2- 172.21.15.55:0/1183846541 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4dd8075110 0x7f4dd80c6830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:51.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.774+0000 7f2e5af20640 1 -- start start 2024-05-27T12:32:51.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.774+0000 7f4dd6d9d640 1 -- 172.21.15.55:0/1183846541 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4dd808afd0 con 0x7f4dd806c290 2024-05-27T12:32:51.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.774+0000 7f260e107640 1 -- 172.21.15.55:0/3303773966 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f2600054930 con 0x7f2600038100 2024-05-27T12:32:51.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.774+0000 7f260e107640 1 -- 172.21.15.55:0/3303773966 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f26000547b0 con 0x7f260004ffc0 2024-05-27T12:32:51.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.773+0000 7f446424e640 1 -- start start 2024-05-27T12:32:51.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.775+0000 7f446424e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f445c071e60 0x7f445c205330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:51.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.775+0000 7f260e107640 1 -- 172.21.15.55:0/3303773966 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f260004f540 con 0x7f26000eacf0 2024-05-27T12:32:51.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.775+0000 7f4dd6d9d640 1 --2- 172.21.15.55:0/1183846541 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4dd806c290 0x7f4dd808aa90 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f4dc802aec0 tx=0x7f4dc80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:51.821 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.775+0000 7f446424e640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f445c0b4fb0 0x7f445c1fe710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:51.821 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.775+0000 7f446424e640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f445c151910 0x7f445c15c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:51.821 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.775+0000 7f446424e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f445c15f350 con 0x7f445c071e60 2024-05-27T12:32:51.821 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.775+0000 7f446424e640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f445c0d02d0 con 0x7f445c151910 2024-05-27T12:32:51.821 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.775+0000 7f446424e640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f445c151cf0 con 0x7f445c0b4fb0 2024-05-27T12:32:51.821 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.775+0000 7f26077fe640 1 --2- 172.21.15.55:0/3303773966 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2600038100 0x7f26000495d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:51.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.775+0000 7fca91ffb640 1 -- 172.21.15.55:0/4069713935 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca98017070 con 0x7fca94006240 2024-05-27T12:32:51.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.775+0000 7f4461fea640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f445c071e60 0x7f445c205330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:51.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.775+0000 7f4461fea640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f445c071e60 0x7f445c205330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55562/0 (socket says 172.21.15.55:55562) 2024-05-27T12:32:51.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.775+0000 7f4461fea640 1 -- 172.21.15.55:0/212870228 learned_addr learned my addr 172.21.15.55:0/212870228 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:32:51.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.775+0000 7f4dbf7fe640 1 -- 172.21.15.55:0/1183846541 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dc8041020 con 0x7f4dd806c290 2024-05-27T12:32:51.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.775+0000 7f4dbf7fe640 1 -- 172.21.15.55:0/1183846541 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4dc8004460 con 0x7f4dd806c290 2024-05-27T12:32:51.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.775+0000 7fcaa3691640 1 -- 172.21.15.55:0/4069713935 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca94051390 con 0x7fca94006240 2024-05-27T12:32:51.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.775+0000 7f4dbf7fe640 1 -- 172.21.15.55:0/1183846541 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dc800a570 con 0x7f4dd806c290 2024-05-27T12:32:51.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.775+0000 7f4ddd16f640 1 -- 172.21.15.55:0/1183846541 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4dd80c54b0 con 0x7f4dd806c290 2024-05-27T12:32:51.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.775+0000 7f2607fff640 1 -- 172.21.15.55:0/3303773966 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f260004ffc0 msgr2=0x7f2600049b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:51.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.775+0000 7faa86144640 1 Processor -- start 2024-05-27T12:32:51.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.775+0000 7f4ddd16f640 1 -- 172.21.15.55:0/1183846541 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4dd80c5a70 con 0x7f4dd806c290 2024-05-27T12:32:51.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.776+0000 7fcaa3691640 1 -- 172.21.15.55:0/4069713935 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca94051950 con 0x7fca94006240 2024-05-27T12:32:51.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.776+0000 7f4461fea640 1 -- 172.21.15.55:0/212870228 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f445c0b4fb0 msgr2=0x7f445c1fe710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:51.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.776+0000 7f44617e9640 1 --2- 172.21.15.55:0/212870228 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f445c0b4fb0 0x7f445c1fe710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:51.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.776+0000 7faa86144640 1 -- start start 2024-05-27T12:32:51.826 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.776+0000 7f4461fea640 1 --2- 172.21.15.55:0/212870228 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f445c0b4fb0 0x7f445c1fe710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:51.826 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.776+0000 7f4461fea640 1 -- 172.21.15.55:0/212870228 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f445c151910 msgr2=0x7f445c15c750 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-27T12:32:51.826 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.776+0000 7f4461fea640 1 --2- 172.21.15.55:0/212870228 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f445c151910 0x7f445c15c750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:51.826 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.776+0000 7f4461fea640 1 -- 172.21.15.55:0/212870228 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f445c205870 con 0x7f445c071e60 2024-05-27T12:32:51.826 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.776+0000 7f44617e9640 1 --2- 172.21.15.55:0/212870228 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f445c0b4fb0 0x7f445c1fe710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T12:32:51.826 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.776+0000 7f2607fff640 1 --2- 172.21.15.55:0/3303773966 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f260004ffc0 0x7f2600049b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:51.826 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.775+0000 7f602208a640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f60140d60a0 0x7f601404bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:51.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.776+0000 7f2607fff640 1 -- 172.21.15.55:0/3303773966 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2600038100 msgr2=0x7f26000495d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:51.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.776+0000 7f2607fff640 1 --2- 172.21.15.55:0/3303773966 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2600038100 0x7f26000495d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:51.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.776+0000 7f2607fff640 1 -- 172.21.15.55:0/3303773966 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26000d6bc0 con 0x7f26000eacf0 2024-05-27T12:32:51.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.775+0000 7f601b7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f600c005230 0x7f60141744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:51.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.776+0000 7f2606ffd640 1 --2- 172.21.15.55:0/3303773966 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f260004ffc0 0x7f2600049b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T12:32:51.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.776+0000 7f2607fff640 1 --2- 172.21.15.55:0/3303773966 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f26000eacf0 0x7f26001807a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f25fc00e610 tx=0x7f25fc00ead0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:51.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.775+0000 7f602208a640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f60140da330 0x7f60140da7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:51.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.775+0000 7f601b7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f600c005230 0x7f60141744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55552/0 (socket says 172.21.15.55:55552) 2024-05-27T12:32:51.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.776+0000 7f4461fea640 1 --2- 172.21.15.55:0/212870228 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f445c071e60 0x7f445c205330 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f445800dfa0 tx=0x7f44580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:51.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.776+0000 7f26077fe640 1 --2- 172.21.15.55:0/3303773966 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2600038100 0x7f26000495d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T12:32:51.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.775+0000 7f602208a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f6014037a80 con 0x7f600c005230 2024-05-27T12:32:51.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.775+0000 7f601b7fe640 1 -- 172.21.15.55:0/3369946349 learned_addr learned my addr 172.21.15.55:0/3369946349 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:32:51.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.775+0000 7f602208a640 1 -- 172.21.15.55:0/3369946349 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f6014037900 con 0x7f60140da330 2024-05-27T12:32:51.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.775+0000 7f602208a640 1 -- 172.21.15.55:0/3369946349 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f60140df5f0 con 0x7f60140d60a0 2024-05-27T12:32:51.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.775+0000 7f601b7fe640 1 -- 172.21.15.55:0/3369946349 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f60140d60a0 msgr2=0x7f601404bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:51.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.775+0000 7f601b7fe640 1 --2- 172.21.15.55:0/3369946349 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f60140d60a0 0x7f601404bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:51.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.775+0000 7f601b7fe640 1 -- 172.21.15.55:0/3369946349 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f60140da330 msgr2=0x7f60140da7e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-27T12:32:51.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.775+0000 7f601b7fe640 1 --2- 172.21.15.55:0/3369946349 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f60140da330 0x7f60140da7e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:51.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.775+0000 7f601b7fe640 1 -- 172.21.15.55:0/3369946349 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6014174a30 con 0x7f600c005230 2024-05-27T12:32:51.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.775+0000 7f601b7fe640 1 --2- 172.21.15.55:0/3369946349 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f600c005230 0x7f60141744f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f6010007960 tx=0x7f60100017c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:51.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.776+0000 7f2e5af20640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e4c048100 0x7f2e4c0dd4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:51.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.776+0000 7f25f3fff640 1 -- 172.21.15.55:0/3303773966 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25fc017070 con 0x7f26000eacf0 2024-05-27T12:32:51.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.776+0000 7f2e5af20640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2e4c04f930 0x7f2e4c17e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:51.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.776+0000 7f25f3fff640 1 -- 172.21.15.55:0/3303773966 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25fc013680 con 0x7f26000eacf0 2024-05-27T12:32:51.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.776+0000 7f25f3fff640 1 -- 172.21.15.55:0/3303773966 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25fc013a50 con 0x7f26000eacf0 2024-05-27T12:32:51.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.777+0000 7f260e107640 1 -- 172.21.15.55:0/3303773966 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26000d6ea0 con 0x7f26000eacf0 2024-05-27T12:32:51.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.777+0000 7f2e5af20640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e4c053e50 0x7f2e4c0e2790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:51.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.777+0000 7f2e53fff640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2e4c04f930 0x7f2e4c17e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:51.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.777+0000 7f260e107640 1 -- 172.21.15.55:0/3303773966 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f26000d7460 con 0x7f26000eacf0 2024-05-27T12:32:51.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.777+0000 7f2e53fff640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2e4c04f930 0x7f2e4c17e6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.55:46062/0 (socket says 172.21.15.55:46062) 2024-05-27T12:32:51.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.777+0000 7f2e594bd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e4c053e50 0x7f2e4c0e2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:51.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.777+0000 7f2e594bd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e4c053e50 0x7f2e4c0e2790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.55:49168/0 (socket says 172.21.15.55:49168) 2024-05-27T12:32:51.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.777+0000 7fca91ffb640 1 -- 172.21.15.55:0/4069713935 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca98005ce0 con 0x7fca94006240 2024-05-27T12:32:51.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.777+0000 7f55627fc640 1 -- 172.21.15.55:0/3541770527 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5568007470 con 0x7f5564047f30 2024-05-27T12:32:51.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.777+0000 7f5572abe640 1 -- 172.21.15.55:0/3541770527 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5564048ba0 con 0x7f5564047f30 2024-05-27T12:32:51.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.777+0000 7faa86144640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faa800d1710 0x7faa800c93f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:51.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.777+0000 7f2e53fff640 1 -- 172.21.15.55:0/3777286461 learned_addr learned my addr 172.21.15.55:0/3777286461 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:32:51.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.777+0000 7faa86144640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faa800d5290 0x7faa800b7490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:51.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.777+0000 7f2e58cbc640 1 --2- 172.21.15.55:0/3777286461 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e4c048100 0x7f2e4c0dd4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:51.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.777+0000 7f2e5af20640 1 -- 172.21.15.55:0/3777286461 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f2e4c006490 con 0x7f2e4c048100 2024-05-27T12:32:51.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.777+0000 7f2e5af20640 1 -- 172.21.15.55:0/3777286461 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f2e4c0061b0 con 0x7f2e4c053e50 2024-05-27T12:32:51.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.777+0000 7f2e5af20640 1 -- 172.21.15.55:0/3777286461 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f2e4c006770 con 0x7f2e4c04f930 2024-05-27T12:32:51.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.778+0000 7f6007fff640 1 -- 172.21.15.55:0/3369946349 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6010019070 con 0x7f600c005230 2024-05-27T12:32:51.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.778+0000 7f602208a640 1 -- 172.21.15.55:0/3369946349 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f601404c0c0 con 0x7f600c005230 2024-05-27T12:32:51.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.777+0000 7fca91ffb640 1 -- 172.21.15.55:0/4069713935 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca980072f0 con 0x7fca94006240 2024-05-27T12:32:51.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.778+0000 7fca91ffb640 1 -- 172.21.15.55:0/4069713935 <== mon.1 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fca9801a070 con 0x7fca94006240 2024-05-27T12:32:51.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.778+0000 7f602208a640 1 -- 172.21.15.55:0/3369946349 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f601404c640 con 0x7f600c005230 2024-05-27T12:32:51.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.778+0000 7f25f1ffb640 1 -- 172.21.15.55:0/3303773966 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25e0005290 con 0x7f26000eacf0 2024-05-27T12:32:51.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.779+0000 7f6007fff640 1 -- 172.21.15.55:0/3369946349 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6010010510 con 0x7f600c005230 2024-05-27T12:32:51.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.778+0000 7f55627fc640 1 --2- 172.21.15.55:0/3541770527 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f555006c8f0 0x7f555006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:51.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.778+0000 7f5571abc640 1 --2- 172.21.15.55:0/3541770527 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f555006c8f0 0x7f555006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:51.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.779+0000 7f55627fc640 1 -- 172.21.15.55:0/3541770527 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f5568089560 con 0x7f5564047f30 2024-05-27T12:32:51.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.779+0000 7fca91ffb640 1 --2- 172.21.15.55:0/4069713935 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fca8006c9f0 0x7fca8006eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:51.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.779+0000 7fca91ffb640 1 -- 172.21.15.55:0/4069713935 <== mon.1 v2:172.21.15.72:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fca9808ae90 con 0x7fca94006240 2024-05-27T12:32:51.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.779+0000 7f6007fff640 1 -- 172.21.15.55:0/3369946349 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60100108c0 con 0x7f600c005230 2024-05-27T12:32:51.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.780+0000 7f5572abe640 1 -- 172.21.15.55:0/3541770527 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5564050f80 con 0x7f5564047f30 2024-05-27T12:32:51.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.780+0000 7fcaa0c2c640 1 --2- 172.21.15.55:0/4069713935 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fca8006c9f0 0x7fca8006eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:51.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.777+0000 7faa86144640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa80163ce0 0x7faa800b79d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:51.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.777+0000 7faa86144640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7faa800d3590 con 0x7faa80163ce0 2024-05-27T12:32:51.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.777+0000 7faa86144640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7faa800d2b30 con 0x7faa800d1710 2024-05-27T12:32:51.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.777+0000 7faa86144640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7faa800d3710 con 0x7faa800d5290 2024-05-27T12:32:51.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.777+0000 7faa7ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa80163ce0 0x7faa800b79d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:51.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.780+0000 7f602208a640 1 -- 172.21.15.55:0/3369946349 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60140052b0 con 0x7f600c005230 2024-05-27T12:32:51.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.778+0000 7faa7ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa80163ce0 0x7faa800b79d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55582/0 (socket says 172.21.15.55:55582) 2024-05-27T12:32:51.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.778+0000 7faa7ffff640 1 -- 172.21.15.55:0/406940860 learned_addr learned my addr 172.21.15.55:0/406940860 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:32:51.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.778+0000 7faa7f7fe640 1 --2- 172.21.15.55:0/406940860 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faa800d1710 0x7faa800c93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:51.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.778+0000 7faa7effd640 1 --2- 172.21.15.55:0/406940860 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faa800d5290 0x7faa800b7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:51.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.778+0000 7faa7ffff640 1 -- 172.21.15.55:0/406940860 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faa800d5290 msgr2=0x7faa800b7490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:51.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.778+0000 7faa7ffff640 1 --2- 172.21.15.55:0/406940860 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faa800d5290 0x7faa800b7490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:51.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.778+0000 7faa7ffff640 1 -- 172.21.15.55:0/406940860 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faa800d1710 msgr2=0x7faa800c93f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:51.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.778+0000 7faa7ffff640 1 --2- 172.21.15.55:0/406940860 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faa800d1710 0x7faa800c93f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:51.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.778+0000 7faa7ffff640 1 -- 172.21.15.55:0/406940860 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa800c9d60 con 0x7faa80163ce0 2024-05-27T12:32:51.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.780+0000 7faa7ffff640 1 --2- 172.21.15.55:0/406940860 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa80163ce0 0x7faa800b79d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7faa68009890 tx=0x7faa680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:51.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.780+0000 7f44527fc640 1 -- 172.21.15.55:0/212870228 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f445803a040 con 0x7f445c071e60 2024-05-27T12:32:51.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.780+0000 7f44527fc640 1 -- 172.21.15.55:0/212870228 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4458035de0 con 0x7f445c071e60 2024-05-27T12:32:51.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.780+0000 7f25f3fff640 1 -- 172.21.15.55:0/3303773966 <== mon.2 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f25fc01a070 con 0x7f26000eacf0 2024-05-27T12:32:51.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.780+0000 7f5571abc640 1 --2- 172.21.15.55:0/3541770527 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f555006c8f0 0x7f555006edb0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f555c033000 tx=0x7f555c008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:51.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.780+0000 7fca877fe640 1 -- 172.21.15.55:0/4069713935 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca7c005290 con 0x7fca94006240 2024-05-27T12:32:51.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.780+0000 7f2e53fff640 1 -- 172.21.15.55:0/3777286461 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e4c053e50 msgr2=0x7f2e4c0e2790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:51.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.780+0000 7f2e53fff640 1 --2- 172.21.15.55:0/3777286461 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e4c053e50 0x7f2e4c0e2790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:51.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.780+0000 7f2e53fff640 1 -- 172.21.15.55:0/3777286461 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e4c048100 msgr2=0x7f2e4c0dd4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:51.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.780+0000 7f2e53fff640 1 --2- 172.21.15.55:0/3777286461 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e4c048100 0x7f2e4c0dd4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:51.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.780+0000 7f2e53fff640 1 -- 172.21.15.55:0/3777286461 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e4c0eab80 con 0x7f2e4c04f930 2024-05-27T12:32:51.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.780+0000 7f4ddd16f640 1 -- 172.21.15.55:0/1183846541 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4db8005290 con 0x7f4dd806c290 2024-05-27T12:32:51.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.780+0000 7f25f3fff640 1 --2- 172.21.15.55:0/3303773966 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f25ec06c8f0 0x7f25ec06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:51.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.780+0000 7f44527fc640 1 -- 172.21.15.55:0/212870228 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4458005bd0 con 0x7f445c071e60 2024-05-27T12:32:51.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.781+0000 7f446424e640 1 -- 172.21.15.55:0/212870228 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f445c2014d0 con 0x7f445c071e60 2024-05-27T12:32:51.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.781+0000 7f446424e640 1 -- 172.21.15.55:0/212870228 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f445c201a90 con 0x7f445c071e60 2024-05-27T12:32:51.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.780+0000 7f2e53fff640 1 --2- 172.21.15.55:0/3777286461 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2e4c04f930 0x7f2e4c17e6b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f2e40009960 tx=0x7f2e400046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:51.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.781+0000 7fcaa0c2c640 1 --2- 172.21.15.55:0/4069713935 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fca8006c9f0 0x7fca8006eeb0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fca9400e600 tx=0x7fca8c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:51.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.781+0000 7f4dbf7fe640 1 -- 172.21.15.55:0/1183846541 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4dc8044020 con 0x7f4dd806c290 2024-05-27T12:32:51.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.780+0000 7f25f3fff640 1 -- 172.21.15.55:0/3303773966 <== mon.2 v2:172.21.15.72:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f25fc08bc10 con 0x7f26000eacf0 2024-05-27T12:32:51.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.781+0000 7f26077fe640 1 --2- 172.21.15.55:0/3303773966 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f25ec06c8f0 0x7f25ec06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:51.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.781+0000 7f6007fff640 1 -- 172.21.15.55:0/3369946349 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f601001c070 con 0x7f600c005230 2024-05-27T12:32:51.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.781+0000 7f26077fe640 1 --2- 172.21.15.55:0/3303773966 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f25ec06c8f0 0x7f25ec06edb0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2608050f50 tx=0x7f260806f040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:51.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.781+0000 7f4dbf7fe640 1 --2- 172.21.15.55:0/1183846541 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f4dc406c9c0 0x7f4dc406ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:51.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.782+0000 7f6007fff640 1 --2- 172.21.15.55:0/3369946349 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f600006c920 0x7f600006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:51.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.782+0000 7f4dbf7fe640 1 -- 172.21.15.55:0/1183846541 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f4dc80acd10 con 0x7f4dd806c290 2024-05-27T12:32:51.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.782+0000 7f4dd659c640 1 --2- 172.21.15.55:0/1183846541 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f4dc406c9c0 0x7f4dc406ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:51.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.782+0000 7f6007fff640 1 -- 172.21.15.55:0/3369946349 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f601008b1a0 con 0x7f600c005230 2024-05-27T12:32:51.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.782+0000 7f601affd640 1 --2- 172.21.15.55:0/3369946349 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f600006c920 0x7f600006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:51.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.782+0000 7f446424e640 1 -- 172.21.15.55:0/212870228 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f445c068a70 con 0x7f445c071e60 2024-05-27T12:32:51.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.782+0000 7f601affd640 1 --2- 172.21.15.55:0/3369946349 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f600006c920 0x7f600006ede0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f60140db0b0 tx=0x7f600800a500 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:51.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.782+0000 7f4dd659c640 1 --2- 172.21.15.55:0/1183846541 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f4dc406c9c0 0x7f4dc406ee80 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4dd81686d0 tx=0x7f4dd0010040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:51.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.785+0000 7f2e517fa640 1 -- 172.21.15.55:0/3777286461 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e40041020 con 0x7f2e4c04f930 2024-05-27T12:32:51.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.785+0000 7f2e517fa640 1 -- 172.21.15.55:0/3777286461 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e4003c930 con 0x7f2e4c04f930 2024-05-27T12:32:51.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.785+0000 7f2e517fa640 1 -- 172.21.15.55:0/3777286461 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e40037040 con 0x7f2e4c04f930 2024-05-27T12:32:51.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.786+0000 7f25f3fff640 1 -- 172.21.15.55:0/3303773966 <== mon.2 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f25fc059950 con 0x7f26000eacf0 2024-05-27T12:32:51.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.785+0000 7f2e5af20640 1 -- 172.21.15.55:0/3777286461 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e4c0ea8a0 con 0x7f2e4c04f930 2024-05-27T12:32:51.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.786+0000 7f2e5af20640 1 -- 172.21.15.55:0/3777286461 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e4c0e8090 con 0x7f2e4c04f930 2024-05-27T12:32:51.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.785+0000 7faa77fff640 1 -- 172.21.15.55:0/406940860 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa68037040 con 0x7faa80163ce0 2024-05-27T12:32:51.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.786+0000 7faa86144640 1 -- 172.21.15.55:0/406940860 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa800ca040 con 0x7faa80163ce0 2024-05-27T12:32:51.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.786+0000 7fca91ffb640 1 -- 172.21.15.55:0/4069713935 <== mon.1 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fca98058dd0 con 0x7fca94006240 2024-05-27T12:32:51.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.786+0000 7f55627fc640 1 -- 172.21.15.55:0/3541770527 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5564050f80 con 0x7f5564047f30 2024-05-27T12:32:51.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.786+0000 7faa86144640 1 -- 172.21.15.55:0/406940860 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa800ca600 con 0x7faa80163ce0 2024-05-27T12:32:51.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.787+0000 7f2e5af20640 1 -- 172.21.15.55:0/3777286461 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e4c0052f0 con 0x7f2e4c04f930 2024-05-27T12:32:51.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.787+0000 7faa86144640 1 -- 172.21.15.55:0/406940860 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa80075460 con 0x7faa80163ce0 2024-05-27T12:32:51.850 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.787+0000 7f2e517fa640 1 -- 172.21.15.55:0/3777286461 <== mon.2 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2e40044020 con 0x7f2e4c04f930 2024-05-27T12:32:51.850 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.788+0000 7f2e517fa640 1 --2- 172.21.15.55:0/3777286461 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f2e3806c8f0 0x7f2e3806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:51.850 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.788+0000 7f2e517fa640 1 -- 172.21.15.55:0/3777286461 <== mon.2 v2:172.21.15.72:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f2e400ac440 con 0x7f2e4c04f930 2024-05-27T12:32:51.850 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.788+0000 7f2e58cbc640 1 --2- 172.21.15.55:0/3777286461 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f2e3806c8f0 0x7f2e3806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:51.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.789+0000 7f2e58cbc640 1 --2- 172.21.15.55:0/3777286461 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f2e3806c8f0 0x7f2e3806edb0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2e480013b0 tx=0x7f2e48009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:51.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.793+0000 7f2e517fa640 1 -- 172.21.15.55:0/3777286461 <== mon.2 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2e4004b030 con 0x7f2e4c04f930 2024-05-27T12:32:51.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.795+0000 7f6007fff640 1 -- 172.21.15.55:0/3369946349 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6014174a30 con 0x7f600c005230 2024-05-27T12:32:51.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.804+0000 7f4dbf7fe640 1 -- 172.21.15.55:0/1183846541 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4dc804b030 con 0x7f4dd806c290 2024-05-27T12:32:51.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.804+0000 7faa77fff640 1 -- 172.21.15.55:0/406940860 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa68042070 con 0x7faa80163ce0 2024-05-27T12:32:51.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.805+0000 7faa77fff640 1 -- 172.21.15.55:0/406940860 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa68047680 con 0x7faa80163ce0 2024-05-27T12:32:51.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.806+0000 7f44527fc640 1 -- 172.21.15.55:0/212870228 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f44580070d0 con 0x7f445c071e60 2024-05-27T12:32:51.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.807+0000 7f44527fc640 1 --2- 172.21.15.55:0/212870228 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f444006c9c0 0x7f444006ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:51.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.807+0000 7f44527fc640 1 -- 172.21.15.55:0/212870228 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f44580aba40 con 0x7f445c071e60 2024-05-27T12:32:51.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.807+0000 7f44617e9640 1 --2- 172.21.15.55:0/212870228 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f444006c9c0 0x7f444006ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:51.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.807+0000 7faa77fff640 1 -- 172.21.15.55:0/406940860 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7faa68047820 con 0x7faa80163ce0 2024-05-27T12:32:51.853 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.808+0000 7faa77fff640 1 --2- 172.21.15.55:0/406940860 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7faa6006c8f0 0x7faa6006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:51.853 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.808+0000 7faa7f7fe640 1 --2- 172.21.15.55:0/406940860 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7faa6006c8f0 0x7faa6006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:51.853 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.808+0000 7f44617e9640 1 --2- 172.21.15.55:0/212870228 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f444006c9c0 0x7f444006ee80 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f445c1543b0 tx=0x7f444c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:51.853 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.809+0000 7faa7f7fe640 1 --2- 172.21.15.55:0/406940860 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7faa6006c8f0 0x7faa6006edb0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7faa78009bd0 tx=0x7faa78009240 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:51.853 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.812+0000 7faa77fff640 1 -- 172.21.15.55:0/406940860 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7faa680789d0 con 0x7faa80163ce0 2024-05-27T12:32:51.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.812+0000 7f44527fc640 1 -- 172.21.15.55:0/212870228 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f445804c070 con 0x7f445c071e60 2024-05-27T12:32:51.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:51.821+0000 7faa77fff640 1 -- 172.21.15.55:0/406940860 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7faa6807a930 con 0x7faa80163ce0 2024-05-27T12:32:52.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:52.210+0000 7f25f1ffb640 1 -- 172.21.15.55:0/3303773966 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f25e0005580 con 0x7f26000eacf0 2024-05-27T12:32:52.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:52.210+0000 7fca877fe640 1 -- 172.21.15.55:0/4069713935 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fca7c005580 con 0x7fca94006240 2024-05-27T12:32:52.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:52.211+0000 7f25f3fff640 1 -- 172.21.15.55:0/3303773966 <== mon.2 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f25fc05dc50 con 0x7f26000eacf0 2024-05-27T12:32:52.210 INFO:teuthology.orchestra.run.smithi055.stdout:64424509446 2024-05-27T12:32:52.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:52.211+0000 7fca91ffb640 1 -- 172.21.15.55:0/4069713935 <== mon.1 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fca9805d0d0 con 0x7fca94006240 2024-05-27T12:32:52.211 INFO:teuthology.orchestra.run.smithi055.stdout:64424509446 2024-05-27T12:32:52.214 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:52.214+0000 7f260e107640 1 -- 172.21.15.55:0/3303773966 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f25ec06c8f0 msgr2=0x7f25ec06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:52.214 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:52.214+0000 7f260e107640 1 --2- 172.21.15.55:0/3303773966 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f25ec06c8f0 0x7f25ec06edb0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2608050f50 tx=0x7f260806f040 comp rx=0 tx=0).stop 2024-05-27T12:32:52.214 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:52.214+0000 7f260e107640 1 -- 172.21.15.55:0/3303773966 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f26000eacf0 msgr2=0x7f26001807a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:52.214 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:52.214+0000 7f260e107640 1 --2- 172.21.15.55:0/3303773966 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f26000eacf0 0x7f26001807a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f25fc00e610 tx=0x7f25fc00ead0 comp rx=0 tx=0).stop 2024-05-27T12:32:52.214 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:52.214+0000 7f260e107640 1 -- 172.21.15.55:0/3303773966 shutdown_connections 2024-05-27T12:32:52.214 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:52.214+0000 7f260e107640 1 --2- 172.21.15.55:0/3303773966 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f26000eacf0 0x7f26001807a0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:52.214 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:52.214+0000 7f260e107640 1 --2- 172.21.15.55:0/3303773966 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f25ec06c8f0 0x7f25ec06edb0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:52.214 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:52.214+0000 7f260e107640 1 --2- 172.21.15.55:0/3303773966 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f260004ffc0 0x7f2600049b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:52.214 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:52.214+0000 7f260e107640 1 --2- 172.21.15.55:0/3303773966 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2600038100 0x7f26000495d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:52.214 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:52.215+0000 7f260e107640 1 -- 172.21.15.55:0/3303773966 >> 172.21.15.55:0/3303773966 conn(0x7f2600009fa0 msgr2=0x7f260004a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:52.215 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:52.215+0000 7fca877fe640 1 -- 172.21.15.55:0/4069713935 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fca8006c9f0 msgr2=0x7fca8006eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:52.215 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:52.215+0000 7fca877fe640 1 --2- 172.21.15.55:0/4069713935 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fca8006c9f0 0x7fca8006eeb0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fca9400e600 tx=0x7fca8c008040 comp rx=0 tx=0).stop 2024-05-27T12:32:52.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:52.215+0000 7fca877fe640 1 -- 172.21.15.55:0/4069713935 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca94006240 msgr2=0x7fca940d5570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:52.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:52.215+0000 7fca877fe640 1 --2- 172.21.15.55:0/4069713935 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca94006240 0x7fca940d5570 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fca9800c500 tx=0x7fca9800c9c0 comp rx=0 tx=0).stop 2024-05-27T12:32:52.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:52.215+0000 7fca877fe640 1 -- 172.21.15.55:0/4069713935 shutdown_connections 2024-05-27T12:32:52.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:52.215+0000 7fca877fe640 1 --2- 172.21.15.55:0/4069713935 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca94058b40 0x7fca9404f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:52.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:52.215+0000 7fca877fe640 1 --2- 172.21.15.55:0/4069713935 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fca940535d0 0x7fca9417d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:52.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:52.215+0000 7fca877fe640 1 --2- 172.21.15.55:0/4069713935 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fca8006c9f0 0x7fca8006eeb0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:52.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:52.215+0000 7fca877fe640 1 --2- 172.21.15.55:0/4069713935 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca94006240 0x7fca940d5570 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:52.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:52.215+0000 7fca877fe640 1 -- 172.21.15.55:0/4069713935 >> 172.21.15.55:0/4069713935 conn(0x7fca9403aa70 msgr2=0x7fca940e8d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:52.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:52.215+0000 7f260e107640 1 -- 172.21.15.55:0/3303773966 shutdown_connections 2024-05-27T12:32:52.217 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:52.215+0000 7fca877fe640 1 -- 172.21.15.55:0/4069713935 shutdown_connections 2024-05-27T12:32:52.217 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:52.215+0000 7fca877fe640 1 -- 172.21.15.55:0/4069713935 wait complete. 2024-05-27T12:32:52.217 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:52.215+0000 7f260e107640 1 -- 172.21.15.55:0/3303773966 wait complete. 2024-05-27T12:32:52.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:52.225+0000 7f5572abe640 1 -- 172.21.15.55:0/3541770527 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f55640052c0 con 0x7f5564047f30 2024-05-27T12:32:52.227 INFO:teuthology.orchestra.run.smithi055.stdout:60129542151 2024-05-27T12:32:52.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:52.225+0000 7f55627fc640 1 -- 172.21.15.55:0/3541770527 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5568059350 con 0x7f5564047f30 2024-05-27T12:32:52.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:52.228+0000 7f2e5af20640 1 -- 172.21.15.55:0/3777286461 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f2e4c052850 con 0x7f2e4c04f930 2024-05-27T12:32:52.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:52.229+0000 7f2e517fa640 1 -- 172.21.15.55:0/3777286461 <== mon.2 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f2e40032e20 con 0x7f2e4c04f930 2024-05-27T12:32:52.228 INFO:teuthology.orchestra.run.smithi055.stdout:64424509446 2024-05-27T12:32:52.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:52.230+0000 7f5572abe640 1 -- 172.21.15.55:0/3541770527 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f555006c8f0 msgr2=0x7f555006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:52.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:52.230+0000 7f5572abe640 1 --2- 172.21.15.55:0/3541770527 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f555006c8f0 0x7f555006edb0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f555c033000 tx=0x7f555c008030 comp rx=0 tx=0).stop 2024-05-27T12:32:52.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:52.230+0000 7f5572abe640 1 -- 172.21.15.55:0/3541770527 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5564047f30 msgr2=0x7f556404dd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:52.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:52.230+0000 7f5572abe640 1 --2- 172.21.15.55:0/3541770527 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5564047f30 0x7f556404dd60 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f556800c840 tx=0x7f556800cd00 comp rx=0 tx=0).stop 2024-05-27T12:32:52.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:52.230+0000 7f5572abe640 1 -- 172.21.15.55:0/3541770527 shutdown_connections 2024-05-27T12:32:52.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:52.230+0000 7f5572abe640 1 --2- 172.21.15.55:0/3541770527 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f555006c8f0 0x7f555006edb0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:52.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:52.230+0000 7f5572abe640 1 --2- 172.21.15.55:0/3541770527 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f556404e2a0 0x7f55640493a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:52.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:52.231+0000 7f5572abe640 1 --2- 172.21.15.55:0/3541770527 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5564047f30 0x7f556404dd60 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:52.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:52.231+0000 7f5572abe640 1 --2- 172.21.15.55:0/3541770527 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f55580039b0 0x7f55640479f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:52.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:52.231+0000 7f5572abe640 1 -- 172.21.15.55:0/3541770527 >> 172.21.15.55:0/3541770527 conn(0x7f5564009fb0 msgr2=0x7f5564038cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:52.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:52.231+0000 7f5572abe640 1 -- 172.21.15.55:0/3541770527 shutdown_connections 2024-05-27T12:32:52.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:52.232+0000 7f5572abe640 1 -- 172.21.15.55:0/3541770527 wait complete. 2024-05-27T12:32:52.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:52.232+0000 7f2e5af20640 1 -- 172.21.15.55:0/3777286461 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f2e3806c8f0 msgr2=0x7f2e3806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:52.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:52.232+0000 7f2e5af20640 1 --2- 172.21.15.55:0/3777286461 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f2e3806c8f0 0x7f2e3806edb0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2e480013b0 tx=0x7f2e48009040 comp rx=0 tx=0).stop 2024-05-27T12:32:52.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:52.232+0000 7f2e5af20640 1 -- 172.21.15.55:0/3777286461 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2e4c04f930 msgr2=0x7f2e4c17e6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:52.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:52.232+0000 7f2e5af20640 1 --2- 172.21.15.55:0/3777286461 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2e4c04f930 0x7f2e4c17e6b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f2e40009960 tx=0x7f2e400046c0 comp rx=0 tx=0).stop 2024-05-27T12:32:52.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:52.232+0000 7f2e5af20640 1 -- 172.21.15.55:0/3777286461 shutdown_connections 2024-05-27T12:32:52.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:52.232+0000 7f2e5af20640 1 --2- 172.21.15.55:0/3777286461 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f2e3806c8f0 0x7f2e3806edb0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:52.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:52.232+0000 7f2e5af20640 1 --2- 172.21.15.55:0/3777286461 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e4c053e50 0x7f2e4c0e2790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:52.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:52.232+0000 7f2e5af20640 1 --2- 172.21.15.55:0/3777286461 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2e4c04f930 0x7f2e4c17e6b0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:52.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:52.232+0000 7f2e5af20640 1 --2- 172.21.15.55:0/3777286461 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e4c048100 0x7f2e4c0dd4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:52.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:52.232+0000 7f2e5af20640 1 -- 172.21.15.55:0/3777286461 >> 172.21.15.55:0/3777286461 conn(0x7f2e4c009fe0 msgr2=0x7f2e4c0e5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:52.234 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:52.233+0000 7f2e5af20640 1 -- 172.21.15.55:0/3777286461 shutdown_connections 2024-05-27T12:32:52.234 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:52.233+0000 7f2e5af20640 1 -- 172.21.15.55:0/3777286461 wait complete. 2024-05-27T12:32:52.235 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.3 2024-05-27T12:32:52.236 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.6 2024-05-27T12:32:52.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:52.233+0000 7f602208a640 1 -- 172.21.15.55:0/3369946349 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f6014052bd0 con 0x7f600c005230 2024-05-27T12:32:52.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:52.234+0000 7f6007fff640 1 -- 172.21.15.55:0/3369946349 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f6010058f70 con 0x7f600c005230 2024-05-27T12:32:52.236 INFO:teuthology.orchestra.run.smithi055.stdout:64424509446 2024-05-27T12:32:52.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:52.235+0000 7f4ddd16f640 1 -- 172.21.15.55:0/1183846541 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f4db8005580 con 0x7f4dd806c290 2024-05-27T12:32:52.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:52.235+0000 7f4dbf7fe640 1 -- 172.21.15.55:0/1183846541 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4dd808afd0 con 0x7f4dd806c290 2024-05-27T12:32:52.237 INFO:teuthology.orchestra.run.smithi055.stdout:64424509446 2024-05-27T12:32:52.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:52.237+0000 7f602208a640 1 -- 172.21.15.55:0/3369946349 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f600006c920 msgr2=0x7f600006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:52.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:52.237+0000 7f602208a640 1 --2- 172.21.15.55:0/3369946349 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f600006c920 0x7f600006ede0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f60140db0b0 tx=0x7f600800a500 comp rx=0 tx=0).stop 2024-05-27T12:32:52.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:52.237+0000 7f602208a640 1 -- 172.21.15.55:0/3369946349 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f600c005230 msgr2=0x7f60141744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:52.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:52.237+0000 7f602208a640 1 --2- 172.21.15.55:0/3369946349 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f600c005230 0x7f60141744f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f6010007960 tx=0x7f60100017c0 comp rx=0 tx=0).stop 2024-05-27T12:32:52.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:52.237+0000 7f602208a640 1 -- 172.21.15.55:0/3369946349 shutdown_connections 2024-05-27T12:32:52.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:52.237+0000 7f602208a640 1 --2- 172.21.15.55:0/3369946349 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f600006c920 0x7f600006ede0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:52.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:52.237+0000 7f602208a640 1 --2- 172.21.15.55:0/3369946349 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f60140da330 0x7f60140da7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:52.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:52.237+0000 7f602208a640 1 --2- 172.21.15.55:0/3369946349 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f60140d60a0 0x7f601404bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:52.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:52.237+0000 7f602208a640 1 --2- 172.21.15.55:0/3369946349 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f600c005230 0x7f60141744f0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:52.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:52.237+0000 7f602208a640 1 -- 172.21.15.55:0/3369946349 >> 172.21.15.55:0/3369946349 conn(0x7f6014009fa0 msgr2=0x7f6014034d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:52.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:52.238+0000 7f602208a640 1 -- 172.21.15.55:0/3369946349 shutdown_connections 2024-05-27T12:32:52.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:52.238+0000 7f602208a640 1 -- 172.21.15.55:0/3369946349 wait complete. 2024-05-27T12:32:52.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:52.238+0000 7f4ddd16f640 1 -- 172.21.15.55:0/1183846541 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f4dc406c9c0 msgr2=0x7f4dc406ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:52.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:52.238+0000 7f4ddd16f640 1 --2- 172.21.15.55:0/1183846541 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f4dc406c9c0 0x7f4dc406ee80 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4dd81686d0 tx=0x7f4dd0010040 comp rx=0 tx=0).stop 2024-05-27T12:32:52.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:52.238+0000 7f4ddd16f640 1 -- 172.21.15.55:0/1183846541 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4dd806c290 msgr2=0x7f4dd808aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:52.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:52.238+0000 7f4ddd16f640 1 --2- 172.21.15.55:0/1183846541 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4dd806c290 0x7f4dd808aa90 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f4dc802aec0 tx=0x7f4dc80046c0 comp rx=0 tx=0).stop 2024-05-27T12:32:52.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:52.239+0000 7f4ddd16f640 1 -- 172.21.15.55:0/1183846541 shutdown_connections 2024-05-27T12:32:52.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:52.239+0000 7f4ddd16f640 1 --2- 172.21.15.55:0/1183846541 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f4dc406c9c0 0x7f4dc406ee80 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:52.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:52.239+0000 7f4ddd16f640 1 --2- 172.21.15.55:0/1183846541 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4dd8075110 0x7f4dd80c6830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:52.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:52.239+0000 7f4ddd16f640 1 --2- 172.21.15.55:0/1183846541 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4dd806f0c0 0x7f4dd8074bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:52.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:52.239+0000 7f4ddd16f640 1 --2- 172.21.15.55:0/1183846541 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4dd806c290 0x7f4dd808aa90 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:52.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:52.239+0000 7f4ddd16f640 1 -- 172.21.15.55:0/1183846541 >> 172.21.15.55:0/1183846541 conn(0x7f4dd80b2660 msgr2=0x7f4dd816dc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:52.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:52.239+0000 7f4ddd16f640 1 -- 172.21.15.55:0/1183846541 shutdown_connections 2024-05-27T12:32:52.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:52.239+0000 7f4ddd16f640 1 -- 172.21.15.55:0/1183846541 wait complete. 2024-05-27T12:32:52.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:52.245+0000 7f446424e640 1 -- 172.21.15.55:0/212870228 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f445c075530 con 0x7f445c071e60 2024-05-27T12:32:52.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:52.246+0000 7f44527fc640 1 -- 172.21.15.55:0/212870228 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f445c205870 con 0x7f445c071e60 2024-05-27T12:32:52.245 INFO:teuthology.orchestra.run.smithi055.stdout:64424509446 2024-05-27T12:32:52.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:52.250+0000 7f446424e640 1 -- 172.21.15.55:0/212870228 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f444006c9c0 msgr2=0x7f444006ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:52.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:52.250+0000 7f446424e640 1 --2- 172.21.15.55:0/212870228 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f444006c9c0 0x7f444006ee80 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f445c1543b0 tx=0x7f444c009040 comp rx=0 tx=0).stop 2024-05-27T12:32:52.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:52.250+0000 7f446424e640 1 -- 172.21.15.55:0/212870228 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f445c071e60 msgr2=0x7f445c205330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:52.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:52.250+0000 7f446424e640 1 --2- 172.21.15.55:0/212870228 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f445c071e60 0x7f445c205330 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f445800dfa0 tx=0x7f44580046c0 comp rx=0 tx=0).stop 2024-05-27T12:32:52.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:52.250+0000 7f446424e640 1 -- 172.21.15.55:0/212870228 shutdown_connections 2024-05-27T12:32:52.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:52.250+0000 7f446424e640 1 --2- 172.21.15.55:0/212870228 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f444006c9c0 0x7f444006ee80 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:52.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:52.250+0000 7f446424e640 1 --2- 172.21.15.55:0/212870228 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f445c151910 0x7f445c15c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:52.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:52.250+0000 7f446424e640 1 --2- 172.21.15.55:0/212870228 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f445c0b4fb0 0x7f445c1fe710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:52.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:52.250+0000 7f446424e640 1 --2- 172.21.15.55:0/212870228 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f445c071e60 0x7f445c205330 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:52.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:52.250+0000 7f446424e640 1 -- 172.21.15.55:0/212870228 >> 172.21.15.55:0/212870228 conn(0x7f445c0b2660 msgr2=0x7f445c0b5460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:52.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:52.250+0000 7f446424e640 1 -- 172.21.15.55:0/212870228 shutdown_connections 2024-05-27T12:32:52.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:52.250+0000 7f446424e640 1 -- 172.21.15.55:0/212870228 wait complete. 2024-05-27T12:32:52.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:52.251+0000 7faa86144640 1 -- 172.21.15.55:0/406940860 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7faa800b3ec0 con 0x7faa80163ce0 2024-05-27T12:32:52.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:52.251+0000 7faa77fff640 1 -- 172.21.15.55:0/406940860 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7faa6807ec30 con 0x7faa80163ce0 2024-05-27T12:32:52.251 INFO:teuthology.orchestra.run.smithi055.stdout:64424509446 2024-05-27T12:32:52.252 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542151 for osd.0 2024-05-27T12:32:52.252 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.1 2024-05-27T12:32:52.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:52.254+0000 7faa86144640 1 -- 172.21.15.55:0/406940860 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7faa6006c8f0 msgr2=0x7faa6006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:52.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:52.254+0000 7faa86144640 1 --2- 172.21.15.55:0/406940860 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7faa6006c8f0 0x7faa6006edb0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7faa78009bd0 tx=0x7faa78009240 comp rx=0 tx=0).stop 2024-05-27T12:32:52.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:52.254+0000 7faa86144640 1 -- 172.21.15.55:0/406940860 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa80163ce0 msgr2=0x7faa800b79d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:52.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:52.254+0000 7faa86144640 1 --2- 172.21.15.55:0/406940860 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa80163ce0 0x7faa800b79d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7faa68009890 tx=0x7faa680046c0 comp rx=0 tx=0).stop 2024-05-27T12:32:52.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:52.255+0000 7faa86144640 1 -- 172.21.15.55:0/406940860 shutdown_connections 2024-05-27T12:32:52.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:52.255+0000 7faa86144640 1 --2- 172.21.15.55:0/406940860 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa80163ce0 0x7faa800b79d0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:52.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:52.255+0000 7faa86144640 1 --2- 172.21.15.55:0/406940860 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faa800d5290 0x7faa800b7490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:52.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:52.255+0000 7faa86144640 1 --2- 172.21.15.55:0/406940860 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7faa6006c8f0 0x7faa6006edb0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:52.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:52.255+0000 7faa86144640 1 --2- 172.21.15.55:0/406940860 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faa800d1710 0x7faa800c93f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:52.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:52.255+0000 7faa86144640 1 -- 172.21.15.55:0/406940860 >> 172.21.15.55:0/406940860 conn(0x7faa80067a50 msgr2=0x7faa80164700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:52.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:52.255+0000 7faa86144640 1 -- 172.21.15.55:0/406940860 shutdown_connections 2024-05-27T12:32:52.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:52.255+0000 7faa86144640 1 -- 172.21.15.55:0/406940860 wait complete. 2024-05-27T12:32:52.258 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.4 2024-05-27T12:32:52.258 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.5 2024-05-27T12:32:52.262 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.7 2024-05-27T12:32:52.265 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.2 2024-05-27T12:32:53.236 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-27T12:32:53.237 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-05-27T12:32:53.253 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-27T12:32:53.253 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-27T12:32:53.259 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-05-27T12:32:53.259 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-05-27T12:32:53.264 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-05-27T12:32:53.266 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-27T12:32:53.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.413+0000 7fd025d76640 1 Processor -- start 2024-05-27T12:32:53.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.413+0000 7f5e2f59e640 1 Processor -- start 2024-05-27T12:32:53.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.413+0000 7fd025d76640 1 -- start start 2024-05-27T12:32:53.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.414+0000 7fd025d76640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd01800b0b0 0x7fd018053f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:53.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.414+0000 7fd025d76640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd018007850 con 0x7fd018007340 2024-05-27T12:32:53.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.413+0000 7f5e2f59e640 1 -- start start 2024-05-27T12:32:53.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.415+0000 7f5e2f59e640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5e280e3040 0x7f5e2803c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:53.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.415+0000 7f5e2f59e640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e28058980 con 0x7f5e280e78d0 2024-05-27T12:32:53.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.415+0000 7f5e2f59e640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e28058c60 con 0x7f5e280e3420 2024-05-27T12:32:53.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.415+0000 7f5e2f59e640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f5e28006860 con 0x7f5e280e3040 2024-05-27T12:32:53.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.414+0000 7fd025d76640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd018007b30 con 0x7fd0180e7760 2024-05-27T12:32:53.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.414+0000 7fd025d76640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fd0180e7b40 con 0x7fd01800b0b0 2024-05-27T12:32:53.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.415+0000 7fd024d74640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fd0180e7760 0x7fd0180489d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.55:51864/0 (socket says 172.21.15.55:51864) 2024-05-27T12:32:53.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.415+0000 7fd024d74640 1 -- 172.21.15.55:0/3865121274 learned_addr learned my addr 172.21.15.55:0/3865121274 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-27T12:32:53.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.415+0000 7f5e2ed9d640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f5e280e78d0 0x7f5e28053d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:36858/0 (socket says 172.21.15.55:36858) 2024-05-27T12:32:53.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.415+0000 7f5e2ed9d640 1 -- 172.21.15.55:0/3394261228 learned_addr learned my addr 172.21.15.55:0/3394261228 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-27T12:32:53.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.415+0000 7fd01ffff640 1 --2- 172.21.15.55:0/3865121274 >> v2:172.21.15.72:3300/0 conn(0x7fd01800b0b0 0x7fd018053f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:53.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.416+0000 7fd01f7fe640 1 -- 172.21.15.55:0/3865121274 <== mon.1 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 135450928 0 0) 0x7fd018007b30 con 0x7fd0180e7760 2024-05-27T12:32:53.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.416+0000 7fd01f7fe640 1 -- 172.21.15.55:0/3865121274 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd008003520 con 0x7fd0180e7760 2024-05-27T12:32:53.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.416+0000 7f5e2e59c640 1 --2- 172.21.15.55:0/3394261228 >> v2:172.21.15.72:3300/0 conn(0x7f5e280e3040 0x7f5e2803c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:53.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.416+0000 7fd01f7fe640 1 -- 172.21.15.55:0/3865121274 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1173126001 0 0) 0x7fd018007850 con 0x7fd018007340 2024-05-27T12:32:53.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.416+0000 7fd01f7fe640 1 -- 172.21.15.55:0/3865121274 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd018007b30 con 0x7fd018007340 2024-05-27T12:32:53.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.416+0000 7fd01ffff640 1 -- 172.21.15.55:0/3865121274 >> v1:172.21.15.72:6789/0 conn(0x7fd0180e7760 legacy=0x7fd0180489d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:53.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.416+0000 7fd01ffff640 1 -- 172.21.15.55:0/3865121274 >> v1:172.21.15.55:6789/0 conn(0x7fd018007340 legacy=0x7fd01804f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:53.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.416+0000 7fd01ffff640 1 -- 172.21.15.55:0/3865121274 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd018053740 con 0x7fd01800b0b0 2024-05-27T12:32:53.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.416+0000 7f5e2d59a640 1 -- 172.21.15.55:0/3394261228 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3043426264 0 0) 0x7f5e28058980 con 0x7f5e280e78d0 2024-05-27T12:32:53.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.417+0000 7f5e2d59a640 1 -- 172.21.15.55:0/3394261228 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5e18003520 con 0x7f5e280e78d0 2024-05-27T12:32:53.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.417+0000 7f5e2d59a640 1 -- 172.21.15.55:0/3394261228 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4109585512 0 0) 0x7f5e18003520 con 0x7f5e280e78d0 2024-05-27T12:32:53.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.417+0000 7f5e2d59a640 1 -- 172.21.15.55:0/3394261228 >> v2:172.21.15.72:3300/0 conn(0x7f5e280e3040 msgr2=0x7f5e2803c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:32:53.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.417+0000 7f5e2d59a640 1 --2- 172.21.15.55:0/3394261228 >> v2:172.21.15.72:3300/0 conn(0x7f5e280e3040 0x7f5e2803c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:53.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.417+0000 7f5e2d59a640 1 -- 172.21.15.55:0/3394261228 >> v1:172.21.15.72:6789/0 conn(0x7f5e280e3420 legacy=0x7f5e28058130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:32:53.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.417+0000 7f5e2d59a640 1 -- 172.21.15.55:0/3394261228 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e28006210 con 0x7f5e280e78d0 2024-05-27T12:32:53.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.417+0000 7f5e2d59a640 1 -- 172.21.15.55:0/3394261228 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 793017739 0 0) 0x7f5e20001670 con 0x7f5e280e78d0 2024-05-27T12:32:53.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.417+0000 7f5e2d59a640 1 -- 172.21.15.55:0/3394261228 >> v1:172.21.15.55:6789/0 conn(0x7f5e280e78d0 legacy=0x7f5e28053d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:53.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.417+0000 7fd01ffff640 1 --2- 172.21.15.55:0/3865121274 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd01800b0b0 0x7fd018053f40 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd0100097a0 tx=0x7fd01002a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e0b6656a4aa24746 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:53.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.417+0000 7f5e2d59a640 1 --2- 172.21.15.55:0/3394261228 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e18003a00 0x7f5e18003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:53.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.418+0000 7f5e2d59a640 1 --2- 172.21.15.55:0/3394261228 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e18004800 0x7f5e18004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:53.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.418+0000 7fd01f7fe640 1 -- 172.21.15.55:0/3865121274 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd010037070 con 0x7fd01800b0b0 2024-05-27T12:32:53.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.418+0000 7f5e2e59c640 1 --2- 172.21.15.55:0/3394261228 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e18003a00 0x7f5e18003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:53.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.418+0000 7fd01f7fe640 1 -- 172.21.15.55:0/3865121274 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd010032440 con 0x7fd01800b0b0 2024-05-27T12:32:53.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.418+0000 7f5e2d59a640 1 --2- 172.21.15.55:0/3394261228 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5e18005290 0x7f5e1800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:53.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.418+0000 7f5e2d59a640 1 -- 172.21.15.55:0/3394261228 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f5e28006860 con 0x7f5e18003a00 2024-05-27T12:32:53.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.418+0000 7f5e2d59a640 1 -- 172.21.15.55:0/3394261228 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f5e1800c1e0 con 0x7f5e18004800 2024-05-27T12:32:53.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.418+0000 7f5e2ed9d640 1 --2- 172.21.15.55:0/3394261228 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5e18005290 0x7f5e1800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:53.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.419+0000 7f5e2d59a640 1 -- 172.21.15.55:0/3394261228 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f5e1800c3e0 con 0x7f5e18005290 2024-05-27T12:32:53.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.419+0000 7fd025d76640 1 -- 172.21.15.55:0/3865121274 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd01800b0b0 msgr2=0x7fd018053f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:53.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.419+0000 7fd025d76640 1 --2- 172.21.15.55:0/3865121274 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd01800b0b0 0x7fd018053f40 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd0100097a0 tx=0x7fd01002a270 comp rx=0 tx=0).stop 2024-05-27T12:32:53.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.419+0000 7f5e2e59c640 1 -- 172.21.15.55:0/3394261228 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5e18005290 msgr2=0x7f5e1800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:32:53.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.419+0000 7f5e2e59c640 1 --2- 172.21.15.55:0/3394261228 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5e18005290 0x7f5e1800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:53.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.419+0000 7f5e2e59c640 1 -- 172.21.15.55:0/3394261228 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e18004800 msgr2=0x7f5e18004c80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-27T12:32:53.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.419+0000 7f5e2e59c640 1 --2- 172.21.15.55:0/3394261228 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e18004800 0x7f5e18004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:53.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.419+0000 7fd025d76640 1 -- 172.21.15.55:0/3865121274 shutdown_connections 2024-05-27T12:32:53.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.419+0000 7fd025d76640 1 --2- 172.21.15.55:0/3865121274 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd01800b0b0 0x7fd018053f40 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:53.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.419+0000 7fd025d76640 1 -- 172.21.15.55:0/3865121274 >> 172.21.15.55:0/3865121274 conn(0x7fd01800a400 msgr2=0x7fd01800a810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:53.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.420+0000 7f5e2e59c640 1 -- 172.21.15.55:0/3394261228 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e18003520 con 0x7f5e18003a00 2024-05-27T12:32:53.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.420+0000 7f5e2ed9d640 1 -- 172.21.15.55:0/3394261228 reap_dead start 2024-05-27T12:32:53.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.420+0000 7fd025d76640 1 -- 172.21.15.55:0/3865121274 shutdown_connections 2024-05-27T12:32:53.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.420+0000 7fd025d76640 1 -- 172.21.15.55:0/3865121274 wait complete. 2024-05-27T12:32:53.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.421+0000 7f5e2e59c640 1 --2- 172.21.15.55:0/3394261228 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e18003a00 0x7f5e18003e00 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f5e2400ba30 tx=0x7f5e18005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fed59cd47903ea75 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:53.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.422+0000 7fd025d76640 1 Processor -- start 2024-05-27T12:32:53.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.422+0000 7fd025d76640 1 -- start start 2024-05-27T12:32:53.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.423+0000 7fd025d76640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd018007340 0x7fd0180d44a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:53.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.424+0000 7fd025d76640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd01800b0b0 0x7fd01804cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:53.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.424+0000 7fd025d76640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd0180e7760 0x7fd01804d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:53.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.424+0000 7fd025d76640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7fd018053430 con 0x7fd018007340 2024-05-27T12:32:53.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.424+0000 7fd025d76640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fd0180490e0 con 0x7fd0180e7760 2024-05-27T12:32:53.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.424+0000 7fd025d76640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fd018048570 con 0x7fd01800b0b0 2024-05-27T12:32:53.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.424+0000 7fd01ffff640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd01800b0b0 0x7fd01804cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:53.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.424+0000 7fd01ffff640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd01800b0b0 0x7fd01804cc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.55:40316/0 (socket says 172.21.15.55:40316) 2024-05-27T12:32:53.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.424+0000 7fd01ffff640 1 -- 172.21.15.55:0/3050447695 learned_addr learned my addr 172.21.15.55:0/3050447695 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:32:53.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.424+0000 7fd025575640 1 --2- 172.21.15.55:0/3050447695 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd0180e7760 0x7fd01804d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:53.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.425+0000 7fd024d74640 1 --2- 172.21.15.55:0/3050447695 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd018007340 0x7fd0180d44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:53.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.425+0000 7f5e2d59a640 1 -- 172.21.15.55:0/3394261228 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e24030070 con 0x7f5e18003a00 2024-05-27T12:32:53.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.425+0000 7f5e2d59a640 1 -- 172.21.15.55:0/3394261228 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e2402ade0 con 0x7f5e18003a00 2024-05-27T12:32:53.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.425+0000 7fd024d74640 1 -- 172.21.15.55:0/3050447695 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd01800b0b0 msgr2=0x7fd01804cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:53.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.425+0000 7fd024d74640 1 --2- 172.21.15.55:0/3050447695 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd01800b0b0 0x7fd01804cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:53.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.425+0000 7fd024d74640 1 -- 172.21.15.55:0/3050447695 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd0180e7760 msgr2=0x7fd01804d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:53.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.425+0000 7fd024d74640 1 --2- 172.21.15.55:0/3050447695 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd0180e7760 0x7fd01804d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:53.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.425+0000 7fd024d74640 1 -- 172.21.15.55:0/3050447695 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd018043d80 con 0x7fd018007340 2024-05-27T12:32:53.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.426+0000 7f5e2f59e640 1 -- 172.21.15.55:0/3394261228 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e18003a00 msgr2=0x7f5e18003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:53.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.426+0000 7f5e2f59e640 1 --2- 172.21.15.55:0/3394261228 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e18003a00 0x7f5e18003e00 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f5e2400ba30 tx=0x7f5e18005830 comp rx=0 tx=0).stop 2024-05-27T12:32:53.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.426+0000 7fd024d74640 1 --2- 172.21.15.55:0/3050447695 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd018007340 0x7fd0180d44a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fd02002db50 tx=0x7fd02006dd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:53.430 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.426+0000 7f5e2f59e640 1 -- 172.21.15.55:0/3394261228 shutdown_connections 2024-05-27T12:32:53.430 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.426+0000 7f5e2f59e640 1 --2- 172.21.15.55:0/3394261228 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e18003a00 0x7f5e18003e00 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:53.430 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.426+0000 7f5e2f59e640 1 -- 172.21.15.55:0/3394261228 >> 172.21.15.55:0/3394261228 conn(0x7f5e2803aa40 msgr2=0x7f5e2803ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:53.430 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.427+0000 7f5e2f59e640 1 -- 172.21.15.55:0/3394261228 shutdown_connections 2024-05-27T12:32:53.430 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.427+0000 7fd01d7fa640 1 -- 172.21.15.55:0/3050447695 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd02006bb30 con 0x7fd018007340 2024-05-27T12:32:53.430 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.427+0000 7fd01d7fa640 1 -- 172.21.15.55:0/3050447695 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd02006bcd0 con 0x7fd018007340 2024-05-27T12:32:53.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.427+0000 7fd01d7fa640 1 -- 172.21.15.55:0/3050447695 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd02006d310 con 0x7fd018007340 2024-05-27T12:32:53.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.427+0000 7fd025d76640 1 -- 172.21.15.55:0/3050447695 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd01804d7e0 con 0x7fd018007340 2024-05-27T12:32:53.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.427+0000 7fd025d76640 1 -- 172.21.15.55:0/3050447695 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd01804dda0 con 0x7fd018007340 2024-05-27T12:32:53.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.428+0000 7f5e2f59e640 1 -- 172.21.15.55:0/3394261228 wait complete. 2024-05-27T12:32:53.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.430+0000 7f5e2f59e640 1 Processor -- start 2024-05-27T12:32:53.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.430+0000 7f5e2f59e640 1 -- start start 2024-05-27T12:32:53.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.430+0000 7fd01d7fa640 1 -- 172.21.15.55:0/3050447695 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd02006d4b0 con 0x7fd018007340 2024-05-27T12:32:53.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.430+0000 7fd01d7fa640 1 --2- 172.21.15.55:0/3050447695 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fd00c06c9c0 0x7fd00c06ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:53.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.430+0000 7fd01d7fa640 1 -- 172.21.15.55:0/3050447695 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fd020106b30 con 0x7fd018007340 2024-05-27T12:32:53.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.431+0000 7fd025d76640 1 -- 172.21.15.55:0/3050447695 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd018033b10 con 0x7fd018007340 2024-05-27T12:32:53.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.432+0000 7f5e2f59e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e18003a00 0x7f5e281875d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:53.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.432+0000 7fd01ffff640 1 --2- 172.21.15.55:0/3050447695 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fd00c06c9c0 0x7fd00c06ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:53.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.432+0000 7f5e2e59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e18003a00 0x7f5e281875d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:53.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.432+0000 7f5e2e59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e18003a00 0x7f5e281875d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57446/0 (socket says 172.21.15.55:57446) 2024-05-27T12:32:53.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.433+0000 7f5e2e59c640 1 -- 172.21.15.55:0/1090517714 learned_addr learned my addr 172.21.15.55:0/1090517714 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:32:53.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.433+0000 7f5e2f59e640 1 --2- 172.21.15.55:0/1090517714 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e28187b10 0x7f5e280e3800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:53.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.433+0000 7f5e2f59e640 1 --2- 172.21.15.55:0/1090517714 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5e280e3d40 0x7f5e280e41c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:53.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.433+0000 7f5e2f59e640 1 -- 172.21.15.55:0/1090517714 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f5e2803c300 con 0x7f5e18003a00 2024-05-27T12:32:53.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.433+0000 7f5e2f59e640 1 -- 172.21.15.55:0/1090517714 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f5e2803c180 con 0x7f5e28187b10 2024-05-27T12:32:53.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.433+0000 7f5e2f59e640 1 -- 172.21.15.55:0/1090517714 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f5e2803c480 con 0x7f5e280e3d40 2024-05-27T12:32:53.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.433+0000 7f5e2dd9b640 1 --2- 172.21.15.55:0/1090517714 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e28187b10 0x7f5e280e3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:53.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.433+0000 7f5e2ed9d640 1 --2- 172.21.15.55:0/1090517714 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5e280e3d40 0x7f5e280e41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:53.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.434+0000 7f5e2ed9d640 1 -- 172.21.15.55:0/1090517714 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e28187b10 msgr2=0x7f5e280e3800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:53.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.434+0000 7f5e2ed9d640 1 --2- 172.21.15.55:0/1090517714 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e28187b10 0x7f5e280e3800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:53.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.434+0000 7f5e2ed9d640 1 -- 172.21.15.55:0/1090517714 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e18003a00 msgr2=0x7f5e281875d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:53.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.434+0000 7f5e2ed9d640 1 --2- 172.21.15.55:0/1090517714 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e18003a00 0x7f5e281875d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:53.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.434+0000 7f5e2ed9d640 1 -- 172.21.15.55:0/1090517714 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e28188300 con 0x7f5e280e3d40 2024-05-27T12:32:53.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.434+0000 7f5e2e59c640 1 --2- 172.21.15.55:0/1090517714 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e18003a00 0x7f5e281875d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T12:32:53.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.435+0000 7f5e2ed9d640 1 --2- 172.21.15.55:0/1090517714 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5e280e3d40 0x7f5e280e41c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5e28055910 tx=0x7f5e2000ec10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:53.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.435+0000 7f5e1effd640 1 -- 172.21.15.55:0/1090517714 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e20019070 con 0x7f5e280e3d40 2024-05-27T12:32:53.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.435+0000 7f5e2f59e640 1 -- 172.21.15.55:0/1090517714 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e281885e0 con 0x7f5e280e3d40 2024-05-27T12:32:53.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.435+0000 7f5e2f59e640 1 -- 172.21.15.55:0/1090517714 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e28188ba0 con 0x7f5e280e3d40 2024-05-27T12:32:53.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.438+0000 7f5e1effd640 1 -- 172.21.15.55:0/1090517714 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e2000c690 con 0x7f5e280e3d40 2024-05-27T12:32:53.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.438+0000 7f5e1effd640 1 -- 172.21.15.55:0/1090517714 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e2000ca80 con 0x7f5e280e3d40 2024-05-27T12:32:53.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.439+0000 7f5e1effd640 1 -- 172.21.15.55:0/1090517714 <== mon.2 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5e2001c070 con 0x7f5e280e3d40 2024-05-27T12:32:53.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.440+0000 7f5e2f59e640 1 -- 172.21.15.55:0/1090517714 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e14005290 con 0x7f5e280e3d40 2024-05-27T12:32:53.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.440+0000 7fd01d7fa640 1 -- 172.21.15.55:0/3050447695 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd0200d4980 con 0x7fd018007340 2024-05-27T12:32:53.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.441+0000 7f5e1effd640 1 --2- 172.21.15.55:0/1090517714 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f5e1006c950 0x7f5e1006ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:53.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.441+0000 7f5e2e59c640 1 --2- 172.21.15.55:0/1090517714 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f5e1006c950 0x7f5e1006ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:53.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.441+0000 7f5e1effd640 1 -- 172.21.15.55:0/1090517714 <== mon.2 v2:172.21.15.72:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f5e2008af50 con 0x7f5e280e3d40 2024-05-27T12:32:53.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.442+0000 7f5e2e59c640 1 --2- 172.21.15.55:0/1090517714 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f5e1006c950 0x7f5e1006ee10 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5e240345d0 tx=0x7f5e24030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:53.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.442+0000 7fd01ffff640 1 --2- 172.21.15.55:0/3050447695 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fd00c06c9c0 0x7fd00c06ee80 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd0180e49f0 tx=0x7fd01002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:53.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.446+0000 7f5e1effd640 1 -- 172.21.15.55:0/1090517714 <== mon.2 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5e20058da0 con 0x7f5e280e3d40 2024-05-27T12:32:53.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.464+0000 7f47add80640 1 Processor -- start 2024-05-27T12:32:53.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.464+0000 7f47add80640 1 -- start start 2024-05-27T12:32:53.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.466+0000 7faeec5d8640 1 Processor -- start 2024-05-27T12:32:53.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.466+0000 7faeec5d8640 1 -- start start 2024-05-27T12:32:53.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.465+0000 7f47add80640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f47a0053fe0 0x7f47a0050890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:53.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.466+0000 7f47add80640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47a00547c0 con 0x7f47a0050dd0 2024-05-27T12:32:53.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.466+0000 7f47add80640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47a0054aa0 con 0x7f47a003b550 2024-05-27T12:32:53.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.466+0000 7f47add80640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f47a0051240 con 0x7f47a0053fe0 2024-05-27T12:32:53.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.466+0000 7f47ad57f640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f47a0050dd0 0x7f47a00eab70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:36874/0 (socket says 172.21.15.55:36874) 2024-05-27T12:32:53.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.466+0000 7f47ad57f640 1 -- 172.21.15.55:0/3080684823 learned_addr learned my addr 172.21.15.55:0/3080684823 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-27T12:32:53.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.466+0000 7f47a77fe640 1 -- 172.21.15.55:0/3080684823 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3086180681 0 0) 0x7f47a00547c0 con 0x7f47a0050dd0 2024-05-27T12:32:53.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.466+0000 7f47a77fe640 1 -- 172.21.15.55:0/3080684823 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4798003520 con 0x7f47a0050dd0 2024-05-27T12:32:53.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.467+0000 7f47a77fe640 1 -- 172.21.15.55:0/3080684823 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4032916991 0 0) 0x7f4798003520 con 0x7f47a0050dd0 2024-05-27T12:32:53.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.467+0000 7f47a77fe640 1 -- 172.21.15.55:0/3080684823 >> v2:172.21.15.72:3300/0 conn(0x7f47a0053fe0 msgr2=0x7f47a0050890 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-27T12:32:53.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.467+0000 7f47a77fe640 1 --2- 172.21.15.55:0/3080684823 >> v2:172.21.15.72:3300/0 conn(0x7f47a0053fe0 0x7f47a0050890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:53.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.467+0000 7f47a77fe640 1 -- 172.21.15.55:0/3080684823 >> v1:172.21.15.72:6789/0 conn(0x7f47a003b550 legacy=0x7f47a00dfd20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-27T12:32:53.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.467+0000 7f47a77fe640 1 -- 172.21.15.55:0/3080684823 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47a0054d80 con 0x7f47a0050dd0 2024-05-27T12:32:53.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.467+0000 7f47a77fe640 1 -- 172.21.15.55:0/3080684823 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 793017739 0 0) 0x7f47a80635b0 con 0x7f47a0050dd0 2024-05-27T12:32:53.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.467+0000 7f47a77fe640 1 -- 172.21.15.55:0/3080684823 >> v1:172.21.15.55:6789/0 conn(0x7f47a0050dd0 legacy=0x7f47a00eab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:53.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.467+0000 7f47a77fe640 1 --2- 172.21.15.55:0/3080684823 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f47980039b0 0x7f4798003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:53.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.467+0000 7f47a77fe640 1 --2- 172.21.15.55:0/3080684823 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4798004800 0x7f4798004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:53.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.467+0000 7f47a77fe640 1 --2- 172.21.15.55:0/3080684823 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47980099b0 0x7f4798005260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:53.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.467+0000 7f47a77fe640 1 -- 172.21.15.55:0/3080684823 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f47a0051240 con 0x7f4798004800 2024-05-27T12:32:53.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.467+0000 7f47a77fe640 1 -- 172.21.15.55:0/3080684823 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f47980148f0 con 0x7f47980099b0 2024-05-27T12:32:53.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.467+0000 7f47a77fe640 1 -- 172.21.15.55:0/3080684823 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f4798014af0 con 0x7f47980039b0 2024-05-27T12:32:53.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.467+0000 7faeec5d8640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7faee40b46d0 0x7faee40cd200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:53.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.468+0000 7faeec5d8640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faee4166c80 con 0x7faee4162b40 2024-05-27T12:32:53.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.468+0000 7faeec5d8640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faee4166f60 con 0x7faee4162f20 2024-05-27T12:32:53.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.468+0000 7faeec5d8640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7faee4167800 con 0x7faee40b46d0 2024-05-27T12:32:53.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.468+0000 7f47acd7e640 1 --2- 172.21.15.55:0/3080684823 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f47980039b0 0x7f4798003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:53.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.468+0000 7f47a7fff640 1 --2- 172.21.15.55:0/3080684823 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4798004800 0x7f4798004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:53.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.468+0000 7f47ad57f640 1 --2- 172.21.15.55:0/3080684823 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47980099b0 0x7f4798005260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:53.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.468+0000 7faeea374640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7faee4162b40 0x7faee40b3fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:36882/0 (socket says 172.21.15.55:36882) 2024-05-27T12:32:53.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.468+0000 7faee9b73640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7faee40b46d0 0x7faee40cd200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:53.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.468+0000 7faeea374640 1 -- 172.21.15.55:0/459407645 learned_addr learned my addr 172.21.15.55:0/459407645 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-27T12:32:53.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.468+0000 7f47ad57f640 1 -- 172.21.15.55:0/3080684823 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f47980039b0 msgr2=0x7f4798003db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:32:53.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.468+0000 7f47ad57f640 1 --2- 172.21.15.55:0/3080684823 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f47980039b0 0x7f4798003db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:53.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.468+0000 7f47ad57f640 1 -- 172.21.15.55:0/3080684823 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4798004800 msgr2=0x7f4798004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:32:53.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.468+0000 7f47ad57f640 1 --2- 172.21.15.55:0/3080684823 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4798004800 0x7f4798004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:53.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.468+0000 7f47ad57f640 1 -- 172.21.15.55:0/3080684823 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4798003520 con 0x7f47980099b0 2024-05-27T12:32:53.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.469+0000 7faee9372640 1 -- 172.21.15.55:0/459407645 <== mon.1 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3944451538 0 0) 0x7faee4166f60 con 0x7faee4162f20 2024-05-27T12:32:53.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.469+0000 7faee9372640 1 -- 172.21.15.55:0/459407645 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faed0003520 con 0x7faee4162f20 2024-05-27T12:32:53.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.469+0000 7faee9372640 1 -- 172.21.15.55:0/459407645 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 16214445 0 0) 0x7faee4166c80 con 0x7faee4162b40 2024-05-27T12:32:53.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.469+0000 7faee9372640 1 -- 172.21.15.55:0/459407645 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faee4166f60 con 0x7faee4162b40 2024-05-27T12:32:53.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.469+0000 7faee9b73640 1 -- 172.21.15.55:0/459407645 >> v1:172.21.15.72:6789/0 conn(0x7faee4162f20 legacy=0x7faee406ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:53.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.469+0000 7faee9b73640 1 -- 172.21.15.55:0/459407645 >> v1:172.21.15.55:6789/0 conn(0x7faee4162b40 legacy=0x7faee40b3fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:53.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.469+0000 7faee9b73640 1 -- 172.21.15.55:0/459407645 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faee4167240 con 0x7faee40b46d0 2024-05-27T12:32:53.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.469+0000 7f47ad57f640 1 -- 172.21.15.55:0/3080684823 reap_dead start 2024-05-27T12:32:53.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.469+0000 7f47ad57f640 1 --2- 172.21.15.55:0/3080684823 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47980099b0 0x7f4798005260 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f47a8074860 tx=0x7f4798005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aee29d1c83e9c051 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:53.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.469+0000 7f55027f7640 1 Processor -- start 2024-05-27T12:32:53.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.470+0000 7f47a77fe640 1 -- 172.21.15.55:0/3080684823 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47a8068a00 con 0x7f47980099b0 2024-05-27T12:32:53.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.470+0000 7f47a77fe640 1 -- 172.21.15.55:0/3080684823 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47a80aa070 con 0x7f47980099b0 2024-05-27T12:32:53.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.470+0000 7f47a77fe640 1 -- 172.21.15.55:0/3080684823 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47a806b930 con 0x7f47980099b0 2024-05-27T12:32:53.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.470+0000 7f55027f7640 1 -- start start 2024-05-27T12:32:53.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.470+0000 7fb937683640 1 Processor -- start 2024-05-27T12:32:53.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.470+0000 7f20559d3640 1 Processor -- start 2024-05-27T12:32:53.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.470+0000 7fb937683640 1 -- start start 2024-05-27T12:32:53.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.471+0000 7f47add80640 1 -- 172.21.15.55:0/3080684823 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47980099b0 msgr2=0x7f4798005260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:53.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.471+0000 7f47add80640 1 --2- 172.21.15.55:0/3080684823 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47980099b0 0x7f4798005260 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f47a8074860 tx=0x7f4798005830 comp rx=0 tx=0).stop 2024-05-27T12:32:53.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.470+0000 7f20559d3640 1 -- start start 2024-05-27T12:32:53.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.471+0000 7faee9b73640 1 --2- 172.21.15.55:0/459407645 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faee40b46d0 0x7faee40cd200 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7faedc009d90 tx=0x7faedc02a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d37aae81e8c660fe server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:53.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.471+0000 7faee9372640 1 -- 172.21.15.55:0/459407645 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faedc007740 con 0x7faee40b46d0 2024-05-27T12:32:53.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.471+0000 7faee9372640 1 -- 172.21.15.55:0/459407645 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faedc0078e0 con 0x7faee40b46d0 2024-05-27T12:32:53.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.471+0000 7faee9372640 1 -- 172.21.15.55:0/459407645 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faedc007cb0 con 0x7faee40b46d0 2024-05-27T12:32:53.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.472+0000 7f55027f7640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f54f40061e0 0x7f54f4006660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:53.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.472+0000 7f55027f7640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f54f4006ba0 0x7f54f403c110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:53.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.472+0000 7fb937683640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb9300b46d0 0x7fb9300cd200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:53.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.472+0000 7fb937683640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb930162f20 0x7fb93006ee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:53.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.472+0000 7f20559d3640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2050158310 0x7f20500cf460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:53.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.472+0000 7fb935c20640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb930162f20 0x7fb93006ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:53.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.472+0000 7fb935c20640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb930162f20 0x7fb93006ee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57468/0 (socket says 172.21.15.55:57468) 2024-05-27T12:32:53.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.472+0000 7fb934c1e640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb9300b46d0 0x7fb9300cd200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:53.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.472+0000 7fb934c1e640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb9300b46d0 0x7fb9300cd200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.55:40362/0 (socket says 172.21.15.55:40362) 2024-05-27T12:32:53.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.472+0000 7fb935c20640 1 -- 172.21.15.55:0/2375705675 learned_addr learned my addr 172.21.15.55:0/2375705675 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:32:53.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.472+0000 7f20549d1640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2050158310 0x7f20500cf460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:53.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.472+0000 7f20549d1640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2050158310 0x7f20500cf460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.55:57782/0 (socket says 172.21.15.55:57782) 2024-05-27T12:32:53.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.472+0000 7f20549d1640 1 -- 172.21.15.55:0/3649055500 learned_addr learned my addr 172.21.15.55:0/3649055500 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:32:53.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.472+0000 7fb937683640 1 -- 172.21.15.55:0/2375705675 --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb930166c80 con 0x7fb930162b40 2024-05-27T12:32:53.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.472+0000 7fb937683640 1 -- 172.21.15.55:0/2375705675 --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7fb930167800 con 0x7fb930162f20 2024-05-27T12:32:53.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.472+0000 7fb937683640 1 -- 172.21.15.55:0/2375705675 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fb930166f60 con 0x7fb9300b46d0 2024-05-27T12:32:53.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.472+0000 7faeec5d8640 1 -- 172.21.15.55:0/459407645 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faee40b46d0 msgr2=0x7faee40cd200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:53.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.472+0000 7faeec5d8640 1 --2- 172.21.15.55:0/459407645 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faee40b46d0 0x7faee40cd200 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7faedc009d90 tx=0x7faedc02a660 comp rx=0 tx=0).stop 2024-05-27T12:32:53.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.473+0000 7faeec5d8640 1 -- 172.21.15.55:0/459407645 shutdown_connections 2024-05-27T12:32:53.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.473+0000 7faeec5d8640 1 --2- 172.21.15.55:0/459407645 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faee40b46d0 0x7faee40cd200 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:53.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.473+0000 7faeec5d8640 1 -- 172.21.15.55:0/459407645 >> 172.21.15.55:0/459407645 conn(0x7faee40b2240 msgr2=0x7faee40b2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:53.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.471+0000 7f47add80640 1 -- 172.21.15.55:0/3080684823 shutdown_connections 2024-05-27T12:32:53.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.471+0000 7f47add80640 1 --2- 172.21.15.55:0/3080684823 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47980099b0 0x7f4798005260 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:53.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.471+0000 7f47add80640 1 -- 172.21.15.55:0/3080684823 >> 172.21.15.55:0/3080684823 conn(0x7f47a0055bc0 msgr2=0x7f47a0055fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:53.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.471+0000 7f47add80640 1 -- 172.21.15.55:0/3080684823 shutdown_connections 2024-05-27T12:32:53.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.471+0000 7f47add80640 1 -- 172.21.15.55:0/3080684823 wait complete. 2024-05-27T12:32:53.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.473+0000 7f56e52fa640 1 Processor -- start 2024-05-27T12:32:53.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.473+0000 7f56e52fa640 1 -- start start 2024-05-27T12:32:53.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.472+0000 7f20559d3640 1 --2- 172.21.15.55:0/3649055500 >> v2:172.21.15.55:3300/0 conn(0x7f205015b5e0 0x7f20500721b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:53.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.472+0000 7f20559d3640 1 -- 172.21.15.55:0/3649055500 --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20500cf9a0 con 0x7f2050071d20 2024-05-27T12:32:53.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.473+0000 7f20551d2640 1 --2- 172.21.15.55:0/3649055500 >> v2:172.21.15.55:3300/0 conn(0x7f205015b5e0 0x7f20500721b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:53.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.473+0000 7f20559d3640 1 -- 172.21.15.55:0/3649055500 --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f205015bc00 con 0x7f205015b5e0 2024-05-27T12:32:53.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.473+0000 7f20559d3640 1 -- 172.21.15.55:0/3649055500 --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f20500ce980 con 0x7f2050158310 2024-05-27T12:32:53.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.473+0000 7faeec5d8640 1 -- 172.21.15.55:0/459407645 shutdown_connections 2024-05-27T12:32:53.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.473+0000 7f47add80640 1 Processor -- start 2024-05-27T12:32:53.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.473+0000 7f47add80640 1 -- start start 2024-05-27T12:32:53.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.474+0000 7f55027f7640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54f40e36d0 con 0x7f54f40e32f0 2024-05-27T12:32:53.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.474+0000 7f55027f7640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f54f4006ff0 con 0x7f54f4006ba0 2024-05-27T12:32:53.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.474+0000 7f55027f7640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f54f4057b30 con 0x7f54f40061e0 2024-05-27T12:32:53.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.473+0000 7fb934c1e640 1 -- 172.21.15.55:0/2375705675 >> v2:172.21.15.55:3300/0 conn(0x7fb930162f20 msgr2=0x7fb93006ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:32:53.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.473+0000 7fb934c1e640 1 --2- 172.21.15.55:0/2375705675 >> v2:172.21.15.55:3300/0 conn(0x7fb930162f20 0x7fb93006ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:53.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.473+0000 7fb934c1e640 1 -- 172.21.15.55:0/2375705675 >> v1:172.21.15.72:6789/0 conn(0x7fb930162b40 legacy=0x7fb9300b3fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-27T12:32:53.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.473+0000 7fb934c1e640 1 -- 172.21.15.55:0/2375705675 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb930167240 con 0x7fb9300b46d0 2024-05-27T12:32:53.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.473+0000 7f55017f5640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f54f40e32f0 0x7f54f40572e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.55:51884/0 (socket says 172.21.15.55:51884) 2024-05-27T12:32:53.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.474+0000 7f55017f5640 1 -- 172.21.15.55:0/2256673620 learned_addr learned my addr 172.21.15.55:0/2256673620 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-27T12:32:53.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.474+0000 7f5501ff6640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f54f4006ba0 0x7f54f403c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:53.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.474+0000 7f56e52fa640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f56e0162b40 0x7f56e00cd200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:53.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.474+0000 7f204f7fe640 1 -- 172.21.15.55:0/3649055500 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1842640042 0 0) 0x7f20500cf9a0 con 0x7f2050071d20 2024-05-27T12:32:53.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.474+0000 7f204f7fe640 1 -- 172.21.15.55:0/3649055500 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2038005730 con 0x7f2050071d20 2024-05-27T12:32:53.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.474+0000 7f20549d1640 1 -- 172.21.15.55:0/3649055500 >> v2:172.21.15.55:3300/0 conn(0x7f205015b5e0 msgr2=0x7f20500721b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:32:53.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.474+0000 7f20549d1640 1 --2- 172.21.15.55:0/3649055500 >> v2:172.21.15.55:3300/0 conn(0x7f205015b5e0 0x7f20500721b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:53.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.474+0000 7f20549d1640 1 -- 172.21.15.55:0/3649055500 >> v1:172.21.15.55:6789/0 conn(0x7f2050071d20 legacy=0x7f205015aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:53.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.474+0000 7f20549d1640 1 -- 172.21.15.55:0/3649055500 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20500cec60 con 0x7f2050158310 2024-05-27T12:32:53.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.472+0000 7f5500ff4640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f54f40061e0 0x7f54f4006660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:53.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.474+0000 7f20551d2640 1 --2- 172.21.15.55:0/3649055500 >> v2:172.21.15.55:3300/0 conn(0x7f205015b5e0 0x7f20500721b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T12:32:53.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.475+0000 7f56e52fa640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f56e00b46d0 0x7f56e006ee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:53.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.475+0000 7f47add80640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47a00cde00 0x7f47a004c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:53.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.475+0000 7f47add80640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47a00ce1e0 0x7f47a0049f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:53.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.473+0000 7faeec5d8640 1 -- 172.21.15.55:0/459407645 wait complete. 2024-05-27T12:32:53.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.475+0000 7f56deffd640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f56e0162b40 0x7f56e00cd200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:53.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.475+0000 7f56deffd640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f56e0162b40 0x7f56e00cd200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.55:40364/0 (socket says 172.21.15.55:40364) 2024-05-27T12:32:53.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.475+0000 7f56de7fc640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f56e0162f20 0x7f56e00b3fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:36898/0 (socket says 172.21.15.55:36898) 2024-05-27T12:32:53.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.475+0000 7faeec5d8640 1 Processor -- start 2024-05-27T12:32:53.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.475+0000 7f47add80640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f47a0039bf0 0x7f47a003a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:53.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.475+0000 7f47add80640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f47a0054440 con 0x7f47a00ce1e0 2024-05-27T12:32:53.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.475+0000 7f47add80640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f47a0055340 con 0x7f47a00cde00 2024-05-27T12:32:53.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.475+0000 7f47add80640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f47a0055860 con 0x7f47a0039bf0 2024-05-27T12:32:53.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.475+0000 7f56deffd640 1 -- 172.21.15.55:0/158716353 learned_addr learned my addr 172.21.15.55:0/158716353 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:32:53.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.475+0000 7f47acd7e640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47a00cde00 0x7f47a004c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:53.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.475+0000 7f5501ff6640 1 -- 172.21.15.55:0/2256673620 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f54f40061e0 msgr2=0x7f54f4006660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:32:53.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.475+0000 7f5501ff6640 1 --2- 172.21.15.55:0/2256673620 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f54f40061e0 0x7f54f4006660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:53.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.475+0000 7f5501ff6640 1 -- 172.21.15.55:0/2256673620 >> v1:172.21.15.72:6789/0 conn(0x7f54f40e32f0 legacy=0x7f54f40572e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:32:53.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.475+0000 7faeec5d8640 1 -- start start 2024-05-27T12:32:53.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.475+0000 7f5501ff6640 1 -- 172.21.15.55:0/2256673620 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54f4057e10 con 0x7f54f4006ba0 2024-05-27T12:32:53.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.475+0000 7f47acd7e640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47a00cde00 0x7f47a004c140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.55:57786/0 (socket says 172.21.15.55:57786) 2024-05-27T12:32:53.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.475+0000 7f47acd7e640 1 -- 172.21.15.55:0/2142003152 learned_addr learned my addr 172.21.15.55:0/2142003152 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:32:53.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.475+0000 7f56e52fa640 1 -- 172.21.15.55:0/158716353 --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56e0166c80 con 0x7f56e0162f20 2024-05-27T12:32:53.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.475+0000 7f56e52fa640 1 -- 172.21.15.55:0/158716353 --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f56e0167800 con 0x7f56e00b46d0 2024-05-27T12:32:53.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.475+0000 7f56e52fa640 1 -- 172.21.15.55:0/158716353 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f56e0166f60 con 0x7f56e0162b40 2024-05-27T12:32:53.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.475+0000 7fb934c1e640 1 --2- 172.21.15.55:0/2375705675 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb9300b46d0 0x7fb9300cd200 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb9200097a0 tx=0x7fb92002a0b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b22e71dd45b4067d server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:53.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.475+0000 7f56df7fe640 1 --2- 172.21.15.55:0/158716353 >> v2:172.21.15.72:3300/0 conn(0x7f56e00b46d0 0x7f56e006ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:53.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.475+0000 7f47ad57f640 1 --2- 172.21.15.55:0/2142003152 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f47a0039bf0 0x7f47a003a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:53.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.475+0000 7fb927fff640 1 -- 172.21.15.55:0/2375705675 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb920037070 con 0x7fb9300b46d0 2024-05-27T12:32:53.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.475+0000 7fb927fff640 1 -- 172.21.15.55:0/2375705675 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb92002adc0 con 0x7fb9300b46d0 2024-05-27T12:32:53.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.475+0000 7fb927fff640 1 -- 172.21.15.55:0/2375705675 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb920032660 con 0x7fb9300b46d0 2024-05-27T12:32:53.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.475+0000 7f47acd7e640 1 -- 172.21.15.55:0/2142003152 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f47a0039bf0 msgr2=0x7f47a003a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:53.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.476+0000 7f47acd7e640 1 --2- 172.21.15.55:0/2142003152 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f47a0039bf0 0x7f47a003a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:53.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.475+0000 7f56df7fe640 1 -- 172.21.15.55:0/158716353 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f56e0162b40 msgr2=0x7f56e00cd200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:32:53.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.475+0000 7f56df7fe640 1 --2- 172.21.15.55:0/158716353 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f56e0162b40 0x7f56e00cd200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:53.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.476+0000 7f56df7fe640 1 -- 172.21.15.55:0/158716353 >> v1:172.21.15.55:6789/0 conn(0x7f56e0162f20 legacy=0x7f56e00b3fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:53.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.476+0000 7f56df7fe640 1 -- 172.21.15.55:0/158716353 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56e0167240 con 0x7f56e00b46d0 2024-05-27T12:32:53.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.476+0000 7f47acd7e640 1 -- 172.21.15.55:0/2142003152 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47a00ce1e0 msgr2=0x7f47a0049f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:53.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.476+0000 7f47acd7e640 1 --2- 172.21.15.55:0/2142003152 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47a00ce1e0 0x7f47a0049f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:53.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.476+0000 7f47acd7e640 1 -- 172.21.15.55:0/2142003152 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47a004af20 con 0x7f47a00cde00 2024-05-27T12:32:53.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.476+0000 7f47acd7e640 1 --2- 172.21.15.55:0/2142003152 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47a00cde00 0x7f47a004c140 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f479c00e870 tx=0x7f479c00ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:53.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.476+0000 7f47a57fa640 1 -- 172.21.15.55:0/2142003152 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f479c017070 con 0x7f47a00cde00 2024-05-27T12:32:53.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.476+0000 7f20549d1640 1 --2- 172.21.15.55:0/3649055500 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2050158310 0x7f20500cf460 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2050072e50 tx=0x7f204802ee90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=47476c6927206110 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:53.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.476+0000 7f47add80640 1 -- 172.21.15.55:0/2142003152 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47a004a680 con 0x7f47a00cde00 2024-05-27T12:32:53.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.476+0000 7faeec5d8640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faee40b46d0 0x7faee4153cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:53.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.476+0000 7faeec5d8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faee4162b40 0x7faee4149620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:53.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.476+0000 7f47add80640 1 -- 172.21.15.55:0/2142003152 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47a004ac40 con 0x7f47a00cde00 2024-05-27T12:32:53.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.476+0000 7faeec5d8640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faee4162f20 0x7faee41556f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:53.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.476+0000 7faeec5d8640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7faee4166a40 con 0x7faee4162b40 2024-05-27T12:32:53.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.476+0000 7faeec5d8640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7faee41668c0 con 0x7faee40b46d0 2024-05-27T12:32:53.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.476+0000 7faeec5d8640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7faee40afce0 con 0x7faee4162f20 2024-05-27T12:32:53.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.476+0000 7f204f7fe640 1 -- 172.21.15.55:0/3649055500 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f204802fbe0 con 0x7f2050158310 2024-05-27T12:32:53.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.476+0000 7f47a57fa640 1 -- 172.21.15.55:0/2142003152 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f479c00ee60 con 0x7f47a00cde00 2024-05-27T12:32:53.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.476+0000 7f47a57fa640 1 -- 172.21.15.55:0/2142003152 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f479c00cb80 con 0x7f47a00cde00 2024-05-27T12:32:53.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.476+0000 7f204f7fe640 1 -- 172.21.15.55:0/3649055500 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f204802fd80 con 0x7f2050158310 2024-05-27T12:32:53.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.476+0000 7f204f7fe640 1 -- 172.21.15.55:0/3649055500 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f204800a2f0 con 0x7f2050158310 2024-05-27T12:32:53.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.476+0000 7faeeab75640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faee4162f20 0x7faee41556f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:53.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.476+0000 7faeeab75640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faee4162f20 0x7faee41556f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.55:40392/0 (socket says 172.21.15.55:40392) 2024-05-27T12:32:53.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.476+0000 7faeeab75640 1 -- 172.21.15.55:0/756495107 learned_addr learned my addr 172.21.15.55:0/756495107 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:32:53.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.477+0000 7fb937683640 1 -- 172.21.15.55:0/2375705675 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb9300b46d0 msgr2=0x7fb9300cd200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:53.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.477+0000 7faeea374640 1 --2- 172.21.15.55:0/756495107 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faee40b46d0 0x7faee4153cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:53.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.477+0000 7fb937683640 1 --2- 172.21.15.55:0/2375705675 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb9300b46d0 0x7fb9300cd200 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb9200097a0 tx=0x7fb92002a0b0 comp rx=0 tx=0).stop 2024-05-27T12:32:53.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.477+0000 7fb937683640 1 -- 172.21.15.55:0/2375705675 shutdown_connections 2024-05-27T12:32:53.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.477+0000 7faeeab75640 1 -- 172.21.15.55:0/756495107 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faee40b46d0 msgr2=0x7faee4153cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:53.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.477+0000 7faeeab75640 1 --2- 172.21.15.55:0/756495107 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faee40b46d0 0x7faee4153cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:53.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.477+0000 7faeeab75640 1 -- 172.21.15.55:0/756495107 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faee4162b40 msgr2=0x7faee4149620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:53.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.477+0000 7faeeab75640 1 --2- 172.21.15.55:0/756495107 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faee4162b40 0x7faee4149620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:53.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.477+0000 7faeeab75640 1 -- 172.21.15.55:0/756495107 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faee4154650 con 0x7faee4162f20 2024-05-27T12:32:53.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.477+0000 7fb937683640 1 --2- 172.21.15.55:0/2375705675 >> v2:172.21.15.55:3300/0 conn(0x7fb930162f20 0x7fb93006ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:53.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.477+0000 7fb937683640 1 --2- 172.21.15.55:0/2375705675 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb9300b46d0 0x7fb9300cd200 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:53.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.477+0000 7fb937683640 1 -- 172.21.15.55:0/2375705675 >> 172.21.15.55:0/2375705675 conn(0x7fb9300b2240 msgr2=0x7fb9300b2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:53.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.477+0000 7faeeab75640 1 --2- 172.21.15.55:0/756495107 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faee4162f20 0x7faee41556f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7faee000c3f0 tx=0x7faee000c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:53.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.477+0000 7f5501ff6640 1 --2- 172.21.15.55:0/2256673620 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f54f4006ba0 0x7f54f403c110 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f54fc02db50 tx=0x7f54fc0a5e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c12498a10eb1d825 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:53.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.477+0000 7f20559d3640 1 -- 172.21.15.55:0/3649055500 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2050158310 msgr2=0x7f20500cf460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:53.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.477+0000 7f20559d3640 1 --2- 172.21.15.55:0/3649055500 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2050158310 0x7f20500cf460 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2050072e50 tx=0x7f204802ee90 comp rx=0 tx=0).stop 2024-05-27T12:32:53.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.478+0000 7fb937683640 1 -- 172.21.15.55:0/2375705675 shutdown_connections 2024-05-27T12:32:53.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.477+0000 7faedaffd640 1 -- 172.21.15.55:0/756495107 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faee0017070 con 0x7faee4162f20 2024-05-27T12:32:53.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.477+0000 7faedaffd640 1 -- 172.21.15.55:0/756495107 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faee00052f0 con 0x7faee4162f20 2024-05-27T12:32:53.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.477+0000 7faedaffd640 1 -- 172.21.15.55:0/756495107 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faee0003830 con 0x7faee4162f20 2024-05-27T12:32:53.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.478+0000 7faeec5d8640 1 -- 172.21.15.55:0/756495107 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faee4154930 con 0x7faee4162f20 2024-05-27T12:32:53.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.478+0000 7faeec5d8640 1 -- 172.21.15.55:0/756495107 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7faee4154ef0 con 0x7faee4162f20 2024-05-27T12:32:53.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.478+0000 7f56df7fe640 1 --2- 172.21.15.55:0/158716353 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f56e00b46d0 0x7f56e006ee70 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f56d8009d90 tx=0x7f56d802a5d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=84aab312b2fc8e79 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:53.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.478+0000 7fb937683640 1 -- 172.21.15.55:0/2375705675 wait complete. 2024-05-27T12:32:53.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.478+0000 7f54f3fff640 1 -- 172.21.15.55:0/2256673620 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54fc0b3070 con 0x7f54f4006ba0 2024-05-27T12:32:53.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.478+0000 7f54f3fff640 1 -- 172.21.15.55:0/2256673620 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54fc0a6a30 con 0x7f54f4006ba0 2024-05-27T12:32:53.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.478+0000 7f54f3fff640 1 -- 172.21.15.55:0/2256673620 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54fc0a6e60 con 0x7f54f4006ba0 2024-05-27T12:32:53.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.478+0000 7f20559d3640 1 -- 172.21.15.55:0/3649055500 shutdown_connections 2024-05-27T12:32:53.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.478+0000 7f20559d3640 1 --2- 172.21.15.55:0/3649055500 >> v2:172.21.15.55:3300/0 conn(0x7f205015b5e0 0x7f20500721b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:53.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.478+0000 7f20559d3640 1 --2- 172.21.15.55:0/3649055500 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2050158310 0x7f20500cf460 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:53.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.478+0000 7f20559d3640 1 -- 172.21.15.55:0/3649055500 >> 172.21.15.55:0/3649055500 conn(0x7f20500b5e50 msgr2=0x7f20500b2240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:53.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.479+0000 7f55027f7640 1 -- 172.21.15.55:0/2256673620 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f54f4006ba0 msgr2=0x7f54f403c110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:53.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.479+0000 7f55027f7640 1 --2- 172.21.15.55:0/2256673620 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f54f4006ba0 0x7f54f403c110 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f54fc02db50 tx=0x7f54fc0a5e70 comp rx=0 tx=0).stop 2024-05-27T12:32:53.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.479+0000 7f56ddffb640 1 -- 172.21.15.55:0/158716353 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56d8031600 con 0x7f56e00b46d0 2024-05-27T12:32:53.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.479+0000 7f56ddffb640 1 -- 172.21.15.55:0/158716353 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56d80317a0 con 0x7f56e00b46d0 2024-05-27T12:32:53.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.479+0000 7f56ddffb640 1 -- 172.21.15.55:0/158716353 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56d8031b70 con 0x7f56e00b46d0 2024-05-27T12:32:53.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.479+0000 7f55027f7640 1 -- 172.21.15.55:0/2256673620 shutdown_connections 2024-05-27T12:32:53.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.479+0000 7f55027f7640 1 --2- 172.21.15.55:0/2256673620 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f54f4006ba0 0x7f54f403c110 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:53.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.479+0000 7f55027f7640 1 --2- 172.21.15.55:0/2256673620 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f54f40061e0 0x7f54f4006660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:53.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.479+0000 7f55027f7640 1 -- 172.21.15.55:0/2256673620 >> 172.21.15.55:0/2256673620 conn(0x7f54f4058ee0 msgr2=0x7f54f40592f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:53.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.479+0000 7f47a57fa640 1 -- 172.21.15.55:0/2142003152 <== mon.1 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f479c01a070 con 0x7f47a00cde00 2024-05-27T12:32:53.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.478+0000 7f47add80640 1 -- 172.21.15.55:0/2142003152 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4788005290 con 0x7f47a00cde00 2024-05-27T12:32:53.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.479+0000 7f55027f7640 1 -- 172.21.15.55:0/2256673620 shutdown_connections 2024-05-27T12:32:53.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.480+0000 7f55027f7640 1 -- 172.21.15.55:0/2256673620 wait complete. 2024-05-27T12:32:53.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.479+0000 7faeec5d8640 1 -- 172.21.15.55:0/756495107 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faee4068a70 con 0x7faee4162f20 2024-05-27T12:32:53.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.480+0000 7fb937683640 1 Processor -- start 2024-05-27T12:32:53.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.480+0000 7faedaffd640 1 -- 172.21.15.55:0/756495107 <== mon.2 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7faee001a070 con 0x7faee4162f20 2024-05-27T12:32:53.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.480+0000 7fb937683640 1 -- start start 2024-05-27T12:32:53.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.480+0000 7f47a57fa640 1 --2- 172.21.15.55:0/2142003152 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f478c06c8f0 0x7f478c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:53.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.480+0000 7f47a57fa640 1 -- 172.21.15.55:0/2142003152 <== mon.1 v2:172.21.15.72:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f479c08bbc0 con 0x7f47a00cde00 2024-05-27T12:32:53.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.480+0000 7f20559d3640 1 -- 172.21.15.55:0/3649055500 shutdown_connections 2024-05-27T12:32:53.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.480+0000 7f20559d3640 1 -- 172.21.15.55:0/3649055500 wait complete. 2024-05-27T12:32:53.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.480+0000 7f47a7fff640 1 --2- 172.21.15.55:0/2142003152 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f478c06c8f0 0x7f478c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:53.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.481+0000 7f56e52fa640 1 -- 172.21.15.55:0/158716353 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f56e00b46d0 msgr2=0x7f56e006ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:53.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.481+0000 7f56e52fa640 1 --2- 172.21.15.55:0/158716353 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f56e00b46d0 0x7f56e006ee70 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f56d8009d90 tx=0x7f56d802a5d0 comp rx=0 tx=0).stop 2024-05-27T12:32:53.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.480+0000 7faedaffd640 1 --2- 172.21.15.55:0/756495107 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7faec806c9c0 0x7faec806ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:53.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.480+0000 7faedaffd640 1 -- 172.21.15.55:0/756495107 <== mon.2 v2:172.21.15.72:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7faee008ae10 con 0x7faee4162f20 2024-05-27T12:32:53.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.481+0000 7faeea374640 1 --2- 172.21.15.55:0/756495107 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7faec806c9c0 0x7faec806ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:53.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.481+0000 7f56e52fa640 1 -- 172.21.15.55:0/158716353 shutdown_connections 2024-05-27T12:32:53.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.481+0000 7f56e52fa640 1 --2- 172.21.15.55:0/158716353 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f56e00b46d0 0x7f56e006ee70 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:53.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.481+0000 7f56e52fa640 1 --2- 172.21.15.55:0/158716353 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f56e0162b40 0x7f56e00cd200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:53.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.481+0000 7f56e52fa640 1 -- 172.21.15.55:0/158716353 >> 172.21.15.55:0/158716353 conn(0x7f56e00b2240 msgr2=0x7f56e00b2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:53.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.481+0000 7fb937683640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb9300b46d0 0x7fb9301532e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:53.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.481+0000 7f56e52fa640 1 -- 172.21.15.55:0/158716353 shutdown_connections 2024-05-27T12:32:53.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.481+0000 7f47a7fff640 1 --2- 172.21.15.55:0/2142003152 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f478c06c8f0 0x7f478c06edb0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4794006bc0 tx=0x7f4794006b50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:53.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.481+0000 7faeea374640 1 --2- 172.21.15.55:0/756495107 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7faec806c9c0 0x7faec806ee80 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7faed40011e0 tx=0x7faed4007d30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:53.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.481+0000 7fb937683640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb930162b40 0x7fb93015f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:53.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.481+0000 7fb93541f640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb9300b46d0 0x7fb9301532e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:53.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.481+0000 7fb93541f640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb9300b46d0 0x7fb9301532e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.55:40408/0 (socket says 172.21.15.55:40408) 2024-05-27T12:32:53.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.481+0000 7fb934c1e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb930162b40 0x7fb93015f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:53.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.482+0000 7fb934c1e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb930162b40 0x7fb93015f250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57504/0 (socket says 172.21.15.55:57504) 2024-05-27T12:32:53.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.482+0000 7fb93541f640 1 -- 172.21.15.55:0/1572232763 learned_addr learned my addr 172.21.15.55:0/1572232763 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:32:53.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.482+0000 7fb937683640 1 --2- 172.21.15.55:0/1572232763 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb930162f20 0x7fb93015f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:53.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.482+0000 7fb937683640 1 -- 172.21.15.55:0/1572232763 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7fb930166a40 con 0x7fb930162b40 2024-05-27T12:32:53.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.482+0000 7f55027f7640 1 Processor -- start 2024-05-27T12:32:53.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.482+0000 7f55027f7640 1 -- start start 2024-05-27T12:32:53.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.482+0000 7f20559d3640 1 Processor -- start 2024-05-27T12:32:53.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.481+0000 7f56e52fa640 1 -- 172.21.15.55:0/158716353 wait complete. 2024-05-27T12:32:53.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.482+0000 7f20559d3640 1 -- start start 2024-05-27T12:32:53.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.482+0000 7fb937683640 1 -- 172.21.15.55:0/1572232763 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fb9301668c0 con 0x7fb930162f20 2024-05-27T12:32:53.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.482+0000 7fb937683640 1 -- 172.21.15.55:0/1572232763 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fb9300afce0 con 0x7fb9300b46d0 2024-05-27T12:32:53.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.482+0000 7fb935c20640 1 --2- 172.21.15.55:0/1572232763 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb930162f20 0x7fb93015f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:53.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.483+0000 7fb93541f640 1 -- 172.21.15.55:0/1572232763 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb930162f20 msgr2=0x7fb93015f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:53.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.483+0000 7fb93541f640 1 --2- 172.21.15.55:0/1572232763 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb930162f20 0x7fb93015f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:53.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.483+0000 7fb93541f640 1 -- 172.21.15.55:0/1572232763 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb930162b40 msgr2=0x7fb93015f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:53.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.483+0000 7fb93541f640 1 --2- 172.21.15.55:0/1572232763 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb930162b40 0x7fb93015f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:53.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.483+0000 7fb93541f640 1 -- 172.21.15.55:0/1572232763 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9300cdfa0 con 0x7fb9300b46d0 2024-05-27T12:32:53.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.483+0000 7fb935c20640 1 --2- 172.21.15.55:0/1572232763 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb930162f20 0x7fb93015f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T12:32:53.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.483+0000 7fb934c1e640 1 --2- 172.21.15.55:0/1572232763 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb930162b40 0x7fb93015f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T12:32:53.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.483+0000 7fb93541f640 1 --2- 172.21.15.55:0/1572232763 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb9300b46d0 0x7fb9301532e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fb92c00b450 tx=0x7fb92c00b910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:53.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.483+0000 7f56e52fa640 1 Processor -- start 2024-05-27T12:32:53.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.483+0000 7f20559d3640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2050071d20 0x7f20501f0a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:53.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.483+0000 7f56e52fa640 1 -- start start 2024-05-27T12:32:53.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.483+0000 7f55027f7640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54f40061e0 0x7f54f40ce240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:53.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.483+0000 7f20559d3640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2050158310 0x7f20500ac260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:53.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.483+0000 7f55027f7640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f54f4006ba0 0x7f54f403e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:53.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.483+0000 7f20559d3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f205015b5e0 0x7f205015a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:53.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.483+0000 7f55027f7640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f54f40e32f0 0x7f54f403e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:53.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.483+0000 7f55027f7640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f54f4058bd0 con 0x7f54f40e32f0 2024-05-27T12:32:53.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.483+0000 7f55027f7640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f54f40583d0 con 0x7f54f40061e0 2024-05-27T12:32:53.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.483+0000 7f55027f7640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f54f40e45c0 con 0x7f54f4006ba0 2024-05-27T12:32:53.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.483+0000 7f20559d3640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f20500ce5e0 con 0x7f205015b5e0 2024-05-27T12:32:53.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.483+0000 7f20559d3640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f20501586f0 con 0x7f2050158310 2024-05-27T12:32:53.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.483+0000 7f20559d3640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f20500ce760 con 0x7f2050071d20 2024-05-27T12:32:53.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.483+0000 7f20549d1640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2050071d20 0x7f20501f0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:53.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.484+0000 7f204ffff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2050158310 0x7f20500ac260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:53.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.484+0000 7f5501ff6640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f54f40e32f0 0x7f54f403e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:53.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.484+0000 7f20549d1640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2050071d20 0x7f20501f0a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.55:40416/0 (socket says 172.21.15.55:40416) 2024-05-27T12:32:53.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.484+0000 7f20549d1640 1 -- 172.21.15.55:0/3212250742 learned_addr learned my addr 172.21.15.55:0/3212250742 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:32:53.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.484+0000 7f5501ff6640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f54f40e32f0 0x7f54f403e740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57510/0 (socket says 172.21.15.55:57510) 2024-05-27T12:32:53.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.484+0000 7f20551d2640 1 --2- 172.21.15.55:0/3212250742 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f205015b5e0 0x7f205015a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:53.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.484+0000 7f5501ff6640 1 -- 172.21.15.55:0/371683814 learned_addr learned my addr 172.21.15.55:0/371683814 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:32:53.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.484+0000 7f55017f5640 1 --2- 172.21.15.55:0/371683814 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54f40061e0 0x7f54f40ce240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:53.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.484+0000 7f20549d1640 1 -- 172.21.15.55:0/3212250742 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2050158310 msgr2=0x7f20500ac260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:53.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.484+0000 7f20549d1640 1 --2- 172.21.15.55:0/3212250742 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2050158310 0x7f20500ac260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:53.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.484+0000 7f20549d1640 1 -- 172.21.15.55:0/3212250742 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f205015b5e0 msgr2=0x7f205015a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:53.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.484+0000 7f20549d1640 1 --2- 172.21.15.55:0/3212250742 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f205015b5e0 0x7f205015a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:53.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.484+0000 7f20549d1640 1 -- 172.21.15.55:0/3212250742 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20501f0fd0 con 0x7f2050071d20 2024-05-27T12:32:53.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.484+0000 7f5500ff4640 1 --2- 172.21.15.55:0/371683814 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f54f4006ba0 0x7f54f403e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:53.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.484+0000 7f204ffff640 1 --2- 172.21.15.55:0/3212250742 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2050158310 0x7f20500ac260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T12:32:53.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.484+0000 7f20549d1640 1 --2- 172.21.15.55:0/3212250742 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2050071d20 0x7f20501f0a90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2048000f80 tx=0x7f2048004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:53.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.484+0000 7f5501ff6640 1 -- 172.21.15.55:0/371683814 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f54f4006ba0 msgr2=0x7f54f403e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:53.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.484+0000 7f5501ff6640 1 --2- 172.21.15.55:0/371683814 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f54f4006ba0 0x7f54f403e200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:53.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.484+0000 7f5501ff6640 1 -- 172.21.15.55:0/371683814 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54f40061e0 msgr2=0x7f54f40ce240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:53.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.484+0000 7f5501ff6640 1 --2- 172.21.15.55:0/371683814 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54f40061e0 0x7f54f40ce240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:53.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.484+0000 7f5501ff6640 1 -- 172.21.15.55:0/371683814 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54f40e39f0 con 0x7f54f40e32f0 2024-05-27T12:32:53.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.485+0000 7f55017f5640 1 --2- 172.21.15.55:0/371683814 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54f40061e0 0x7f54f40ce240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T12:32:53.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.485+0000 7f5500ff4640 1 --2- 172.21.15.55:0/371683814 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f54f4006ba0 0x7f54f403e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T12:32:53.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.485+0000 7f56e52fa640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56e00b46d0 0x7f56e01643f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:53.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.485+0000 7f5501ff6640 1 --2- 172.21.15.55:0/371683814 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f54f40e32f0 0x7f54f403e740 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f54fc076910 tx=0x7f54fc069780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:53.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.485+0000 7f56e52fa640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f56e0162b40 0x7f56e01565b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:53.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.485+0000 7f56e52fa640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f56e0162f20 0x7f56e015bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:53.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.485+0000 7f56deffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56e00b46d0 0x7f56e01643f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:53.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.485+0000 7f204d7fa640 1 -- 172.21.15.55:0/3212250742 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2048047020 con 0x7f2050071d20 2024-05-27T12:32:53.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.485+0000 7f204d7fa640 1 -- 172.21.15.55:0/3212250742 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2048043670 con 0x7f2050071d20 2024-05-27T12:32:53.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.485+0000 7fb925ffb640 1 -- 172.21.15.55:0/1572232763 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb92c015020 con 0x7fb9300b46d0 2024-05-27T12:32:53.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.485+0000 7f204d7fa640 1 -- 172.21.15.55:0/3212250742 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2048043a60 con 0x7f2050071d20 2024-05-27T12:32:53.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.485+0000 7f20559d3640 1 -- 172.21.15.55:0/3212250742 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20501f17a0 con 0x7f2050071d20 2024-05-27T12:32:53.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.485+0000 7fb925ffb640 1 -- 172.21.15.55:0/1572232763 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb92c0118b0 con 0x7fb9300b46d0 2024-05-27T12:32:53.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.485+0000 7f56deffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56e00b46d0 0x7f56e01643f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57524/0 (socket says 172.21.15.55:57524) 2024-05-27T12:32:53.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.485+0000 7faedaffd640 1 -- 172.21.15.55:0/756495107 <== mon.2 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7faee0058bd0 con 0x7faee4162f20 2024-05-27T12:32:53.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.485+0000 7f56de7fc640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f56e0162b40 0x7f56e01565b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:53.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.485+0000 7f56de7fc640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f56e0162b40 0x7f56e01565b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.55:40440/0 (socket says 172.21.15.55:40440) 2024-05-27T12:32:53.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.485+0000 7f54f1ffb640 1 -- 172.21.15.55:0/371683814 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54fc0b3050 con 0x7f54f40e32f0 2024-05-27T12:32:53.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.486+0000 7f56e52fa640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f56e0166a40 con 0x7f56e00b46d0 2024-05-27T12:32:53.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.485+0000 7f20559d3640 1 -- 172.21.15.55:0/3212250742 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f20501f1d60 con 0x7f2050071d20 2024-05-27T12:32:53.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.486+0000 7f47a57fa640 1 -- 172.21.15.55:0/2142003152 <== mon.1 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f479c059910 con 0x7f47a00cde00 2024-05-27T12:32:53.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.485+0000 7f54f1ffb640 1 -- 172.21.15.55:0/371683814 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54fc0b4040 con 0x7f54f40e32f0 2024-05-27T12:32:53.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.486+0000 7fb925ffb640 1 -- 172.21.15.55:0/1572232763 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb92c011ca0 con 0x7fb9300b46d0 2024-05-27T12:32:53.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.486+0000 7fb937683640 1 -- 172.21.15.55:0/1572232763 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9300ce280 con 0x7fb9300b46d0 2024-05-27T12:32:53.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.486+0000 7f55027f7640 1 -- 172.21.15.55:0/371683814 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54f40e3c90 con 0x7f54f40e32f0 2024-05-27T12:32:53.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.486+0000 7fb937683640 1 -- 172.21.15.55:0/1572232763 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb930163d20 con 0x7fb9300b46d0 2024-05-27T12:32:53.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.487+0000 7f55027f7640 1 -- 172.21.15.55:0/371683814 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54f40e4250 con 0x7f54f40e32f0 2024-05-27T12:32:53.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.487+0000 7f54f1ffb640 1 -- 172.21.15.55:0/371683814 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54fc0b3050 con 0x7f54f40e32f0 2024-05-27T12:32:53.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.487+0000 7f20559d3640 1 -- 172.21.15.55:0/3212250742 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2050075460 con 0x7f2050071d20 2024-05-27T12:32:53.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.487+0000 7f204d7fa640 1 -- 172.21.15.55:0/3212250742 <== mon.2 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f204804a020 con 0x7f2050071d20 2024-05-27T12:32:53.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.488+0000 7f204d7fa640 1 --2- 172.21.15.55:0/3212250742 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f203c06c940 0x7f203c06ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:53.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.488+0000 7f204d7fa640 1 -- 172.21.15.55:0/3212250742 <== mon.2 v2:172.21.15.72:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f20480b0b90 con 0x7f2050071d20 2024-05-27T12:32:53.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.488+0000 7f55027f7640 1 -- 172.21.15.55:0/371683814 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54f4005700 con 0x7f54f40e32f0 2024-05-27T12:32:53.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.488+0000 7f204ffff640 1 --2- 172.21.15.55:0/3212250742 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f203c06c940 0x7f203c06ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:53.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.488+0000 7fb9137fe640 1 -- 172.21.15.55:0/1572232763 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb90c005290 con 0x7fb9300b46d0 2024-05-27T12:32:53.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.489+0000 7f204ffff640 1 --2- 172.21.15.55:0/3212250742 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f203c06c940 0x7f203c06ee00 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f2040007fd0 tx=0x7f2040009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:53.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.487+0000 7f56deffd640 1 -- 172.21.15.55:0/3296333681 learned_addr learned my addr 172.21.15.55:0/3296333681 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:32:53.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.489+0000 7f56e52fa640 1 -- 172.21.15.55:0/3296333681 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f56e01668c0 con 0x7f56e0162f20 2024-05-27T12:32:53.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.489+0000 7f56e52fa640 1 -- 172.21.15.55:0/3296333681 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f56e00afce0 con 0x7f56e0162b40 2024-05-27T12:32:53.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.489+0000 7f56deffd640 1 -- 172.21.15.55:0/3296333681 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f56e0162b40 msgr2=0x7f56e01565b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:53.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.489+0000 7f56deffd640 1 --2- 172.21.15.55:0/3296333681 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f56e0162b40 0x7f56e01565b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:53.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.489+0000 7f56deffd640 1 -- 172.21.15.55:0/3296333681 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f56e0162f20 msgr2=0x7f56e015bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:53.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.489+0000 7f56deffd640 1 --2- 172.21.15.55:0/3296333681 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f56e0162f20 0x7f56e015bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:53.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.489+0000 7f56deffd640 1 -- 172.21.15.55:0/3296333681 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56e01633c0 con 0x7f56e00b46d0 2024-05-27T12:32:53.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.490+0000 7f56de7fc640 1 --2- 172.21.15.55:0/3296333681 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f56e0162b40 0x7f56e01565b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2024-05-27T12:32:53.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.490+0000 7f56deffd640 1 --2- 172.21.15.55:0/3296333681 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56e00b46d0 0x7f56e01643f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f56d000e8b0 tx=0x7f56d000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:53.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.490+0000 7f54f1ffb640 1 -- 172.21.15.55:0/371683814 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f54fc0c1020 con 0x7f54f40e32f0 2024-05-27T12:32:53.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.490+0000 7fb925ffb640 1 -- 172.21.15.55:0/1572232763 <== mon.2 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb92c018020 con 0x7fb9300b46d0 2024-05-27T12:32:53.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.490+0000 7fb925ffb640 1 --2- 172.21.15.55:0/1572232763 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fb91406c9c0 0x7fb91406ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:53.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.490+0000 7f54f1ffb640 1 --2- 172.21.15.55:0/371683814 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f54e006cd20 0x7f54e006f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:53.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.491+0000 7fb925ffb640 1 -- 172.21.15.55:0/1572232763 <== mon.2 v2:172.21.15.72:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fb92c08bbd0 con 0x7fb9300b46d0 2024-05-27T12:32:53.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.491+0000 7fb934c1e640 1 --2- 172.21.15.55:0/1572232763 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fb91406c9c0 0x7fb91406ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:53.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.491+0000 7f54f1ffb640 1 -- 172.21.15.55:0/371683814 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f54fc0bf020 con 0x7f54f40e32f0 2024-05-27T12:32:53.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.491+0000 7f55017f5640 1 --2- 172.21.15.55:0/371683814 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f54e006cd20 0x7f54e006f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:53.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.491+0000 7fb934c1e640 1 --2- 172.21.15.55:0/1572232763 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fb91406c9c0 0x7fb91406ee80 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb920034000 tx=0x7fb92002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:53.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.492+0000 7f55017f5640 1 --2- 172.21.15.55:0/371683814 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f54e006cd20 0x7f54e006f1e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f54f8007c90 tx=0x7f54f8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:53.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.493+0000 7f204d7fa640 1 -- 172.21.15.55:0/3212250742 <== mon.2 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f204807eae0 con 0x7f2050071d20 2024-05-27T12:32:53.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.497+0000 7fb925ffb640 1 -- 172.21.15.55:0/1572232763 <== mon.2 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb92c01f020 con 0x7fb9300b46d0 2024-05-27T12:32:53.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.498+0000 7f56c77fe640 1 -- 172.21.15.55:0/3296333681 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56d0017070 con 0x7f56e00b46d0 2024-05-27T12:32:53.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.498+0000 7f56c77fe640 1 -- 172.21.15.55:0/3296333681 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56d000c940 con 0x7f56e00b46d0 2024-05-27T12:32:53.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.498+0000 7f56c77fe640 1 -- 172.21.15.55:0/3296333681 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56d000cd10 con 0x7f56e00b46d0 2024-05-27T12:32:53.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.499+0000 7f56e52fa640 1 -- 172.21.15.55:0/3296333681 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56e0163630 con 0x7f56e00b46d0 2024-05-27T12:32:53.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.499+0000 7f54f1ffb640 1 -- 172.21.15.55:0/371683814 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f54fc0c8020 con 0x7f54f40e32f0 2024-05-27T12:32:53.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.499+0000 7f56e52fa640 1 -- 172.21.15.55:0/3296333681 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56e0163bf0 con 0x7f56e00b46d0 2024-05-27T12:32:53.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.502+0000 7f56c77fe640 1 -- 172.21.15.55:0/3296333681 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f56d001a070 con 0x7f56e00b46d0 2024-05-27T12:32:53.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.502+0000 7f56c77fe640 1 --2- 172.21.15.55:0/3296333681 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f56cc06c9c0 0x7f56cc06ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:53.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.502+0000 7f56c77fe640 1 -- 172.21.15.55:0/3296333681 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f56d008ba10 con 0x7f56e00b46d0 2024-05-27T12:32:53.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.503+0000 7f56de7fc640 1 --2- 172.21.15.55:0/3296333681 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f56cc06c9c0 0x7f56cc06ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:53.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.504+0000 7f56de7fc640 1 --2- 172.21.15.55:0/3296333681 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f56cc06c9c0 0x7f56cc06ee80 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f56e00d1450 tx=0x7f56d4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:53.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.504+0000 7f56e52fa640 1 -- 172.21.15.55:0/3296333681 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56e0068a70 con 0x7f56e00b46d0 2024-05-27T12:32:53.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.514+0000 7f56c77fe640 1 -- 172.21.15.55:0/3296333681 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f56d0059eb0 con 0x7f56e00b46d0 2024-05-27T12:32:53.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.875+0000 7f5e2f59e640 1 -- 172.21.15.55:0/1090517714 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f5e14005580 con 0x7f5e280e3d40 2024-05-27T12:32:53.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.875+0000 7f5e1effd640 1 -- 172.21.15.55:0/1090517714 <== mon.2 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5e2005d0a0 con 0x7f5e280e3d40 2024-05-27T12:32:53.875 INFO:teuthology.orchestra.run.smithi055.stdout:64424509447 2024-05-27T12:32:53.876 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.877+0000 7fd025d76640 1 -- 172.21.15.55:0/3050447695 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fd018050340 con 0x7fd018007340 2024-05-27T12:32:53.877 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.878+0000 7fd01d7fa640 1 -- 172.21.15.55:0/3050447695 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd0200d8c80 con 0x7fd018007340 2024-05-27T12:32:53.877 INFO:teuthology.orchestra.run.smithi055.stdout:64424509447 2024-05-27T12:32:53.878 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.878+0000 7f5e1cff9640 1 -- 172.21.15.55:0/1090517714 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f5e1006c950 msgr2=0x7f5e1006ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:53.879 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.878+0000 7f5e1cff9640 1 --2- 172.21.15.55:0/1090517714 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f5e1006c950 0x7f5e1006ee10 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5e240345d0 tx=0x7f5e24030000 comp rx=0 tx=0).stop 2024-05-27T12:32:53.879 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.879+0000 7f5e1cff9640 1 -- 172.21.15.55:0/1090517714 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5e280e3d40 msgr2=0x7f5e280e41c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:53.879 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.879+0000 7f5e1cff9640 1 --2- 172.21.15.55:0/1090517714 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5e280e3d40 0x7f5e280e41c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5e28055910 tx=0x7f5e2000ec10 comp rx=0 tx=0).stop 2024-05-27T12:32:53.879 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.879+0000 7f5e1cff9640 1 -- 172.21.15.55:0/1090517714 shutdown_connections 2024-05-27T12:32:53.879 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.879+0000 7f5e1cff9640 1 --2- 172.21.15.55:0/1090517714 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5e280e3d40 0x7f5e280e41c0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:53.879 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.879+0000 7f5e1cff9640 1 --2- 172.21.15.55:0/1090517714 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f5e1006c950 0x7f5e1006ee10 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:53.879 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.879+0000 7f5e1cff9640 1 --2- 172.21.15.55:0/1090517714 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e28187b10 0x7f5e280e3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:53.879 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.879+0000 7f5e1cff9640 1 --2- 172.21.15.55:0/1090517714 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e18003a00 0x7f5e281875d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:53.879 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.879+0000 7f5e1cff9640 1 -- 172.21.15.55:0/1090517714 >> 172.21.15.55:0/1090517714 conn(0x7f5e2803aa40 msgr2=0x7f5e280e6a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:53.879 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.879+0000 7f5e1cff9640 1 -- 172.21.15.55:0/1090517714 shutdown_connections 2024-05-27T12:32:53.879 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.879+0000 7f5e1cff9640 1 -- 172.21.15.55:0/1090517714 wait complete. 2024-05-27T12:32:53.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.882+0000 7fd025d76640 1 -- 172.21.15.55:0/3050447695 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fd00c06c9c0 msgr2=0x7fd00c06ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:53.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.882+0000 7fd025d76640 1 --2- 172.21.15.55:0/3050447695 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fd00c06c9c0 0x7fd00c06ee80 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd0180e49f0 tx=0x7fd01002e000 comp rx=0 tx=0).stop 2024-05-27T12:32:53.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.882+0000 7fd025d76640 1 -- 172.21.15.55:0/3050447695 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd018007340 msgr2=0x7fd0180d44a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:53.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.882+0000 7fd025d76640 1 --2- 172.21.15.55:0/3050447695 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd018007340 0x7fd0180d44a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fd02002db50 tx=0x7fd02006dd20 comp rx=0 tx=0).stop 2024-05-27T12:32:53.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.883+0000 7fd025d76640 1 -- 172.21.15.55:0/3050447695 shutdown_connections 2024-05-27T12:32:53.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.883+0000 7fd025d76640 1 --2- 172.21.15.55:0/3050447695 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fd00c06c9c0 0x7fd00c06ee80 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:53.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.883+0000 7fd025d76640 1 --2- 172.21.15.55:0/3050447695 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd0180e7760 0x7fd01804d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:53.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.883+0000 7fd025d76640 1 --2- 172.21.15.55:0/3050447695 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd01800b0b0 0x7fd01804cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:53.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.883+0000 7fd025d76640 1 --2- 172.21.15.55:0/3050447695 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd018007340 0x7fd0180d44a0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:53.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.883+0000 7fd025d76640 1 -- 172.21.15.55:0/3050447695 >> 172.21.15.55:0/3050447695 conn(0x7fd01800a400 msgr2=0x7fd0180e1500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:53.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.883+0000 7fd025d76640 1 -- 172.21.15.55:0/3050447695 shutdown_connections 2024-05-27T12:32:53.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.883+0000 7fd025d76640 1 -- 172.21.15.55:0/3050447695 wait complete. 2024-05-27T12:32:53.896 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.6 2024-05-27T12:32:53.896 DEBUG:teuthology.parallel:result is None 2024-05-27T12:32:53.900 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.3 2024-05-27T12:32:53.900 DEBUG:teuthology.parallel:result is None 2024-05-27T12:32:53.909 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.910+0000 7f47add80640 1 -- 172.21.15.55:0/2142003152 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f4788005580 con 0x7f47a00cde00 2024-05-27T12:32:53.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.911+0000 7f47a57fa640 1 -- 172.21.15.55:0/2142003152 <== mon.1 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f479c05dc10 con 0x7f47a00cde00 2024-05-27T12:32:53.910 INFO:teuthology.orchestra.run.smithi055.stdout:64424509447 2024-05-27T12:32:53.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.912+0000 7f55027f7640 1 -- 172.21.15.55:0/371683814 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f54f403bad0 con 0x7f54f40e32f0 2024-05-27T12:32:53.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.912+0000 7f54f1ffb640 1 -- 172.21.15.55:0/371683814 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f54fc0f5390 con 0x7f54f40e32f0 2024-05-27T12:32:53.912 INFO:teuthology.orchestra.run.smithi055.stdout:64424509447 2024-05-27T12:32:53.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.914+0000 7f47add80640 1 -- 172.21.15.55:0/2142003152 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f478c06c8f0 msgr2=0x7f478c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:53.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.914+0000 7f47add80640 1 --2- 172.21.15.55:0/2142003152 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f478c06c8f0 0x7f478c06edb0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4794006bc0 tx=0x7f4794006b50 comp rx=0 tx=0).stop 2024-05-27T12:32:53.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.914+0000 7f47add80640 1 -- 172.21.15.55:0/2142003152 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47a00cde00 msgr2=0x7f47a004c140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:53.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.914+0000 7f47add80640 1 --2- 172.21.15.55:0/2142003152 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47a00cde00 0x7f47a004c140 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f479c00e870 tx=0x7f479c00ed30 comp rx=0 tx=0).stop 2024-05-27T12:32:53.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.914+0000 7f47add80640 1 -- 172.21.15.55:0/2142003152 shutdown_connections 2024-05-27T12:32:53.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.914+0000 7f47add80640 1 --2- 172.21.15.55:0/2142003152 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f47a0039bf0 0x7f47a003a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:53.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.914+0000 7f47add80640 1 --2- 172.21.15.55:0/2142003152 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47a00ce1e0 0x7f47a0049f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:53.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.914+0000 7f47add80640 1 --2- 172.21.15.55:0/2142003152 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f478c06c8f0 0x7f478c06edb0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:53.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.914+0000 7f47add80640 1 --2- 172.21.15.55:0/2142003152 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47a00cde00 0x7f47a004c140 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:53.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.914+0000 7f47add80640 1 -- 172.21.15.55:0/2142003152 >> 172.21.15.55:0/2142003152 conn(0x7f47a0055bc0 msgr2=0x7f47a00de260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:53.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.914+0000 7f47add80640 1 -- 172.21.15.55:0/2142003152 shutdown_connections 2024-05-27T12:32:53.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.914+0000 7f47add80640 1 -- 172.21.15.55:0/2142003152 wait complete. 2024-05-27T12:32:53.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.915+0000 7f55027f7640 1 -- 172.21.15.55:0/371683814 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f54e006cd20 msgr2=0x7f54e006f1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:53.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.915+0000 7f55027f7640 1 --2- 172.21.15.55:0/371683814 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f54e006cd20 0x7f54e006f1e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f54f8007c90 tx=0x7f54f8009040 comp rx=0 tx=0).stop 2024-05-27T12:32:53.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.915+0000 7f55027f7640 1 -- 172.21.15.55:0/371683814 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f54f40e32f0 msgr2=0x7f54f403e740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:53.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.915+0000 7f55027f7640 1 --2- 172.21.15.55:0/371683814 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f54f40e32f0 0x7f54f403e740 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f54fc076910 tx=0x7f54fc069780 comp rx=0 tx=0).stop 2024-05-27T12:32:53.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.915+0000 7f55027f7640 1 -- 172.21.15.55:0/371683814 shutdown_connections 2024-05-27T12:32:53.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.915+0000 7f55027f7640 1 --2- 172.21.15.55:0/371683814 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f54f40e32f0 0x7f54f403e740 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:53.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.915+0000 7f55027f7640 1 --2- 172.21.15.55:0/371683814 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f54f4006ba0 0x7f54f403e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:53.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.915+0000 7f55027f7640 1 --2- 172.21.15.55:0/371683814 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f54e006cd20 0x7f54e006f1e0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:53.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.915+0000 7f55027f7640 1 --2- 172.21.15.55:0/371683814 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54f40061e0 0x7f54f40ce240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:53.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.915+0000 7f55027f7640 1 -- 172.21.15.55:0/371683814 >> 172.21.15.55:0/371683814 conn(0x7f54f4058ee0 msgr2=0x7f54f403a160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:53.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.915+0000 7f55027f7640 1 -- 172.21.15.55:0/371683814 shutdown_connections 2024-05-27T12:32:53.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.915+0000 7f55027f7640 1 -- 172.21.15.55:0/371683814 wait complete. 2024-05-27T12:32:53.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.920+0000 7f56e52fa640 1 -- 172.21.15.55:0/3296333681 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f56e006e5d0 con 0x7f56e00b46d0 2024-05-27T12:32:53.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.921+0000 7f56c77fe640 1 -- 172.21.15.55:0/3296333681 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f56d00597b0 con 0x7f56e00b46d0 2024-05-27T12:32:53.920 INFO:teuthology.orchestra.run.smithi055.stdout:64424509447 2024-05-27T12:32:53.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.923+0000 7faeec5d8640 1 -- 172.21.15.55:0/756495107 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7faee406e5d0 con 0x7faee4162f20 2024-05-27T12:32:53.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.923+0000 7faedaffd640 1 -- 172.21.15.55:0/756495107 <== mon.2 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7faee005ced0 con 0x7faee4162f20 2024-05-27T12:32:53.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.923+0000 7f56e52fa640 1 -- 172.21.15.55:0/3296333681 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f56cc06c9c0 msgr2=0x7f56cc06ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:53.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.923+0000 7f56e52fa640 1 --2- 172.21.15.55:0/3296333681 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f56cc06c9c0 0x7f56cc06ee80 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f56e00d1450 tx=0x7f56d4009040 comp rx=0 tx=0).stop 2024-05-27T12:32:53.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.923+0000 7f56e52fa640 1 -- 172.21.15.55:0/3296333681 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56e00b46d0 msgr2=0x7f56e01643f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:53.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.923+0000 7f56e52fa640 1 --2- 172.21.15.55:0/3296333681 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56e00b46d0 0x7f56e01643f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f56d000e8b0 tx=0x7f56d000ed70 comp rx=0 tx=0).stop 2024-05-27T12:32:53.923 INFO:teuthology.orchestra.run.smithi055.stdout:64424509447 2024-05-27T12:32:53.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.924+0000 7f56e52fa640 1 -- 172.21.15.55:0/3296333681 shutdown_connections 2024-05-27T12:32:53.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.924+0000 7f56e52fa640 1 --2- 172.21.15.55:0/3296333681 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f56cc06c9c0 0x7f56cc06ee80 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:53.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.924+0000 7f56e52fa640 1 --2- 172.21.15.55:0/3296333681 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f56e0162f20 0x7f56e015bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:53.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.924+0000 7f56e52fa640 1 --2- 172.21.15.55:0/3296333681 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f56e0162b40 0x7f56e01565b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:53.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.924+0000 7f56e52fa640 1 --2- 172.21.15.55:0/3296333681 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56e00b46d0 0x7f56e01643f0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:53.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.924+0000 7f56e52fa640 1 -- 172.21.15.55:0/3296333681 >> 172.21.15.55:0/3296333681 conn(0x7f56e00b2240 msgr2=0x7f56e00b0c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:53.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.924+0000 7f56e52fa640 1 -- 172.21.15.55:0/3296333681 shutdown_connections 2024-05-27T12:32:53.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.924+0000 7f56e52fa640 1 -- 172.21.15.55:0/3296333681 wait complete. 2024-05-27T12:32:53.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.926+0000 7faeec5d8640 1 -- 172.21.15.55:0/756495107 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7faec806c9c0 msgr2=0x7faec806ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:53.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.926+0000 7faeec5d8640 1 --2- 172.21.15.55:0/756495107 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7faec806c9c0 0x7faec806ee80 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7faed40011e0 tx=0x7faed4007d30 comp rx=0 tx=0).stop 2024-05-27T12:32:53.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.926+0000 7faeec5d8640 1 -- 172.21.15.55:0/756495107 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faee4162f20 msgr2=0x7faee41556f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:53.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.926+0000 7faeec5d8640 1 --2- 172.21.15.55:0/756495107 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faee4162f20 0x7faee41556f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7faee000c3f0 tx=0x7faee000c8b0 comp rx=0 tx=0).stop 2024-05-27T12:32:53.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.926+0000 7faeec5d8640 1 -- 172.21.15.55:0/756495107 shutdown_connections 2024-05-27T12:32:53.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.926+0000 7faeec5d8640 1 --2- 172.21.15.55:0/756495107 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faee4162f20 0x7faee41556f0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:53.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.926+0000 7faeec5d8640 1 --2- 172.21.15.55:0/756495107 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faee4162b40 0x7faee4149620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:53.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.926+0000 7faeec5d8640 1 --2- 172.21.15.55:0/756495107 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7faec806c9c0 0x7faec806ee80 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:53.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.926+0000 7faeec5d8640 1 --2- 172.21.15.55:0/756495107 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faee40b46d0 0x7faee4153cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:53.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.926+0000 7faeec5d8640 1 -- 172.21.15.55:0/756495107 >> 172.21.15.55:0/756495107 conn(0x7faee40b2240 msgr2=0x7faee4071e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:53.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.926+0000 7faeec5d8640 1 -- 172.21.15.55:0/756495107 shutdown_connections 2024-05-27T12:32:53.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.926+0000 7faeec5d8640 1 -- 172.21.15.55:0/756495107 wait complete. 2024-05-27T12:32:53.927 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.7 2024-05-27T12:32:53.928 DEBUG:teuthology.parallel:result is None 2024-05-27T12:32:53.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.929+0000 7f20559d3640 1 -- 172.21.15.55:0/3212250742 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f205006f690 con 0x7f2050071d20 2024-05-27T12:32:53.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.930+0000 7f204d7fa640 1 -- 172.21.15.55:0/3212250742 <== mon.2 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f2048082de0 con 0x7f2050071d20 2024-05-27T12:32:53.929 INFO:teuthology.orchestra.run.smithi055.stdout:64424509447 2024-05-27T12:32:53.931 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.4 2024-05-27T12:32:53.931 DEBUG:teuthology.parallel:result is None 2024-05-27T12:32:53.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.933+0000 7f20559d3640 1 -- 172.21.15.55:0/3212250742 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f203c06c940 msgr2=0x7f203c06ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:53.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.933+0000 7f20559d3640 1 --2- 172.21.15.55:0/3212250742 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f203c06c940 0x7f203c06ee00 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f2040007fd0 tx=0x7f2040009040 comp rx=0 tx=0).stop 2024-05-27T12:32:53.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.933+0000 7f20559d3640 1 -- 172.21.15.55:0/3212250742 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2050071d20 msgr2=0x7f20501f0a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:53.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.933+0000 7f20559d3640 1 --2- 172.21.15.55:0/3212250742 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2050071d20 0x7f20501f0a90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2048000f80 tx=0x7f2048004a40 comp rx=0 tx=0).stop 2024-05-27T12:32:53.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.933+0000 7f20559d3640 1 -- 172.21.15.55:0/3212250742 shutdown_connections 2024-05-27T12:32:53.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.933+0000 7f20559d3640 1 --2- 172.21.15.55:0/3212250742 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f205015b5e0 0x7f205015a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:53.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.933+0000 7f20559d3640 1 --2- 172.21.15.55:0/3212250742 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f203c06c940 0x7f203c06ee00 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:53.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.933+0000 7f20559d3640 1 --2- 172.21.15.55:0/3212250742 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2050158310 0x7f20500ac260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:53.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.933+0000 7f20559d3640 1 --2- 172.21.15.55:0/3212250742 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2050071d20 0x7f20501f0a90 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:53.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.933+0000 7f20559d3640 1 -- 172.21.15.55:0/3212250742 >> 172.21.15.55:0/3212250742 conn(0x7f20500b5e50 msgr2=0x7f2050159080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:53.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.933+0000 7f20559d3640 1 -- 172.21.15.55:0/3212250742 shutdown_connections 2024-05-27T12:32:53.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.933+0000 7f20559d3640 1 -- 172.21.15.55:0/3212250742 wait complete. 2024-05-27T12:32:53.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.934+0000 7fb9137fe640 1 -- 172.21.15.55:0/1572232763 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fb90c005580 con 0x7fb9300b46d0 2024-05-27T12:32:53.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.935+0000 7fb925ffb640 1 -- 172.21.15.55:0/1572232763 <== mon.2 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb92c00d040 con 0x7fb9300b46d0 2024-05-27T12:32:53.934 INFO:teuthology.orchestra.run.smithi055.stdout:60129542153 2024-05-27T12:32:53.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.938+0000 7fb9137fe640 1 -- 172.21.15.55:0/1572232763 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fb91406c9c0 msgr2=0x7fb91406ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:53.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.938+0000 7fb9137fe640 1 --2- 172.21.15.55:0/1572232763 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fb91406c9c0 0x7fb91406ee80 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb920034000 tx=0x7fb92002e000 comp rx=0 tx=0).stop 2024-05-27T12:32:53.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.938+0000 7fb9137fe640 1 -- 172.21.15.55:0/1572232763 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb9300b46d0 msgr2=0x7fb9301532e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:53.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.938+0000 7fb9137fe640 1 --2- 172.21.15.55:0/1572232763 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb9300b46d0 0x7fb9301532e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fb92c00b450 tx=0x7fb92c00b910 comp rx=0 tx=0).stop 2024-05-27T12:32:53.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.938+0000 7fb9137fe640 1 -- 172.21.15.55:0/1572232763 shutdown_connections 2024-05-27T12:32:53.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.938+0000 7fb9137fe640 1 --2- 172.21.15.55:0/1572232763 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fb91406c9c0 0x7fb91406ee80 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:53.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.938+0000 7fb9137fe640 1 --2- 172.21.15.55:0/1572232763 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb930162f20 0x7fb93015f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:53.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.938+0000 7fb9137fe640 1 --2- 172.21.15.55:0/1572232763 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb930162b40 0x7fb93015f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:53.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.938+0000 7fb9137fe640 1 --2- 172.21.15.55:0/1572232763 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb9300b46d0 0x7fb9301532e0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:53.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.938+0000 7fb9137fe640 1 -- 172.21.15.55:0/1572232763 >> 172.21.15.55:0/1572232763 conn(0x7fb9300b2240 msgr2=0x7fb9300b00b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:53.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.938+0000 7fb9137fe640 1 -- 172.21.15.55:0/1572232763 shutdown_connections 2024-05-27T12:32:53.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:53.938+0000 7fb9137fe640 1 -- 172.21.15.55:0/1572232763 wait complete. 2024-05-27T12:32:53.940 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.5 2024-05-27T12:32:53.941 DEBUG:teuthology.parallel:result is None 2024-05-27T12:32:53.941 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.1 2024-05-27T12:32:53.941 DEBUG:teuthology.parallel:result is None 2024-05-27T12:32:53.950 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.2 2024-05-27T12:32:53.950 DEBUG:teuthology.parallel:result is None 2024-05-27T12:32:53.951 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542153 for osd.0 2024-05-27T12:32:53.951 DEBUG:teuthology.parallel:result is None 2024-05-27T12:32:53.951 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-27T12:32:53.951 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-27T12:32:54.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.096+0000 7f6543885640 1 Processor -- start 2024-05-27T12:32:54.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.096+0000 7f6543885640 1 -- start start 2024-05-27T12:32:54.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.097+0000 7f6543885640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f653c15e960 0x7f653c0b0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:54.097 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.097+0000 7f6543885640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f653c0707b0 0x7f653c15ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:54.097 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.097+0000 7f6543885640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f653c15f780 con 0x7f653c070c10 2024-05-27T12:32:54.097 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.097+0000 7f6543885640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f653c0b1100 con 0x7f653c15e960 2024-05-27T12:32:54.097 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.097+0000 7f6543885640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f653c15fa60 con 0x7f653c0707b0 2024-05-27T12:32:54.097 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.097+0000 7f6540e20640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f653c0707b0 0x7f653c15ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:54.097 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.097+0000 7f6541621640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f653c15e960 0x7f653c0b0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:54.097 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.097+0000 7f6540e20640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f653c0707b0 0x7f653c15ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.55:40446/0 (socket says 172.21.15.55:40446) 2024-05-27T12:32:54.097 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.097+0000 7f6540e20640 1 -- 172.21.15.55:0/1458789519 learned_addr learned my addr 172.21.15.55:0/1458789519 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:32:54.097 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.097+0000 7f6541e22640 1 --1- 172.21.15.55:0/1458789519 >> v1:172.21.15.72:6789/0 conn(0x7f653c070c10 0x7f653c06b930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.55:51900/0 (socket says 172.21.15.55:51900) 2024-05-27T12:32:54.097 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.097+0000 7f6541621640 1 -- 172.21.15.55:0/1458789519 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f653c0707b0 msgr2=0x7f653c15ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:32:54.097 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.097+0000 7f6541621640 1 --2- 172.21.15.55:0/1458789519 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f653c0707b0 0x7f653c15ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:54.097 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.097+0000 7f6541621640 1 -- 172.21.15.55:0/1458789519 >> v1:172.21.15.72:6789/0 conn(0x7f653c070c10 legacy=0x7f653c06b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:54.097 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.097+0000 7f6541621640 1 -- 172.21.15.55:0/1458789519 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f653c15fd40 con 0x7f653c15e960 2024-05-27T12:32:54.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.098+0000 7f6541621640 1 --2- 172.21.15.55:0/1458789519 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f653c15e960 0x7f653c0b0bc0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f65380097a0 tx=0x7f653802a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9c34dc91b428e3fa server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:54.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.098+0000 7f6533fff640 1 -- 172.21.15.55:0/1458789519 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6538037070 con 0x7f653c15e960 2024-05-27T12:32:54.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.098+0000 7f6533fff640 1 -- 172.21.15.55:0/1458789519 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f653802ae50 con 0x7f653c15e960 2024-05-27T12:32:54.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.098+0000 7f6533fff640 1 -- 172.21.15.55:0/1458789519 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6538032660 con 0x7f653c15e960 2024-05-27T12:32:54.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.099+0000 7f6543885640 1 -- 172.21.15.55:0/1458789519 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f653c15e960 msgr2=0x7f653c0b0bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:54.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.099+0000 7f6543885640 1 --2- 172.21.15.55:0/1458789519 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f653c15e960 0x7f653c0b0bc0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f65380097a0 tx=0x7f653802a100 comp rx=0 tx=0).stop 2024-05-27T12:32:54.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.099+0000 7f6543885640 1 -- 172.21.15.55:0/1458789519 shutdown_connections 2024-05-27T12:32:54.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.099+0000 7f6543885640 1 --2- 172.21.15.55:0/1458789519 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f653c0707b0 0x7f653c15ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:54.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.099+0000 7f6543885640 1 --2- 172.21.15.55:0/1458789519 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f653c15e960 0x7f653c0b0bc0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:54.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.099+0000 7f6543885640 1 -- 172.21.15.55:0/1458789519 >> 172.21.15.55:0/1458789519 conn(0x7f653c0b3360 msgr2=0x7f653c0b3770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:54.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.099+0000 7f6543885640 1 -- 172.21.15.55:0/1458789519 shutdown_connections 2024-05-27T12:32:54.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.099+0000 7f6543885640 1 -- 172.21.15.55:0/1458789519 wait complete. 2024-05-27T12:32:54.101 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.100+0000 7f6543885640 1 Processor -- start 2024-05-27T12:32:54.101 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.100+0000 7f6543885640 1 -- start start 2024-05-27T12:32:54.101 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.101+0000 7f6543885640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f653c0707b0 0x7f653c145810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:54.101 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.101+0000 7f6543885640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f653c15e960 0x7f653c153960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:54.101 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.101+0000 7f6543885640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f653c1424f0 0x7f653c142dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:54.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.101+0000 7f6543885640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f653c06c1c0 con 0x7f653c1424f0 2024-05-27T12:32:54.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.101+0000 7f6543885640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f653c06c040 con 0x7f653c15e960 2024-05-27T12:32:54.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.101+0000 7f6543885640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f653c15f280 con 0x7f653c0707b0 2024-05-27T12:32:54.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.101+0000 7f6540e20640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f653c15e960 0x7f653c153960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:54.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.101+0000 7f6541e22640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f653c1424f0 0x7f653c142dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:54.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.101+0000 7f6540e20640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f653c15e960 0x7f653c153960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.55:57866/0 (socket says 172.21.15.55:57866) 2024-05-27T12:32:54.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.101+0000 7f6540e20640 1 -- 172.21.15.55:0/444688046 learned_addr learned my addr 172.21.15.55:0/444688046 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:32:54.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.101+0000 7f6541621640 1 --2- 172.21.15.55:0/444688046 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f653c0707b0 0x7f653c145810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:54.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.101+0000 7f6541e22640 1 -- 172.21.15.55:0/444688046 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f653c0707b0 msgr2=0x7f653c145810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:54.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.101+0000 7f6541e22640 1 --2- 172.21.15.55:0/444688046 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f653c0707b0 0x7f653c145810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:54.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.101+0000 7f6541e22640 1 -- 172.21.15.55:0/444688046 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f653c15e960 msgr2=0x7f653c153960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:54.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.101+0000 7f6541e22640 1 --2- 172.21.15.55:0/444688046 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f653c15e960 0x7f653c153960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:54.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.101+0000 7f6541e22640 1 -- 172.21.15.55:0/444688046 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f653c155330 con 0x7f653c1424f0 2024-05-27T12:32:54.103 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.101+0000 7f6540e20640 1 --2- 172.21.15.55:0/444688046 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f653c15e960 0x7f653c153960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T12:32:54.103 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.102+0000 7f6541e22640 1 --2- 172.21.15.55:0/444688046 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f653c1424f0 0x7f653c142dd0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f653400c6f0 tx=0x7f653400cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:54.103 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.102+0000 7f6531ffb640 1 -- 172.21.15.55:0/444688046 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6534017070 con 0x7f653c1424f0 2024-05-27T12:32:54.103 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.102+0000 7f6531ffb640 1 -- 172.21.15.55:0/444688046 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6534005da0 con 0x7f653c1424f0 2024-05-27T12:32:54.103 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.102+0000 7f6543885640 1 -- 172.21.15.55:0/444688046 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f653c153ea0 con 0x7f653c1424f0 2024-05-27T12:32:54.103 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.102+0000 7f6531ffb640 1 -- 172.21.15.55:0/444688046 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f653400a840 con 0x7f653c1424f0 2024-05-27T12:32:54.103 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.102+0000 7f6543885640 1 -- 172.21.15.55:0/444688046 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f653c155890 con 0x7f653c1424f0 2024-05-27T12:32:54.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.103+0000 7f6543885640 1 -- 172.21.15.55:0/444688046 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f653c075460 con 0x7f653c1424f0 2024-05-27T12:32:54.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.103+0000 7f6531ffb640 1 -- 172.21.15.55:0/444688046 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f653401a070 con 0x7f653c1424f0 2024-05-27T12:32:54.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.104+0000 7f6531ffb640 1 --2- 172.21.15.55:0/444688046 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f652006c8f0 0x7f652006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:54.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.104+0000 7f6531ffb640 1 -- 172.21.15.55:0/444688046 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f653408af70 con 0x7f653c1424f0 2024-05-27T12:32:54.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.104+0000 7f6541621640 1 --2- 172.21.15.55:0/444688046 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f652006c8f0 0x7f652006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:54.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.105+0000 7f6541621640 1 --2- 172.21.15.55:0/444688046 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f652006c8f0 0x7f652006edb0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6538034000 tx=0x7f653802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:54.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.108+0000 7f6531ffb640 1 -- 172.21.15.55:0/444688046 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f653c155330 con 0x7f653c1424f0 2024-05-27T12:32:54.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.289+0000 7f6543885640 1 -- 172.21.15.55:0/444688046 --> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f653c0cfd60 con 0x7f652006c8f0 2024-05-27T12:32:54.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.295+0000 7f6531ffb640 1 -- 172.21.15.55:0/444688046 <== mgr.4105 v2:172.21.15.72:6832/3152720583 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251837 (secure 0 0 0) 0x7f653c0cfd60 con 0x7f652006c8f0 2024-05-27T12:32:54.297 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-27T12:32:54.298 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2024-05-27T12:32:54.300 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.298+0000 7f6543885640 1 -- 172.21.15.55:0/444688046 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f652006c8f0 msgr2=0x7f652006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:54.300 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.298+0000 7f6543885640 1 --2- 172.21.15.55:0/444688046 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f652006c8f0 0x7f652006edb0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6538034000 tx=0x7f653802e000 comp rx=0 tx=0).stop 2024-05-27T12:32:54.300 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.298+0000 7f6543885640 1 -- 172.21.15.55:0/444688046 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f653c1424f0 msgr2=0x7f653c142dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:54.300 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.298+0000 7f6543885640 1 --2- 172.21.15.55:0/444688046 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f653c1424f0 0x7f653c142dd0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f653400c6f0 tx=0x7f653400cbb0 comp rx=0 tx=0).stop 2024-05-27T12:32:54.300 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.298+0000 7f6543885640 1 -- 172.21.15.55:0/444688046 shutdown_connections 2024-05-27T12:32:54.300 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.298+0000 7f6543885640 1 --2- 172.21.15.55:0/444688046 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f653c1424f0 0x7f653c142dd0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:54.300 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.298+0000 7f6543885640 1 --2- 172.21.15.55:0/444688046 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f652006c8f0 0x7f652006edb0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:54.300 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.298+0000 7f6543885640 1 --2- 172.21.15.55:0/444688046 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f653c15e960 0x7f653c153960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:54.300 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.298+0000 7f6543885640 1 --2- 172.21.15.55:0/444688046 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f653c0707b0 0x7f653c145810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:54.300 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.298+0000 7f6543885640 1 -- 172.21.15.55:0/444688046 >> 172.21.15.55:0/444688046 conn(0x7f653c0b3360 msgr2=0x7f653c0b5ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:54.301 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.298+0000 7f6543885640 1 -- 172.21.15.55:0/444688046 shutdown_connections 2024-05-27T12:32:54.301 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.298+0000 7f6543885640 1 -- 172.21.15.55:0/444688046 wait complete. 2024-05-27T12:32:54.308 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":29,"stamp":"2024-05-27T12:32:53.265177+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235884,"kb_used_data":3048,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738836,"statfs":{"total":773094113280,"available":772852568064,"internally_reserved":0,"allocated":3121152,"data_stored":1833196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002490"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.371081+0000","last_change":"2024-05-27T12:32:42.368378+0000","last_active":"2024-05-27T12:32:43.371081+0000","last_peered":"2024-05-27T12:32:43.371081+0000","last_clean":"2024-05-27T12:32:43.371081+0000","last_became_active":"2024-05-27T12:32:42.367689+0000","last_became_peered":"2024-05-27T12:32:42.367689+0000","last_unstale":"2024-05-27T12:32:43.371081+0000","last_undegraded":"2024-05-27T12:32:43.371081+0000","last_fullsized":"2024-05-27T12:32:43.371081+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:45:54.226012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.789170+0000","last_change":"2024-05-27T12:32:42.380372+0000","last_active":"2024-05-27T12:32:43.789170+0000","last_peered":"2024-05-27T12:32:43.789170+0000","last_clean":"2024-05-27T12:32:43.789170+0000","last_became_active":"2024-05-27T12:32:42.379503+0000","last_became_peered":"2024-05-27T12:32:42.379503+0000","last_unstale":"2024-05-27T12:32:43.789170+0000","last_undegraded":"2024-05-27T12:32:43.789170+0000","last_fullsized":"2024-05-27T12:32:43.789170+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:45:06.261408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.789354+0000","last_change":"2024-05-27T12:32:42.374630+0000","last_active":"2024-05-27T12:32:43.789354+0000","last_peered":"2024-05-27T12:32:43.789354+0000","last_clean":"2024-05-27T12:32:43.789354+0000","last_became_active":"2024-05-27T12:32:42.374368+0000","last_became_peered":"2024-05-27T12:32:42.374368+0000","last_unstale":"2024-05-27T12:32:43.789354+0000","last_undegraded":"2024-05-27T12:32:43.789354+0000","last_fullsized":"2024-05-27T12:32:43.789354+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:08:10.051388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.790169+0000","last_change":"2024-05-27T12:32:42.384566+0000","last_active":"2024-05-27T12:32:43.790169+0000","last_peered":"2024-05-27T12:32:43.790169+0000","last_clean":"2024-05-27T12:32:43.790169+0000","last_became_active":"2024-05-27T12:32:42.384269+0000","last_became_peered":"2024-05-27T12:32:42.384269+0000","last_unstale":"2024-05-27T12:32:43.790169+0000","last_undegraded":"2024-05-27T12:32:43.790169+0000","last_fullsized":"2024-05-27T12:32:43.790169+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:39:46.806156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.370806+0000","last_change":"2024-05-27T12:32:42.367164+0000","last_active":"2024-05-27T12:32:43.370806+0000","last_peered":"2024-05-27T12:32:43.370806+0000","last_clean":"2024-05-27T12:32:43.370806+0000","last_became_active":"2024-05-27T12:32:42.366882+0000","last_became_peered":"2024-05-27T12:32:42.366882+0000","last_unstale":"2024-05-27T12:32:43.370806+0000","last_undegraded":"2024-05-27T12:32:43.370806+0000","last_fullsized":"2024-05-27T12:32:43.370806+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:49:19.170865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.790649+0000","last_change":"2024-05-27T12:32:42.385413+0000","last_active":"2024-05-27T12:32:43.790649+0000","last_peered":"2024-05-27T12:32:43.790649+0000","last_clean":"2024-05-27T12:32:43.790649+0000","last_became_active":"2024-05-27T12:32:42.385163+0000","last_became_peered":"2024-05-27T12:32:42.385163+0000","last_unstale":"2024-05-27T12:32:43.790649+0000","last_undegraded":"2024-05-27T12:32:43.790649+0000","last_fullsized":"2024-05-27T12:32:43.790649+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:01:15.130683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.370657+0000","last_change":"2024-05-27T12:32:42.376081+0000","last_active":"2024-05-27T12:32:43.370657+0000","last_peered":"2024-05-27T12:32:43.370657+0000","last_clean":"2024-05-27T12:32:43.370657+0000","last_became_active":"2024-05-27T12:32:42.375689+0000","last_became_peered":"2024-05-27T12:32:42.375689+0000","last_unstale":"2024-05-27T12:32:43.370657+0000","last_undegraded":"2024-05-27T12:32:43.370657+0000","last_fullsized":"2024-05-27T12:32:43.370657+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:45:58.205716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.371027+0000","last_change":"2024-05-27T12:32:42.385659+0000","last_active":"2024-05-27T12:32:43.371027+0000","last_peered":"2024-05-27T12:32:43.371027+0000","last_clean":"2024-05-27T12:32:43.371027+0000","last_became_active":"2024-05-27T12:32:42.385356+0000","last_became_peered":"2024-05-27T12:32:42.385356+0000","last_unstale":"2024-05-27T12:32:43.371027+0000","last_undegraded":"2024-05-27T12:32:43.371027+0000","last_fullsized":"2024-05-27T12:32:43.371027+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:44:31.058083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.371221+0000","last_change":"2024-05-27T12:32:42.382460+0000","last_active":"2024-05-27T12:32:43.371221+0000","last_peered":"2024-05-27T12:32:43.371221+0000","last_clean":"2024-05-27T12:32:43.371221+0000","last_became_active":"2024-05-27T12:32:42.382093+0000","last_became_peered":"2024-05-27T12:32:42.382093+0000","last_unstale":"2024-05-27T12:32:43.371221+0000","last_undegraded":"2024-05-27T12:32:43.371221+0000","last_fullsized":"2024-05-27T12:32:43.371221+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:09:27.419514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.789639+0000","last_change":"2024-05-27T12:32:42.384546+0000","last_active":"2024-05-27T12:32:43.789639+0000","last_peered":"2024-05-27T12:32:43.789639+0000","last_clean":"2024-05-27T12:32:43.789639+0000","last_became_active":"2024-05-27T12:32:42.384270+0000","last_became_peered":"2024-05-27T12:32:42.384270+0000","last_unstale":"2024-05-27T12:32:43.789639+0000","last_undegraded":"2024-05-27T12:32:43.789639+0000","last_fullsized":"2024-05-27T12:32:43.789639+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:17:24.104572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.789963+0000","last_change":"2024-05-27T12:32:42.385206+0000","last_active":"2024-05-27T12:32:43.789963+0000","last_peered":"2024-05-27T12:32:43.789963+0000","last_clean":"2024-05-27T12:32:43.789963+0000","last_became_active":"2024-05-27T12:32:42.384940+0000","last_became_peered":"2024-05-27T12:32:42.384940+0000","last_unstale":"2024-05-27T12:32:43.789963+0000","last_undegraded":"2024-05-27T12:32:43.789963+0000","last_fullsized":"2024-05-27T12:32:43.789963+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:46:07.761461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.790813+0000","last_change":"2024-05-27T12:32:42.376596+0000","last_active":"2024-05-27T12:32:43.790813+0000","last_peered":"2024-05-27T12:32:43.790813+0000","last_clean":"2024-05-27T12:32:43.790813+0000","last_became_active":"2024-05-27T12:32:42.376147+0000","last_became_peered":"2024-05-27T12:32:42.376147+0000","last_unstale":"2024-05-27T12:32:43.790813+0000","last_undegraded":"2024-05-27T12:32:43.790813+0000","last_fullsized":"2024-05-27T12:32:43.790813+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:07:22.262394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.371230+0000","last_change":"2024-05-27T12:32:42.375358+0000","last_active":"2024-05-27T12:32:43.371230+0000","last_peered":"2024-05-27T12:32:43.371230+0000","last_clean":"2024-05-27T12:32:43.371230+0000","last_became_active":"2024-05-27T12:32:42.375096+0000","last_became_peered":"2024-05-27T12:32:42.375096+0000","last_unstale":"2024-05-27T12:32:43.371230+0000","last_undegraded":"2024-05-27T12:32:43.371230+0000","last_fullsized":"2024-05-27T12:32:43.371230+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:17:24.104572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.789171+0000","last_change":"2024-05-27T12:32:42.375413+0000","last_active":"2024-05-27T12:32:43.789171+0000","last_peered":"2024-05-27T12:32:43.789171+0000","last_clean":"2024-05-27T12:32:43.789171+0000","last_became_active":"2024-05-27T12:32:42.374741+0000","last_became_peered":"2024-05-27T12:32:42.374741+0000","last_unstale":"2024-05-27T12:32:43.789171+0000","last_undegraded":"2024-05-27T12:32:43.789171+0000","last_fullsized":"2024-05-27T12:32:43.789171+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:59:07.890771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.789046+0000","last_change":"2024-05-27T12:32:42.376055+0000","last_active":"2024-05-27T12:32:43.789046+0000","last_peered":"2024-05-27T12:32:43.789046+0000","last_clean":"2024-05-27T12:32:43.789046+0000","last_became_active":"2024-05-27T12:32:42.374091+0000","last_became_peered":"2024-05-27T12:32:42.374091+0000","last_unstale":"2024-05-27T12:32:43.789046+0000","last_undegraded":"2024-05-27T12:32:43.789046+0000","last_fullsized":"2024-05-27T12:32:43.789046+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:41:35.310708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.789858+0000","last_change":"2024-05-27T12:32:42.387113+0000","last_active":"2024-05-27T12:32:43.789858+0000","last_peered":"2024-05-27T12:32:43.789858+0000","last_clean":"2024-05-27T12:32:43.789858+0000","last_became_active":"2024-05-27T12:32:42.386810+0000","last_became_peered":"2024-05-27T12:32:42.386810+0000","last_unstale":"2024-05-27T12:32:43.789858+0000","last_undegraded":"2024-05-27T12:32:43.789858+0000","last_fullsized":"2024-05-27T12:32:43.789858+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:44:31.058083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.790040+0000","last_change":"2024-05-27T12:32:42.383993+0000","last_active":"2024-05-27T12:32:43.790040+0000","last_peered":"2024-05-27T12:32:43.790040+0000","last_clean":"2024-05-27T12:32:43.790040+0000","last_became_active":"2024-05-27T12:32:42.383274+0000","last_became_peered":"2024-05-27T12:32:42.383274+0000","last_unstale":"2024-05-27T12:32:43.790040+0000","last_undegraded":"2024-05-27T12:32:43.790040+0000","last_fullsized":"2024-05-27T12:32:43.790040+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:03:50.593154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.371618+0000","last_change":"2024-05-27T12:32:42.376831+0000","last_active":"2024-05-27T12:32:43.371618+0000","last_peered":"2024-05-27T12:32:43.371618+0000","last_clean":"2024-05-27T12:32:43.371618+0000","last_became_active":"2024-05-27T12:32:42.376498+0000","last_became_peered":"2024-05-27T12:32:42.376498+0000","last_unstale":"2024-05-27T12:32:43.371618+0000","last_undegraded":"2024-05-27T12:32:43.371618+0000","last_fullsized":"2024-05-27T12:32:43.371618+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:10:30.753626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.370953+0000","last_change":"2024-05-27T12:32:42.366751+0000","last_active":"2024-05-27T12:32:43.370953+0000","last_peered":"2024-05-27T12:32:43.370953+0000","last_clean":"2024-05-27T12:32:43.370953+0000","last_became_active":"2024-05-27T12:32:42.366438+0000","last_became_peered":"2024-05-27T12:32:42.366438+0000","last_unstale":"2024-05-27T12:32:43.370953+0000","last_undegraded":"2024-05-27T12:32:43.370953+0000","last_fullsized":"2024-05-27T12:32:43.370953+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:31:12.368847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.789791+0000","last_change":"2024-05-27T12:32:42.370650+0000","last_active":"2024-05-27T12:32:43.789791+0000","last_peered":"2024-05-27T12:32:43.789791+0000","last_clean":"2024-05-27T12:32:43.789791+0000","last_became_active":"2024-05-27T12:32:42.370319+0000","last_became_peered":"2024-05-27T12:32:42.370319+0000","last_unstale":"2024-05-27T12:32:43.789791+0000","last_undegraded":"2024-05-27T12:32:43.789791+0000","last_fullsized":"2024-05-27T12:32:43.789791+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:41:35.310708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.789324+0000","last_change":"2024-05-27T12:32:42.382051+0000","last_active":"2024-05-27T12:32:43.789324+0000","last_peered":"2024-05-27T12:32:43.789324+0000","last_clean":"2024-05-27T12:32:43.789324+0000","last_became_active":"2024-05-27T12:32:42.380690+0000","last_became_peered":"2024-05-27T12:32:42.380690+0000","last_unstale":"2024-05-27T12:32:43.789324+0000","last_undegraded":"2024-05-27T12:32:43.789324+0000","last_fullsized":"2024-05-27T12:32:43.789324+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:33:45.178199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.790674+0000","last_change":"2024-05-27T12:32:42.383033+0000","last_active":"2024-05-27T12:32:43.790674+0000","last_peered":"2024-05-27T12:32:43.790674+0000","last_clean":"2024-05-27T12:32:43.790674+0000","last_became_active":"2024-05-27T12:32:42.382745+0000","last_became_peered":"2024-05-27T12:32:42.382745+0000","last_unstale":"2024-05-27T12:32:43.790674+0000","last_undegraded":"2024-05-27T12:32:43.790674+0000","last_fullsized":"2024-05-27T12:32:43.790674+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:31:12.368847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.371383+0000","last_change":"2024-05-27T12:32:42.378742+0000","last_active":"2024-05-27T12:32:43.371383+0000","last_peered":"2024-05-27T12:32:43.371383+0000","last_clean":"2024-05-27T12:32:43.371383+0000","last_became_active":"2024-05-27T12:32:42.378328+0000","last_became_peered":"2024-05-27T12:32:42.378328+0000","last_unstale":"2024-05-27T12:32:43.371383+0000","last_undegraded":"2024-05-27T12:32:43.371383+0000","last_fullsized":"2024-05-27T12:32:43.371383+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:46:07.761461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.789508+0000","last_change":"2024-05-27T12:32:42.381867+0000","last_active":"2024-05-27T12:32:43.789508+0000","last_peered":"2024-05-27T12:32:43.789508+0000","last_clean":"2024-05-27T12:32:43.789508+0000","last_became_active":"2024-05-27T12:32:42.381591+0000","last_became_peered":"2024-05-27T12:32:42.381591+0000","last_unstale":"2024-05-27T12:32:43.789508+0000","last_undegraded":"2024-05-27T12:32:43.789508+0000","last_fullsized":"2024-05-27T12:32:43.789508+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:45:06.261408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.371545+0000","last_change":"2024-05-27T12:32:42.372176+0000","last_active":"2024-05-27T12:32:43.371545+0000","last_peered":"2024-05-27T12:32:43.371545+0000","last_clean":"2024-05-27T12:32:43.371545+0000","last_became_active":"2024-05-27T12:32:42.371874+0000","last_became_peered":"2024-05-27T12:32:42.371874+0000","last_unstale":"2024-05-27T12:32:43.371545+0000","last_undegraded":"2024-05-27T12:32:43.371545+0000","last_fullsized":"2024-05-27T12:32:43.371545+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:03:50.593154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.790461+0000","last_change":"2024-05-27T12:32:42.374766+0000","last_active":"2024-05-27T12:32:43.790461+0000","last_peered":"2024-05-27T12:32:43.790461+0000","last_clean":"2024-05-27T12:32:43.790461+0000","last_became_active":"2024-05-27T12:32:42.374450+0000","last_became_peered":"2024-05-27T12:32:42.374450+0000","last_unstale":"2024-05-27T12:32:43.790461+0000","last_undegraded":"2024-05-27T12:32:43.790461+0000","last_fullsized":"2024-05-27T12:32:43.790461+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:44:31.058083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.789330+0000","last_change":"2024-05-27T12:32:42.376636+0000","last_active":"2024-05-27T12:32:43.789330+0000","last_peered":"2024-05-27T12:32:43.789330+0000","last_clean":"2024-05-27T12:32:43.789330+0000","last_became_active":"2024-05-27T12:32:42.376364+0000","last_became_peered":"2024-05-27T12:32:42.376364+0000","last_unstale":"2024-05-27T12:32:43.789330+0000","last_undegraded":"2024-05-27T12:32:43.789330+0000","last_fullsized":"2024-05-27T12:32:43.789330+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:46:07.761461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.372306+0000","last_change":"2024-05-27T12:32:42.371595+0000","last_active":"2024-05-27T12:32:43.372306+0000","last_peered":"2024-05-27T12:32:43.372306+0000","last_clean":"2024-05-27T12:32:43.372306+0000","last_became_active":"2024-05-27T12:32:42.370375+0000","last_became_peered":"2024-05-27T12:32:42.370375+0000","last_unstale":"2024-05-27T12:32:43.372306+0000","last_undegraded":"2024-05-27T12:32:43.372306+0000","last_fullsized":"2024-05-27T12:32:43.372306+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:45:58.205716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.789405+0000","last_change":"2024-05-27T12:32:42.381462+0000","last_active":"2024-05-27T12:32:43.789405+0000","last_peered":"2024-05-27T12:32:43.789405+0000","last_clean":"2024-05-27T12:32:43.789405+0000","last_became_active":"2024-05-27T12:32:42.380574+0000","last_became_peered":"2024-05-27T12:32:42.380574+0000","last_unstale":"2024-05-27T12:32:43.789405+0000","last_undegraded":"2024-05-27T12:32:43.789405+0000","last_fullsized":"2024-05-27T12:32:43.789405+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:39:15.319359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.790845+0000","last_change":"2024-05-27T12:32:42.384076+0000","last_active":"2024-05-27T12:32:43.790845+0000","last_peered":"2024-05-27T12:32:43.790845+0000","last_clean":"2024-05-27T12:32:43.790845+0000","last_became_active":"2024-05-27T12:32:42.383738+0000","last_became_peered":"2024-05-27T12:32:42.383738+0000","last_unstale":"2024-05-27T12:32:43.790845+0000","last_undegraded":"2024-05-27T12:32:43.790845+0000","last_fullsized":"2024-05-27T12:32:43.790845+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:45:54.226012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.372374+0000","last_change":"2024-05-27T12:32:42.379700+0000","last_active":"2024-05-27T12:32:43.372374+0000","last_peered":"2024-05-27T12:32:43.372374+0000","last_clean":"2024-05-27T12:32:43.372374+0000","last_became_active":"2024-05-27T12:32:42.379421+0000","last_became_peered":"2024-05-27T12:32:42.379421+0000","last_unstale":"2024-05-27T12:32:43.372374+0000","last_undegraded":"2024-05-27T12:32:43.372374+0000","last_fullsized":"2024-05-27T12:32:43.372374+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:20:05.304417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.789328+0000","last_change":"2024-05-27T12:32:42.379719+0000","last_active":"2024-05-27T12:32:43.789328+0000","last_peered":"2024-05-27T12:32:43.789328+0000","last_clean":"2024-05-27T12:32:43.789328+0000","last_became_active":"2024-05-27T12:32:42.379234+0000","last_became_peered":"2024-05-27T12:32:42.379234+0000","last_unstale":"2024-05-27T12:32:43.789328+0000","last_undegraded":"2024-05-27T12:32:43.789328+0000","last_fullsized":"2024-05-27T12:32:43.789328+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:23:59.137419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.790076+0000","last_change":"2024-05-27T12:32:42.371233+0000","last_active":"2024-05-27T12:32:43.790076+0000","last_peered":"2024-05-27T12:32:43.790076+0000","last_clean":"2024-05-27T12:32:43.790076+0000","last_became_active":"2024-05-27T12:32:42.370965+0000","last_became_peered":"2024-05-27T12:32:42.370965+0000","last_unstale":"2024-05-27T12:32:43.790076+0000","last_undegraded":"2024-05-27T12:32:43.790076+0000","last_fullsized":"2024-05-27T12:32:43.790076+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T23:34:59.101630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.371329+0000","last_change":"2024-05-27T12:32:41.365100+0000","last_active":"2024-05-27T12:32:43.371329+0000","last_peered":"2024-05-27T12:32:43.371329+0000","last_clean":"2024-05-27T12:32:43.371329+0000","last_became_active":"2024-05-27T12:32:41.364795+0000","last_became_peered":"2024-05-27T12:32:41.364795+0000","last_unstale":"2024-05-27T12:32:43.371329+0000","last_undegraded":"2024-05-27T12:32:43.371329+0000","last_fullsized":"2024-05-27T12:32:43.371329+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:24:00.607915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.789475+0000","last_change":"2024-05-27T12:32:42.375571+0000","last_active":"2024-05-27T12:32:43.789475+0000","last_peered":"2024-05-27T12:32:43.789475+0000","last_clean":"2024-05-27T12:32:43.789475+0000","last_became_active":"2024-05-27T12:32:42.375317+0000","last_became_peered":"2024-05-27T12:32:42.375317+0000","last_unstale":"2024-05-27T12:32:43.789475+0000","last_undegraded":"2024-05-27T12:32:43.789475+0000","last_fullsized":"2024-05-27T12:32:43.789475+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:52:18.747481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.790038+0000","last_change":"2024-05-27T12:32:41.370064+0000","last_active":"2024-05-27T12:32:43.790038+0000","last_peered":"2024-05-27T12:32:43.790038+0000","last_clean":"2024-05-27T12:32:43.790038+0000","last_became_active":"2024-05-27T12:32:41.368679+0000","last_became_peered":"2024-05-27T12:32:41.368679+0000","last_unstale":"2024-05-27T12:32:43.790038+0000","last_undegraded":"2024-05-27T12:32:43.790038+0000","last_fullsized":"2024-05-27T12:32:43.790038+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:31:52.368166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.371463+0000","last_change":"2024-05-27T12:32:41.369441+0000","last_active":"2024-05-27T12:32:43.371463+0000","last_peered":"2024-05-27T12:32:43.371463+0000","last_clean":"2024-05-27T12:32:43.371463+0000","last_became_active":"2024-05-27T12:32:41.369164+0000","last_became_peered":"2024-05-27T12:32:41.369164+0000","last_unstale":"2024-05-27T12:32:43.371463+0000","last_undegraded":"2024-05-27T12:32:43.371463+0000","last_fullsized":"2024-05-27T12:32:43.371463+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:10:55.375726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.371049+0000","last_change":"2024-05-27T12:32:42.381264+0000","last_active":"2024-05-27T12:32:43.371049+0000","last_peered":"2024-05-27T12:32:43.371049+0000","last_clean":"2024-05-27T12:32:43.371049+0000","last_became_active":"2024-05-27T12:32:42.380823+0000","last_became_peered":"2024-05-27T12:32:42.380823+0000","last_unstale":"2024-05-27T12:32:43.371049+0000","last_undegraded":"2024-05-27T12:32:43.371049+0000","last_fullsized":"2024-05-27T12:32:43.371049+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:23:59.137419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.789618+0000","last_change":"2024-05-27T12:32:41.371539+0000","last_active":"2024-05-27T12:32:43.789618+0000","last_peered":"2024-05-27T12:32:43.789618+0000","last_clean":"2024-05-27T12:32:43.789618+0000","last_became_active":"2024-05-27T12:32:41.370827+0000","last_became_peered":"2024-05-27T12:32:41.370827+0000","last_unstale":"2024-05-27T12:32:43.789618+0000","last_undegraded":"2024-05-27T12:32:43.789618+0000","last_fullsized":"2024-05-27T12:32:43.789618+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T23:34:58.092780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.788872+0000","last_change":"2024-05-27T12:32:42.371446+0000","last_active":"2024-05-27T12:32:43.788872+0000","last_peered":"2024-05-27T12:32:43.788872+0000","last_clean":"2024-05-27T12:32:43.788872+0000","last_became_active":"2024-05-27T12:32:42.371197+0000","last_became_peered":"2024-05-27T12:32:42.371197+0000","last_unstale":"2024-05-27T12:32:43.788872+0000","last_undegraded":"2024-05-27T12:32:43.788872+0000","last_fullsized":"2024-05-27T12:32:43.788872+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:23:59.137419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.789638+0000","last_change":"2024-05-27T12:32:41.374793+0000","last_active":"2024-05-27T12:32:43.789638+0000","last_peered":"2024-05-27T12:32:43.789638+0000","last_clean":"2024-05-27T12:32:43.789638+0000","last_became_active":"2024-05-27T12:32:41.374503+0000","last_became_peered":"2024-05-27T12:32:41.374503+0000","last_unstale":"2024-05-27T12:32:43.789638+0000","last_undegraded":"2024-05-27T12:32:43.789638+0000","last_fullsized":"2024-05-27T12:32:43.789638+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T23:33:13.169169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.789772+0000","last_change":"2024-05-27T12:32:42.382592+0000","last_active":"2024-05-27T12:32:43.789772+0000","last_peered":"2024-05-27T12:32:43.789772+0000","last_clean":"2024-05-27T12:32:43.789772+0000","last_became_active":"2024-05-27T12:32:42.382289+0000","last_became_peered":"2024-05-27T12:32:42.382289+0000","last_unstale":"2024-05-27T12:32:43.789772+0000","last_undegraded":"2024-05-27T12:32:43.789772+0000","last_fullsized":"2024-05-27T12:32:43.789772+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:46:07.761461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.789819+0000","last_change":"2024-05-27T12:32:41.370517+0000","last_active":"2024-05-27T12:32:43.789819+0000","last_peered":"2024-05-27T12:32:43.789819+0000","last_clean":"2024-05-27T12:32:43.789819+0000","last_became_active":"2024-05-27T12:32:41.370216+0000","last_became_peered":"2024-05-27T12:32:41.370216+0000","last_unstale":"2024-05-27T12:32:43.789819+0000","last_undegraded":"2024-05-27T12:32:43.789819+0000","last_fullsized":"2024-05-27T12:32:43.789819+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:24:00.607915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.789709+0000","last_change":"2024-05-27T12:32:42.384361+0000","last_active":"2024-05-27T12:32:43.789709+0000","last_peered":"2024-05-27T12:32:43.789709+0000","last_clean":"2024-05-27T12:32:43.789709+0000","last_became_active":"2024-05-27T12:32:42.384083+0000","last_became_peered":"2024-05-27T12:32:42.384083+0000","last_unstale":"2024-05-27T12:32:43.789709+0000","last_undegraded":"2024-05-27T12:32:43.789709+0000","last_fullsized":"2024-05-27T12:32:43.789709+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:34:54.979924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.789374+0000","last_change":"2024-05-27T12:32:41.373060+0000","last_active":"2024-05-27T12:32:43.789374+0000","last_peered":"2024-05-27T12:32:43.789374+0000","last_clean":"2024-05-27T12:32:43.789374+0000","last_became_active":"2024-05-27T12:32:41.372729+0000","last_became_peered":"2024-05-27T12:32:41.372729+0000","last_unstale":"2024-05-27T12:32:43.789374+0000","last_undegraded":"2024-05-27T12:32:43.789374+0000","last_fullsized":"2024-05-27T12:32:43.789374+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T23:34:58.092780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.790835+0000","last_change":"2024-05-27T12:32:42.368863+0000","last_active":"2024-05-27T12:32:43.790835+0000","last_peered":"2024-05-27T12:32:43.790835+0000","last_clean":"2024-05-27T12:32:43.790835+0000","last_became_active":"2024-05-27T12:32:42.368593+0000","last_became_peered":"2024-05-27T12:32:42.368593+0000","last_unstale":"2024-05-27T12:32:43.790835+0000","last_undegraded":"2024-05-27T12:32:43.790835+0000","last_fullsized":"2024-05-27T12:32:43.790835+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:10:30.753626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"22'6","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.790164+0000","last_change":"2024-05-27T12:32:41.369617+0000","last_active":"2024-05-27T12:32:43.790164+0000","last_peered":"2024-05-27T12:32:43.790164+0000","last_clean":"2024-05-27T12:32:43.790164+0000","last_became_active":"2024-05-27T12:32:41.369371+0000","last_became_peered":"2024-05-27T12:32:41.369371+0000","last_unstale":"2024-05-27T12:32:43.790164+0000","last_undegraded":"2024-05-27T12:32:43.790164+0000","last_fullsized":"2024-05-27T12:32:43.790164+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:24:00.607915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.370555+0000","last_change":"2024-05-27T12:32:42.362804+0000","last_active":"2024-05-27T12:32:43.370555+0000","last_peered":"2024-05-27T12:32:43.370555+0000","last_clean":"2024-05-27T12:32:43.370555+0000","last_became_active":"2024-05-27T12:32:42.362483+0000","last_became_peered":"2024-05-27T12:32:42.362483+0000","last_unstale":"2024-05-27T12:32:43.370555+0000","last_undegraded":"2024-05-27T12:32:43.370555+0000","last_fullsized":"2024-05-27T12:32:43.370555+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:29:54.817031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.789520+0000","last_change":"2024-05-27T12:32:41.365663+0000","last_active":"2024-05-27T12:32:43.789520+0000","last_peered":"2024-05-27T12:32:43.789520+0000","last_clean":"2024-05-27T12:32:43.789520+0000","last_became_active":"2024-05-27T12:32:41.365362+0000","last_became_peered":"2024-05-27T12:32:41.365362+0000","last_unstale":"2024-05-27T12:32:43.789520+0000","last_undegraded":"2024-05-27T12:32:43.789520+0000","last_fullsized":"2024-05-27T12:32:43.789520+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:34:40.641559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.789225+0000","last_change":"2024-05-27T12:32:42.374786+0000","last_active":"2024-05-27T12:32:43.789225+0000","last_peered":"2024-05-27T12:32:43.789225+0000","last_clean":"2024-05-27T12:32:43.789225+0000","last_became_active":"2024-05-27T12:32:42.374527+0000","last_became_peered":"2024-05-27T12:32:42.374527+0000","last_unstale":"2024-05-27T12:32:43.789225+0000","last_undegraded":"2024-05-27T12:32:43.789225+0000","last_fullsized":"2024-05-27T12:32:43.789225+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:21:44.592343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.790766+0000","last_change":"2024-05-27T12:32:41.371087+0000","last_active":"2024-05-27T12:32:43.790766+0000","last_peered":"2024-05-27T12:32:43.790766+0000","last_clean":"2024-05-27T12:32:43.790766+0000","last_became_active":"2024-05-27T12:32:41.370237+0000","last_became_peered":"2024-05-27T12:32:41.370237+0000","last_unstale":"2024-05-27T12:32:43.790766+0000","last_undegraded":"2024-05-27T12:32:43.790766+0000","last_fullsized":"2024-05-27T12:32:43.790766+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:31:52.368166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.370939+0000","last_change":"2024-05-27T12:32:42.371339+0000","last_active":"2024-05-27T12:32:43.370939+0000","last_peered":"2024-05-27T12:32:43.370939+0000","last_clean":"2024-05-27T12:32:43.370939+0000","last_became_active":"2024-05-27T12:32:42.370848+0000","last_became_peered":"2024-05-27T12:32:42.370848+0000","last_unstale":"2024-05-27T12:32:43.370939+0000","last_undegraded":"2024-05-27T12:32:43.370939+0000","last_fullsized":"2024-05-27T12:32:43.370939+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:01:15.130683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.789256+0000","last_change":"2024-05-27T12:32:41.368354+0000","last_active":"2024-05-27T12:32:43.789256+0000","last_peered":"2024-05-27T12:32:43.789256+0000","last_clean":"2024-05-27T12:32:43.789256+0000","last_became_active":"2024-05-27T12:32:41.368086+0000","last_became_peered":"2024-05-27T12:32:41.368086+0000","last_unstale":"2024-05-27T12:32:43.789256+0000","last_undegraded":"2024-05-27T12:32:43.789256+0000","last_fullsized":"2024-05-27T12:32:43.789256+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T23:55:01.390036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.789345+0000","last_change":"2024-05-27T12:32:42.379489+0000","last_active":"2024-05-27T12:32:43.789345+0000","last_peered":"2024-05-27T12:32:43.789345+0000","last_clean":"2024-05-27T12:32:43.789345+0000","last_became_active":"2024-05-27T12:32:42.378880+0000","last_became_peered":"2024-05-27T12:32:42.378880+0000","last_unstale":"2024-05-27T12:32:43.789345+0000","last_undegraded":"2024-05-27T12:32:43.789345+0000","last_fullsized":"2024-05-27T12:32:43.789345+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:45:06.261408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.371422+0000","last_change":"2024-05-27T12:32:41.362154+0000","last_active":"2024-05-27T12:32:43.371422+0000","last_peered":"2024-05-27T12:32:43.371422+0000","last_clean":"2024-05-27T12:32:43.371422+0000","last_became_active":"2024-05-27T12:32:41.361845+0000","last_became_peered":"2024-05-27T12:32:41.361845+0000","last_unstale":"2024-05-27T12:32:43.371422+0000","last_undegraded":"2024-05-27T12:32:43.371422+0000","last_fullsized":"2024-05-27T12:32:43.371422+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:10:55.375726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.370584+0000","last_change":"2024-05-27T12:32:42.378975+0000","last_active":"2024-05-27T12:32:43.370584+0000","last_peered":"2024-05-27T12:32:43.370584+0000","last_clean":"2024-05-27T12:32:43.370584+0000","last_became_active":"2024-05-27T12:32:42.378666+0000","last_became_peered":"2024-05-27T12:32:42.378666+0000","last_unstale":"2024-05-27T12:32:43.370584+0000","last_undegraded":"2024-05-27T12:32:43.370584+0000","last_fullsized":"2024-05-27T12:32:43.370584+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:39:46.806156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.790090+0000","last_change":"2024-05-27T12:32:41.363195+0000","last_active":"2024-05-27T12:32:43.790090+0000","last_peered":"2024-05-27T12:32:43.790090+0000","last_clean":"2024-05-27T12:32:43.790090+0000","last_became_active":"2024-05-27T12:32:41.362693+0000","last_became_peered":"2024-05-27T12:32:41.362693+0000","last_unstale":"2024-05-27T12:32:43.790090+0000","last_undegraded":"2024-05-27T12:32:43.790090+0000","last_fullsized":"2024-05-27T12:32:43.790090+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:10:55.375726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.371196+0000","last_change":"2024-05-27T12:32:42.370922+0000","last_active":"2024-05-27T12:32:43.371196+0000","last_peered":"2024-05-27T12:32:43.371196+0000","last_clean":"2024-05-27T12:32:43.371196+0000","last_became_active":"2024-05-27T12:32:42.370170+0000","last_became_peered":"2024-05-27T12:32:42.370170+0000","last_unstale":"2024-05-27T12:32:43.371196+0000","last_undegraded":"2024-05-27T12:32:43.371196+0000","last_fullsized":"2024-05-27T12:32:43.371196+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:10:10.701630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.371717+0000","last_change":"2024-05-27T12:32:41.366108+0000","last_active":"2024-05-27T12:32:43.371717+0000","last_peered":"2024-05-27T12:32:43.371717+0000","last_clean":"2024-05-27T12:32:43.371717+0000","last_became_active":"2024-05-27T12:32:41.365777+0000","last_became_peered":"2024-05-27T12:32:41.365777+0000","last_unstale":"2024-05-27T12:32:43.371717+0000","last_undegraded":"2024-05-27T12:32:43.371717+0000","last_fullsized":"2024-05-27T12:32:43.371717+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:24:00.607915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.371292+0000","last_change":"2024-05-27T12:32:42.374653+0000","last_active":"2024-05-27T12:32:43.371292+0000","last_peered":"2024-05-27T12:32:43.371292+0000","last_clean":"2024-05-27T12:32:43.371292+0000","last_became_active":"2024-05-27T12:32:42.370933+0000","last_became_peered":"2024-05-27T12:32:42.370933+0000","last_unstale":"2024-05-27T12:32:43.371292+0000","last_undegraded":"2024-05-27T12:32:43.371292+0000","last_fullsized":"2024-05-27T12:32:43.371292+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:08:15.290969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.789475+0000","last_change":"2024-05-27T12:32:41.366243+0000","last_active":"2024-05-27T12:32:43.789475+0000","last_peered":"2024-05-27T12:32:43.789475+0000","last_clean":"2024-05-27T12:32:43.789475+0000","last_became_active":"2024-05-27T12:32:41.365843+0000","last_became_peered":"2024-05-27T12:32:41.365843+0000","last_unstale":"2024-05-27T12:32:43.789475+0000","last_undegraded":"2024-05-27T12:32:43.789475+0000","last_fullsized":"2024-05-27T12:32:43.789475+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:31:52.368166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.790495+0000","last_change":"2024-05-27T12:32:42.384741+0000","last_active":"2024-05-27T12:32:43.790495+0000","last_peered":"2024-05-27T12:32:43.790495+0000","last_clean":"2024-05-27T12:32:43.790495+0000","last_became_active":"2024-05-27T12:32:42.383818+0000","last_became_peered":"2024-05-27T12:32:42.383818+0000","last_unstale":"2024-05-27T12:32:43.790495+0000","last_undegraded":"2024-05-27T12:32:43.790495+0000","last_fullsized":"2024-05-27T12:32:43.790495+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:49:19.170865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.371621+0000","last_change":"2024-05-27T12:32:41.374511+0000","last_active":"2024-05-27T12:32:43.371621+0000","last_peered":"2024-05-27T12:32:43.371621+0000","last_clean":"2024-05-27T12:32:43.371621+0000","last_became_active":"2024-05-27T12:32:41.374221+0000","last_became_peered":"2024-05-27T12:32:41.374221+0000","last_unstale":"2024-05-27T12:32:43.371621+0000","last_undegraded":"2024-05-27T12:32:43.371621+0000","last_fullsized":"2024-05-27T12:32:43.371621+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T23:34:58.092780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.370723+0000","last_change":"2024-05-27T12:32:42.384647+0000","last_active":"2024-05-27T12:32:43.370723+0000","last_peered":"2024-05-27T12:32:43.370723+0000","last_clean":"2024-05-27T12:32:43.370723+0000","last_became_active":"2024-05-27T12:32:42.384389+0000","last_became_peered":"2024-05-27T12:32:42.384389+0000","last_unstale":"2024-05-27T12:32:43.370723+0000","last_undegraded":"2024-05-27T12:32:43.370723+0000","last_fullsized":"2024-05-27T12:32:43.370723+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:46:37.922278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":170,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.370450+0000","last_change":"2024-05-27T12:32:31.185664+0000","last_active":"2024-05-27T12:32:43.370450+0000","last_peered":"2024-05-27T12:32:43.370450+0000","last_clean":"2024-05-27T12:32:43.370450+0000","last_became_active":"2024-05-27T12:32:31.184757+0000","last_became_peered":"2024-05-27T12:32:31.184757+0000","last_unstale":"2024-05-27T12:32:43.370450+0000","last_undegraded":"2024-05-27T12:32:43.370450+0000","last_fullsized":"2024-05-27T12:32:43.370450+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:30.136480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:30.136480+0000","last_clean_scrub_stamp":"2024-05-27T12:32:30.136480+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:49:13.241747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.789668+0000","last_change":"2024-05-27T12:32:41.371475+0000","last_active":"2024-05-27T12:32:43.789668+0000","last_peered":"2024-05-27T12:32:43.789668+0000","last_clean":"2024-05-27T12:32:43.789668+0000","last_became_active":"2024-05-27T12:32:41.371198+0000","last_became_peered":"2024-05-27T12:32:41.371198+0000","last_unstale":"2024-05-27T12:32:43.789668+0000","last_undegraded":"2024-05-27T12:32:43.789668+0000","last_fullsized":"2024-05-27T12:32:43.789668+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T23:55:01.390036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.371225+0000","last_change":"2024-05-27T12:32:42.385699+0000","last_active":"2024-05-27T12:32:43.371225+0000","last_peered":"2024-05-27T12:32:43.371225+0000","last_clean":"2024-05-27T12:32:43.371225+0000","last_became_active":"2024-05-27T12:32:42.385464+0000","last_became_peered":"2024-05-27T12:32:42.385464+0000","last_unstale":"2024-05-27T12:32:43.371225+0000","last_undegraded":"2024-05-27T12:32:43.371225+0000","last_fullsized":"2024-05-27T12:32:43.371225+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:41:35.310708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.370292+0000","last_change":"2024-05-27T12:32:41.371263+0000","last_active":"2024-05-27T12:32:43.370292+0000","last_peered":"2024-05-27T12:32:43.370292+0000","last_clean":"2024-05-27T12:32:43.370292+0000","last_became_active":"2024-05-27T12:32:41.370961+0000","last_became_peered":"2024-05-27T12:32:41.370961+0000","last_unstale":"2024-05-27T12:32:43.370292+0000","last_undegraded":"2024-05-27T12:32:43.370292+0000","last_fullsized":"2024-05-27T12:32:43.370292+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:07:21.253545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.789059+0000","last_change":"2024-05-27T12:32:42.375057+0000","last_active":"2024-05-27T12:32:43.789059+0000","last_peered":"2024-05-27T12:32:43.789059+0000","last_clean":"2024-05-27T12:32:43.789059+0000","last_became_active":"2024-05-27T12:32:42.374593+0000","last_became_peered":"2024-05-27T12:32:42.374593+0000","last_unstale":"2024-05-27T12:32:43.789059+0000","last_undegraded":"2024-05-27T12:32:43.789059+0000","last_fullsized":"2024-05-27T12:32:43.789059+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:31:57.042894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.372424+0000","last_change":"2024-05-27T12:32:41.366189+0000","last_active":"2024-05-27T12:32:43.372424+0000","last_peered":"2024-05-27T12:32:43.372424+0000","last_clean":"2024-05-27T12:32:43.372424+0000","last_became_active":"2024-05-27T12:32:41.365860+0000","last_became_peered":"2024-05-27T12:32:41.365860+0000","last_unstale":"2024-05-27T12:32:43.372424+0000","last_undegraded":"2024-05-27T12:32:43.372424+0000","last_fullsized":"2024-05-27T12:32:43.372424+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T23:55:01.390036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.789114+0000","last_change":"2024-05-27T12:32:42.370436+0000","last_active":"2024-05-27T12:32:43.789114+0000","last_peered":"2024-05-27T12:32:43.789114+0000","last_clean":"2024-05-27T12:32:43.789114+0000","last_became_active":"2024-05-27T12:32:42.370051+0000","last_became_peered":"2024-05-27T12:32:42.370051+0000","last_unstale":"2024-05-27T12:32:43.789114+0000","last_undegraded":"2024-05-27T12:32:43.789114+0000","last_fullsized":"2024-05-27T12:32:43.789114+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:17:24.104572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.790865+0000","last_change":"2024-05-27T12:32:41.368242+0000","last_active":"2024-05-27T12:32:43.790865+0000","last_peered":"2024-05-27T12:32:43.790865+0000","last_clean":"2024-05-27T12:32:43.790865+0000","last_became_active":"2024-05-27T12:32:41.366995+0000","last_became_peered":"2024-05-27T12:32:41.366995+0000","last_unstale":"2024-05-27T12:32:43.790865+0000","last_undegraded":"2024-05-27T12:32:43.790865+0000","last_fullsized":"2024-05-27T12:32:43.790865+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T23:33:13.169169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.790572+0000","last_change":"2024-05-27T12:32:42.382859+0000","last_active":"2024-05-27T12:32:43.790572+0000","last_peered":"2024-05-27T12:32:43.790572+0000","last_clean":"2024-05-27T12:32:43.790572+0000","last_became_active":"2024-05-27T12:32:42.382312+0000","last_became_peered":"2024-05-27T12:32:42.382312+0000","last_unstale":"2024-05-27T12:32:43.790572+0000","last_undegraded":"2024-05-27T12:32:43.790572+0000","last_fullsized":"2024-05-27T12:32:43.790572+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T23:33:14.178019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.788938+0000","last_change":"2024-05-27T12:32:41.362976+0000","last_active":"2024-05-27T12:32:43.788938+0000","last_peered":"2024-05-27T12:32:43.788938+0000","last_clean":"2024-05-27T12:32:43.788938+0000","last_became_active":"2024-05-27T12:32:41.362645+0000","last_became_peered":"2024-05-27T12:32:41.362645+0000","last_unstale":"2024-05-27T12:32:43.788938+0000","last_undegraded":"2024-05-27T12:32:43.788938+0000","last_fullsized":"2024-05-27T12:32:43.788938+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T23:55:01.390036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.790293+0000","last_change":"2024-05-27T12:32:42.382156+0000","last_active":"2024-05-27T12:32:43.790293+0000","last_peered":"2024-05-27T12:32:43.790293+0000","last_clean":"2024-05-27T12:32:43.790293+0000","last_became_active":"2024-05-27T12:32:42.381678+0000","last_became_peered":"2024-05-27T12:32:42.381678+0000","last_unstale":"2024-05-27T12:32:43.790293+0000","last_undegraded":"2024-05-27T12:32:43.790293+0000","last_fullsized":"2024-05-27T12:32:43.790293+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:45:58.205716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.371082+0000","last_change":"2024-05-27T12:32:41.371270+0000","last_active":"2024-05-27T12:32:43.371082+0000","last_peered":"2024-05-27T12:32:43.371082+0000","last_clean":"2024-05-27T12:32:43.371082+0000","last_became_active":"2024-05-27T12:32:41.370665+0000","last_became_peered":"2024-05-27T12:32:41.370665+0000","last_unstale":"2024-05-27T12:32:43.371082+0000","last_undegraded":"2024-05-27T12:32:43.371082+0000","last_fullsized":"2024-05-27T12:32:43.371082+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:45:13.017421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.788973+0000","last_change":"2024-05-27T12:32:42.371153+0000","last_active":"2024-05-27T12:32:43.788973+0000","last_peered":"2024-05-27T12:32:43.788973+0000","last_clean":"2024-05-27T12:32:43.788973+0000","last_became_active":"2024-05-27T12:32:42.370862+0000","last_became_peered":"2024-05-27T12:32:42.370862+0000","last_unstale":"2024-05-27T12:32:43.788973+0000","last_undegraded":"2024-05-27T12:32:43.788973+0000","last_fullsized":"2024-05-27T12:32:43.788973+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:46:59.701728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.789282+0000","last_change":"2024-05-27T12:32:41.368774+0000","last_active":"2024-05-27T12:32:43.789282+0000","last_peered":"2024-05-27T12:32:43.789282+0000","last_clean":"2024-05-27T12:32:43.789282+0000","last_became_active":"2024-05-27T12:32:41.368343+0000","last_became_peered":"2024-05-27T12:32:41.368343+0000","last_unstale":"2024-05-27T12:32:43.789282+0000","last_undegraded":"2024-05-27T12:32:43.789282+0000","last_fullsized":"2024-05-27T12:32:43.789282+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:07:21.253545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.371690+0000","last_change":"2024-05-27T12:32:42.361807+0000","last_active":"2024-05-27T12:32:43.371690+0000","last_peered":"2024-05-27T12:32:43.371690+0000","last_clean":"2024-05-27T12:32:43.371690+0000","last_became_active":"2024-05-27T12:32:42.361508+0000","last_became_peered":"2024-05-27T12:32:42.361508+0000","last_unstale":"2024-05-27T12:32:43.371690+0000","last_undegraded":"2024-05-27T12:32:43.371690+0000","last_fullsized":"2024-05-27T12:32:43.371690+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:29:54.817031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.789737+0000","last_change":"2024-05-27T12:32:41.368907+0000","last_active":"2024-05-27T12:32:43.789737+0000","last_peered":"2024-05-27T12:32:43.789737+0000","last_clean":"2024-05-27T12:32:43.789737+0000","last_became_active":"2024-05-27T12:32:41.368392+0000","last_became_peered":"2024-05-27T12:32:41.368392+0000","last_unstale":"2024-05-27T12:32:43.789737+0000","last_undegraded":"2024-05-27T12:32:43.789737+0000","last_fullsized":"2024-05-27T12:32:43.789737+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T23:34:58.092780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.789583+0000","last_change":"2024-05-27T12:32:42.378690+0000","last_active":"2024-05-27T12:32:43.789583+0000","last_peered":"2024-05-27T12:32:43.789583+0000","last_clean":"2024-05-27T12:32:43.789583+0000","last_became_active":"2024-05-27T12:32:42.378367+0000","last_became_peered":"2024-05-27T12:32:42.378367+0000","last_unstale":"2024-05-27T12:32:43.789583+0000","last_undegraded":"2024-05-27T12:32:43.789583+0000","last_fullsized":"2024-05-27T12:32:43.789583+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:20:51.752584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.370292+0000","last_change":"2024-05-27T12:32:41.369723+0000","last_active":"2024-05-27T12:32:43.370292+0000","last_peered":"2024-05-27T12:32:43.370292+0000","last_clean":"2024-05-27T12:32:43.370292+0000","last_became_active":"2024-05-27T12:32:41.369404+0000","last_became_peered":"2024-05-27T12:32:41.369404+0000","last_unstale":"2024-05-27T12:32:43.370292+0000","last_undegraded":"2024-05-27T12:32:43.370292+0000","last_fullsized":"2024-05-27T12:32:43.370292+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T23:33:13.169169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.790391+0000","last_change":"2024-05-27T12:32:42.371958+0000","last_active":"2024-05-27T12:32:43.790391+0000","last_peered":"2024-05-27T12:32:43.790391+0000","last_clean":"2024-05-27T12:32:43.790391+0000","last_became_active":"2024-05-27T12:32:42.371689+0000","last_became_peered":"2024-05-27T12:32:42.371689+0000","last_unstale":"2024-05-27T12:32:43.790391+0000","last_undegraded":"2024-05-27T12:32:43.790391+0000","last_fullsized":"2024-05-27T12:32:43.790391+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:31:53.377015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.789137+0000","last_change":"2024-05-27T12:32:41.367208+0000","last_active":"2024-05-27T12:32:43.789137+0000","last_peered":"2024-05-27T12:32:43.789137+0000","last_clean":"2024-05-27T12:32:43.789137+0000","last_became_active":"2024-05-27T12:32:41.366772+0000","last_became_peered":"2024-05-27T12:32:41.366772+0000","last_unstale":"2024-05-27T12:32:43.789137+0000","last_undegraded":"2024-05-27T12:32:43.789137+0000","last_fullsized":"2024-05-27T12:32:43.789137+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T23:33:13.169169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.371204+0000","last_change":"2024-05-27T12:32:42.371618+0000","last_active":"2024-05-27T12:32:43.371204+0000","last_peered":"2024-05-27T12:32:43.371204+0000","last_clean":"2024-05-27T12:32:43.371204+0000","last_became_active":"2024-05-27T12:32:42.369525+0000","last_became_peered":"2024-05-27T12:32:42.369525+0000","last_unstale":"2024-05-27T12:32:43.371204+0000","last_undegraded":"2024-05-27T12:32:43.371204+0000","last_fullsized":"2024-05-27T12:32:43.371204+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:46:59.701728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.788977+0000","last_change":"2024-05-27T12:32:41.366388+0000","last_active":"2024-05-27T12:32:43.788977+0000","last_peered":"2024-05-27T12:32:43.788977+0000","last_clean":"2024-05-27T12:32:43.788977+0000","last_became_active":"2024-05-27T12:32:41.365881+0000","last_became_peered":"2024-05-27T12:32:41.365881+0000","last_unstale":"2024-05-27T12:32:43.788977+0000","last_undegraded":"2024-05-27T12:32:43.788977+0000","last_fullsized":"2024-05-27T12:32:43.788977+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:24:00.607915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.371263+0000","last_change":"2024-05-27T12:32:42.383798+0000","last_active":"2024-05-27T12:32:43.371263+0000","last_peered":"2024-05-27T12:32:43.371263+0000","last_clean":"2024-05-27T12:32:43.371263+0000","last_became_active":"2024-05-27T12:32:42.383431+0000","last_became_peered":"2024-05-27T12:32:42.383431+0000","last_unstale":"2024-05-27T12:32:43.371263+0000","last_undegraded":"2024-05-27T12:32:43.371263+0000","last_fullsized":"2024-05-27T12:32:43.371263+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:45:06.261408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.371165+0000","last_change":"2024-05-27T12:32:41.373716+0000","last_active":"2024-05-27T12:32:43.371165+0000","last_peered":"2024-05-27T12:32:43.371165+0000","last_clean":"2024-05-27T12:32:43.371165+0000","last_became_active":"2024-05-27T12:32:41.373364+0000","last_became_peered":"2024-05-27T12:32:41.373364+0000","last_unstale":"2024-05-27T12:32:43.371165+0000","last_undegraded":"2024-05-27T12:32:43.371165+0000","last_fullsized":"2024-05-27T12:32:43.371165+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:21:03.909608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.789527+0000","last_change":"2024-05-27T12:32:42.370445+0000","last_active":"2024-05-27T12:32:43.789527+0000","last_peered":"2024-05-27T12:32:43.789527+0000","last_clean":"2024-05-27T12:32:43.789527+0000","last_became_active":"2024-05-27T12:32:42.370164+0000","last_became_peered":"2024-05-27T12:32:42.370164+0000","last_unstale":"2024-05-27T12:32:43.789527+0000","last_undegraded":"2024-05-27T12:32:43.789527+0000","last_fullsized":"2024-05-27T12:32:43.789527+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:46:59.701728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.790143+0000","last_change":"2024-05-27T12:32:42.386589+0000","last_active":"2024-05-27T12:32:43.790143+0000","last_peered":"2024-05-27T12:32:43.790143+0000","last_clean":"2024-05-27T12:32:43.790143+0000","last_became_active":"2024-05-27T12:32:42.386297+0000","last_became_peered":"2024-05-27T12:32:42.386297+0000","last_unstale":"2024-05-27T12:32:43.790143+0000","last_undegraded":"2024-05-27T12:32:43.790143+0000","last_fullsized":"2024-05-27T12:32:43.790143+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:29:54.817031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.370575+0000","last_change":"2024-05-27T12:32:41.374812+0000","last_active":"2024-05-27T12:32:43.370575+0000","last_peered":"2024-05-27T12:32:43.370575+0000","last_clean":"2024-05-27T12:32:43.370575+0000","last_became_active":"2024-05-27T12:32:41.374488+0000","last_became_peered":"2024-05-27T12:32:41.374488+0000","last_unstale":"2024-05-27T12:32:43.370575+0000","last_undegraded":"2024-05-27T12:32:43.370575+0000","last_fullsized":"2024-05-27T12:32:43.370575+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:10:29.744776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.790329+0000","last_change":"2024-05-27T12:32:42.389941+0000","last_active":"2024-05-27T12:32:43.790329+0000","last_peered":"2024-05-27T12:32:43.790329+0000","last_clean":"2024-05-27T12:32:43.790329+0000","last_became_active":"2024-05-27T12:32:42.389630+0000","last_became_peered":"2024-05-27T12:32:42.389630+0000","last_unstale":"2024-05-27T12:32:43.790329+0000","last_undegraded":"2024-05-27T12:32:43.790329+0000","last_fullsized":"2024-05-27T12:32:43.790329+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:46:37.922278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.370730+0000","last_change":"2024-05-27T12:32:41.371373+0000","last_active":"2024-05-27T12:32:43.370730+0000","last_peered":"2024-05-27T12:32:43.370730+0000","last_clean":"2024-05-27T12:32:43.370730+0000","last_became_active":"2024-05-27T12:32:41.371009+0000","last_became_peered":"2024-05-27T12:32:41.371009+0000","last_unstale":"2024-05-27T12:32:43.370730+0000","last_undegraded":"2024-05-27T12:32:43.370730+0000","last_fullsized":"2024-05-27T12:32:43.370730+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:20:04.295568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.789661+0000","last_change":"2024-05-27T12:32:42.382123+0000","last_active":"2024-05-27T12:32:43.789661+0000","last_peered":"2024-05-27T12:32:43.789661+0000","last_clean":"2024-05-27T12:32:43.789661+0000","last_became_active":"2024-05-27T12:32:42.381762+0000","last_became_peered":"2024-05-27T12:32:42.381762+0000","last_unstale":"2024-05-27T12:32:43.789661+0000","last_undegraded":"2024-05-27T12:32:43.789661+0000","last_fullsized":"2024-05-27T12:32:43.789661+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:37:15.902329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.372004+0000","last_change":"2024-05-27T12:32:41.362828+0000","last_active":"2024-05-27T12:32:43.372004+0000","last_peered":"2024-05-27T12:32:43.372004+0000","last_clean":"2024-05-27T12:32:43.372004+0000","last_became_active":"2024-05-27T12:32:41.362526+0000","last_became_peered":"2024-05-27T12:32:41.362526+0000","last_unstale":"2024-05-27T12:32:43.372004+0000","last_undegraded":"2024-05-27T12:32:43.372004+0000","last_fullsized":"2024-05-27T12:32:43.372004+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T23:55:01.390036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.371918+0000","last_change":"2024-05-27T12:32:42.368191+0000","last_active":"2024-05-27T12:32:43.371918+0000","last_peered":"2024-05-27T12:32:43.371918+0000","last_clean":"2024-05-27T12:32:43.371918+0000","last_became_active":"2024-05-27T12:32:42.367914+0000","last_became_peered":"2024-05-27T12:32:42.367914+0000","last_unstale":"2024-05-27T12:32:43.371918+0000","last_undegraded":"2024-05-27T12:32:43.371918+0000","last_fullsized":"2024-05-27T12:32:43.371918+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:39:46.806156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"22'4","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.789749+0000","last_change":"2024-05-27T12:32:41.364608+0000","last_active":"2024-05-27T12:32:43.789749+0000","last_peered":"2024-05-27T12:32:43.789749+0000","last_clean":"2024-05-27T12:32:43.789749+0000","last_became_active":"2024-05-27T12:32:41.364245+0000","last_became_peered":"2024-05-27T12:32:41.364245+0000","last_unstale":"2024-05-27T12:32:43.789749+0000","last_undegraded":"2024-05-27T12:32:43.789749+0000","last_fullsized":"2024-05-27T12:32:43.789749+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:56:45.451315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509447,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27836,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344004,"statfs":{"total":96636764160,"available":96608260096,"internally_reserved":0,"allocated":831488,"data_stored":671905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509447,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":245760,"data_stored":82567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509447,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":237568,"data_stored":81045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509447,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":245760,"data_stored":81081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509447,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31424,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340416,"statfs":{"total":96636764160,"available":96604585984,"internally_reserved":0,"allocated":245760,"data_stored":82567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509447,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31412,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340428,"statfs":{"total":96636764160,"available":96604598272,"internally_reserved":0,"allocated":233472,"data_stored":80955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509447,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31420,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340420,"statfs":{"total":96636764160,"available":96604590080,"internally_reserved":0,"allocated":241664,"data_stored":81115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542153,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32008,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339832,"statfs":{"total":96636764160,"available":96603987968,"internally_reserved":0,"allocated":839680,"data_stored":671961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-27T12:32:54.312 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-27T12:32:54.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.454+0000 7f884b5d6640 1 Processor -- start 2024-05-27T12:32:54.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.454+0000 7f884b5d6640 1 -- start start 2024-05-27T12:32:54.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.455+0000 7f884b5d6640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f88441620b0 0x7f88440b79c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:54.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.455+0000 7f884b5d6640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f884406d590 0x7f88440d3950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:54.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.455+0000 7f884b5d6640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88440b39a0 con 0x7f88440cf8d0 2024-05-27T12:32:54.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.455+0000 7f884b5d6640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f88440d56d0 con 0x7f88441620b0 2024-05-27T12:32:54.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.455+0000 7f884b5d6640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f88440b7f00 con 0x7f884406d590 2024-05-27T12:32:54.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.455+0000 7f8848b71640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f88440cf8d0 0x7f884406ce80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:36904/0 (socket says 172.21.15.55:36904) 2024-05-27T12:32:54.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.455+0000 7f8848b71640 1 -- 172.21.15.55:0/2888933359 learned_addr learned my addr 172.21.15.55:0/2888933359 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-27T12:32:54.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.455+0000 7f8849372640 1 --2- 172.21.15.55:0/2888933359 >> v2:172.21.15.72:3300/0 conn(0x7f88441620b0 0x7f88440b79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:54.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.455+0000 7f8849b73640 1 --2- 172.21.15.55:0/2888933359 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f884406d590 0x7f88440d3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:54.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.455+0000 7f883bfff640 1 -- 172.21.15.55:0/2888933359 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 682832172 0 0) 0x7f88440b39a0 con 0x7f88440cf8d0 2024-05-27T12:32:54.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.455+0000 7f883bfff640 1 -- 172.21.15.55:0/2888933359 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8830003520 con 0x7f88440cf8d0 2024-05-27T12:32:54.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.455+0000 7f883bfff640 1 -- 172.21.15.55:0/2888933359 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4250842836 0 0) 0x7f8830003520 con 0x7f88440cf8d0 2024-05-27T12:32:54.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.455+0000 7f883bfff640 1 -- 172.21.15.55:0/2888933359 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f884406d590 msgr2=0x7f88440d3950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:32:54.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.455+0000 7f883bfff640 1 --2- 172.21.15.55:0/2888933359 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f884406d590 0x7f88440d3950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:54.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.455+0000 7f883bfff640 1 -- 172.21.15.55:0/2888933359 >> v2:172.21.15.72:3300/0 conn(0x7f88441620b0 msgr2=0x7f88440b79c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:32:54.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.455+0000 7f883bfff640 1 --2- 172.21.15.55:0/2888933359 >> v2:172.21.15.72:3300/0 conn(0x7f88441620b0 0x7f88440b79c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:54.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.455+0000 7f883bfff640 1 -- 172.21.15.55:0/2888933359 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88440b3c80 con 0x7f88440cf8d0 2024-05-27T12:32:54.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.455+0000 7f883bfff640 1 -- 172.21.15.55:0/2888933359 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 793017739 0 0) 0x7f8834001670 con 0x7f88440cf8d0 2024-05-27T12:32:54.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.455+0000 7f883bfff640 1 -- 172.21.15.55:0/2888933359 >> v1:172.21.15.55:6789/0 conn(0x7f88440cf8d0 legacy=0x7f884406ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:54.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.455+0000 7f883bfff640 1 --2- 172.21.15.55:0/2888933359 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8830003a90 0x7f8830003eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:54.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.455+0000 7f883bfff640 1 --2- 172.21.15.55:0/2888933359 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8830004800 0x7f8830004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:54.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.455+0000 7f883bfff640 1 --2- 172.21.15.55:0/2888933359 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f884406d590 0x7f88300051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:54.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.455+0000 7f883bfff640 1 -- 172.21.15.55:0/2888933359 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f88440b7f00 con 0x7f8830003a90 2024-05-27T12:32:54.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.455+0000 7f883bfff640 1 -- 172.21.15.55:0/2888933359 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f883000b9c0 con 0x7f8830004800 2024-05-27T12:32:54.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.455+0000 7f883bfff640 1 -- 172.21.15.55:0/2888933359 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f883000bbc0 con 0x7f884406d590 2024-05-27T12:32:54.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.455+0000 7f8849372640 1 --2- 172.21.15.55:0/2888933359 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8830003a90 0x7f8830003eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:54.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.456+0000 7f8848b71640 1 --2- 172.21.15.55:0/2888933359 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8830004800 0x7f8830004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:54.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.456+0000 7f8849b73640 1 --2- 172.21.15.55:0/2888933359 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f884406d590 0x7f88300051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:54.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.456+0000 7f8849372640 1 -- 172.21.15.55:0/2888933359 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f884406d590 msgr2=0x7f88300051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:32:54.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.456+0000 7f8849372640 1 --2- 172.21.15.55:0/2888933359 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f884406d590 0x7f88300051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:54.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.456+0000 7f8849372640 1 -- 172.21.15.55:0/2888933359 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8830004800 msgr2=0x7f8830004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:32:54.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.456+0000 7f8849372640 1 --2- 172.21.15.55:0/2888933359 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8830004800 0x7f8830004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:54.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.456+0000 7f8849372640 1 -- 172.21.15.55:0/2888933359 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8830003520 con 0x7f8830003a90 2024-05-27T12:32:54.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.456+0000 7f8849372640 1 --2- 172.21.15.55:0/2888933359 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8830003a90 0x7f8830003eb0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f8840009fc0 tx=0x7f8830005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcefcf19d450011a server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:54.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.457+0000 7f883bfff640 1 -- 172.21.15.55:0/2888933359 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8840009c10 con 0x7f8830003a90 2024-05-27T12:32:54.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.457+0000 7f883bfff640 1 -- 172.21.15.55:0/2888933359 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8840036070 con 0x7f8830003a90 2024-05-27T12:32:54.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.457+0000 7f883bfff640 1 -- 172.21.15.55:0/2888933359 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f884002d070 con 0x7f8830003a90 2024-05-27T12:32:54.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.457+0000 7f884b5d6640 1 -- 172.21.15.55:0/2888933359 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8830003a90 msgr2=0x7f8830003eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:54.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.457+0000 7f884b5d6640 1 --2- 172.21.15.55:0/2888933359 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8830003a90 0x7f8830003eb0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f8840009fc0 tx=0x7f8830005830 comp rx=0 tx=0).stop 2024-05-27T12:32:54.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.457+0000 7f8849b73640 1 -- 172.21.15.55:0/2888933359 reap_dead start 2024-05-27T12:32:54.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.457+0000 7f884b5d6640 1 -- 172.21.15.55:0/2888933359 shutdown_connections 2024-05-27T12:32:54.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.457+0000 7f884b5d6640 1 -- 172.21.15.55:0/2888933359 >> 172.21.15.55:0/2888933359 conn(0x7f88440d1940 msgr2=0x7f88440d4890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:54.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.457+0000 7f884b5d6640 1 -- 172.21.15.55:0/2888933359 shutdown_connections 2024-05-27T12:32:54.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.457+0000 7f884b5d6640 1 -- 172.21.15.55:0/2888933359 wait complete. 2024-05-27T12:32:54.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.458+0000 7f884b5d6640 1 Processor -- start 2024-05-27T12:32:54.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.458+0000 7f884b5d6640 1 -- start start 2024-05-27T12:32:54.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.459+0000 7f884b5d6640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8830003a90 0x7f88441608a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:54.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.459+0000 7f884b5d6640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8844160de0 0x7f88440b53c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:54.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.459+0000 7f884b5d6640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f88440b5900 0x7f88441f3df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:54.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.459+0000 7f884b5d6640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f88440d3430 con 0x7f8844160de0 2024-05-27T12:32:54.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.459+0000 7f884b5d6640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f88440d3150 con 0x7f88440b5900 2024-05-27T12:32:54.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.459+0000 7f884b5d6640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f88440b3650 con 0x7f8830003a90 2024-05-27T12:32:54.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.459+0000 7f8848b71640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8844160de0 0x7f88440b53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:54.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.459+0000 7f8848b71640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8844160de0 0x7f88440b53c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57550/0 (socket says 172.21.15.55:57550) 2024-05-27T12:32:54.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.459+0000 7f8848b71640 1 -- 172.21.15.55:0/2658450198 learned_addr learned my addr 172.21.15.55:0/2658450198 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:32:54.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.459+0000 7f8849372640 1 --2- 172.21.15.55:0/2658450198 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8830003a90 0x7f88441608a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:54.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.459+0000 7f8849b73640 1 --2- 172.21.15.55:0/2658450198 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f88440b5900 0x7f88441f3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:54.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.460+0000 7f8848b71640 1 -- 172.21.15.55:0/2658450198 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8830003a90 msgr2=0x7f88441608a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:54.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.460+0000 7f8848b71640 1 --2- 172.21.15.55:0/2658450198 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8830003a90 0x7f88441608a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:54.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.460+0000 7f8848b71640 1 -- 172.21.15.55:0/2658450198 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f88440b5900 msgr2=0x7f88441f3df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:54.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.460+0000 7f8848b71640 1 --2- 172.21.15.55:0/2658450198 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f88440b5900 0x7f88441f3df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:54.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.460+0000 7f8848b71640 1 -- 172.21.15.55:0/2658450198 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8844160670 con 0x7f8844160de0 2024-05-27T12:32:54.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.460+0000 7f8848b71640 1 --2- 172.21.15.55:0/2658450198 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8844160de0 0x7f88440b53c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f8834004fa0 tx=0x7f8834007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:54.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.460+0000 7f8839ffb640 1 -- 172.21.15.55:0/2658450198 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f883401a070 con 0x7f8844160de0 2024-05-27T12:32:54.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.460+0000 7f8839ffb640 1 -- 172.21.15.55:0/2658450198 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f883400f6e0 con 0x7f8844160de0 2024-05-27T12:32:54.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.460+0000 7f884b5d6640 1 -- 172.21.15.55:0/2658450198 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f884415dec0 con 0x7f8844160de0 2024-05-27T12:32:54.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.460+0000 7f8839ffb640 1 -- 172.21.15.55:0/2658450198 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f883400fab0 con 0x7f8844160de0 2024-05-27T12:32:54.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.460+0000 7f884b5d6640 1 -- 172.21.15.55:0/2658450198 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f884415e480 con 0x7f8844160de0 2024-05-27T12:32:54.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.461+0000 7f884b5d6640 1 -- 172.21.15.55:0/2658450198 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8844075460 con 0x7f8844160de0 2024-05-27T12:32:54.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.462+0000 7f8839ffb640 1 -- 172.21.15.55:0/2658450198 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f883401d070 con 0x7f8844160de0 2024-05-27T12:32:54.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.462+0000 7f8839ffb640 1 --2- 172.21.15.55:0/2658450198 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f882806c8f0 0x7f882806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:54.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.462+0000 7f8839ffb640 1 -- 172.21.15.55:0/2658450198 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f883408b2a0 con 0x7f8844160de0 2024-05-27T12:32:54.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.462+0000 7f8849372640 1 --2- 172.21.15.55:0/2658450198 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f882806c8f0 0x7f882806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:54.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.463+0000 7f8849372640 1 --2- 172.21.15.55:0/2658450198 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f882806c8f0 0x7f882806edb0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8840035000 tx=0x7f884002f000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:54.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.466+0000 7f8839ffb640 1 -- 172.21.15.55:0/2658450198 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8834059080 con 0x7f8844160de0 2024-05-27T12:32:54.648 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.648+0000 7f884b5d6640 1 -- 172.21.15.55:0/2658450198 --> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f884406cef0 con 0x7f882806c8f0 2024-05-27T12:32:54.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.655+0000 7f8839ffb640 1 -- 172.21.15.55:0/2658450198 <== mgr.4105 v2:172.21.15.72:6832/3152720583 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251837 (secure 0 0 0) 0x7f884406cef0 con 0x7f882806c8f0 2024-05-27T12:32:54.657 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-27T12:32:54.658 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2024-05-27T12:32:54.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.658+0000 7f884b5d6640 1 -- 172.21.15.55:0/2658450198 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f882806c8f0 msgr2=0x7f882806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:54.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.658+0000 7f884b5d6640 1 --2- 172.21.15.55:0/2658450198 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f882806c8f0 0x7f882806edb0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8840035000 tx=0x7f884002f000 comp rx=0 tx=0).stop 2024-05-27T12:32:54.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.658+0000 7f884b5d6640 1 -- 172.21.15.55:0/2658450198 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8844160de0 msgr2=0x7f88440b53c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:54.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.658+0000 7f884b5d6640 1 --2- 172.21.15.55:0/2658450198 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8844160de0 0x7f88440b53c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f8834004fa0 tx=0x7f8834007430 comp rx=0 tx=0).stop 2024-05-27T12:32:54.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.658+0000 7f884b5d6640 1 -- 172.21.15.55:0/2658450198 shutdown_connections 2024-05-27T12:32:54.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.658+0000 7f884b5d6640 1 --2- 172.21.15.55:0/2658450198 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f882806c8f0 0x7f882806edb0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:54.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.658+0000 7f884b5d6640 1 --2- 172.21.15.55:0/2658450198 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f88440b5900 0x7f88441f3df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:54.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.658+0000 7f884b5d6640 1 --2- 172.21.15.55:0/2658450198 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8844160de0 0x7f88440b53c0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:54.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.658+0000 7f884b5d6640 1 --2- 172.21.15.55:0/2658450198 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8830003a90 0x7f88441608a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:54.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.658+0000 7f884b5d6640 1 -- 172.21.15.55:0/2658450198 >> 172.21.15.55:0/2658450198 conn(0x7f88440d1940 msgr2=0x7f88440d3850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:54.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.659+0000 7f884b5d6640 1 -- 172.21.15.55:0/2658450198 shutdown_connections 2024-05-27T12:32:54.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.659+0000 7f884b5d6640 1 -- 172.21.15.55:0/2658450198 wait complete. 2024-05-27T12:32:54.669 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":29,"stamp":"2024-05-27T12:32:53.265177+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235884,"kb_used_data":3048,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738836,"statfs":{"total":773094113280,"available":772852568064,"internally_reserved":0,"allocated":3121152,"data_stored":1833196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002490"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.371081+0000","last_change":"2024-05-27T12:32:42.368378+0000","last_active":"2024-05-27T12:32:43.371081+0000","last_peered":"2024-05-27T12:32:43.371081+0000","last_clean":"2024-05-27T12:32:43.371081+0000","last_became_active":"2024-05-27T12:32:42.367689+0000","last_became_peered":"2024-05-27T12:32:42.367689+0000","last_unstale":"2024-05-27T12:32:43.371081+0000","last_undegraded":"2024-05-27T12:32:43.371081+0000","last_fullsized":"2024-05-27T12:32:43.371081+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:45:54.226012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.789170+0000","last_change":"2024-05-27T12:32:42.380372+0000","last_active":"2024-05-27T12:32:43.789170+0000","last_peered":"2024-05-27T12:32:43.789170+0000","last_clean":"2024-05-27T12:32:43.789170+0000","last_became_active":"2024-05-27T12:32:42.379503+0000","last_became_peered":"2024-05-27T12:32:42.379503+0000","last_unstale":"2024-05-27T12:32:43.789170+0000","last_undegraded":"2024-05-27T12:32:43.789170+0000","last_fullsized":"2024-05-27T12:32:43.789170+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:45:06.261408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.789354+0000","last_change":"2024-05-27T12:32:42.374630+0000","last_active":"2024-05-27T12:32:43.789354+0000","last_peered":"2024-05-27T12:32:43.789354+0000","last_clean":"2024-05-27T12:32:43.789354+0000","last_became_active":"2024-05-27T12:32:42.374368+0000","last_became_peered":"2024-05-27T12:32:42.374368+0000","last_unstale":"2024-05-27T12:32:43.789354+0000","last_undegraded":"2024-05-27T12:32:43.789354+0000","last_fullsized":"2024-05-27T12:32:43.789354+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:08:10.051388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.790169+0000","last_change":"2024-05-27T12:32:42.384566+0000","last_active":"2024-05-27T12:32:43.790169+0000","last_peered":"2024-05-27T12:32:43.790169+0000","last_clean":"2024-05-27T12:32:43.790169+0000","last_became_active":"2024-05-27T12:32:42.384269+0000","last_became_peered":"2024-05-27T12:32:42.384269+0000","last_unstale":"2024-05-27T12:32:43.790169+0000","last_undegraded":"2024-05-27T12:32:43.790169+0000","last_fullsized":"2024-05-27T12:32:43.790169+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:39:46.806156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.370806+0000","last_change":"2024-05-27T12:32:42.367164+0000","last_active":"2024-05-27T12:32:43.370806+0000","last_peered":"2024-05-27T12:32:43.370806+0000","last_clean":"2024-05-27T12:32:43.370806+0000","last_became_active":"2024-05-27T12:32:42.366882+0000","last_became_peered":"2024-05-27T12:32:42.366882+0000","last_unstale":"2024-05-27T12:32:43.370806+0000","last_undegraded":"2024-05-27T12:32:43.370806+0000","last_fullsized":"2024-05-27T12:32:43.370806+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:49:19.170865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.790649+0000","last_change":"2024-05-27T12:32:42.385413+0000","last_active":"2024-05-27T12:32:43.790649+0000","last_peered":"2024-05-27T12:32:43.790649+0000","last_clean":"2024-05-27T12:32:43.790649+0000","last_became_active":"2024-05-27T12:32:42.385163+0000","last_became_peered":"2024-05-27T12:32:42.385163+0000","last_unstale":"2024-05-27T12:32:43.790649+0000","last_undegraded":"2024-05-27T12:32:43.790649+0000","last_fullsized":"2024-05-27T12:32:43.790649+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:01:15.130683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.370657+0000","last_change":"2024-05-27T12:32:42.376081+0000","last_active":"2024-05-27T12:32:43.370657+0000","last_peered":"2024-05-27T12:32:43.370657+0000","last_clean":"2024-05-27T12:32:43.370657+0000","last_became_active":"2024-05-27T12:32:42.375689+0000","last_became_peered":"2024-05-27T12:32:42.375689+0000","last_unstale":"2024-05-27T12:32:43.370657+0000","last_undegraded":"2024-05-27T12:32:43.370657+0000","last_fullsized":"2024-05-27T12:32:43.370657+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:45:58.205716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.371027+0000","last_change":"2024-05-27T12:32:42.385659+0000","last_active":"2024-05-27T12:32:43.371027+0000","last_peered":"2024-05-27T12:32:43.371027+0000","last_clean":"2024-05-27T12:32:43.371027+0000","last_became_active":"2024-05-27T12:32:42.385356+0000","last_became_peered":"2024-05-27T12:32:42.385356+0000","last_unstale":"2024-05-27T12:32:43.371027+0000","last_undegraded":"2024-05-27T12:32:43.371027+0000","last_fullsized":"2024-05-27T12:32:43.371027+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:44:31.058083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.371221+0000","last_change":"2024-05-27T12:32:42.382460+0000","last_active":"2024-05-27T12:32:43.371221+0000","last_peered":"2024-05-27T12:32:43.371221+0000","last_clean":"2024-05-27T12:32:43.371221+0000","last_became_active":"2024-05-27T12:32:42.382093+0000","last_became_peered":"2024-05-27T12:32:42.382093+0000","last_unstale":"2024-05-27T12:32:43.371221+0000","last_undegraded":"2024-05-27T12:32:43.371221+0000","last_fullsized":"2024-05-27T12:32:43.371221+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:09:27.419514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.789639+0000","last_change":"2024-05-27T12:32:42.384546+0000","last_active":"2024-05-27T12:32:43.789639+0000","last_peered":"2024-05-27T12:32:43.789639+0000","last_clean":"2024-05-27T12:32:43.789639+0000","last_became_active":"2024-05-27T12:32:42.384270+0000","last_became_peered":"2024-05-27T12:32:42.384270+0000","last_unstale":"2024-05-27T12:32:43.789639+0000","last_undegraded":"2024-05-27T12:32:43.789639+0000","last_fullsized":"2024-05-27T12:32:43.789639+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:17:24.104572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.789963+0000","last_change":"2024-05-27T12:32:42.385206+0000","last_active":"2024-05-27T12:32:43.789963+0000","last_peered":"2024-05-27T12:32:43.789963+0000","last_clean":"2024-05-27T12:32:43.789963+0000","last_became_active":"2024-05-27T12:32:42.384940+0000","last_became_peered":"2024-05-27T12:32:42.384940+0000","last_unstale":"2024-05-27T12:32:43.789963+0000","last_undegraded":"2024-05-27T12:32:43.789963+0000","last_fullsized":"2024-05-27T12:32:43.789963+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:46:07.761461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.790813+0000","last_change":"2024-05-27T12:32:42.376596+0000","last_active":"2024-05-27T12:32:43.790813+0000","last_peered":"2024-05-27T12:32:43.790813+0000","last_clean":"2024-05-27T12:32:43.790813+0000","last_became_active":"2024-05-27T12:32:42.376147+0000","last_became_peered":"2024-05-27T12:32:42.376147+0000","last_unstale":"2024-05-27T12:32:43.790813+0000","last_undegraded":"2024-05-27T12:32:43.790813+0000","last_fullsized":"2024-05-27T12:32:43.790813+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:07:22.262394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.371230+0000","last_change":"2024-05-27T12:32:42.375358+0000","last_active":"2024-05-27T12:32:43.371230+0000","last_peered":"2024-05-27T12:32:43.371230+0000","last_clean":"2024-05-27T12:32:43.371230+0000","last_became_active":"2024-05-27T12:32:42.375096+0000","last_became_peered":"2024-05-27T12:32:42.375096+0000","last_unstale":"2024-05-27T12:32:43.371230+0000","last_undegraded":"2024-05-27T12:32:43.371230+0000","last_fullsized":"2024-05-27T12:32:43.371230+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:17:24.104572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.789171+0000","last_change":"2024-05-27T12:32:42.375413+0000","last_active":"2024-05-27T12:32:43.789171+0000","last_peered":"2024-05-27T12:32:43.789171+0000","last_clean":"2024-05-27T12:32:43.789171+0000","last_became_active":"2024-05-27T12:32:42.374741+0000","last_became_peered":"2024-05-27T12:32:42.374741+0000","last_unstale":"2024-05-27T12:32:43.789171+0000","last_undegraded":"2024-05-27T12:32:43.789171+0000","last_fullsized":"2024-05-27T12:32:43.789171+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:59:07.890771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.789046+0000","last_change":"2024-05-27T12:32:42.376055+0000","last_active":"2024-05-27T12:32:43.789046+0000","last_peered":"2024-05-27T12:32:43.789046+0000","last_clean":"2024-05-27T12:32:43.789046+0000","last_became_active":"2024-05-27T12:32:42.374091+0000","last_became_peered":"2024-05-27T12:32:42.374091+0000","last_unstale":"2024-05-27T12:32:43.789046+0000","last_undegraded":"2024-05-27T12:32:43.789046+0000","last_fullsized":"2024-05-27T12:32:43.789046+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:41:35.310708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.789858+0000","last_change":"2024-05-27T12:32:42.387113+0000","last_active":"2024-05-27T12:32:43.789858+0000","last_peered":"2024-05-27T12:32:43.789858+0000","last_clean":"2024-05-27T12:32:43.789858+0000","last_became_active":"2024-05-27T12:32:42.386810+0000","last_became_peered":"2024-05-27T12:32:42.386810+0000","last_unstale":"2024-05-27T12:32:43.789858+0000","last_undegraded":"2024-05-27T12:32:43.789858+0000","last_fullsized":"2024-05-27T12:32:43.789858+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:44:31.058083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.790040+0000","last_change":"2024-05-27T12:32:42.383993+0000","last_active":"2024-05-27T12:32:43.790040+0000","last_peered":"2024-05-27T12:32:43.790040+0000","last_clean":"2024-05-27T12:32:43.790040+0000","last_became_active":"2024-05-27T12:32:42.383274+0000","last_became_peered":"2024-05-27T12:32:42.383274+0000","last_unstale":"2024-05-27T12:32:43.790040+0000","last_undegraded":"2024-05-27T12:32:43.790040+0000","last_fullsized":"2024-05-27T12:32:43.790040+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:03:50.593154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.371618+0000","last_change":"2024-05-27T12:32:42.376831+0000","last_active":"2024-05-27T12:32:43.371618+0000","last_peered":"2024-05-27T12:32:43.371618+0000","last_clean":"2024-05-27T12:32:43.371618+0000","last_became_active":"2024-05-27T12:32:42.376498+0000","last_became_peered":"2024-05-27T12:32:42.376498+0000","last_unstale":"2024-05-27T12:32:43.371618+0000","last_undegraded":"2024-05-27T12:32:43.371618+0000","last_fullsized":"2024-05-27T12:32:43.371618+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:10:30.753626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.370953+0000","last_change":"2024-05-27T12:32:42.366751+0000","last_active":"2024-05-27T12:32:43.370953+0000","last_peered":"2024-05-27T12:32:43.370953+0000","last_clean":"2024-05-27T12:32:43.370953+0000","last_became_active":"2024-05-27T12:32:42.366438+0000","last_became_peered":"2024-05-27T12:32:42.366438+0000","last_unstale":"2024-05-27T12:32:43.370953+0000","last_undegraded":"2024-05-27T12:32:43.370953+0000","last_fullsized":"2024-05-27T12:32:43.370953+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:31:12.368847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.789791+0000","last_change":"2024-05-27T12:32:42.370650+0000","last_active":"2024-05-27T12:32:43.789791+0000","last_peered":"2024-05-27T12:32:43.789791+0000","last_clean":"2024-05-27T12:32:43.789791+0000","last_became_active":"2024-05-27T12:32:42.370319+0000","last_became_peered":"2024-05-27T12:32:42.370319+0000","last_unstale":"2024-05-27T12:32:43.789791+0000","last_undegraded":"2024-05-27T12:32:43.789791+0000","last_fullsized":"2024-05-27T12:32:43.789791+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:41:35.310708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.789324+0000","last_change":"2024-05-27T12:32:42.382051+0000","last_active":"2024-05-27T12:32:43.789324+0000","last_peered":"2024-05-27T12:32:43.789324+0000","last_clean":"2024-05-27T12:32:43.789324+0000","last_became_active":"2024-05-27T12:32:42.380690+0000","last_became_peered":"2024-05-27T12:32:42.380690+0000","last_unstale":"2024-05-27T12:32:43.789324+0000","last_undegraded":"2024-05-27T12:32:43.789324+0000","last_fullsized":"2024-05-27T12:32:43.789324+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:33:45.178199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.790674+0000","last_change":"2024-05-27T12:32:42.383033+0000","last_active":"2024-05-27T12:32:43.790674+0000","last_peered":"2024-05-27T12:32:43.790674+0000","last_clean":"2024-05-27T12:32:43.790674+0000","last_became_active":"2024-05-27T12:32:42.382745+0000","last_became_peered":"2024-05-27T12:32:42.382745+0000","last_unstale":"2024-05-27T12:32:43.790674+0000","last_undegraded":"2024-05-27T12:32:43.790674+0000","last_fullsized":"2024-05-27T12:32:43.790674+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:31:12.368847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.371383+0000","last_change":"2024-05-27T12:32:42.378742+0000","last_active":"2024-05-27T12:32:43.371383+0000","last_peered":"2024-05-27T12:32:43.371383+0000","last_clean":"2024-05-27T12:32:43.371383+0000","last_became_active":"2024-05-27T12:32:42.378328+0000","last_became_peered":"2024-05-27T12:32:42.378328+0000","last_unstale":"2024-05-27T12:32:43.371383+0000","last_undegraded":"2024-05-27T12:32:43.371383+0000","last_fullsized":"2024-05-27T12:32:43.371383+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:46:07.761461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.789508+0000","last_change":"2024-05-27T12:32:42.381867+0000","last_active":"2024-05-27T12:32:43.789508+0000","last_peered":"2024-05-27T12:32:43.789508+0000","last_clean":"2024-05-27T12:32:43.789508+0000","last_became_active":"2024-05-27T12:32:42.381591+0000","last_became_peered":"2024-05-27T12:32:42.381591+0000","last_unstale":"2024-05-27T12:32:43.789508+0000","last_undegraded":"2024-05-27T12:32:43.789508+0000","last_fullsized":"2024-05-27T12:32:43.789508+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:45:06.261408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.371545+0000","last_change":"2024-05-27T12:32:42.372176+0000","last_active":"2024-05-27T12:32:43.371545+0000","last_peered":"2024-05-27T12:32:43.371545+0000","last_clean":"2024-05-27T12:32:43.371545+0000","last_became_active":"2024-05-27T12:32:42.371874+0000","last_became_peered":"2024-05-27T12:32:42.371874+0000","last_unstale":"2024-05-27T12:32:43.371545+0000","last_undegraded":"2024-05-27T12:32:43.371545+0000","last_fullsized":"2024-05-27T12:32:43.371545+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:03:50.593154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.790461+0000","last_change":"2024-05-27T12:32:42.374766+0000","last_active":"2024-05-27T12:32:43.790461+0000","last_peered":"2024-05-27T12:32:43.790461+0000","last_clean":"2024-05-27T12:32:43.790461+0000","last_became_active":"2024-05-27T12:32:42.374450+0000","last_became_peered":"2024-05-27T12:32:42.374450+0000","last_unstale":"2024-05-27T12:32:43.790461+0000","last_undegraded":"2024-05-27T12:32:43.790461+0000","last_fullsized":"2024-05-27T12:32:43.790461+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:44:31.058083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.789330+0000","last_change":"2024-05-27T12:32:42.376636+0000","last_active":"2024-05-27T12:32:43.789330+0000","last_peered":"2024-05-27T12:32:43.789330+0000","last_clean":"2024-05-27T12:32:43.789330+0000","last_became_active":"2024-05-27T12:32:42.376364+0000","last_became_peered":"2024-05-27T12:32:42.376364+0000","last_unstale":"2024-05-27T12:32:43.789330+0000","last_undegraded":"2024-05-27T12:32:43.789330+0000","last_fullsized":"2024-05-27T12:32:43.789330+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:46:07.761461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.372306+0000","last_change":"2024-05-27T12:32:42.371595+0000","last_active":"2024-05-27T12:32:43.372306+0000","last_peered":"2024-05-27T12:32:43.372306+0000","last_clean":"2024-05-27T12:32:43.372306+0000","last_became_active":"2024-05-27T12:32:42.370375+0000","last_became_peered":"2024-05-27T12:32:42.370375+0000","last_unstale":"2024-05-27T12:32:43.372306+0000","last_undegraded":"2024-05-27T12:32:43.372306+0000","last_fullsized":"2024-05-27T12:32:43.372306+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:45:58.205716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.789405+0000","last_change":"2024-05-27T12:32:42.381462+0000","last_active":"2024-05-27T12:32:43.789405+0000","last_peered":"2024-05-27T12:32:43.789405+0000","last_clean":"2024-05-27T12:32:43.789405+0000","last_became_active":"2024-05-27T12:32:42.380574+0000","last_became_peered":"2024-05-27T12:32:42.380574+0000","last_unstale":"2024-05-27T12:32:43.789405+0000","last_undegraded":"2024-05-27T12:32:43.789405+0000","last_fullsized":"2024-05-27T12:32:43.789405+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:39:15.319359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.790845+0000","last_change":"2024-05-27T12:32:42.384076+0000","last_active":"2024-05-27T12:32:43.790845+0000","last_peered":"2024-05-27T12:32:43.790845+0000","last_clean":"2024-05-27T12:32:43.790845+0000","last_became_active":"2024-05-27T12:32:42.383738+0000","last_became_peered":"2024-05-27T12:32:42.383738+0000","last_unstale":"2024-05-27T12:32:43.790845+0000","last_undegraded":"2024-05-27T12:32:43.790845+0000","last_fullsized":"2024-05-27T12:32:43.790845+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:45:54.226012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.372374+0000","last_change":"2024-05-27T12:32:42.379700+0000","last_active":"2024-05-27T12:32:43.372374+0000","last_peered":"2024-05-27T12:32:43.372374+0000","last_clean":"2024-05-27T12:32:43.372374+0000","last_became_active":"2024-05-27T12:32:42.379421+0000","last_became_peered":"2024-05-27T12:32:42.379421+0000","last_unstale":"2024-05-27T12:32:43.372374+0000","last_undegraded":"2024-05-27T12:32:43.372374+0000","last_fullsized":"2024-05-27T12:32:43.372374+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:20:05.304417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.789328+0000","last_change":"2024-05-27T12:32:42.379719+0000","last_active":"2024-05-27T12:32:43.789328+0000","last_peered":"2024-05-27T12:32:43.789328+0000","last_clean":"2024-05-27T12:32:43.789328+0000","last_became_active":"2024-05-27T12:32:42.379234+0000","last_became_peered":"2024-05-27T12:32:42.379234+0000","last_unstale":"2024-05-27T12:32:43.789328+0000","last_undegraded":"2024-05-27T12:32:43.789328+0000","last_fullsized":"2024-05-27T12:32:43.789328+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:23:59.137419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.790076+0000","last_change":"2024-05-27T12:32:42.371233+0000","last_active":"2024-05-27T12:32:43.790076+0000","last_peered":"2024-05-27T12:32:43.790076+0000","last_clean":"2024-05-27T12:32:43.790076+0000","last_became_active":"2024-05-27T12:32:42.370965+0000","last_became_peered":"2024-05-27T12:32:42.370965+0000","last_unstale":"2024-05-27T12:32:43.790076+0000","last_undegraded":"2024-05-27T12:32:43.790076+0000","last_fullsized":"2024-05-27T12:32:43.790076+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T23:34:59.101630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.371329+0000","last_change":"2024-05-27T12:32:41.365100+0000","last_active":"2024-05-27T12:32:43.371329+0000","last_peered":"2024-05-27T12:32:43.371329+0000","last_clean":"2024-05-27T12:32:43.371329+0000","last_became_active":"2024-05-27T12:32:41.364795+0000","last_became_peered":"2024-05-27T12:32:41.364795+0000","last_unstale":"2024-05-27T12:32:43.371329+0000","last_undegraded":"2024-05-27T12:32:43.371329+0000","last_fullsized":"2024-05-27T12:32:43.371329+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:24:00.607915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.789475+0000","last_change":"2024-05-27T12:32:42.375571+0000","last_active":"2024-05-27T12:32:43.789475+0000","last_peered":"2024-05-27T12:32:43.789475+0000","last_clean":"2024-05-27T12:32:43.789475+0000","last_became_active":"2024-05-27T12:32:42.375317+0000","last_became_peered":"2024-05-27T12:32:42.375317+0000","last_unstale":"2024-05-27T12:32:43.789475+0000","last_undegraded":"2024-05-27T12:32:43.789475+0000","last_fullsized":"2024-05-27T12:32:43.789475+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:52:18.747481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.790038+0000","last_change":"2024-05-27T12:32:41.370064+0000","last_active":"2024-05-27T12:32:43.790038+0000","last_peered":"2024-05-27T12:32:43.790038+0000","last_clean":"2024-05-27T12:32:43.790038+0000","last_became_active":"2024-05-27T12:32:41.368679+0000","last_became_peered":"2024-05-27T12:32:41.368679+0000","last_unstale":"2024-05-27T12:32:43.790038+0000","last_undegraded":"2024-05-27T12:32:43.790038+0000","last_fullsized":"2024-05-27T12:32:43.790038+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:31:52.368166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.371463+0000","last_change":"2024-05-27T12:32:41.369441+0000","last_active":"2024-05-27T12:32:43.371463+0000","last_peered":"2024-05-27T12:32:43.371463+0000","last_clean":"2024-05-27T12:32:43.371463+0000","last_became_active":"2024-05-27T12:32:41.369164+0000","last_became_peered":"2024-05-27T12:32:41.369164+0000","last_unstale":"2024-05-27T12:32:43.371463+0000","last_undegraded":"2024-05-27T12:32:43.371463+0000","last_fullsized":"2024-05-27T12:32:43.371463+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:10:55.375726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.371049+0000","last_change":"2024-05-27T12:32:42.381264+0000","last_active":"2024-05-27T12:32:43.371049+0000","last_peered":"2024-05-27T12:32:43.371049+0000","last_clean":"2024-05-27T12:32:43.371049+0000","last_became_active":"2024-05-27T12:32:42.380823+0000","last_became_peered":"2024-05-27T12:32:42.380823+0000","last_unstale":"2024-05-27T12:32:43.371049+0000","last_undegraded":"2024-05-27T12:32:43.371049+0000","last_fullsized":"2024-05-27T12:32:43.371049+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:23:59.137419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.789618+0000","last_change":"2024-05-27T12:32:41.371539+0000","last_active":"2024-05-27T12:32:43.789618+0000","last_peered":"2024-05-27T12:32:43.789618+0000","last_clean":"2024-05-27T12:32:43.789618+0000","last_became_active":"2024-05-27T12:32:41.370827+0000","last_became_peered":"2024-05-27T12:32:41.370827+0000","last_unstale":"2024-05-27T12:32:43.789618+0000","last_undegraded":"2024-05-27T12:32:43.789618+0000","last_fullsized":"2024-05-27T12:32:43.789618+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T23:34:58.092780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.788872+0000","last_change":"2024-05-27T12:32:42.371446+0000","last_active":"2024-05-27T12:32:43.788872+0000","last_peered":"2024-05-27T12:32:43.788872+0000","last_clean":"2024-05-27T12:32:43.788872+0000","last_became_active":"2024-05-27T12:32:42.371197+0000","last_became_peered":"2024-05-27T12:32:42.371197+0000","last_unstale":"2024-05-27T12:32:43.788872+0000","last_undegraded":"2024-05-27T12:32:43.788872+0000","last_fullsized":"2024-05-27T12:32:43.788872+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:23:59.137419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.789638+0000","last_change":"2024-05-27T12:32:41.374793+0000","last_active":"2024-05-27T12:32:43.789638+0000","last_peered":"2024-05-27T12:32:43.789638+0000","last_clean":"2024-05-27T12:32:43.789638+0000","last_became_active":"2024-05-27T12:32:41.374503+0000","last_became_peered":"2024-05-27T12:32:41.374503+0000","last_unstale":"2024-05-27T12:32:43.789638+0000","last_undegraded":"2024-05-27T12:32:43.789638+0000","last_fullsized":"2024-05-27T12:32:43.789638+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T23:33:13.169169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.789772+0000","last_change":"2024-05-27T12:32:42.382592+0000","last_active":"2024-05-27T12:32:43.789772+0000","last_peered":"2024-05-27T12:32:43.789772+0000","last_clean":"2024-05-27T12:32:43.789772+0000","last_became_active":"2024-05-27T12:32:42.382289+0000","last_became_peered":"2024-05-27T12:32:42.382289+0000","last_unstale":"2024-05-27T12:32:43.789772+0000","last_undegraded":"2024-05-27T12:32:43.789772+0000","last_fullsized":"2024-05-27T12:32:43.789772+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:46:07.761461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.789819+0000","last_change":"2024-05-27T12:32:41.370517+0000","last_active":"2024-05-27T12:32:43.789819+0000","last_peered":"2024-05-27T12:32:43.789819+0000","last_clean":"2024-05-27T12:32:43.789819+0000","last_became_active":"2024-05-27T12:32:41.370216+0000","last_became_peered":"2024-05-27T12:32:41.370216+0000","last_unstale":"2024-05-27T12:32:43.789819+0000","last_undegraded":"2024-05-27T12:32:43.789819+0000","last_fullsized":"2024-05-27T12:32:43.789819+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:24:00.607915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.789709+0000","last_change":"2024-05-27T12:32:42.384361+0000","last_active":"2024-05-27T12:32:43.789709+0000","last_peered":"2024-05-27T12:32:43.789709+0000","last_clean":"2024-05-27T12:32:43.789709+0000","last_became_active":"2024-05-27T12:32:42.384083+0000","last_became_peered":"2024-05-27T12:32:42.384083+0000","last_unstale":"2024-05-27T12:32:43.789709+0000","last_undegraded":"2024-05-27T12:32:43.789709+0000","last_fullsized":"2024-05-27T12:32:43.789709+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:34:54.979924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.789374+0000","last_change":"2024-05-27T12:32:41.373060+0000","last_active":"2024-05-27T12:32:43.789374+0000","last_peered":"2024-05-27T12:32:43.789374+0000","last_clean":"2024-05-27T12:32:43.789374+0000","last_became_active":"2024-05-27T12:32:41.372729+0000","last_became_peered":"2024-05-27T12:32:41.372729+0000","last_unstale":"2024-05-27T12:32:43.789374+0000","last_undegraded":"2024-05-27T12:32:43.789374+0000","last_fullsized":"2024-05-27T12:32:43.789374+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T23:34:58.092780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.790835+0000","last_change":"2024-05-27T12:32:42.368863+0000","last_active":"2024-05-27T12:32:43.790835+0000","last_peered":"2024-05-27T12:32:43.790835+0000","last_clean":"2024-05-27T12:32:43.790835+0000","last_became_active":"2024-05-27T12:32:42.368593+0000","last_became_peered":"2024-05-27T12:32:42.368593+0000","last_unstale":"2024-05-27T12:32:43.790835+0000","last_undegraded":"2024-05-27T12:32:43.790835+0000","last_fullsized":"2024-05-27T12:32:43.790835+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:10:30.753626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"22'6","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.790164+0000","last_change":"2024-05-27T12:32:41.369617+0000","last_active":"2024-05-27T12:32:43.790164+0000","last_peered":"2024-05-27T12:32:43.790164+0000","last_clean":"2024-05-27T12:32:43.790164+0000","last_became_active":"2024-05-27T12:32:41.369371+0000","last_became_peered":"2024-05-27T12:32:41.369371+0000","last_unstale":"2024-05-27T12:32:43.790164+0000","last_undegraded":"2024-05-27T12:32:43.790164+0000","last_fullsized":"2024-05-27T12:32:43.790164+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:24:00.607915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.370555+0000","last_change":"2024-05-27T12:32:42.362804+0000","last_active":"2024-05-27T12:32:43.370555+0000","last_peered":"2024-05-27T12:32:43.370555+0000","last_clean":"2024-05-27T12:32:43.370555+0000","last_became_active":"2024-05-27T12:32:42.362483+0000","last_became_peered":"2024-05-27T12:32:42.362483+0000","last_unstale":"2024-05-27T12:32:43.370555+0000","last_undegraded":"2024-05-27T12:32:43.370555+0000","last_fullsized":"2024-05-27T12:32:43.370555+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:29:54.817031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.789520+0000","last_change":"2024-05-27T12:32:41.365663+0000","last_active":"2024-05-27T12:32:43.789520+0000","last_peered":"2024-05-27T12:32:43.789520+0000","last_clean":"2024-05-27T12:32:43.789520+0000","last_became_active":"2024-05-27T12:32:41.365362+0000","last_became_peered":"2024-05-27T12:32:41.365362+0000","last_unstale":"2024-05-27T12:32:43.789520+0000","last_undegraded":"2024-05-27T12:32:43.789520+0000","last_fullsized":"2024-05-27T12:32:43.789520+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:34:40.641559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.789225+0000","last_change":"2024-05-27T12:32:42.374786+0000","last_active":"2024-05-27T12:32:43.789225+0000","last_peered":"2024-05-27T12:32:43.789225+0000","last_clean":"2024-05-27T12:32:43.789225+0000","last_became_active":"2024-05-27T12:32:42.374527+0000","last_became_peered":"2024-05-27T12:32:42.374527+0000","last_unstale":"2024-05-27T12:32:43.789225+0000","last_undegraded":"2024-05-27T12:32:43.789225+0000","last_fullsized":"2024-05-27T12:32:43.789225+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:21:44.592343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.790766+0000","last_change":"2024-05-27T12:32:41.371087+0000","last_active":"2024-05-27T12:32:43.790766+0000","last_peered":"2024-05-27T12:32:43.790766+0000","last_clean":"2024-05-27T12:32:43.790766+0000","last_became_active":"2024-05-27T12:32:41.370237+0000","last_became_peered":"2024-05-27T12:32:41.370237+0000","last_unstale":"2024-05-27T12:32:43.790766+0000","last_undegraded":"2024-05-27T12:32:43.790766+0000","last_fullsized":"2024-05-27T12:32:43.790766+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:31:52.368166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.370939+0000","last_change":"2024-05-27T12:32:42.371339+0000","last_active":"2024-05-27T12:32:43.370939+0000","last_peered":"2024-05-27T12:32:43.370939+0000","last_clean":"2024-05-27T12:32:43.370939+0000","last_became_active":"2024-05-27T12:32:42.370848+0000","last_became_peered":"2024-05-27T12:32:42.370848+0000","last_unstale":"2024-05-27T12:32:43.370939+0000","last_undegraded":"2024-05-27T12:32:43.370939+0000","last_fullsized":"2024-05-27T12:32:43.370939+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:01:15.130683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.789256+0000","last_change":"2024-05-27T12:32:41.368354+0000","last_active":"2024-05-27T12:32:43.789256+0000","last_peered":"2024-05-27T12:32:43.789256+0000","last_clean":"2024-05-27T12:32:43.789256+0000","last_became_active":"2024-05-27T12:32:41.368086+0000","last_became_peered":"2024-05-27T12:32:41.368086+0000","last_unstale":"2024-05-27T12:32:43.789256+0000","last_undegraded":"2024-05-27T12:32:43.789256+0000","last_fullsized":"2024-05-27T12:32:43.789256+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T23:55:01.390036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.789345+0000","last_change":"2024-05-27T12:32:42.379489+0000","last_active":"2024-05-27T12:32:43.789345+0000","last_peered":"2024-05-27T12:32:43.789345+0000","last_clean":"2024-05-27T12:32:43.789345+0000","last_became_active":"2024-05-27T12:32:42.378880+0000","last_became_peered":"2024-05-27T12:32:42.378880+0000","last_unstale":"2024-05-27T12:32:43.789345+0000","last_undegraded":"2024-05-27T12:32:43.789345+0000","last_fullsized":"2024-05-27T12:32:43.789345+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:45:06.261408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.371422+0000","last_change":"2024-05-27T12:32:41.362154+0000","last_active":"2024-05-27T12:32:43.371422+0000","last_peered":"2024-05-27T12:32:43.371422+0000","last_clean":"2024-05-27T12:32:43.371422+0000","last_became_active":"2024-05-27T12:32:41.361845+0000","last_became_peered":"2024-05-27T12:32:41.361845+0000","last_unstale":"2024-05-27T12:32:43.371422+0000","last_undegraded":"2024-05-27T12:32:43.371422+0000","last_fullsized":"2024-05-27T12:32:43.371422+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:10:55.375726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.370584+0000","last_change":"2024-05-27T12:32:42.378975+0000","last_active":"2024-05-27T12:32:43.370584+0000","last_peered":"2024-05-27T12:32:43.370584+0000","last_clean":"2024-05-27T12:32:43.370584+0000","last_became_active":"2024-05-27T12:32:42.378666+0000","last_became_peered":"2024-05-27T12:32:42.378666+0000","last_unstale":"2024-05-27T12:32:43.370584+0000","last_undegraded":"2024-05-27T12:32:43.370584+0000","last_fullsized":"2024-05-27T12:32:43.370584+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:39:46.806156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.790090+0000","last_change":"2024-05-27T12:32:41.363195+0000","last_active":"2024-05-27T12:32:43.790090+0000","last_peered":"2024-05-27T12:32:43.790090+0000","last_clean":"2024-05-27T12:32:43.790090+0000","last_became_active":"2024-05-27T12:32:41.362693+0000","last_became_peered":"2024-05-27T12:32:41.362693+0000","last_unstale":"2024-05-27T12:32:43.790090+0000","last_undegraded":"2024-05-27T12:32:43.790090+0000","last_fullsized":"2024-05-27T12:32:43.790090+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:10:55.375726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.371196+0000","last_change":"2024-05-27T12:32:42.370922+0000","last_active":"2024-05-27T12:32:43.371196+0000","last_peered":"2024-05-27T12:32:43.371196+0000","last_clean":"2024-05-27T12:32:43.371196+0000","last_became_active":"2024-05-27T12:32:42.370170+0000","last_became_peered":"2024-05-27T12:32:42.370170+0000","last_unstale":"2024-05-27T12:32:43.371196+0000","last_undegraded":"2024-05-27T12:32:43.371196+0000","last_fullsized":"2024-05-27T12:32:43.371196+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:10:10.701630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.371717+0000","last_change":"2024-05-27T12:32:41.366108+0000","last_active":"2024-05-27T12:32:43.371717+0000","last_peered":"2024-05-27T12:32:43.371717+0000","last_clean":"2024-05-27T12:32:43.371717+0000","last_became_active":"2024-05-27T12:32:41.365777+0000","last_became_peered":"2024-05-27T12:32:41.365777+0000","last_unstale":"2024-05-27T12:32:43.371717+0000","last_undegraded":"2024-05-27T12:32:43.371717+0000","last_fullsized":"2024-05-27T12:32:43.371717+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:24:00.607915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.371292+0000","last_change":"2024-05-27T12:32:42.374653+0000","last_active":"2024-05-27T12:32:43.371292+0000","last_peered":"2024-05-27T12:32:43.371292+0000","last_clean":"2024-05-27T12:32:43.371292+0000","last_became_active":"2024-05-27T12:32:42.370933+0000","last_became_peered":"2024-05-27T12:32:42.370933+0000","last_unstale":"2024-05-27T12:32:43.371292+0000","last_undegraded":"2024-05-27T12:32:43.371292+0000","last_fullsized":"2024-05-27T12:32:43.371292+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:08:15.290969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.789475+0000","last_change":"2024-05-27T12:32:41.366243+0000","last_active":"2024-05-27T12:32:43.789475+0000","last_peered":"2024-05-27T12:32:43.789475+0000","last_clean":"2024-05-27T12:32:43.789475+0000","last_became_active":"2024-05-27T12:32:41.365843+0000","last_became_peered":"2024-05-27T12:32:41.365843+0000","last_unstale":"2024-05-27T12:32:43.789475+0000","last_undegraded":"2024-05-27T12:32:43.789475+0000","last_fullsized":"2024-05-27T12:32:43.789475+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:31:52.368166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.790495+0000","last_change":"2024-05-27T12:32:42.384741+0000","last_active":"2024-05-27T12:32:43.790495+0000","last_peered":"2024-05-27T12:32:43.790495+0000","last_clean":"2024-05-27T12:32:43.790495+0000","last_became_active":"2024-05-27T12:32:42.383818+0000","last_became_peered":"2024-05-27T12:32:42.383818+0000","last_unstale":"2024-05-27T12:32:43.790495+0000","last_undegraded":"2024-05-27T12:32:43.790495+0000","last_fullsized":"2024-05-27T12:32:43.790495+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:49:19.170865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.371621+0000","last_change":"2024-05-27T12:32:41.374511+0000","last_active":"2024-05-27T12:32:43.371621+0000","last_peered":"2024-05-27T12:32:43.371621+0000","last_clean":"2024-05-27T12:32:43.371621+0000","last_became_active":"2024-05-27T12:32:41.374221+0000","last_became_peered":"2024-05-27T12:32:41.374221+0000","last_unstale":"2024-05-27T12:32:43.371621+0000","last_undegraded":"2024-05-27T12:32:43.371621+0000","last_fullsized":"2024-05-27T12:32:43.371621+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T23:34:58.092780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.370723+0000","last_change":"2024-05-27T12:32:42.384647+0000","last_active":"2024-05-27T12:32:43.370723+0000","last_peered":"2024-05-27T12:32:43.370723+0000","last_clean":"2024-05-27T12:32:43.370723+0000","last_became_active":"2024-05-27T12:32:42.384389+0000","last_became_peered":"2024-05-27T12:32:42.384389+0000","last_unstale":"2024-05-27T12:32:43.370723+0000","last_undegraded":"2024-05-27T12:32:43.370723+0000","last_fullsized":"2024-05-27T12:32:43.370723+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:46:37.922278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":170,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.370450+0000","last_change":"2024-05-27T12:32:31.185664+0000","last_active":"2024-05-27T12:32:43.370450+0000","last_peered":"2024-05-27T12:32:43.370450+0000","last_clean":"2024-05-27T12:32:43.370450+0000","last_became_active":"2024-05-27T12:32:31.184757+0000","last_became_peered":"2024-05-27T12:32:31.184757+0000","last_unstale":"2024-05-27T12:32:43.370450+0000","last_undegraded":"2024-05-27T12:32:43.370450+0000","last_fullsized":"2024-05-27T12:32:43.370450+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:30.136480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:30.136480+0000","last_clean_scrub_stamp":"2024-05-27T12:32:30.136480+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:49:13.241747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.789668+0000","last_change":"2024-05-27T12:32:41.371475+0000","last_active":"2024-05-27T12:32:43.789668+0000","last_peered":"2024-05-27T12:32:43.789668+0000","last_clean":"2024-05-27T12:32:43.789668+0000","last_became_active":"2024-05-27T12:32:41.371198+0000","last_became_peered":"2024-05-27T12:32:41.371198+0000","last_unstale":"2024-05-27T12:32:43.789668+0000","last_undegraded":"2024-05-27T12:32:43.789668+0000","last_fullsized":"2024-05-27T12:32:43.789668+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T23:55:01.390036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.371225+0000","last_change":"2024-05-27T12:32:42.385699+0000","last_active":"2024-05-27T12:32:43.371225+0000","last_peered":"2024-05-27T12:32:43.371225+0000","last_clean":"2024-05-27T12:32:43.371225+0000","last_became_active":"2024-05-27T12:32:42.385464+0000","last_became_peered":"2024-05-27T12:32:42.385464+0000","last_unstale":"2024-05-27T12:32:43.371225+0000","last_undegraded":"2024-05-27T12:32:43.371225+0000","last_fullsized":"2024-05-27T12:32:43.371225+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:41:35.310708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.370292+0000","last_change":"2024-05-27T12:32:41.371263+0000","last_active":"2024-05-27T12:32:43.370292+0000","last_peered":"2024-05-27T12:32:43.370292+0000","last_clean":"2024-05-27T12:32:43.370292+0000","last_became_active":"2024-05-27T12:32:41.370961+0000","last_became_peered":"2024-05-27T12:32:41.370961+0000","last_unstale":"2024-05-27T12:32:43.370292+0000","last_undegraded":"2024-05-27T12:32:43.370292+0000","last_fullsized":"2024-05-27T12:32:43.370292+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:07:21.253545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.789059+0000","last_change":"2024-05-27T12:32:42.375057+0000","last_active":"2024-05-27T12:32:43.789059+0000","last_peered":"2024-05-27T12:32:43.789059+0000","last_clean":"2024-05-27T12:32:43.789059+0000","last_became_active":"2024-05-27T12:32:42.374593+0000","last_became_peered":"2024-05-27T12:32:42.374593+0000","last_unstale":"2024-05-27T12:32:43.789059+0000","last_undegraded":"2024-05-27T12:32:43.789059+0000","last_fullsized":"2024-05-27T12:32:43.789059+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:31:57.042894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.372424+0000","last_change":"2024-05-27T12:32:41.366189+0000","last_active":"2024-05-27T12:32:43.372424+0000","last_peered":"2024-05-27T12:32:43.372424+0000","last_clean":"2024-05-27T12:32:43.372424+0000","last_became_active":"2024-05-27T12:32:41.365860+0000","last_became_peered":"2024-05-27T12:32:41.365860+0000","last_unstale":"2024-05-27T12:32:43.372424+0000","last_undegraded":"2024-05-27T12:32:43.372424+0000","last_fullsized":"2024-05-27T12:32:43.372424+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T23:55:01.390036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.789114+0000","last_change":"2024-05-27T12:32:42.370436+0000","last_active":"2024-05-27T12:32:43.789114+0000","last_peered":"2024-05-27T12:32:43.789114+0000","last_clean":"2024-05-27T12:32:43.789114+0000","last_became_active":"2024-05-27T12:32:42.370051+0000","last_became_peered":"2024-05-27T12:32:42.370051+0000","last_unstale":"2024-05-27T12:32:43.789114+0000","last_undegraded":"2024-05-27T12:32:43.789114+0000","last_fullsized":"2024-05-27T12:32:43.789114+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:17:24.104572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.790865+0000","last_change":"2024-05-27T12:32:41.368242+0000","last_active":"2024-05-27T12:32:43.790865+0000","last_peered":"2024-05-27T12:32:43.790865+0000","last_clean":"2024-05-27T12:32:43.790865+0000","last_became_active":"2024-05-27T12:32:41.366995+0000","last_became_peered":"2024-05-27T12:32:41.366995+0000","last_unstale":"2024-05-27T12:32:43.790865+0000","last_undegraded":"2024-05-27T12:32:43.790865+0000","last_fullsized":"2024-05-27T12:32:43.790865+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T23:33:13.169169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.790572+0000","last_change":"2024-05-27T12:32:42.382859+0000","last_active":"2024-05-27T12:32:43.790572+0000","last_peered":"2024-05-27T12:32:43.790572+0000","last_clean":"2024-05-27T12:32:43.790572+0000","last_became_active":"2024-05-27T12:32:42.382312+0000","last_became_peered":"2024-05-27T12:32:42.382312+0000","last_unstale":"2024-05-27T12:32:43.790572+0000","last_undegraded":"2024-05-27T12:32:43.790572+0000","last_fullsized":"2024-05-27T12:32:43.790572+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T23:33:14.178019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.788938+0000","last_change":"2024-05-27T12:32:41.362976+0000","last_active":"2024-05-27T12:32:43.788938+0000","last_peered":"2024-05-27T12:32:43.788938+0000","last_clean":"2024-05-27T12:32:43.788938+0000","last_became_active":"2024-05-27T12:32:41.362645+0000","last_became_peered":"2024-05-27T12:32:41.362645+0000","last_unstale":"2024-05-27T12:32:43.788938+0000","last_undegraded":"2024-05-27T12:32:43.788938+0000","last_fullsized":"2024-05-27T12:32:43.788938+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T23:55:01.390036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.790293+0000","last_change":"2024-05-27T12:32:42.382156+0000","last_active":"2024-05-27T12:32:43.790293+0000","last_peered":"2024-05-27T12:32:43.790293+0000","last_clean":"2024-05-27T12:32:43.790293+0000","last_became_active":"2024-05-27T12:32:42.381678+0000","last_became_peered":"2024-05-27T12:32:42.381678+0000","last_unstale":"2024-05-27T12:32:43.790293+0000","last_undegraded":"2024-05-27T12:32:43.790293+0000","last_fullsized":"2024-05-27T12:32:43.790293+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:45:58.205716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.371082+0000","last_change":"2024-05-27T12:32:41.371270+0000","last_active":"2024-05-27T12:32:43.371082+0000","last_peered":"2024-05-27T12:32:43.371082+0000","last_clean":"2024-05-27T12:32:43.371082+0000","last_became_active":"2024-05-27T12:32:41.370665+0000","last_became_peered":"2024-05-27T12:32:41.370665+0000","last_unstale":"2024-05-27T12:32:43.371082+0000","last_undegraded":"2024-05-27T12:32:43.371082+0000","last_fullsized":"2024-05-27T12:32:43.371082+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:45:13.017421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.788973+0000","last_change":"2024-05-27T12:32:42.371153+0000","last_active":"2024-05-27T12:32:43.788973+0000","last_peered":"2024-05-27T12:32:43.788973+0000","last_clean":"2024-05-27T12:32:43.788973+0000","last_became_active":"2024-05-27T12:32:42.370862+0000","last_became_peered":"2024-05-27T12:32:42.370862+0000","last_unstale":"2024-05-27T12:32:43.788973+0000","last_undegraded":"2024-05-27T12:32:43.788973+0000","last_fullsized":"2024-05-27T12:32:43.788973+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:46:59.701728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.789282+0000","last_change":"2024-05-27T12:32:41.368774+0000","last_active":"2024-05-27T12:32:43.789282+0000","last_peered":"2024-05-27T12:32:43.789282+0000","last_clean":"2024-05-27T12:32:43.789282+0000","last_became_active":"2024-05-27T12:32:41.368343+0000","last_became_peered":"2024-05-27T12:32:41.368343+0000","last_unstale":"2024-05-27T12:32:43.789282+0000","last_undegraded":"2024-05-27T12:32:43.789282+0000","last_fullsized":"2024-05-27T12:32:43.789282+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:07:21.253545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.371690+0000","last_change":"2024-05-27T12:32:42.361807+0000","last_active":"2024-05-27T12:32:43.371690+0000","last_peered":"2024-05-27T12:32:43.371690+0000","last_clean":"2024-05-27T12:32:43.371690+0000","last_became_active":"2024-05-27T12:32:42.361508+0000","last_became_peered":"2024-05-27T12:32:42.361508+0000","last_unstale":"2024-05-27T12:32:43.371690+0000","last_undegraded":"2024-05-27T12:32:43.371690+0000","last_fullsized":"2024-05-27T12:32:43.371690+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:29:54.817031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.789737+0000","last_change":"2024-05-27T12:32:41.368907+0000","last_active":"2024-05-27T12:32:43.789737+0000","last_peered":"2024-05-27T12:32:43.789737+0000","last_clean":"2024-05-27T12:32:43.789737+0000","last_became_active":"2024-05-27T12:32:41.368392+0000","last_became_peered":"2024-05-27T12:32:41.368392+0000","last_unstale":"2024-05-27T12:32:43.789737+0000","last_undegraded":"2024-05-27T12:32:43.789737+0000","last_fullsized":"2024-05-27T12:32:43.789737+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T23:34:58.092780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.789583+0000","last_change":"2024-05-27T12:32:42.378690+0000","last_active":"2024-05-27T12:32:43.789583+0000","last_peered":"2024-05-27T12:32:43.789583+0000","last_clean":"2024-05-27T12:32:43.789583+0000","last_became_active":"2024-05-27T12:32:42.378367+0000","last_became_peered":"2024-05-27T12:32:42.378367+0000","last_unstale":"2024-05-27T12:32:43.789583+0000","last_undegraded":"2024-05-27T12:32:43.789583+0000","last_fullsized":"2024-05-27T12:32:43.789583+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:20:51.752584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.370292+0000","last_change":"2024-05-27T12:32:41.369723+0000","last_active":"2024-05-27T12:32:43.370292+0000","last_peered":"2024-05-27T12:32:43.370292+0000","last_clean":"2024-05-27T12:32:43.370292+0000","last_became_active":"2024-05-27T12:32:41.369404+0000","last_became_peered":"2024-05-27T12:32:41.369404+0000","last_unstale":"2024-05-27T12:32:43.370292+0000","last_undegraded":"2024-05-27T12:32:43.370292+0000","last_fullsized":"2024-05-27T12:32:43.370292+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T23:33:13.169169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.790391+0000","last_change":"2024-05-27T12:32:42.371958+0000","last_active":"2024-05-27T12:32:43.790391+0000","last_peered":"2024-05-27T12:32:43.790391+0000","last_clean":"2024-05-27T12:32:43.790391+0000","last_became_active":"2024-05-27T12:32:42.371689+0000","last_became_peered":"2024-05-27T12:32:42.371689+0000","last_unstale":"2024-05-27T12:32:43.790391+0000","last_undegraded":"2024-05-27T12:32:43.790391+0000","last_fullsized":"2024-05-27T12:32:43.790391+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:31:53.377015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.789137+0000","last_change":"2024-05-27T12:32:41.367208+0000","last_active":"2024-05-27T12:32:43.789137+0000","last_peered":"2024-05-27T12:32:43.789137+0000","last_clean":"2024-05-27T12:32:43.789137+0000","last_became_active":"2024-05-27T12:32:41.366772+0000","last_became_peered":"2024-05-27T12:32:41.366772+0000","last_unstale":"2024-05-27T12:32:43.789137+0000","last_undegraded":"2024-05-27T12:32:43.789137+0000","last_fullsized":"2024-05-27T12:32:43.789137+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T23:33:13.169169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.371204+0000","last_change":"2024-05-27T12:32:42.371618+0000","last_active":"2024-05-27T12:32:43.371204+0000","last_peered":"2024-05-27T12:32:43.371204+0000","last_clean":"2024-05-27T12:32:43.371204+0000","last_became_active":"2024-05-27T12:32:42.369525+0000","last_became_peered":"2024-05-27T12:32:42.369525+0000","last_unstale":"2024-05-27T12:32:43.371204+0000","last_undegraded":"2024-05-27T12:32:43.371204+0000","last_fullsized":"2024-05-27T12:32:43.371204+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:46:59.701728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.788977+0000","last_change":"2024-05-27T12:32:41.366388+0000","last_active":"2024-05-27T12:32:43.788977+0000","last_peered":"2024-05-27T12:32:43.788977+0000","last_clean":"2024-05-27T12:32:43.788977+0000","last_became_active":"2024-05-27T12:32:41.365881+0000","last_became_peered":"2024-05-27T12:32:41.365881+0000","last_unstale":"2024-05-27T12:32:43.788977+0000","last_undegraded":"2024-05-27T12:32:43.788977+0000","last_fullsized":"2024-05-27T12:32:43.788977+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:24:00.607915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.371263+0000","last_change":"2024-05-27T12:32:42.383798+0000","last_active":"2024-05-27T12:32:43.371263+0000","last_peered":"2024-05-27T12:32:43.371263+0000","last_clean":"2024-05-27T12:32:43.371263+0000","last_became_active":"2024-05-27T12:32:42.383431+0000","last_became_peered":"2024-05-27T12:32:42.383431+0000","last_unstale":"2024-05-27T12:32:43.371263+0000","last_undegraded":"2024-05-27T12:32:43.371263+0000","last_fullsized":"2024-05-27T12:32:43.371263+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:45:06.261408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.371165+0000","last_change":"2024-05-27T12:32:41.373716+0000","last_active":"2024-05-27T12:32:43.371165+0000","last_peered":"2024-05-27T12:32:43.371165+0000","last_clean":"2024-05-27T12:32:43.371165+0000","last_became_active":"2024-05-27T12:32:41.373364+0000","last_became_peered":"2024-05-27T12:32:41.373364+0000","last_unstale":"2024-05-27T12:32:43.371165+0000","last_undegraded":"2024-05-27T12:32:43.371165+0000","last_fullsized":"2024-05-27T12:32:43.371165+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:21:03.909608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.789527+0000","last_change":"2024-05-27T12:32:42.370445+0000","last_active":"2024-05-27T12:32:43.789527+0000","last_peered":"2024-05-27T12:32:43.789527+0000","last_clean":"2024-05-27T12:32:43.789527+0000","last_became_active":"2024-05-27T12:32:42.370164+0000","last_became_peered":"2024-05-27T12:32:42.370164+0000","last_unstale":"2024-05-27T12:32:43.789527+0000","last_undegraded":"2024-05-27T12:32:43.789527+0000","last_fullsized":"2024-05-27T12:32:43.789527+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:46:59.701728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.790143+0000","last_change":"2024-05-27T12:32:42.386589+0000","last_active":"2024-05-27T12:32:43.790143+0000","last_peered":"2024-05-27T12:32:43.790143+0000","last_clean":"2024-05-27T12:32:43.790143+0000","last_became_active":"2024-05-27T12:32:42.386297+0000","last_became_peered":"2024-05-27T12:32:42.386297+0000","last_unstale":"2024-05-27T12:32:43.790143+0000","last_undegraded":"2024-05-27T12:32:43.790143+0000","last_fullsized":"2024-05-27T12:32:43.790143+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:29:54.817031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.370575+0000","last_change":"2024-05-27T12:32:41.374812+0000","last_active":"2024-05-27T12:32:43.370575+0000","last_peered":"2024-05-27T12:32:43.370575+0000","last_clean":"2024-05-27T12:32:43.370575+0000","last_became_active":"2024-05-27T12:32:41.374488+0000","last_became_peered":"2024-05-27T12:32:41.374488+0000","last_unstale":"2024-05-27T12:32:43.370575+0000","last_undegraded":"2024-05-27T12:32:43.370575+0000","last_fullsized":"2024-05-27T12:32:43.370575+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:10:29.744776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.790329+0000","last_change":"2024-05-27T12:32:42.389941+0000","last_active":"2024-05-27T12:32:43.790329+0000","last_peered":"2024-05-27T12:32:43.790329+0000","last_clean":"2024-05-27T12:32:43.790329+0000","last_became_active":"2024-05-27T12:32:42.389630+0000","last_became_peered":"2024-05-27T12:32:42.389630+0000","last_unstale":"2024-05-27T12:32:43.790329+0000","last_undegraded":"2024-05-27T12:32:43.790329+0000","last_fullsized":"2024-05-27T12:32:43.790329+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:46:37.922278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.370730+0000","last_change":"2024-05-27T12:32:41.371373+0000","last_active":"2024-05-27T12:32:43.370730+0000","last_peered":"2024-05-27T12:32:43.370730+0000","last_clean":"2024-05-27T12:32:43.370730+0000","last_became_active":"2024-05-27T12:32:41.371009+0000","last_became_peered":"2024-05-27T12:32:41.371009+0000","last_unstale":"2024-05-27T12:32:43.370730+0000","last_undegraded":"2024-05-27T12:32:43.370730+0000","last_fullsized":"2024-05-27T12:32:43.370730+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:20:04.295568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.789661+0000","last_change":"2024-05-27T12:32:42.382123+0000","last_active":"2024-05-27T12:32:43.789661+0000","last_peered":"2024-05-27T12:32:43.789661+0000","last_clean":"2024-05-27T12:32:43.789661+0000","last_became_active":"2024-05-27T12:32:42.381762+0000","last_became_peered":"2024-05-27T12:32:42.381762+0000","last_unstale":"2024-05-27T12:32:43.789661+0000","last_undegraded":"2024-05-27T12:32:43.789661+0000","last_fullsized":"2024-05-27T12:32:43.789661+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:37:15.902329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.372004+0000","last_change":"2024-05-27T12:32:41.362828+0000","last_active":"2024-05-27T12:32:43.372004+0000","last_peered":"2024-05-27T12:32:43.372004+0000","last_clean":"2024-05-27T12:32:43.372004+0000","last_became_active":"2024-05-27T12:32:41.362526+0000","last_became_peered":"2024-05-27T12:32:41.362526+0000","last_unstale":"2024-05-27T12:32:43.372004+0000","last_undegraded":"2024-05-27T12:32:43.372004+0000","last_fullsized":"2024-05-27T12:32:43.372004+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T23:55:01.390036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.371918+0000","last_change":"2024-05-27T12:32:42.368191+0000","last_active":"2024-05-27T12:32:43.371918+0000","last_peered":"2024-05-27T12:32:43.371918+0000","last_clean":"2024-05-27T12:32:43.371918+0000","last_became_active":"2024-05-27T12:32:42.367914+0000","last_became_peered":"2024-05-27T12:32:42.367914+0000","last_unstale":"2024-05-27T12:32:43.371918+0000","last_undegraded":"2024-05-27T12:32:43.371918+0000","last_fullsized":"2024-05-27T12:32:43.371918+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:41.333908+0000","last_clean_scrub_stamp":"2024-05-27T12:32:41.333908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:39:46.806156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"22'4","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-27T12:32:43.789749+0000","last_change":"2024-05-27T12:32:41.364608+0000","last_active":"2024-05-27T12:32:43.789749+0000","last_peered":"2024-05-27T12:32:43.789749+0000","last_clean":"2024-05-27T12:32:43.789749+0000","last_became_active":"2024-05-27T12:32:41.364245+0000","last_became_peered":"2024-05-27T12:32:41.364245+0000","last_unstale":"2024-05-27T12:32:43.789749+0000","last_undegraded":"2024-05-27T12:32:43.789749+0000","last_fullsized":"2024-05-27T12:32:43.789749+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:40.325059+0000","last_clean_scrub_stamp":"2024-05-27T12:32:40.325059+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:56:45.451315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509447,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27836,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344004,"statfs":{"total":96636764160,"available":96608260096,"internally_reserved":0,"allocated":831488,"data_stored":671905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509447,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":245760,"data_stored":82567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509447,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":237568,"data_stored":81045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509447,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":245760,"data_stored":81081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509447,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31424,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340416,"statfs":{"total":96636764160,"available":96604585984,"internally_reserved":0,"allocated":245760,"data_stored":82567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509447,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31412,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340428,"statfs":{"total":96636764160,"available":96604598272,"internally_reserved":0,"allocated":233472,"data_stored":80955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509447,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31420,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340420,"statfs":{"total":96636764160,"available":96604590080,"internally_reserved":0,"allocated":241664,"data_stored":81115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542153,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32008,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339832,"statfs":{"total":96636764160,"available":96603987968,"internally_reserved":0,"allocated":839680,"data_stored":671961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-27T12:32:54.673 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-27T12:32:54.673 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-05-27T12:32:54.673 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-05-27T12:32:54.673 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-05-27T12:32:54.812 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.813+0000 7f3ffe805640 1 Processor -- start 2024-05-27T12:32:54.812 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.813+0000 7f3ffe805640 1 -- start start 2024-05-27T12:32:54.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.814+0000 7f3ffe805640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3ff81620b0 0x7f3ff80b79c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:54.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.814+0000 7f3ffe805640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3ff80cf8d0 0x7f3ff806ce80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:54.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.814+0000 7f3ffe805640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ff80b39a0 con 0x7f3ff80cfd30 2024-05-27T12:32:54.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.814+0000 7f3ffe805640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f3ff80d56d0 con 0x7f3ff81620b0 2024-05-27T12:32:54.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.814+0000 7f3ffe805640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f3ff80b7f00 con 0x7f3ff80cf8d0 2024-05-27T12:32:54.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.814+0000 7f3ff7fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3ff81620b0 0x7f3ff80b79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:54.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.814+0000 7f3ffcda2640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f3ff80cfd30 0x7f3ff80d3950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:36908/0 (socket says 172.21.15.55:36908) 2024-05-27T12:32:54.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.814+0000 7f3ffcda2640 1 -- 172.21.15.55:0/579896405 learned_addr learned my addr 172.21.15.55:0/579896405 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-27T12:32:54.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.814+0000 7f3feffff640 1 --2- 172.21.15.55:0/579896405 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3ff80cf8d0 0x7f3ff806ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:54.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.814+0000 7f3ff7fff640 1 -- 172.21.15.55:0/579896405 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3ff80cf8d0 msgr2=0x7f3ff806ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:32:54.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.814+0000 7f3ff7fff640 1 --2- 172.21.15.55:0/579896405 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3ff80cf8d0 0x7f3ff806ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:54.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.814+0000 7f3ff7fff640 1 -- 172.21.15.55:0/579896405 >> v1:172.21.15.55:6789/0 conn(0x7f3ff80cfd30 legacy=0x7f3ff80d3950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:54.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.814+0000 7f3ff77fe640 1 -- 172.21.15.55:0/579896405 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 687914570 0 0) 0x7f3ff80b39a0 con 0x7f3ff80cfd30 2024-05-27T12:32:54.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.814+0000 7f3ff7fff640 1 -- 172.21.15.55:0/579896405 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ff80b3c80 con 0x7f3ff81620b0 2024-05-27T12:32:54.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.815+0000 7f3ff7fff640 1 --2- 172.21.15.55:0/579896405 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ff81620b0 0x7f3ff80b79c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f3fe80097a0 tx=0x7f3fe802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36e6387c2d74c51a server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:54.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.815+0000 7f3ff77fe640 1 -- 172.21.15.55:0/579896405 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fe8037070 con 0x7f3ff81620b0 2024-05-27T12:32:54.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.815+0000 7f3ff77fe640 1 -- 172.21.15.55:0/579896405 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fe8032440 con 0x7f3ff81620b0 2024-05-27T12:32:54.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.815+0000 7f3ff77fe640 1 -- 172.21.15.55:0/579896405 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fe8032810 con 0x7f3ff81620b0 2024-05-27T12:32:54.818 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.815+0000 7f3ffe805640 1 -- 172.21.15.55:0/579896405 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ff81620b0 msgr2=0x7f3ff80b79c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:54.818 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.815+0000 7f3ffe805640 1 --2- 172.21.15.55:0/579896405 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ff81620b0 0x7f3ff80b79c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f3fe80097a0 tx=0x7f3fe802a180 comp rx=0 tx=0).stop 2024-05-27T12:32:54.818 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.816+0000 7f3ffe805640 1 -- 172.21.15.55:0/579896405 shutdown_connections 2024-05-27T12:32:54.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.816+0000 7f3ffe805640 1 --2- 172.21.15.55:0/579896405 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3ff80cf8d0 0x7f3ff806ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:54.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.816+0000 7f3ffe805640 1 --2- 172.21.15.55:0/579896405 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ff81620b0 0x7f3ff80b79c0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:54.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.816+0000 7f3ffe805640 1 -- 172.21.15.55:0/579896405 >> 172.21.15.55:0/579896405 conn(0x7f3ff80d1940 msgr2=0x7f3ff80d4890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:54.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.816+0000 7f3ffe805640 1 -- 172.21.15.55:0/579896405 shutdown_connections 2024-05-27T12:32:54.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.816+0000 7f3ffe805640 1 -- 172.21.15.55:0/579896405 wait complete. 2024-05-27T12:32:54.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.817+0000 7f3ffe805640 1 Processor -- start 2024-05-27T12:32:54.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.817+0000 7f3ffe805640 1 -- start start 2024-05-27T12:32:54.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.817+0000 7f3ffe805640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3ff80cf8d0 0x7f3ff80cb960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:54.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.818+0000 7f3ffe805640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ff80cfd30 0x7f3ff8147370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:54.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.818+0000 7f3ffe805640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3ff81620b0 0x7f3ff8160b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:54.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.818+0000 7f3ffe805640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f3ff80d3430 con 0x7f3ff80cfd30 2024-05-27T12:32:54.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.818+0000 7f3ffe805640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f3ff80d3150 con 0x7f3ff80cf8d0 2024-05-27T12:32:54.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.818+0000 7f3ffe805640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f3ff80b3650 con 0x7f3ff81620b0 2024-05-27T12:32:54.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.818+0000 7f3feffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ff80cfd30 0x7f3ff8147370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:54.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.818+0000 7f3feffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ff80cfd30 0x7f3ff8147370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57566/0 (socket says 172.21.15.55:57566) 2024-05-27T12:32:54.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.818+0000 7f3feffff640 1 -- 172.21.15.55:0/846073497 learned_addr learned my addr 172.21.15.55:0/846073497 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:32:54.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.818+0000 7f3ffcda2640 1 --2- 172.21.15.55:0/846073497 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3ff81620b0 0x7f3ff8160b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:54.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.818+0000 7f3ff7fff640 1 --2- 172.21.15.55:0/846073497 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3ff80cf8d0 0x7f3ff80cb960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:54.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.818+0000 7f3feffff640 1 -- 172.21.15.55:0/846073497 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3ff81620b0 msgr2=0x7f3ff8160b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:54.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.818+0000 7f3feffff640 1 --2- 172.21.15.55:0/846073497 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3ff81620b0 0x7f3ff8160b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:54.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.818+0000 7f3feffff640 1 -- 172.21.15.55:0/846073497 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3ff80cf8d0 msgr2=0x7f3ff80cb960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:54.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.818+0000 7f3feffff640 1 --2- 172.21.15.55:0/846073497 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3ff80cf8d0 0x7f3ff80cb960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:54.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.818+0000 7f3feffff640 1 -- 172.21.15.55:0/846073497 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ff8161090 con 0x7f3ff80cfd30 2024-05-27T12:32:54.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.818+0000 7f3ffcda2640 1 --2- 172.21.15.55:0/846073497 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3ff81620b0 0x7f3ff8160b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T12:32:54.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.818+0000 7f3ff7fff640 1 --2- 172.21.15.55:0/846073497 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3ff80cf8d0 0x7f3ff80cb960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T12:32:54.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.818+0000 7f3feffff640 1 --2- 172.21.15.55:0/846073497 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ff80cfd30 0x7f3ff8147370 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f3fe000d620 tx=0x7f3fe000dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:54.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.818+0000 7f3ff57fa640 1 -- 172.21.15.55:0/846073497 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fe000b620 con 0x7f3ff80cfd30 2024-05-27T12:32:54.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.818+0000 7f3ff57fa640 1 -- 172.21.15.55:0/846073497 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fe0019070 con 0x7f3ff80cfd30 2024-05-27T12:32:54.821 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.818+0000 7f3ffe805640 1 -- 172.21.15.55:0/846073497 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ff80cc000 con 0x7f3ff80cfd30 2024-05-27T12:32:54.821 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.818+0000 7f3ff57fa640 1 -- 172.21.15.55:0/846073497 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fe000ba00 con 0x7f3ff80cfd30 2024-05-27T12:32:54.821 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.818+0000 7f3ffe805640 1 -- 172.21.15.55:0/846073497 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ff81f7f00 con 0x7f3ff80cfd30 2024-05-27T12:32:54.821 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.819+0000 7f3ffe805640 1 -- 172.21.15.55:0/846073497 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ff8075460 con 0x7f3ff80cfd30 2024-05-27T12:32:54.821 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.820+0000 7f3ff57fa640 1 -- 172.21.15.55:0/846073497 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3fe000bba0 con 0x7f3ff80cfd30 2024-05-27T12:32:54.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.820+0000 7f3ff57fa640 1 --2- 172.21.15.55:0/846073497 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f3fd806c8f0 0x7f3fd806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:54.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.820+0000 7f3ff57fa640 1 -- 172.21.15.55:0/846073497 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f3fe008bec0 con 0x7f3ff80cfd30 2024-05-27T12:32:54.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.821+0000 7f3ff7fff640 1 --2- 172.21.15.55:0/846073497 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f3fd806c8f0 0x7f3fd806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:54.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.821+0000 7f3ff7fff640 1 --2- 172.21.15.55:0/846073497 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f3fd806c8f0 0x7f3fd806edb0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3fe8034000 tx=0x7f3fe802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:54.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:54.824+0000 7f3ff57fa640 1 -- 172.21.15.55:0/846073497 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3fe005a380 con 0x7f3ff80cfd30 2024-05-27T12:32:55.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.049+0000 7f3ffe805640 1 -- 172.21.15.55:0/846073497 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f3ff806db20 con 0x7f3ff80cfd30 2024-05-27T12:32:55.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.049+0000 7f3ff57fa640 1 -- 172.21.15.55:0/846073497 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f3fe0059c80 con 0x7f3ff80cfd30 2024-05-27T12:32:55.049 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-27T12:32:55.049 INFO:teuthology.orchestra.run.smithi055.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-05-27T12:32:55.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.051+0000 7f3ffe805640 1 -- 172.21.15.55:0/846073497 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f3fd806c8f0 msgr2=0x7f3fd806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:55.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.051+0000 7f3ffe805640 1 --2- 172.21.15.55:0/846073497 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f3fd806c8f0 0x7f3fd806edb0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3fe8034000 tx=0x7f3fe802e000 comp rx=0 tx=0).stop 2024-05-27T12:32:55.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.051+0000 7f3ffe805640 1 -- 172.21.15.55:0/846073497 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ff80cfd30 msgr2=0x7f3ff8147370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:55.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.051+0000 7f3ffe805640 1 --2- 172.21.15.55:0/846073497 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ff80cfd30 0x7f3ff8147370 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f3fe000d620 tx=0x7f3fe000dae0 comp rx=0 tx=0).stop 2024-05-27T12:32:55.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.051+0000 7f3ffe805640 1 -- 172.21.15.55:0/846073497 shutdown_connections 2024-05-27T12:32:55.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.051+0000 7f3ffe805640 1 --2- 172.21.15.55:0/846073497 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3ff81620b0 0x7f3ff8160b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:55.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.051+0000 7f3ffe805640 1 --2- 172.21.15.55:0/846073497 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ff80cfd30 0x7f3ff8147370 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:55.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.051+0000 7f3ffe805640 1 --2- 172.21.15.55:0/846073497 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f3fd806c8f0 0x7f3fd806edb0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:55.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.051+0000 7f3ffe805640 1 --2- 172.21.15.55:0/846073497 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3ff80cf8d0 0x7f3ff80cb960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:55.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.051+0000 7f3ffe805640 1 -- 172.21.15.55:0/846073497 >> 172.21.15.55:0/846073497 conn(0x7f3ff80d1940 msgr2=0x7f3ff806ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:55.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.051+0000 7f3ffe805640 1 -- 172.21.15.55:0/846073497 shutdown_connections 2024-05-27T12:32:55.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.051+0000 7f3ffe805640 1 -- 172.21.15.55:0/846073497 wait complete. 2024-05-27T12:32:55.061 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-05-27T12:32:55.062 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-27T12:32:55.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.165+0000 7f450b07c640 1 Processor -- start 2024-05-27T12:32:55.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.166+0000 7f450b07c640 1 -- start start 2024-05-27T12:32:55.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.166+0000 7f450b07c640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f450415ec00 0x7f45040b3db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:55.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.166+0000 7f450b07c640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45041632f0 con 0x7f45040b6370 2024-05-27T12:32:55.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.166+0000 7f450b07c640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45041635d0 con 0x7f45040b3860 2024-05-27T12:32:55.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.166+0000 7f450b07c640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f45040cf2e0 con 0x7f450415ec00 2024-05-27T12:32:55.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.166+0000 7f4509619640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f45040b6370 0x7f45040d2980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:36914/0 (socket says 172.21.15.55:36914) 2024-05-27T12:32:55.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.166+0000 7f4509619640 1 -- 172.21.15.55:0/1003351401 learned_addr learned my addr 172.21.15.55:0/1003351401 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-27T12:32:55.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.167+0000 7f4508e18640 1 --2- 172.21.15.55:0/1003351401 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f450415ec00 0x7f45040b3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:55.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.167+0000 7f45037fe640 1 -- 172.21.15.55:0/1003351401 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3448640660 0 0) 0x7f45041632f0 con 0x7f45040b6370 2024-05-27T12:32:55.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.167+0000 7f45037fe640 1 -- 172.21.15.55:0/1003351401 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f44f0003520 con 0x7f45040b6370 2024-05-27T12:32:55.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.167+0000 7f45037fe640 1 -- 172.21.15.55:0/1003351401 <== mon.1 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1240348992 0 0) 0x7f45041635d0 con 0x7f45040b3860 2024-05-27T12:32:55.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.167+0000 7f45037fe640 1 -- 172.21.15.55:0/1003351401 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f45041632f0 con 0x7f45040b3860 2024-05-27T12:32:55.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.167+0000 7f45037fe640 1 -- 172.21.15.55:0/1003351401 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2693632420 0 0) 0x7f44f0003520 con 0x7f45040b6370 2024-05-27T12:32:55.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.167+0000 7f45037fe640 1 -- 172.21.15.55:0/1003351401 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f450415ec00 msgr2=0x7f45040b3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:32:55.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.167+0000 7f45037fe640 1 --2- 172.21.15.55:0/1003351401 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f450415ec00 0x7f45040b3db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:55.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.167+0000 7f45037fe640 1 -- 172.21.15.55:0/1003351401 >> v1:172.21.15.72:6789/0 conn(0x7f45040b3860 legacy=0x7f45040cfd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:55.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.167+0000 7f45037fe640 1 -- 172.21.15.55:0/1003351401 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45040cf530 con 0x7f45040b6370 2024-05-27T12:32:55.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.167+0000 7f45037fe640 1 -- 172.21.15.55:0/1003351401 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 793017739 0 0) 0x7f44ec001670 con 0x7f45040b6370 2024-05-27T12:32:55.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.167+0000 7f45037fe640 1 -- 172.21.15.55:0/1003351401 >> v1:172.21.15.55:6789/0 conn(0x7f45040b6370 legacy=0x7f45040d2980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:55.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.167+0000 7f45037fe640 1 --2- 172.21.15.55:0/1003351401 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44f0003c50 0x7f44f0004050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:55.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.167+0000 7f45037fe640 1 --2- 172.21.15.55:0/1003351401 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f450415ec00 0x7f44f0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:55.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.167+0000 7f45037fe640 1 --2- 172.21.15.55:0/1003351401 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f44f0004d40 0x7f44f00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:55.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.167+0000 7f45037fe640 1 -- 172.21.15.55:0/1003351401 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f45040cf2e0 con 0x7f44f0003c50 2024-05-27T12:32:55.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.167+0000 7f45037fe640 1 -- 172.21.15.55:0/1003351401 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f44f000bb50 con 0x7f44f0004d40 2024-05-27T12:32:55.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.167+0000 7f45037fe640 1 -- 172.21.15.55:0/1003351401 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f44f000bd50 con 0x7f450415ec00 2024-05-27T12:32:55.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.167+0000 7f4508e18640 1 --2- 172.21.15.55:0/1003351401 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44f0003c50 0x7f44f0004050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:55.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.167+0000 7f4503fff640 1 --2- 172.21.15.55:0/1003351401 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f450415ec00 0x7f44f0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:55.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.167+0000 7f4509619640 1 --2- 172.21.15.55:0/1003351401 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f44f0004d40 0x7f44f00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:55.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.167+0000 7f4508e18640 1 -- 172.21.15.55:0/1003351401 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f450415ec00 msgr2=0x7f44f0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:32:55.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.167+0000 7f4508e18640 1 --2- 172.21.15.55:0/1003351401 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f450415ec00 0x7f44f0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:55.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.167+0000 7f4508e18640 1 -- 172.21.15.55:0/1003351401 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f44f0004d40 msgr2=0x7f44f00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:32:55.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.167+0000 7f4508e18640 1 --2- 172.21.15.55:0/1003351401 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f44f0004d40 0x7f44f00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:55.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.167+0000 7f4508e18640 1 -- 172.21.15.55:0/1003351401 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44f0003520 con 0x7f44f0003c50 2024-05-27T12:32:55.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.168+0000 7f4508e18640 1 --2- 172.21.15.55:0/1003351401 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44f0003c50 0x7f44f0004050 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f44fc009ac0 tx=0x7f44f0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f9932d1274b5e21 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:55.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.168+0000 7f45037fe640 1 -- 172.21.15.55:0/1003351401 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44fc036070 con 0x7f44f0003c50 2024-05-27T12:32:55.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.168+0000 7f45037fe640 1 -- 172.21.15.55:0/1003351401 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44fc031400 con 0x7f44f0003c50 2024-05-27T12:32:55.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.168+0000 7f45037fe640 1 -- 172.21.15.55:0/1003351401 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44fc009690 con 0x7f44f0003c50 2024-05-27T12:32:55.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.169+0000 7f450b07c640 1 -- 172.21.15.55:0/1003351401 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44f0003c50 msgr2=0x7f44f0004050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:55.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.169+0000 7f450b07c640 1 --2- 172.21.15.55:0/1003351401 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44f0003c50 0x7f44f0004050 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f44fc009ac0 tx=0x7f44f0005830 comp rx=0 tx=0).stop 2024-05-27T12:32:55.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.169+0000 7f4509619640 1 -- 172.21.15.55:0/1003351401 reap_dead start 2024-05-27T12:32:55.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.169+0000 7f450b07c640 1 -- 172.21.15.55:0/1003351401 shutdown_connections 2024-05-27T12:32:55.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.169+0000 7f450b07c640 1 -- 172.21.15.55:0/1003351401 >> 172.21.15.55:0/1003351401 conn(0x7f45040d1370 msgr2=0x7f45040d1780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:55.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.169+0000 7f450b07c640 1 -- 172.21.15.55:0/1003351401 shutdown_connections 2024-05-27T12:32:55.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.169+0000 7f450b07c640 1 -- 172.21.15.55:0/1003351401 wait complete. 2024-05-27T12:32:55.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.170+0000 7f450b07c640 1 Processor -- start 2024-05-27T12:32:55.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.170+0000 7f450b07c640 1 -- start start 2024-05-27T12:32:55.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.171+0000 7f450b07c640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f44f0003c50 0x7f45040cc540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:55.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.171+0000 7f450b07c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f45040ca2a0 0x7f45040b87a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:55.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.171+0000 7f450b07c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4504158dc0 0x7f4504159240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:55.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.171+0000 7f450b07c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f450415efe0 con 0x7f45040ca2a0 2024-05-27T12:32:55.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.171+0000 7f450b07c640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f45040b3530 con 0x7f4504158dc0 2024-05-27T12:32:55.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.171+0000 7f450b07c640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f450415f160 con 0x7f44f0003c50 2024-05-27T12:32:55.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.171+0000 7f4503fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f45040ca2a0 0x7f45040b87a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:55.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.171+0000 7f4503fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f45040ca2a0 0x7f45040b87a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57590/0 (socket says 172.21.15.55:57590) 2024-05-27T12:32:55.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.171+0000 7f4503fff640 1 -- 172.21.15.55:0/201457706 learned_addr learned my addr 172.21.15.55:0/201457706 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:32:55.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.171+0000 7f4508e18640 1 --2- 172.21.15.55:0/201457706 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f44f0003c50 0x7f45040cc540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:55.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.171+0000 7f4509619640 1 --2- 172.21.15.55:0/201457706 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4504158dc0 0x7f4504159240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:55.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.171+0000 7f4503fff640 1 -- 172.21.15.55:0/201457706 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f44f0003c50 msgr2=0x7f45040cc540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:55.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.171+0000 7f4503fff640 1 --2- 172.21.15.55:0/201457706 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f44f0003c50 0x7f45040cc540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:55.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.171+0000 7f4503fff640 1 -- 172.21.15.55:0/201457706 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4504158dc0 msgr2=0x7f4504159240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:55.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.171+0000 7f4503fff640 1 --2- 172.21.15.55:0/201457706 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4504158dc0 0x7f4504159240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:55.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.171+0000 7f4503fff640 1 -- 172.21.15.55:0/201457706 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45040cca80 con 0x7f45040ca2a0 2024-05-27T12:32:55.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.172+0000 7f4503fff640 1 --2- 172.21.15.55:0/201457706 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f45040ca2a0 0x7f45040b87a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f44f400fb50 tx=0x7f44f400d520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:55.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.172+0000 7f45017fa640 1 -- 172.21.15.55:0/201457706 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44f400dc30 con 0x7f45040ca2a0 2024-05-27T12:32:55.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.172+0000 7f45017fa640 1 -- 172.21.15.55:0/201457706 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44f4018070 con 0x7f45040ca2a0 2024-05-27T12:32:55.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.172+0000 7f450b07c640 1 -- 172.21.15.55:0/201457706 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45040b99e0 con 0x7f45040ca2a0 2024-05-27T12:32:55.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.172+0000 7f45017fa640 1 -- 172.21.15.55:0/201457706 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44f4003970 con 0x7f45040ca2a0 2024-05-27T12:32:55.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.172+0000 7f450b07c640 1 -- 172.21.15.55:0/201457706 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45040cbd40 con 0x7f45040ca2a0 2024-05-27T12:32:55.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.173+0000 7f450b07c640 1 -- 172.21.15.55:0/201457706 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f450406db20 con 0x7f45040ca2a0 2024-05-27T12:32:55.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.173+0000 7f45017fa640 1 -- 172.21.15.55:0/201457706 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f44f4003b30 con 0x7f45040ca2a0 2024-05-27T12:32:55.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.174+0000 7f45017fa640 1 --2- 172.21.15.55:0/201457706 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f44e406c920 0x7f44e406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:55.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.174+0000 7f45017fa640 1 -- 172.21.15.55:0/201457706 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f44f408bd40 con 0x7f45040ca2a0 2024-05-27T12:32:55.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.174+0000 7f4508e18640 1 --2- 172.21.15.55:0/201457706 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f44e406c920 0x7f44e406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:55.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.174+0000 7f4508e18640 1 --2- 172.21.15.55:0/201457706 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f44e406c920 0x7f44e406ede0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f44fc033000 tx=0x7f44fc008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:55.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.178+0000 7f45017fa640 1 -- 172.21.15.55:0/201457706 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f450406db20 con 0x7f45040ca2a0 2024-05-27T12:32:55.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.364+0000 7f450b07c640 1 -- 172.21.15.55:0/201457706 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4504075460 con 0x7f45040ca2a0 2024-05-27T12:32:55.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.365+0000 7f45017fa640 1 -- 172.21.15.55:0/201457706 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16557 (secure 0 0 0) 0x7f44f4003e20 con 0x7f45040ca2a0 2024-05-27T12:32:55.365 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-27T12:32:55.365 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":23,"fsid":"c3ff4e3b-8dae-4856-9593-e5cc66c59982","created":"2024-05-27T12:32:17.019097+0000","modified":"2024-05-27T12:32:43.361598+0000","last_up_change":"2024-05-27T12:32:28.109744+0000","last_in_change":"2024-05-27T12:32:19.309872+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-27T12:32:29.277895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-27T12:32:39.442745+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-27T12:32:40.672118+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e607b598-061b-4b6f-92ff-95c20b330599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":807572567},{"type":"v1","addr":"172.21.15.55:6801","nonce":807572567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":807572567},{"type":"v1","addr":"172.21.15.55:6803","nonce":807572567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":807572567},{"type":"v1","addr":"172.21.15.55:6807","nonce":807572567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":807572567},{"type":"v1","addr":"172.21.15.55:6805","nonce":807572567}]},"public_addr":"172.21.15.55:6801/807572567","cluster_addr":"172.21.15.55:6803/807572567","heartbeat_back_addr":"172.21.15.55:6807/807572567","heartbeat_front_addr":"172.21.15.55:6805/807572567","state":["exists","up"]},{"osd":1,"uuid":"ba2b5b1d-71a9-4ecc-9a48-55aa7fe54261","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":3426897300},{"type":"v1","addr":"172.21.15.55:6825","nonce":3426897300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":3426897300},{"type":"v1","addr":"172.21.15.55:6827","nonce":3426897300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":3426897300},{"type":"v1","addr":"172.21.15.55:6831","nonce":3426897300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":3426897300},{"type":"v1","addr":"172.21.15.55:6829","nonce":3426897300}]},"public_addr":"172.21.15.55:6825/3426897300","cluster_addr":"172.21.15.55:6827/3426897300","heartbeat_back_addr":"172.21.15.55:6831/3426897300","heartbeat_front_addr":"172.21.15.55:6829/3426897300","state":["exists","up"]},{"osd":2,"uuid":"e6b81cc6-4ff1-45d0-87eb-9f04ccf986a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3510271725},{"type":"v1","addr":"172.21.15.55:6809","nonce":3510271725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3510271725},{"type":"v1","addr":"172.21.15.55:6811","nonce":3510271725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3510271725},{"type":"v1","addr":"172.21.15.55:6815","nonce":3510271725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3510271725},{"type":"v1","addr":"172.21.15.55:6813","nonce":3510271725}]},"public_addr":"172.21.15.55:6809/3510271725","cluster_addr":"172.21.15.55:6811/3510271725","heartbeat_back_addr":"172.21.15.55:6815/3510271725","heartbeat_front_addr":"172.21.15.55:6813/3510271725","state":["exists","up"]},{"osd":3,"uuid":"b6a34b75-807d-4693-b1c3-903cb4c618d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":1066693520},{"type":"v1","addr":"172.21.15.55:6817","nonce":1066693520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":1066693520},{"type":"v1","addr":"172.21.15.55:6819","nonce":1066693520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":1066693520},{"type":"v1","addr":"172.21.15.55:6823","nonce":1066693520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":1066693520},{"type":"v1","addr":"172.21.15.55:6821","nonce":1066693520}]},"public_addr":"172.21.15.55:6817/1066693520","cluster_addr":"172.21.15.55:6819/1066693520","heartbeat_back_addr":"172.21.15.55:6823/1066693520","heartbeat_front_addr":"172.21.15.55:6821/1066693520","state":["exists","up"]},{"osd":4,"uuid":"272ec937-56b4-4f0a-b2e1-b0bc189c9d79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":4190771237},{"type":"v1","addr":"172.21.15.72:6820","nonce":4190771237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":4190771237},{"type":"v1","addr":"172.21.15.72:6824","nonce":4190771237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":4190771237},{"type":"v1","addr":"172.21.15.72:6831","nonce":4190771237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":4190771237},{"type":"v1","addr":"172.21.15.72:6828","nonce":4190771237}]},"public_addr":"172.21.15.72:6820/4190771237","cluster_addr":"172.21.15.72:6824/4190771237","heartbeat_back_addr":"172.21.15.72:6831/4190771237","heartbeat_front_addr":"172.21.15.72:6828/4190771237","state":["exists","up"]},{"osd":5,"uuid":"56439854-72a0-4ef4-81ff-184a3d924a5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":2421889184},{"type":"v1","addr":"172.21.15.72:6801","nonce":2421889184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6803","nonce":2421889184},{"type":"v1","addr":"172.21.15.72:6805","nonce":2421889184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":2421889184},{"type":"v1","addr":"172.21.15.72:6813","nonce":2421889184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6807","nonce":2421889184},{"type":"v1","addr":"172.21.15.72:6809","nonce":2421889184}]},"public_addr":"172.21.15.72:6801/2421889184","cluster_addr":"172.21.15.72:6805/2421889184","heartbeat_back_addr":"172.21.15.72:6813/2421889184","heartbeat_front_addr":"172.21.15.72:6809/2421889184","state":["exists","up"]},{"osd":6,"uuid":"e248e2be-3b6e-49cf-8c8a-1a4152827582","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3796994599},{"type":"v1","addr":"172.21.15.72:6804","nonce":3796994599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":3796994599},{"type":"v1","addr":"172.21.15.72:6808","nonce":3796994599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":3796994599},{"type":"v1","addr":"172.21.15.72:6815","nonce":3796994599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":3796994599},{"type":"v1","addr":"172.21.15.72:6812","nonce":3796994599}]},"public_addr":"172.21.15.72:6804/3796994599","cluster_addr":"172.21.15.72:6808/3796994599","heartbeat_back_addr":"172.21.15.72:6815/3796994599","heartbeat_front_addr":"172.21.15.72:6812/3796994599","state":["exists","up"]},{"osd":7,"uuid":"505a62d3-322b-4629-b4fd-187a55563709","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":3024877895},{"type":"v1","addr":"172.21.15.72:6817","nonce":3024877895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":3024877895},{"type":"v1","addr":"172.21.15.72:6821","nonce":3024877895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6827","nonce":3024877895},{"type":"v1","addr":"172.21.15.72:6829","nonce":3024877895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6823","nonce":3024877895},{"type":"v1","addr":"172.21.15.72:6825","nonce":3024877895}]},"public_addr":"172.21.15.72:6817/3024877895","cluster_addr":"172.21.15.72:6821/3024877895","heartbeat_back_addr":"172.21.15.72:6829/3024877895","heartbeat_front_addr":"172.21.15.72:6825/3024877895","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.241014+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.450799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.465018+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.507647+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.534763+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.495895+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.427110+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.547466+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-27T12:32:55.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.367+0000 7f450b07c640 1 -- 172.21.15.55:0/201457706 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f44e406c920 msgr2=0x7f44e406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:55.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.367+0000 7f450b07c640 1 --2- 172.21.15.55:0/201457706 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f44e406c920 0x7f44e406ede0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f44fc033000 tx=0x7f44fc008030 comp rx=0 tx=0).stop 2024-05-27T12:32:55.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.367+0000 7f450b07c640 1 -- 172.21.15.55:0/201457706 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f45040ca2a0 msgr2=0x7f45040b87a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:55.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.367+0000 7f450b07c640 1 --2- 172.21.15.55:0/201457706 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f45040ca2a0 0x7f45040b87a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f44f400fb50 tx=0x7f44f400d520 comp rx=0 tx=0).stop 2024-05-27T12:32:55.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.368+0000 7f450b07c640 1 -- 172.21.15.55:0/201457706 shutdown_connections 2024-05-27T12:32:55.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.368+0000 7f450b07c640 1 --2- 172.21.15.55:0/201457706 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f44e406c920 0x7f44e406ede0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:55.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.368+0000 7f450b07c640 1 --2- 172.21.15.55:0/201457706 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4504158dc0 0x7f4504159240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:55.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.368+0000 7f450b07c640 1 --2- 172.21.15.55:0/201457706 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f45040ca2a0 0x7f45040b87a0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:55.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.368+0000 7f450b07c640 1 --2- 172.21.15.55:0/201457706 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f44f0003c50 0x7f45040cc540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:55.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.368+0000 7f450b07c640 1 -- 172.21.15.55:0/201457706 >> 172.21.15.55:0/201457706 conn(0x7f45040d1370 msgr2=0x7f45041627b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:55.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.368+0000 7f450b07c640 1 -- 172.21.15.55:0/201457706 shutdown_connections 2024-05-27T12:32:55.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.368+0000 7f450b07c640 1 -- 172.21.15.55:0/201457706 wait complete. 2024-05-27T12:32:55.378 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-27T12:32:29.277895+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-27T12:32:39.442745+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-27T12:32:40.672118+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-27T12:32:55.378 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-27T12:32:55.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.486+0000 7fb4614d0640 1 Processor -- start 2024-05-27T12:32:55.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.486+0000 7fb4614d0640 1 -- start start 2024-05-27T12:32:55.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.487+0000 7fb4614d0640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb45c0cfb40 0x7fb45c0d1830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:55.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.487+0000 7fb4614d0640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb45c0d2180 con 0x7fb45c15eb00 2024-05-27T12:32:55.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.487+0000 7fb4614d0640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb45c15eee0 con 0x7fb45c0d1d70 2024-05-27T12:32:55.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.487+0000 7fb4614d0640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fb45c0d5700 con 0x7fb45c0cfb40 2024-05-27T12:32:55.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.487+0000 7fb45affd640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fb45c15eb00 0x7fb45c0d3e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:36920/0 (socket says 172.21.15.55:36920) 2024-05-27T12:32:55.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.487+0000 7fb45affd640 1 -- 172.21.15.55:0/2588496593 learned_addr learned my addr 172.21.15.55:0/2588496593 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-27T12:32:55.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.487+0000 7fb45a7fc640 1 --2- 172.21.15.55:0/2588496593 >> v2:172.21.15.72:3300/0 conn(0x7fb45c0cfb40 0x7fb45c0d1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:55.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.487+0000 7fb459ffb640 1 -- 172.21.15.55:0/2588496593 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1778176019 0 0) 0x7fb44c001490 con 0x7fb45c15eb00 2024-05-27T12:32:55.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.488+0000 7fb459ffb640 1 -- 172.21.15.55:0/2588496593 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb448003520 con 0x7fb45c15eb00 2024-05-27T12:32:55.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.488+0000 7fb459ffb640 1 -- 172.21.15.55:0/2588496593 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2328227222 0 0) 0x7fb448003520 con 0x7fb45c15eb00 2024-05-27T12:32:55.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.488+0000 7fb45a7fc640 1 -- 172.21.15.55:0/2588496593 >> v1:172.21.15.72:6789/0 conn(0x7fb45c0d1d70 legacy=0x7fb45c0b78f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:55.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.488+0000 7fb45a7fc640 1 -- 172.21.15.55:0/2588496593 >> v1:172.21.15.55:6789/0 conn(0x7fb45c15eb00 legacy=0x7fb45c0d3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:55.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.488+0000 7fb45a7fc640 1 -- 172.21.15.55:0/2588496593 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb45c0d4660 con 0x7fb45c0cfb40 2024-05-27T12:32:55.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.489+0000 7fb45a7fc640 1 --2- 172.21.15.55:0/2588496593 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb45c0cfb40 0x7fb45c0d1830 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb4440097a0 tx=0x7fb44402a250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9f04f53400eaebb0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:55.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.489+0000 7fb459ffb640 1 -- 172.21.15.55:0/2588496593 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb444037070 con 0x7fb45c0cfb40 2024-05-27T12:32:55.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.489+0000 7fb459ffb640 1 -- 172.21.15.55:0/2588496593 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb44402ace0 con 0x7fb45c0cfb40 2024-05-27T12:32:55.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.489+0000 7fb459ffb640 1 -- 172.21.15.55:0/2588496593 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb44c001bc0 con 0x7fb45c0cfb40 2024-05-27T12:32:55.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.489+0000 7fb4614d0640 1 -- 172.21.15.55:0/2588496593 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb45c0cfb40 msgr2=0x7fb45c0d1830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:55.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.489+0000 7fb4614d0640 1 --2- 172.21.15.55:0/2588496593 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb45c0cfb40 0x7fb45c0d1830 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb4440097a0 tx=0x7fb44402a250 comp rx=0 tx=0).stop 2024-05-27T12:32:55.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.489+0000 7fb4614d0640 1 -- 172.21.15.55:0/2588496593 shutdown_connections 2024-05-27T12:32:55.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.489+0000 7fb4614d0640 1 --2- 172.21.15.55:0/2588496593 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb45c0cfb40 0x7fb45c0d1830 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:55.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.489+0000 7fb4614d0640 1 -- 172.21.15.55:0/2588496593 >> 172.21.15.55:0/2588496593 conn(0x7fb45c067a50 msgr2=0x7fb45c067e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:55.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.489+0000 7fb4614d0640 1 -- 172.21.15.55:0/2588496593 shutdown_connections 2024-05-27T12:32:55.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.489+0000 7fb4614d0640 1 -- 172.21.15.55:0/2588496593 wait complete. 2024-05-27T12:32:55.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.491+0000 7fb4614d0640 1 Processor -- start 2024-05-27T12:32:55.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.491+0000 7fb4614d0640 1 -- start start 2024-05-27T12:32:55.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.491+0000 7fb4614d0640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb45c0cfb40 0x7fb45c1f4000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:55.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.491+0000 7fb4614d0640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb45c0d1d70 0x7fb45c1f7da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:55.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.491+0000 7fb4614d0640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb45c15eb00 0x7fb45c0b79e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:55.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.491+0000 7fb4614d0640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7fb45c0d4f00 con 0x7fb45c0d1d70 2024-05-27T12:32:55.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.491+0000 7fb4614d0640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fb45c0d4c20 con 0x7fb45c15eb00 2024-05-27T12:32:55.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.491+0000 7fb4614d0640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fb45c0d51e0 con 0x7fb45c0cfb40 2024-05-27T12:32:55.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.491+0000 7fb45a7fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb45c0d1d70 0x7fb45c1f7da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:55.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.492+0000 7fb45a7fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb45c0d1d70 0x7fb45c1f7da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57600/0 (socket says 172.21.15.55:57600) 2024-05-27T12:32:55.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.492+0000 7fb45a7fc640 1 -- 172.21.15.55:0/1858160769 learned_addr learned my addr 172.21.15.55:0/1858160769 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:32:55.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.492+0000 7fb45b7fe640 1 --2- 172.21.15.55:0/1858160769 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb45c15eb00 0x7fb45c0b79e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:55.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.492+0000 7fb45affd640 1 --2- 172.21.15.55:0/1858160769 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb45c0cfb40 0x7fb45c1f4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:55.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.492+0000 7fb45a7fc640 1 -- 172.21.15.55:0/1858160769 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb45c0cfb40 msgr2=0x7fb45c1f4000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:55.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.492+0000 7fb45a7fc640 1 --2- 172.21.15.55:0/1858160769 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb45c0cfb40 0x7fb45c1f4000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:55.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.492+0000 7fb45a7fc640 1 -- 172.21.15.55:0/1858160769 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb45c15eb00 msgr2=0x7fb45c0b79e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:55.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.492+0000 7fb45a7fc640 1 --2- 172.21.15.55:0/1858160769 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb45c15eb00 0x7fb45c0b79e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:55.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.492+0000 7fb45a7fc640 1 -- 172.21.15.55:0/1858160769 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb45c1f8680 con 0x7fb45c0d1d70 2024-05-27T12:32:55.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.492+0000 7fb45affd640 1 --2- 172.21.15.55:0/1858160769 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb45c0cfb40 0x7fb45c1f4000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T12:32:55.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.492+0000 7fb45a7fc640 1 --2- 172.21.15.55:0/1858160769 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb45c0d1d70 0x7fb45c1f7da0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb444000c00 tx=0x7fb4440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:55.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.492+0000 7fb4537fe640 1 -- 172.21.15.55:0/1858160769 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb444041070 con 0x7fb45c0d1d70 2024-05-27T12:32:55.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.492+0000 7fb4537fe640 1 -- 172.21.15.55:0/1858160769 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb44403c660 con 0x7fb45c0d1d70 2024-05-27T12:32:55.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.492+0000 7fb4614d0640 1 -- 172.21.15.55:0/1858160769 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb45c1f8960 con 0x7fb45c0d1d70 2024-05-27T12:32:55.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.492+0000 7fb4537fe640 1 -- 172.21.15.55:0/1858160769 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb444037040 con 0x7fb45c0d1d70 2024-05-27T12:32:55.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.492+0000 7fb4614d0640 1 -- 172.21.15.55:0/1858160769 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb45c15f170 con 0x7fb45c0d1d70 2024-05-27T12:32:55.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.493+0000 7fb4614d0640 1 -- 172.21.15.55:0/1858160769 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb45c068a70 con 0x7fb45c0d1d70 2024-05-27T12:32:55.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.494+0000 7fb4537fe640 1 -- 172.21.15.55:0/1858160769 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb444044070 con 0x7fb45c0d1d70 2024-05-27T12:32:55.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.494+0000 7fb4537fe640 1 --2- 172.21.15.55:0/1858160769 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fb43c06c8f0 0x7fb43c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:55.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.494+0000 7fb4537fe640 1 -- 172.21.15.55:0/1858160769 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fb4440ac460 con 0x7fb45c0d1d70 2024-05-27T12:32:55.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.494+0000 7fb45affd640 1 --2- 172.21.15.55:0/1858160769 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fb43c06c8f0 0x7fb43c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:55.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.495+0000 7fb45affd640 1 --2- 172.21.15.55:0/1858160769 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fb43c06c8f0 0x7fb43c06edb0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb44c005c00 tx=0x7fb44c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:55.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.498+0000 7fb4537fe640 1 -- 172.21.15.55:0/1858160769 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb44407a360 con 0x7fb45c0d1d70 2024-05-27T12:32:55.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.682+0000 7fb4614d0640 1 -- 172.21.15.55:0/1858160769 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fb45c06bcc0 con 0x7fb45c0d1d70 2024-05-27T12:32:55.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.683+0000 7fb4537fe640 1 -- 172.21.15.55:0/1858160769 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) ==== 93+0+10 (secure 0 0 0) 0x7fb44407e660 con 0x7fb45c0d1d70 2024-05-27T12:32:55.682 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-05-27T12:32:55.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.685+0000 7fb4614d0640 1 -- 172.21.15.55:0/1858160769 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fb43c06c8f0 msgr2=0x7fb43c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:55.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.685+0000 7fb4614d0640 1 --2- 172.21.15.55:0/1858160769 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fb43c06c8f0 0x7fb43c06edb0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb44c005c00 tx=0x7fb44c009040 comp rx=0 tx=0).stop 2024-05-27T12:32:55.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.685+0000 7fb4614d0640 1 -- 172.21.15.55:0/1858160769 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb45c0d1d70 msgr2=0x7fb45c1f7da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:55.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.685+0000 7fb4614d0640 1 --2- 172.21.15.55:0/1858160769 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb45c0d1d70 0x7fb45c1f7da0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb444000c00 tx=0x7fb4440046c0 comp rx=0 tx=0).stop 2024-05-27T12:32:55.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.685+0000 7fb4614d0640 1 -- 172.21.15.55:0/1858160769 shutdown_connections 2024-05-27T12:32:55.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.685+0000 7fb4614d0640 1 --2- 172.21.15.55:0/1858160769 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fb43c06c8f0 0x7fb43c06edb0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:55.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.685+0000 7fb4614d0640 1 --2- 172.21.15.55:0/1858160769 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb45c15eb00 0x7fb45c0b79e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:55.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.685+0000 7fb4614d0640 1 --2- 172.21.15.55:0/1858160769 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb45c0d1d70 0x7fb45c1f7da0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:55.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.685+0000 7fb4614d0640 1 --2- 172.21.15.55:0/1858160769 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb45c0cfb40 0x7fb45c1f4000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:55.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.685+0000 7fb4614d0640 1 -- 172.21.15.55:0/1858160769 >> 172.21.15.55:0/1858160769 conn(0x7fb45c067a50 msgr2=0x7fb45c074bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:55.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.685+0000 7fb4614d0640 1 -- 172.21.15.55:0/1858160769 shutdown_connections 2024-05-27T12:32:55.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.685+0000 7fb4614d0640 1 -- 172.21.15.55:0/1858160769 wait complete. 2024-05-27T12:32:55.695 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-27T12:32:55.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.803+0000 7f48a7576640 1 Processor -- start 2024-05-27T12:32:55.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.803+0000 7f48a7576640 1 -- start start 2024-05-27T12:32:55.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.804+0000 7f48a7576640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f48a015eb00 0x7f48a00cfb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:55.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.804+0000 7f48a7576640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48a015eee0 con 0x7f48a00d1f40 2024-05-27T12:32:55.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.804+0000 7f48a7576640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48a00d4660 con 0x7f48a00d3e50 2024-05-27T12:32:55.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.804+0000 7f48a7576640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f48a00d5700 con 0x7f48a015eb00 2024-05-27T12:32:55.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.804+0000 7f48a5b13640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f48a00d1f40 0x7f48a00b78f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:36928/0 (socket says 172.21.15.55:36928) 2024-05-27T12:32:55.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.804+0000 7f48a5b13640 1 -- 172.21.15.55:0/1507385386 learned_addr learned my addr 172.21.15.55:0/1507385386 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-27T12:32:55.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.804+0000 7f48a5312640 1 --2- 172.21.15.55:0/1507385386 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f48a015eb00 0x7f48a00cfb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:55.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.804+0000 7f489ffff640 1 -- 172.21.15.55:0/1507385386 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3135041874 0 0) 0x7f48a015eee0 con 0x7f48a00d1f40 2024-05-27T12:32:55.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.804+0000 7f489ffff640 1 -- 172.21.15.55:0/1507385386 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4888003520 con 0x7f48a00d1f40 2024-05-27T12:32:55.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.805+0000 7f489ffff640 1 -- 172.21.15.55:0/1507385386 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 6463842 0 0) 0x7f4888003520 con 0x7f48a00d1f40 2024-05-27T12:32:55.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.805+0000 7f489ffff640 1 -- 172.21.15.55:0/1507385386 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f48a015eb00 msgr2=0x7f48a00cfb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:32:55.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.805+0000 7f489ffff640 1 --2- 172.21.15.55:0/1507385386 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f48a015eb00 0x7f48a00cfb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:55.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.805+0000 7f489ffff640 1 -- 172.21.15.55:0/1507385386 >> v1:172.21.15.72:6789/0 conn(0x7f48a00d3e50 legacy=0x7f48a00d1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:55.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.805+0000 7f489ffff640 1 -- 172.21.15.55:0/1507385386 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48a00d4940 con 0x7f48a00d1f40 2024-05-27T12:32:55.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.805+0000 7f489ffff640 1 -- 172.21.15.55:0/1507385386 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 793017739 0 0) 0x7f4898001670 con 0x7f48a00d1f40 2024-05-27T12:32:55.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.805+0000 7f489ffff640 1 -- 172.21.15.55:0/1507385386 >> v1:172.21.15.55:6789/0 conn(0x7f48a00d1f40 legacy=0x7f48a00b78f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:55.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.805+0000 7f489ffff640 1 --2- 172.21.15.55:0/1507385386 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f48a015eb00 0x7f48880039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:55.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.805+0000 7f489ffff640 1 --2- 172.21.15.55:0/1507385386 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4888003f60 0x7f4888004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:55.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.805+0000 7f489ffff640 1 --2- 172.21.15.55:0/1507385386 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4888004d40 0x7f48880051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:55.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.805+0000 7f489ffff640 1 -- 172.21.15.55:0/1507385386 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f48a00d5700 con 0x7f4888004d40 2024-05-27T12:32:55.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.805+0000 7f489ffff640 1 -- 172.21.15.55:0/1507385386 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f488800bb30 con 0x7f4888003f60 2024-05-27T12:32:55.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.805+0000 7f489ffff640 1 -- 172.21.15.55:0/1507385386 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f488800bd30 con 0x7f48a015eb00 2024-05-27T12:32:55.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.805+0000 7f48a5b13640 1 --2- 172.21.15.55:0/1507385386 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4888004d40 0x7f48880051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:55.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.805+0000 7f48a5312640 1 --2- 172.21.15.55:0/1507385386 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f48a015eb00 0x7f48880039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:55.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.805+0000 7f48a4b11640 1 --2- 172.21.15.55:0/1507385386 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4888003f60 0x7f4888004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:55.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.805+0000 7f48a5b13640 1 -- 172.21.15.55:0/1507385386 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f48a015eb00 msgr2=0x7f48880039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:32:55.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.805+0000 7f48a5b13640 1 --2- 172.21.15.55:0/1507385386 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f48a015eb00 0x7f48880039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:55.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.805+0000 7f48a5b13640 1 -- 172.21.15.55:0/1507385386 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4888003f60 msgr2=0x7f4888004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:32:55.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.805+0000 7f48a5b13640 1 --2- 172.21.15.55:0/1507385386 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4888003f60 0x7f4888004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:55.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.805+0000 7f48a5b13640 1 -- 172.21.15.55:0/1507385386 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4888003520 con 0x7f4888004d40 2024-05-27T12:32:55.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.806+0000 7f48a5b13640 1 --2- 172.21.15.55:0/1507385386 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4888004d40 0x7f48880051c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f48a00b7780 tx=0x7f4888005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ec5ac124c32ff21 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:55.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.806+0000 7f489ffff640 1 -- 172.21.15.55:0/1507385386 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4898007d30 con 0x7f4888004d40 2024-05-27T12:32:55.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.806+0000 7f489ffff640 1 -- 172.21.15.55:0/1507385386 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4898005af0 con 0x7f4888004d40 2024-05-27T12:32:55.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.806+0000 7f489ffff640 1 -- 172.21.15.55:0/1507385386 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4898007070 con 0x7f4888004d40 2024-05-27T12:32:55.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.806+0000 7f48a7576640 1 -- 172.21.15.55:0/1507385386 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4888004d40 msgr2=0x7f48880051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:55.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.806+0000 7f48a7576640 1 --2- 172.21.15.55:0/1507385386 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4888004d40 0x7f48880051c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f48a00b7780 tx=0x7f4888005830 comp rx=0 tx=0).stop 2024-05-27T12:32:55.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.806+0000 7f48a5b13640 1 -- 172.21.15.55:0/1507385386 reap_dead start 2024-05-27T12:32:55.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.807+0000 7f48a7576640 1 -- 172.21.15.55:0/1507385386 shutdown_connections 2024-05-27T12:32:55.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.807+0000 7f48a7576640 1 -- 172.21.15.55:0/1507385386 >> 172.21.15.55:0/1507385386 conn(0x7f48a0067a50 msgr2=0x7f48a0067e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:55.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.807+0000 7f48a7576640 1 -- 172.21.15.55:0/1507385386 shutdown_connections 2024-05-27T12:32:55.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.807+0000 7f48a7576640 1 -- 172.21.15.55:0/1507385386 wait complete. 2024-05-27T12:32:55.812 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.808+0000 7f48a7576640 1 Processor -- start 2024-05-27T12:32:55.812 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.808+0000 7f48a7576640 1 -- start start 2024-05-27T12:32:55.812 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.809+0000 7f48a7576640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4888004d40 0x7f48a0160060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:55.812 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.809+0000 7f48a7576640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f48a01f5050 0x7f48a015d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:55.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.809+0000 7f48a7576640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f48a00acb10 0x7f48a00ccf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:55.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.809+0000 7f48a7576640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f48a00d51e0 con 0x7f48a00acb10 2024-05-27T12:32:55.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.809+0000 7f48a7576640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f48a00d4f00 con 0x7f48a01f5050 2024-05-27T12:32:55.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.809+0000 7f48a7576640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f48a00d4290 con 0x7f4888004d40 2024-05-27T12:32:55.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.809+0000 7f48a5b13640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f48a00acb10 0x7f48a00ccf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:55.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.809+0000 7f48a5b13640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f48a00acb10 0x7f48a00ccf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57618/0 (socket says 172.21.15.55:57618) 2024-05-27T12:32:55.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.809+0000 7f48a5b13640 1 -- 172.21.15.55:0/1036349664 learned_addr learned my addr 172.21.15.55:0/1036349664 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:32:55.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.809+0000 7f48a5312640 1 --2- 172.21.15.55:0/1036349664 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4888004d40 0x7f48a0160060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:55.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.809+0000 7f48a4b11640 1 --2- 172.21.15.55:0/1036349664 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f48a01f5050 0x7f48a015d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:55.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.809+0000 7f48a5b13640 1 -- 172.21.15.55:0/1036349664 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4888004d40 msgr2=0x7f48a0160060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:55.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.809+0000 7f48a5b13640 1 --2- 172.21.15.55:0/1036349664 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4888004d40 0x7f48a0160060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:55.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.809+0000 7f48a5b13640 1 -- 172.21.15.55:0/1036349664 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f48a01f5050 msgr2=0x7f48a015d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:55.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.809+0000 7f48a5b13640 1 --2- 172.21.15.55:0/1036349664 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f48a01f5050 0x7f48a015d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:55.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.809+0000 7f48a5b13640 1 -- 172.21.15.55:0/1036349664 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48a01f54d0 con 0x7f48a00acb10 2024-05-27T12:32:55.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.809+0000 7f48a5b13640 1 --2- 172.21.15.55:0/1036349664 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f48a00acb10 0x7f48a00ccf70 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4898001970 tx=0x7f4898000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:55.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.809+0000 7f489dffb640 1 -- 172.21.15.55:0/1036349664 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4898001c80 con 0x7f48a00acb10 2024-05-27T12:32:55.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.809+0000 7f489dffb640 1 -- 172.21.15.55:0/1036349664 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4898042070 con 0x7f48a00acb10 2024-05-27T12:32:55.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.809+0000 7f48a7576640 1 -- 172.21.15.55:0/1036349664 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48a0161000 con 0x7f48a00acb10 2024-05-27T12:32:55.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.809+0000 7f489dffb640 1 -- 172.21.15.55:0/1036349664 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4898007270 con 0x7f48a00acb10 2024-05-27T12:32:55.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.810+0000 7f48a7576640 1 -- 172.21.15.55:0/1036349664 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48a0160a40 con 0x7f48a00acb10 2024-05-27T12:32:55.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.810+0000 7f48a7576640 1 -- 172.21.15.55:0/1036349664 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48a0068a70 con 0x7f48a00acb10 2024-05-27T12:32:55.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.811+0000 7f489dffb640 1 -- 172.21.15.55:0/1036349664 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4898007410 con 0x7f48a00acb10 2024-05-27T12:32:55.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.811+0000 7f489dffb640 1 --2- 172.21.15.55:0/1036349664 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f488c06c8f0 0x7f488c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:55.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.812+0000 7f489dffb640 1 -- 172.21.15.55:0/1036349664 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f48980abfb0 con 0x7f48a00acb10 2024-05-27T12:32:55.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.812+0000 7f48a5312640 1 --2- 172.21.15.55:0/1036349664 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f488c06c8f0 0x7f488c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:55.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.812+0000 7f48a5312640 1 --2- 172.21.15.55:0/1036349664 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f488c06c8f0 0x7f488c06edb0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f48a01618d0 tx=0x7f489000b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:55.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:55.816+0000 7f489dffb640 1 -- 172.21.15.55:0/1036349664 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4898079cf0 con 0x7f48a00acb10 2024-05-27T12:32:56.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.003+0000 7f48a7576640 1 -- 172.21.15.55:0/1036349664 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f48a015e300 con 0x7f48a00acb10 2024-05-27T12:32:56.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.004+0000 7f489dffb640 1 -- 172.21.15.55:0/1036349664 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) ==== 104+0+11 (secure 0 0 0) 0x7f489807dff0 con 0x7f48a00acb10 2024-05-27T12:32:56.003 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2024-05-27T12:32:56.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.006+0000 7f48a7576640 1 -- 172.21.15.55:0/1036349664 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f488c06c8f0 msgr2=0x7f488c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:56.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.006+0000 7f48a7576640 1 --2- 172.21.15.55:0/1036349664 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f488c06c8f0 0x7f488c06edb0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f48a01618d0 tx=0x7f489000b040 comp rx=0 tx=0).stop 2024-05-27T12:32:56.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.006+0000 7f48a7576640 1 -- 172.21.15.55:0/1036349664 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f48a00acb10 msgr2=0x7f48a00ccf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:56.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.006+0000 7f48a7576640 1 --2- 172.21.15.55:0/1036349664 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f48a00acb10 0x7f48a00ccf70 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4898001970 tx=0x7f4898000fe0 comp rx=0 tx=0).stop 2024-05-27T12:32:56.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.006+0000 7f48a7576640 1 -- 172.21.15.55:0/1036349664 shutdown_connections 2024-05-27T12:32:56.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.006+0000 7f48a7576640 1 --2- 172.21.15.55:0/1036349664 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f48a00acb10 0x7f48a00ccf70 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:56.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.006+0000 7f48a7576640 1 --2- 172.21.15.55:0/1036349664 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f488c06c8f0 0x7f488c06edb0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:56.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.006+0000 7f48a7576640 1 --2- 172.21.15.55:0/1036349664 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f48a01f5050 0x7f48a015d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:56.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.006+0000 7f48a7576640 1 --2- 172.21.15.55:0/1036349664 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4888004d40 0x7f48a0160060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:56.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.006+0000 7f48a7576640 1 -- 172.21.15.55:0/1036349664 >> 172.21.15.55:0/1036349664 conn(0x7f48a0067a50 msgr2=0x7f48a00b5af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:56.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.006+0000 7f48a7576640 1 -- 172.21.15.55:0/1036349664 shutdown_connections 2024-05-27T12:32:56.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.006+0000 7f48a7576640 1 -- 172.21.15.55:0/1036349664 wait complete. 2024-05-27T12:32:56.015 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-27T12:32:56.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.123+0000 7f2c0f8cf640 1 Processor -- start 2024-05-27T12:32:56.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.123+0000 7f2c0f8cf640 1 -- start start 2024-05-27T12:32:56.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.124+0000 7f2c0f8cf640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2c0815eb00 0x7f2c080cfb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:56.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.124+0000 7f2c0f8cf640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2c080d3e50 0x7f2c080d1830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:56.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.124+0000 7f2c0f8cf640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c080d2180 con 0x7f2c080d1d70 2024-05-27T12:32:56.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.124+0000 7f2c0f8cf640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f2c080d5700 con 0x7f2c080d3e50 2024-05-27T12:32:56.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.124+0000 7f2c0f8cf640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f2c0815eee0 con 0x7f2c0815eb00 2024-05-27T12:32:56.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.124+0000 7f2c0ce6a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2c080d3e50 0x7f2c080d1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:56.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.124+0000 7f2c0ce6a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2c080d3e50 0x7f2c080d1830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57626/0 (socket says 172.21.15.55:57626) 2024-05-27T12:32:56.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.124+0000 7f2c0ce6a640 1 -- 172.21.15.55:0/3815360166 learned_addr learned my addr 172.21.15.55:0/3815360166 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:32:56.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.124+0000 7f2c0d66b640 1 --2- 172.21.15.55:0/3815360166 >> v2:172.21.15.72:3300/0 conn(0x7f2c0815eb00 0x7f2c080cfb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:56.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.124+0000 7f2c0ce6a640 1 -- 172.21.15.55:0/3815360166 >> v2:172.21.15.72:3300/0 conn(0x7f2c0815eb00 msgr2=0x7f2c080cfb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:32:56.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.124+0000 7f2c0ce6a640 1 --2- 172.21.15.55:0/3815360166 >> v2:172.21.15.72:3300/0 conn(0x7f2c0815eb00 0x7f2c080cfb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:56.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.124+0000 7f2c0ce6a640 1 -- 172.21.15.55:0/3815360166 >> v1:172.21.15.72:6789/0 conn(0x7f2c080d1d70 legacy=0x7f2c080d2910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:32:56.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.124+0000 7f2c0ce6a640 1 -- 172.21.15.55:0/3815360166 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c080d4660 con 0x7f2c080d3e50 2024-05-27T12:32:56.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.125+0000 7f2c0ce6a640 1 --2- 172.21.15.55:0/3815360166 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2c080d3e50 0x7f2c080d1830 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f2c0806dcf0 tx=0x7f2bf802a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=709ca0ed33a18743 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:56.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.125+0000 7f2bfffff640 1 -- 172.21.15.55:0/3815360166 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bf8037070 con 0x7f2c080d3e50 2024-05-27T12:32:56.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.125+0000 7f2bfffff640 1 -- 172.21.15.55:0/3815360166 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2bf802ae50 con 0x7f2c080d3e50 2024-05-27T12:32:56.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.125+0000 7f2bfffff640 1 -- 172.21.15.55:0/3815360166 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bf8032860 con 0x7f2c080d3e50 2024-05-27T12:32:56.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.126+0000 7f2c0f8cf640 1 -- 172.21.15.55:0/3815360166 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2c080d3e50 msgr2=0x7f2c080d1830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:56.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.126+0000 7f2c0f8cf640 1 --2- 172.21.15.55:0/3815360166 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2c080d3e50 0x7f2c080d1830 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f2c0806dcf0 tx=0x7f2bf802a300 comp rx=0 tx=0).stop 2024-05-27T12:32:56.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.126+0000 7f2c0f8cf640 1 -- 172.21.15.55:0/3815360166 shutdown_connections 2024-05-27T12:32:56.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.126+0000 7f2c0f8cf640 1 --2- 172.21.15.55:0/3815360166 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2c080d3e50 0x7f2c080d1830 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:56.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.126+0000 7f2c0f8cf640 1 --2- 172.21.15.55:0/3815360166 >> v2:172.21.15.72:3300/0 conn(0x7f2c0815eb00 0x7f2c080cfb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:56.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.126+0000 7f2c0f8cf640 1 -- 172.21.15.55:0/3815360166 >> 172.21.15.55:0/3815360166 conn(0x7f2c08067a50 msgr2=0x7f2c08067e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:56.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.126+0000 7f2c0f8cf640 1 -- 172.21.15.55:0/3815360166 shutdown_connections 2024-05-27T12:32:56.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.126+0000 7f2c0f8cf640 1 -- 172.21.15.55:0/3815360166 wait complete. 2024-05-27T12:32:56.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.127+0000 7f2c0f8cf640 1 Processor -- start 2024-05-27T12:32:56.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.127+0000 7f2c0f8cf640 1 -- start start 2024-05-27T12:32:56.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.128+0000 7f2c0f8cf640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2c080d1d70 0x7f2c08146ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:56.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.128+0000 7f2c0f8cf640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2c080d3e50 0x7f2c080c8390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:56.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.128+0000 7f2c0f8cf640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2c0815eb00 0x7f2c081f7370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:56.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.128+0000 7f2c0f8cf640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f2c080d4f00 con 0x7f2c0815eb00 2024-05-27T12:32:56.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.128+0000 7f2c0f8cf640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f2c080d4c20 con 0x7f2c080d1d70 2024-05-27T12:32:56.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.128+0000 7f2c0f8cf640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f2c080d51e0 con 0x7f2c080d3e50 2024-05-27T12:32:56.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.128+0000 7f2c0de6c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2c0815eb00 0x7f2c081f7370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:56.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.128+0000 7f2c0de6c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2c0815eb00 0x7f2c081f7370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57632/0 (socket says 172.21.15.55:57632) 2024-05-27T12:32:56.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.128+0000 7f2c0de6c640 1 -- 172.21.15.55:0/2071188358 learned_addr learned my addr 172.21.15.55:0/2071188358 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:32:56.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.128+0000 7f2c0d66b640 1 --2- 172.21.15.55:0/2071188358 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2c080d1d70 0x7f2c08146ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:56.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.128+0000 7f2c0ce6a640 1 --2- 172.21.15.55:0/2071188358 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2c080d3e50 0x7f2c080c8390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:56.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.128+0000 7f2c0de6c640 1 -- 172.21.15.55:0/2071188358 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2c080d3e50 msgr2=0x7f2c080c8390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:56.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.128+0000 7f2c0de6c640 1 --2- 172.21.15.55:0/2071188358 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2c080d3e50 0x7f2c080c8390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:56.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.128+0000 7f2c0de6c640 1 -- 172.21.15.55:0/2071188358 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2c080d1d70 msgr2=0x7f2c08146ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:56.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.128+0000 7f2c0de6c640 1 --2- 172.21.15.55:0/2071188358 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2c080d1d70 0x7f2c08146ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:56.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.128+0000 7f2c0de6c640 1 -- 172.21.15.55:0/2071188358 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c080cc890 con 0x7f2c0815eb00 2024-05-27T12:32:56.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.128+0000 7f2c0ce6a640 1 --2- 172.21.15.55:0/2071188358 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2c080d3e50 0x7f2c080c8390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T12:32:56.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.128+0000 7f2c0de6c640 1 --2- 172.21.15.55:0/2071188358 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2c0815eb00 0x7f2c081f7370 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f2c0000c7a0 tx=0x7f2c0000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:56.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.129+0000 7f2bfdffb640 1 -- 172.21.15.55:0/2071188358 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c00003b70 con 0x7f2c0815eb00 2024-05-27T12:32:56.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.129+0000 7f2bfdffb640 1 -- 172.21.15.55:0/2071188358 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c00003d30 con 0x7f2c0815eb00 2024-05-27T12:32:56.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.129+0000 7f2bfdffb640 1 -- 172.21.15.55:0/2071188358 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c0000aa90 con 0x7f2c0815eb00 2024-05-27T12:32:56.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.129+0000 7f2c0f8cf640 1 -- 172.21.15.55:0/2071188358 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c080ccb30 con 0x7f2c0815eb00 2024-05-27T12:32:56.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.129+0000 7f2c0f8cf640 1 -- 172.21.15.55:0/2071188358 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c080cd0f0 con 0x7f2c0815eb00 2024-05-27T12:32:56.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.130+0000 7f2c0f8cf640 1 -- 172.21.15.55:0/2071188358 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c08068a70 con 0x7f2c0815eb00 2024-05-27T12:32:56.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.130+0000 7f2bfdffb640 1 -- 172.21.15.55:0/2071188358 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2c0000ac30 con 0x7f2c0815eb00 2024-05-27T12:32:56.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.131+0000 7f2bfdffb640 1 --2- 172.21.15.55:0/2071188358 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f2bec06c8f0 0x7f2bec06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:56.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.131+0000 7f2bfdffb640 1 -- 172.21.15.55:0/2071188358 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f2c0008ba20 con 0x7f2c0815eb00 2024-05-27T12:32:56.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.131+0000 7f2c0d66b640 1 --2- 172.21.15.55:0/2071188358 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f2bec06c8f0 0x7f2bec06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:56.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.131+0000 7f2c0d66b640 1 --2- 172.21.15.55:0/2071188358 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f2bec06c8f0 0x7f2bec06edb0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f2c04006fd0 tx=0x7f2c04008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:56.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.135+0000 7f2bfdffb640 1 -- 172.21.15.55:0/2071188358 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2c080d2180 con 0x7f2c0815eb00 2024-05-27T12:32:56.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.317+0000 7f2c0f8cf640 1 -- 172.21.15.55:0/2071188358 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f2c0815e170 con 0x7f2c0815eb00 2024-05-27T12:32:56.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.317+0000 7f2bfdffb640 1 -- 172.21.15.55:0/2071188358 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) ==== 100+0+11 (secure 0 0 0) 0x7f2c00059ee0 con 0x7f2c0815eb00 2024-05-27T12:32:56.317 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2024-05-27T12:32:56.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.319+0000 7f2c0f8cf640 1 -- 172.21.15.55:0/2071188358 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f2bec06c8f0 msgr2=0x7f2bec06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:56.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.319+0000 7f2c0f8cf640 1 --2- 172.21.15.55:0/2071188358 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f2bec06c8f0 0x7f2bec06edb0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f2c04006fd0 tx=0x7f2c04008040 comp rx=0 tx=0).stop 2024-05-27T12:32:56.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.319+0000 7f2c0f8cf640 1 -- 172.21.15.55:0/2071188358 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2c0815eb00 msgr2=0x7f2c081f7370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:56.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.319+0000 7f2c0f8cf640 1 --2- 172.21.15.55:0/2071188358 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2c0815eb00 0x7f2c081f7370 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f2c0000c7a0 tx=0x7f2c0000cc60 comp rx=0 tx=0).stop 2024-05-27T12:32:56.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.319+0000 7f2c0f8cf640 1 -- 172.21.15.55:0/2071188358 shutdown_connections 2024-05-27T12:32:56.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.319+0000 7f2c0f8cf640 1 --2- 172.21.15.55:0/2071188358 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2c0815eb00 0x7f2c081f7370 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:56.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.319+0000 7f2c0f8cf640 1 --2- 172.21.15.55:0/2071188358 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2c080d3e50 0x7f2c080c8390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:56.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.319+0000 7f2c0f8cf640 1 --2- 172.21.15.55:0/2071188358 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f2bec06c8f0 0x7f2bec06edb0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:56.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.319+0000 7f2c0f8cf640 1 --2- 172.21.15.55:0/2071188358 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2c080d1d70 0x7f2c08146ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:56.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.319+0000 7f2c0f8cf640 1 -- 172.21.15.55:0/2071188358 >> 172.21.15.55:0/2071188358 conn(0x7f2c08067a50 msgr2=0x7f2c080b5aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:56.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.319+0000 7f2c0f8cf640 1 -- 172.21.15.55:0/2071188358 shutdown_connections 2024-05-27T12:32:56.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.319+0000 7f2c0f8cf640 1 -- 172.21.15.55:0/2071188358 wait complete. 2024-05-27T12:32:56.329 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-27T12:32:56.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.434+0000 7f12f8744640 1 Processor -- start 2024-05-27T12:32:56.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.434+0000 7f12f8744640 1 -- start start 2024-05-27T12:32:56.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.435+0000 7f12f8744640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f12f00b6950 0x7f12f00b6db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:56.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.435+0000 7f12f8744640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f12f00aff00 0x7f12f00b0350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:56.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.435+0000 7f12f8744640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12f00b6710 con 0x7f12f0145390 2024-05-27T12:32:56.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.435+0000 7f12f8744640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f12f00b72f0 con 0x7f12f00aff00 2024-05-27T12:32:56.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.435+0000 7f12f8744640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f12f0160fe0 con 0x7f12f00b6950 2024-05-27T12:32:56.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.435+0000 7f12f6ce1640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f12f00aff00 0x7f12f00b0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:56.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.435+0000 7f12f5cdf640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f12f00b6950 0x7f12f00b6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:56.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.435+0000 7f12f6ce1640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f12f00aff00 0x7f12f00b0350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.55:57966/0 (socket says 172.21.15.55:57966) 2024-05-27T12:32:56.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.435+0000 7f12f64e0640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f12f0145390 0x7f12f00b6000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.55:51946/0 (socket says 172.21.15.55:51946) 2024-05-27T12:32:56.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.435+0000 7f12f5cdf640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f12f00b6950 0x7f12f00b6db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.55:40564/0 (socket says 172.21.15.55:40564) 2024-05-27T12:32:56.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.435+0000 7f12f6ce1640 1 -- 172.21.15.55:0/3054914532 learned_addr learned my addr 172.21.15.55:0/3054914532 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:32:56.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.435+0000 7f12f6ce1640 1 -- 172.21.15.55:0/3054914532 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f12f00b6950 msgr2=0x7f12f00b6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:32:56.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.435+0000 7f12f6ce1640 1 --2- 172.21.15.55:0/3054914532 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f12f00b6950 0x7f12f00b6db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:56.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.435+0000 7f12f6ce1640 1 -- 172.21.15.55:0/3054914532 >> v1:172.21.15.72:6789/0 conn(0x7f12f0145390 legacy=0x7f12f00b6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:56.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.435+0000 7f12f6ce1640 1 -- 172.21.15.55:0/3054914532 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12f00ae6a0 con 0x7f12f00aff00 2024-05-27T12:32:56.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.436+0000 7f12f6ce1640 1 --2- 172.21.15.55:0/3054914532 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12f00aff00 0x7f12f00b0350 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f12e8009870 tx=0x7f12e802a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=76b090d0a9269168 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:56.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.436+0000 7f12f54de640 1 -- 172.21.15.55:0/3054914532 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12e8037070 con 0x7f12f00aff00 2024-05-27T12:32:56.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.436+0000 7f12f54de640 1 -- 172.21.15.55:0/3054914532 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12e8032440 con 0x7f12f00aff00 2024-05-27T12:32:56.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.436+0000 7f12f54de640 1 -- 172.21.15.55:0/3054914532 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12e8032810 con 0x7f12f00aff00 2024-05-27T12:32:56.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.437+0000 7f12f8744640 1 -- 172.21.15.55:0/3054914532 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12f00aff00 msgr2=0x7f12f00b0350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:56.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.437+0000 7f12f8744640 1 --2- 172.21.15.55:0/3054914532 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12f00aff00 0x7f12f00b0350 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f12e8009870 tx=0x7f12e802a270 comp rx=0 tx=0).stop 2024-05-27T12:32:56.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.437+0000 7f12f8744640 1 -- 172.21.15.55:0/3054914532 shutdown_connections 2024-05-27T12:32:56.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.437+0000 7f12f8744640 1 --2- 172.21.15.55:0/3054914532 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12f00aff00 0x7f12f00b0350 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:56.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.437+0000 7f12f8744640 1 --2- 172.21.15.55:0/3054914532 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f12f00b6950 0x7f12f00b6db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:56.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.437+0000 7f12f8744640 1 -- 172.21.15.55:0/3054914532 >> 172.21.15.55:0/3054914532 conn(0x7f12f00734b0 msgr2=0x7f12f009aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:56.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.437+0000 7f12f8744640 1 -- 172.21.15.55:0/3054914532 shutdown_connections 2024-05-27T12:32:56.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.437+0000 7f12f8744640 1 -- 172.21.15.55:0/3054914532 wait complete. 2024-05-27T12:32:56.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.438+0000 7f12f8744640 1 Processor -- start 2024-05-27T12:32:56.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.438+0000 7f12f8744640 1 -- start start 2024-05-27T12:32:56.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.439+0000 7f12f8744640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f12f00aff00 0x7f12f015b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:56.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.439+0000 7f12f8744640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f12f00b6950 0x7f12f00b02e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:56.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.439+0000 7f12f8744640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12f0145390 0x7f12f00b1f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:56.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.439+0000 7f12f8744640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f12f0160990 con 0x7f12f00b6950 2024-05-27T12:32:56.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.439+0000 7f12f8744640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f12f01606b0 con 0x7f12f0145390 2024-05-27T12:32:56.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.439+0000 7f12f8744640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f12f0160c70 con 0x7f12f00aff00 2024-05-27T12:32:56.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.439+0000 7f12f5cdf640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f12f00b6950 0x7f12f00b02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:56.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.439+0000 7f12f5cdf640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f12f00b6950 0x7f12f00b02e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57638/0 (socket says 172.21.15.55:57638) 2024-05-27T12:32:56.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.439+0000 7f12f5cdf640 1 -- 172.21.15.55:0/3041389728 learned_addr learned my addr 172.21.15.55:0/3041389728 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:32:56.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.439+0000 7f12f6ce1640 1 --2- 172.21.15.55:0/3041389728 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12f0145390 0x7f12f00b1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:56.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.439+0000 7f12f64e0640 1 --2- 172.21.15.55:0/3041389728 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f12f00aff00 0x7f12f015b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:56.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.439+0000 7f12f5cdf640 1 -- 172.21.15.55:0/3041389728 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f12f00aff00 msgr2=0x7f12f015b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:56.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.439+0000 7f12f5cdf640 1 --2- 172.21.15.55:0/3041389728 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f12f00aff00 0x7f12f015b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:56.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.439+0000 7f12f5cdf640 1 -- 172.21.15.55:0/3041389728 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12f0145390 msgr2=0x7f12f00b1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:56.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.439+0000 7f12f5cdf640 1 --2- 172.21.15.55:0/3041389728 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12f0145390 0x7f12f00b1f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:56.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.439+0000 7f12f5cdf640 1 -- 172.21.15.55:0/3041389728 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12f015d2d0 con 0x7f12f00b6950 2024-05-27T12:32:56.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.439+0000 7f12f5cdf640 1 --2- 172.21.15.55:0/3041389728 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f12f00b6950 0x7f12f00b02e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f12e000e9b0 tx=0x7f12e000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:56.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.440+0000 7f12e6ffd640 1 -- 172.21.15.55:0/3041389728 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12e0017070 con 0x7f12f00b6950 2024-05-27T12:32:56.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.440+0000 7f12e6ffd640 1 -- 172.21.15.55:0/3041389728 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12e000c9a0 con 0x7f12f00b6950 2024-05-27T12:32:56.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.440+0000 7f12f8744640 1 -- 172.21.15.55:0/3041389728 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12f015d5b0 con 0x7f12f00b6950 2024-05-27T12:32:56.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.440+0000 7f12e6ffd640 1 -- 172.21.15.55:0/3041389728 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12e000cd90 con 0x7f12f00b6950 2024-05-27T12:32:56.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.440+0000 7f12f8744640 1 -- 172.21.15.55:0/3041389728 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12f015db70 con 0x7f12f00b6950 2024-05-27T12:32:56.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.441+0000 7f12f8744640 1 -- 172.21.15.55:0/3041389728 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12f00d1a30 con 0x7f12f00b6950 2024-05-27T12:32:56.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.441+0000 7f12e6ffd640 1 -- 172.21.15.55:0/3041389728 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f12e001a070 con 0x7f12f00b6950 2024-05-27T12:32:56.443 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.442+0000 7f12e6ffd640 1 --2- 172.21.15.55:0/3041389728 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f12d406c8f0 0x7f12d406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:56.443 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.442+0000 7f12e6ffd640 1 -- 172.21.15.55:0/3041389728 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f12e008bf60 con 0x7f12f00b6950 2024-05-27T12:32:56.443 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.442+0000 7f12f64e0640 1 --2- 172.21.15.55:0/3041389728 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f12d406c8f0 0x7f12d406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:56.443 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.442+0000 7f12f64e0640 1 --2- 172.21.15.55:0/3041389728 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f12d406c8f0 0x7f12d406edb0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f12ec007fd0 tx=0x7f12ec0016d0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:56.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.446+0000 7f12e6ffd640 1 -- 172.21.15.55:0/3041389728 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f12e0059c10 con 0x7f12f00b6950 2024-05-27T12:32:56.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.672+0000 7f12f8744640 1 -- 172.21.15.55:0/3041389728 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f12f015df70 con 0x7f12f00b6950 2024-05-27T12:32:56.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.672+0000 7f12e6ffd640 1 -- 172.21.15.55:0/3041389728 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5166 (secure 0 0 0) 0x7f12e005df10 con 0x7f12f00b6950 2024-05-27T12:32:56.672 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-27T12:32:56.672 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/1501264038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":1501264038},{"type":"v1","addr":"172.21.15.55:6834","nonce":1501264038}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/3311546358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":3311546358},{"type":"v1","addr":"172.21.15.55:6835","nonce":3311546358}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4282,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/138819105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6835","nonce":138819105},{"type":"v1","addr":"172.21.15.72:6837","nonce":138819105}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-27T12:32:41.727353+0000","modified":"2024-05-27T12:32:43.723059+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.72:6836/70510151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":70510151},{"type":"v1","addr":"172.21.15.72:6836","nonce":70510151}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4290,"qdb_cluster":[4290]},"id":1}]} 2024-05-27T12:32:56.672 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 6 2024-05-27T12:32:56.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.674+0000 7f12f8744640 1 -- 172.21.15.55:0/3041389728 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f12d406c8f0 msgr2=0x7f12d406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:56.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.674+0000 7f12f8744640 1 --2- 172.21.15.55:0/3041389728 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f12d406c8f0 0x7f12d406edb0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f12ec007fd0 tx=0x7f12ec0016d0 comp rx=0 tx=0).stop 2024-05-27T12:32:56.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.674+0000 7f12f8744640 1 -- 172.21.15.55:0/3041389728 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f12f00b6950 msgr2=0x7f12f00b02e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:56.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.674+0000 7f12f8744640 1 --2- 172.21.15.55:0/3041389728 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f12f00b6950 0x7f12f00b02e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f12e000e9b0 tx=0x7f12e000ee70 comp rx=0 tx=0).stop 2024-05-27T12:32:56.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.674+0000 7f12f8744640 1 -- 172.21.15.55:0/3041389728 shutdown_connections 2024-05-27T12:32:56.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.674+0000 7f12f8744640 1 --2- 172.21.15.55:0/3041389728 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f12d406c8f0 0x7f12d406edb0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:56.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.674+0000 7f12f8744640 1 --2- 172.21.15.55:0/3041389728 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12f0145390 0x7f12f00b1f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:56.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.674+0000 7f12f8744640 1 --2- 172.21.15.55:0/3041389728 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f12f00b6950 0x7f12f00b02e0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:56.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.674+0000 7f12f8744640 1 --2- 172.21.15.55:0/3041389728 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f12f00aff00 0x7f12f015b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:56.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.674+0000 7f12f8744640 1 -- 172.21.15.55:0/3041389728 >> 172.21.15.55:0/3041389728 conn(0x7f12f00734b0 msgr2=0x7f12f00b57a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:56.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.674+0000 7f12f8744640 1 -- 172.21.15.55:0/3041389728 shutdown_connections 2024-05-27T12:32:56.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.674+0000 7f12f8744640 1 -- 172.21.15.55:0/3041389728 wait complete. 2024-05-27T12:32:56.685 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-27T12:32:56.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.789+0000 7f6642fef640 1 Processor -- start 2024-05-27T12:32:56.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.789+0000 7f6642fef640 1 -- start start 2024-05-27T12:32:56.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.790+0000 7f6642fef640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f663c15a250 0x7f663c06ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:56.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.790+0000 7f6642fef640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f663c06f280 0x7f663c0cf400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:56.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.790+0000 7f6642fef640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f663c160360 con 0x7f663c0cf940 2024-05-27T12:32:56.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.790+0000 7f6642fef640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f663c160f70 con 0x7f663c15a250 2024-05-27T12:32:56.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.790+0000 7f6642fef640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f663c0cfd90 con 0x7f663c06f280 2024-05-27T12:32:56.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.790+0000 7f6640d8b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f663c15a250 0x7f663c06ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:56.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.790+0000 7f664158c640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f663c0cf940 0x7f663c071f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:36944/0 (socket says 172.21.15.55:36944) 2024-05-27T12:32:56.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.790+0000 7f664158c640 1 -- 172.21.15.55:0/1266107792 learned_addr learned my addr 172.21.15.55:0/1266107792 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-27T12:32:56.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.790+0000 7f663bfff640 1 --2- 172.21.15.55:0/1266107792 >> v2:172.21.15.72:3300/0 conn(0x7f663c06f280 0x7f663c0cf400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:56.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.790+0000 7f6640d8b640 1 -- 172.21.15.55:0/1266107792 >> v2:172.21.15.72:3300/0 conn(0x7f663c06f280 msgr2=0x7f663c0cf400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:32:56.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.790+0000 7f6640d8b640 1 --2- 172.21.15.55:0/1266107792 >> v2:172.21.15.72:3300/0 conn(0x7f663c06f280 0x7f663c0cf400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:56.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.790+0000 7f6640d8b640 1 -- 172.21.15.55:0/1266107792 >> v1:172.21.15.55:6789/0 conn(0x7f663c0cf940 legacy=0x7f663c071f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:56.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.790+0000 7f6640d8b640 1 -- 172.21.15.55:0/1266107792 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f663c160640 con 0x7f663c15a250 2024-05-27T12:32:56.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.790+0000 7f663b7fe640 1 -- 172.21.15.55:0/1266107792 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2940990657 0 0) 0x7f663c160360 con 0x7f663c0cf940 2024-05-27T12:32:56.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.791+0000 7f6640d8b640 1 --2- 172.21.15.55:0/1266107792 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f663c15a250 0x7f663c06ed40 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f663c0b2ad0 tx=0x7f662c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=168dd8321aa26d3d server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:56.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.791+0000 7f663b7fe640 1 -- 172.21.15.55:0/1266107792 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f662c037070 con 0x7f663c15a250 2024-05-27T12:32:56.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.791+0000 7f663b7fe640 1 -- 172.21.15.55:0/1266107792 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f662c032440 con 0x7f663c15a250 2024-05-27T12:32:56.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.791+0000 7f663b7fe640 1 -- 172.21.15.55:0/1266107792 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f662c032810 con 0x7f663c15a250 2024-05-27T12:32:56.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.792+0000 7f6642fef640 1 -- 172.21.15.55:0/1266107792 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f663c15a250 msgr2=0x7f663c06ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:56.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.792+0000 7f6642fef640 1 --2- 172.21.15.55:0/1266107792 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f663c15a250 0x7f663c06ed40 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f663c0b2ad0 tx=0x7f662c02a1a0 comp rx=0 tx=0).stop 2024-05-27T12:32:56.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.792+0000 7f6642fef640 1 -- 172.21.15.55:0/1266107792 shutdown_connections 2024-05-27T12:32:56.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.792+0000 7f6642fef640 1 --2- 172.21.15.55:0/1266107792 >> v2:172.21.15.72:3300/0 conn(0x7f663c06f280 0x7f663c0cf400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:56.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.792+0000 7f6642fef640 1 --2- 172.21.15.55:0/1266107792 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f663c15a250 0x7f663c06ed40 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:56.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.792+0000 7f6642fef640 1 -- 172.21.15.55:0/1266107792 >> 172.21.15.55:0/1266107792 conn(0x7f663c0b3830 msgr2=0x7f663c0b3c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:56.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.792+0000 7f6642fef640 1 -- 172.21.15.55:0/1266107792 shutdown_connections 2024-05-27T12:32:56.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.792+0000 7f6642fef640 1 -- 172.21.15.55:0/1266107792 wait complete. 2024-05-27T12:32:56.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.793+0000 7f6642fef640 1 Processor -- start 2024-05-27T12:32:56.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.793+0000 7f6642fef640 1 -- start start 2024-05-27T12:32:56.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.794+0000 7f6642fef640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f663c06f280 0x7f663c14e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:56.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.794+0000 7f6642fef640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f663c0cf940 0x7f663c14c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:56.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.794+0000 7f6642fef640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f663c15a250 0x7f663c15b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:56.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.794+0000 7f6642fef640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f663c15a630 con 0x7f663c0cf940 2024-05-27T12:32:56.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.794+0000 7f6642fef640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f663c160c00 con 0x7f663c06f280 2024-05-27T12:32:56.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.794+0000 7f6642fef640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f663c06e7f0 con 0x7f663c15a250 2024-05-27T12:32:56.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.794+0000 7f663bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f663c0cf940 0x7f663c14c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:56.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.794+0000 7f663bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f663c0cf940 0x7f663c14c010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57658/0 (socket says 172.21.15.55:57658) 2024-05-27T12:32:56.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.794+0000 7f663bfff640 1 -- 172.21.15.55:0/3905338296 learned_addr learned my addr 172.21.15.55:0/3905338296 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:32:56.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.794+0000 7f6640d8b640 1 --2- 172.21.15.55:0/3905338296 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f663c06f280 0x7f663c14e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:56.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.794+0000 7f664158c640 1 --2- 172.21.15.55:0/3905338296 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f663c15a250 0x7f663c15b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:56.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.794+0000 7f663bfff640 1 -- 172.21.15.55:0/3905338296 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f663c15a250 msgr2=0x7f663c15b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:56.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.794+0000 7f663bfff640 1 --2- 172.21.15.55:0/3905338296 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f663c15a250 0x7f663c15b930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:56.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.794+0000 7f663bfff640 1 -- 172.21.15.55:0/3905338296 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f663c06f280 msgr2=0x7f663c14e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:56.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.794+0000 7f663bfff640 1 --2- 172.21.15.55:0/3905338296 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f663c06f280 0x7f663c14e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:56.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.794+0000 7f663bfff640 1 -- 172.21.15.55:0/3905338296 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f663c1544d0 con 0x7f663c0cf940 2024-05-27T12:32:56.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.795+0000 7f663bfff640 1 --2- 172.21.15.55:0/3905338296 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f663c0cf940 0x7f663c14c010 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f663000e9b0 tx=0x7f663000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:56.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.795+0000 7f66397fa640 1 -- 172.21.15.55:0/3905338296 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6630017070 con 0x7f663c0cf940 2024-05-27T12:32:56.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.795+0000 7f66397fa640 1 -- 172.21.15.55:0/3905338296 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f663000c9a0 con 0x7f663c0cf940 2024-05-27T12:32:56.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.795+0000 7f6642fef640 1 -- 172.21.15.55:0/3905338296 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f663c14de40 con 0x7f663c0cf940 2024-05-27T12:32:56.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.795+0000 7f66397fa640 1 -- 172.21.15.55:0/3905338296 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f663000cd90 con 0x7f663c0cf940 2024-05-27T12:32:56.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.795+0000 7f6642fef640 1 -- 172.21.15.55:0/3905338296 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f663c14e400 con 0x7f663c0cf940 2024-05-27T12:32:56.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.796+0000 7f6642fef640 1 -- 172.21.15.55:0/3905338296 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f663c075460 con 0x7f663c0cf940 2024-05-27T12:32:56.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.796+0000 7f66397fa640 1 -- 172.21.15.55:0/3905338296 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f663001a070 con 0x7f663c0cf940 2024-05-27T12:32:56.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.797+0000 7f66397fa640 1 --2- 172.21.15.55:0/3905338296 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f662806c8f0 0x7f662806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:56.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.797+0000 7f66397fa640 1 -- 172.21.15.55:0/3905338296 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f663008bee0 con 0x7f663c0cf940 2024-05-27T12:32:56.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.797+0000 7f6640d8b640 1 --2- 172.21.15.55:0/3905338296 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f662806c8f0 0x7f662806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:56.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.798+0000 7f6640d8b640 1 --2- 172.21.15.55:0/3905338296 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f662806c8f0 0x7f662806edb0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f662c034000 tx=0x7f662c02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:56.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.801+0000 7f66397fa640 1 -- 172.21.15.55:0/3905338296 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f663005a310 con 0x7f663c0cf940 2024-05-27T12:32:56.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.987+0000 7f6642fef640 1 -- 172.21.15.55:0/3905338296 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f663c06e1c0 con 0x7f663c0cf940 2024-05-27T12:32:56.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.988+0000 7f66397fa640 1 -- 172.21.15.55:0/3905338296 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16557 (secure 0 0 0) 0x7f6630059c10 con 0x7f663c0cf940 2024-05-27T12:32:56.987 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-27T12:32:56.987 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":23,"fsid":"c3ff4e3b-8dae-4856-9593-e5cc66c59982","created":"2024-05-27T12:32:17.019097+0000","modified":"2024-05-27T12:32:43.361598+0000","last_up_change":"2024-05-27T12:32:28.109744+0000","last_in_change":"2024-05-27T12:32:19.309872+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-27T12:32:29.277895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-27T12:32:39.442745+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-27T12:32:40.672118+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e607b598-061b-4b6f-92ff-95c20b330599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":807572567},{"type":"v1","addr":"172.21.15.55:6801","nonce":807572567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":807572567},{"type":"v1","addr":"172.21.15.55:6803","nonce":807572567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":807572567},{"type":"v1","addr":"172.21.15.55:6807","nonce":807572567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":807572567},{"type":"v1","addr":"172.21.15.55:6805","nonce":807572567}]},"public_addr":"172.21.15.55:6801/807572567","cluster_addr":"172.21.15.55:6803/807572567","heartbeat_back_addr":"172.21.15.55:6807/807572567","heartbeat_front_addr":"172.21.15.55:6805/807572567","state":["exists","up"]},{"osd":1,"uuid":"ba2b5b1d-71a9-4ecc-9a48-55aa7fe54261","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":3426897300},{"type":"v1","addr":"172.21.15.55:6825","nonce":3426897300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":3426897300},{"type":"v1","addr":"172.21.15.55:6827","nonce":3426897300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":3426897300},{"type":"v1","addr":"172.21.15.55:6831","nonce":3426897300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":3426897300},{"type":"v1","addr":"172.21.15.55:6829","nonce":3426897300}]},"public_addr":"172.21.15.55:6825/3426897300","cluster_addr":"172.21.15.55:6827/3426897300","heartbeat_back_addr":"172.21.15.55:6831/3426897300","heartbeat_front_addr":"172.21.15.55:6829/3426897300","state":["exists","up"]},{"osd":2,"uuid":"e6b81cc6-4ff1-45d0-87eb-9f04ccf986a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3510271725},{"type":"v1","addr":"172.21.15.55:6809","nonce":3510271725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3510271725},{"type":"v1","addr":"172.21.15.55:6811","nonce":3510271725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3510271725},{"type":"v1","addr":"172.21.15.55:6815","nonce":3510271725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3510271725},{"type":"v1","addr":"172.21.15.55:6813","nonce":3510271725}]},"public_addr":"172.21.15.55:6809/3510271725","cluster_addr":"172.21.15.55:6811/3510271725","heartbeat_back_addr":"172.21.15.55:6815/3510271725","heartbeat_front_addr":"172.21.15.55:6813/3510271725","state":["exists","up"]},{"osd":3,"uuid":"b6a34b75-807d-4693-b1c3-903cb4c618d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":1066693520},{"type":"v1","addr":"172.21.15.55:6817","nonce":1066693520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":1066693520},{"type":"v1","addr":"172.21.15.55:6819","nonce":1066693520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":1066693520},{"type":"v1","addr":"172.21.15.55:6823","nonce":1066693520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":1066693520},{"type":"v1","addr":"172.21.15.55:6821","nonce":1066693520}]},"public_addr":"172.21.15.55:6817/1066693520","cluster_addr":"172.21.15.55:6819/1066693520","heartbeat_back_addr":"172.21.15.55:6823/1066693520","heartbeat_front_addr":"172.21.15.55:6821/1066693520","state":["exists","up"]},{"osd":4,"uuid":"272ec937-56b4-4f0a-b2e1-b0bc189c9d79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":4190771237},{"type":"v1","addr":"172.21.15.72:6820","nonce":4190771237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":4190771237},{"type":"v1","addr":"172.21.15.72:6824","nonce":4190771237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":4190771237},{"type":"v1","addr":"172.21.15.72:6831","nonce":4190771237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":4190771237},{"type":"v1","addr":"172.21.15.72:6828","nonce":4190771237}]},"public_addr":"172.21.15.72:6820/4190771237","cluster_addr":"172.21.15.72:6824/4190771237","heartbeat_back_addr":"172.21.15.72:6831/4190771237","heartbeat_front_addr":"172.21.15.72:6828/4190771237","state":["exists","up"]},{"osd":5,"uuid":"56439854-72a0-4ef4-81ff-184a3d924a5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":2421889184},{"type":"v1","addr":"172.21.15.72:6801","nonce":2421889184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6803","nonce":2421889184},{"type":"v1","addr":"172.21.15.72:6805","nonce":2421889184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":2421889184},{"type":"v1","addr":"172.21.15.72:6813","nonce":2421889184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6807","nonce":2421889184},{"type":"v1","addr":"172.21.15.72:6809","nonce":2421889184}]},"public_addr":"172.21.15.72:6801/2421889184","cluster_addr":"172.21.15.72:6805/2421889184","heartbeat_back_addr":"172.21.15.72:6813/2421889184","heartbeat_front_addr":"172.21.15.72:6809/2421889184","state":["exists","up"]},{"osd":6,"uuid":"e248e2be-3b6e-49cf-8c8a-1a4152827582","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3796994599},{"type":"v1","addr":"172.21.15.72:6804","nonce":3796994599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":3796994599},{"type":"v1","addr":"172.21.15.72:6808","nonce":3796994599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":3796994599},{"type":"v1","addr":"172.21.15.72:6815","nonce":3796994599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":3796994599},{"type":"v1","addr":"172.21.15.72:6812","nonce":3796994599}]},"public_addr":"172.21.15.72:6804/3796994599","cluster_addr":"172.21.15.72:6808/3796994599","heartbeat_back_addr":"172.21.15.72:6815/3796994599","heartbeat_front_addr":"172.21.15.72:6812/3796994599","state":["exists","up"]},{"osd":7,"uuid":"505a62d3-322b-4629-b4fd-187a55563709","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":3024877895},{"type":"v1","addr":"172.21.15.72:6817","nonce":3024877895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":3024877895},{"type":"v1","addr":"172.21.15.72:6821","nonce":3024877895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6827","nonce":3024877895},{"type":"v1","addr":"172.21.15.72:6829","nonce":3024877895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6823","nonce":3024877895},{"type":"v1","addr":"172.21.15.72:6825","nonce":3024877895}]},"public_addr":"172.21.15.72:6817/3024877895","cluster_addr":"172.21.15.72:6821/3024877895","heartbeat_back_addr":"172.21.15.72:6829/3024877895","heartbeat_front_addr":"172.21.15.72:6825/3024877895","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.241014+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.450799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.465018+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.507647+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.534763+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.495895+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.427110+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.547466+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-27T12:32:56.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.990+0000 7f6642fef640 1 -- 172.21.15.55:0/3905338296 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f662806c8f0 msgr2=0x7f662806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:56.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.990+0000 7f6642fef640 1 --2- 172.21.15.55:0/3905338296 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f662806c8f0 0x7f662806edb0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f662c034000 tx=0x7f662c02e000 comp rx=0 tx=0).stop 2024-05-27T12:32:56.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.990+0000 7f6642fef640 1 -- 172.21.15.55:0/3905338296 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f663c0cf940 msgr2=0x7f663c14c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:56.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.990+0000 7f6642fef640 1 --2- 172.21.15.55:0/3905338296 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f663c0cf940 0x7f663c14c010 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f663000e9b0 tx=0x7f663000ee70 comp rx=0 tx=0).stop 2024-05-27T12:32:56.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.990+0000 7f6642fef640 1 -- 172.21.15.55:0/3905338296 shutdown_connections 2024-05-27T12:32:56.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.990+0000 7f6642fef640 1 --2- 172.21.15.55:0/3905338296 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f663c15a250 0x7f663c15b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:56.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.990+0000 7f6642fef640 1 --2- 172.21.15.55:0/3905338296 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f663c0cf940 0x7f663c14c010 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:56.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.990+0000 7f6642fef640 1 --2- 172.21.15.55:0/3905338296 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f662806c8f0 0x7f662806edb0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:56.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.990+0000 7f6642fef640 1 --2- 172.21.15.55:0/3905338296 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f663c06f280 0x7f663c14e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:56.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.990+0000 7f6642fef640 1 -- 172.21.15.55:0/3905338296 >> 172.21.15.55:0/3905338296 conn(0x7f663c0b3830 msgr2=0x7f663c071e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:56.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.990+0000 7f6642fef640 1 -- 172.21.15.55:0/3905338296 shutdown_connections 2024-05-27T12:32:56.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:56.990+0000 7f6642fef640 1 -- 172.21.15.55:0/3905338296 wait complete. 2024-05-27T12:32:57.001 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-27T12:32:29.277895+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-27T12:32:39.442745+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-27T12:32:40.672118+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-27T12:32:57.001 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-27T12:32:57.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.108+0000 7fa572fc6640 1 Processor -- start 2024-05-27T12:32:57.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.108+0000 7fa572fc6640 1 -- start start 2024-05-27T12:32:57.110 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.109+0000 7fa572fc6640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa56c15c750 0x7fa56c0d0c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:57.110 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.109+0000 7fa572fc6640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa56c0d1180 0x7fa56c0cee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:57.110 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.109+0000 7fa572fc6640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa56c0cdb50 con 0x7fa56c0cf3d0 2024-05-27T12:32:57.110 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.109+0000 7fa572fc6640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7fa56c0cf810 con 0x7fa56c15c750 2024-05-27T12:32:57.110 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.109+0000 7fa572fc6640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fa56c0cde30 con 0x7fa56c0d1180 2024-05-27T12:32:57.110 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.109+0000 7fa570d62640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa56c15c750 0x7fa56c0d0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:57.110 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.109+0000 7fa570d62640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa56c15c750 0x7fa56c0d0c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57660/0 (socket says 172.21.15.55:57660) 2024-05-27T12:32:57.110 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.109+0000 7fa571563640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fa56c0cf3d0 0x7fa56c09aa30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:36960/0 (socket says 172.21.15.55:36960) 2024-05-27T12:32:57.110 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.109+0000 7fa570d62640 1 -- 172.21.15.55:0/809364824 learned_addr learned my addr 172.21.15.55:0/809364824 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:32:57.110 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.110+0000 7fa56bfff640 1 --2- 172.21.15.55:0/809364824 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa56c0d1180 0x7fa56c0cee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:57.110 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.110+0000 7fa570d62640 1 -- 172.21.15.55:0/809364824 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa56c0d1180 msgr2=0x7fa56c0cee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:32:57.111 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.110+0000 7fa570d62640 1 --2- 172.21.15.55:0/809364824 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa56c0d1180 0x7fa56c0cee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:57.111 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.110+0000 7fa570d62640 1 -- 172.21.15.55:0/809364824 >> v1:172.21.15.55:6789/0 conn(0x7fa56c0cf3d0 legacy=0x7fa56c09aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:57.111 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.110+0000 7fa56b7fe640 1 -- 172.21.15.55:0/809364824 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2572456124 0 0) 0x7fa56c0cdb50 con 0x7fa56c0cf3d0 2024-05-27T12:32:57.111 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.110+0000 7fa570d62640 1 -- 172.21.15.55:0/809364824 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa56c0ce110 con 0x7fa56c15c750 2024-05-27T12:32:57.111 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.110+0000 7fa570d62640 1 --2- 172.21.15.55:0/809364824 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa56c15c750 0x7fa56c0d0c40 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa560009870 tx=0x7fa56002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb89ea0048de4d server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:57.111 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.111+0000 7fa56b7fe640 1 -- 172.21.15.55:0/809364824 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa560037070 con 0x7fa56c15c750 2024-05-27T12:32:57.111 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.111+0000 7fa56b7fe640 1 -- 172.21.15.55:0/809364824 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa560032440 con 0x7fa56c15c750 2024-05-27T12:32:57.111 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.111+0000 7fa56b7fe640 1 -- 172.21.15.55:0/809364824 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa560032810 con 0x7fa56c15c750 2024-05-27T12:32:57.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.111+0000 7fa572fc6640 1 -- 172.21.15.55:0/809364824 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa56c15c750 msgr2=0x7fa56c0d0c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:57.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.111+0000 7fa572fc6640 1 --2- 172.21.15.55:0/809364824 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa56c15c750 0x7fa56c0d0c40 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa560009870 tx=0x7fa56002a270 comp rx=0 tx=0).stop 2024-05-27T12:32:57.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.111+0000 7fa572fc6640 1 -- 172.21.15.55:0/809364824 shutdown_connections 2024-05-27T12:32:57.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.111+0000 7fa572fc6640 1 --2- 172.21.15.55:0/809364824 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa56c0d1180 0x7fa56c0cee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:57.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.111+0000 7fa572fc6640 1 --2- 172.21.15.55:0/809364824 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa56c15c750 0x7fa56c0d0c40 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:57.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.111+0000 7fa572fc6640 1 -- 172.21.15.55:0/809364824 >> 172.21.15.55:0/809364824 conn(0x7fa56c0d2660 msgr2=0x7fa56c0d2a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:57.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.111+0000 7fa572fc6640 1 -- 172.21.15.55:0/809364824 shutdown_connections 2024-05-27T12:32:57.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.111+0000 7fa572fc6640 1 -- 172.21.15.55:0/809364824 wait complete. 2024-05-27T12:32:57.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.112+0000 7fa572fc6640 1 Processor -- start 2024-05-27T12:32:57.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.112+0000 7fa572fc6640 1 -- start start 2024-05-27T12:32:57.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.113+0000 7fa572fc6640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa56c0cf3d0 0x7fa56c1592d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:57.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.113+0000 7fa572fc6640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa56c0d1180 0x7fa56c0b7c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:57.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.113+0000 7fa572fc6640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa56c15c750 0x7fa56c0c9730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:57.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.113+0000 7fa572fc6640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7fa56c0c6490 con 0x7fa56c0cf3d0 2024-05-27T12:32:57.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.113+0000 7fa572fc6640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fa56c0c61b0 con 0x7fa56c0d1180 2024-05-27T12:32:57.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.113+0000 7fa572fc6640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fa56c15cb30 con 0x7fa56c15c750 2024-05-27T12:32:57.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.113+0000 7fa570d62640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa56c0cf3d0 0x7fa56c1592d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:57.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.113+0000 7fa570d62640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa56c0cf3d0 0x7fa56c1592d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57662/0 (socket says 172.21.15.55:57662) 2024-05-27T12:32:57.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.113+0000 7fa570d62640 1 -- 172.21.15.55:0/1742464943 learned_addr learned my addr 172.21.15.55:0/1742464943 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:32:57.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.114+0000 7fa571563640 1 --2- 172.21.15.55:0/1742464943 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa56c15c750 0x7fa56c0c9730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:57.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.114+0000 7fa56bfff640 1 --2- 172.21.15.55:0/1742464943 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa56c0d1180 0x7fa56c0b7c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:57.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.114+0000 7fa570d62640 1 -- 172.21.15.55:0/1742464943 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa56c15c750 msgr2=0x7fa56c0c9730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:57.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.114+0000 7fa570d62640 1 --2- 172.21.15.55:0/1742464943 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa56c15c750 0x7fa56c0c9730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:57.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.114+0000 7fa570d62640 1 -- 172.21.15.55:0/1742464943 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa56c0d1180 msgr2=0x7fa56c0b7c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:57.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.114+0000 7fa570d62640 1 --2- 172.21.15.55:0/1742464943 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa56c0d1180 0x7fa56c0b7c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:57.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.114+0000 7fa570d62640 1 -- 172.21.15.55:0/1742464943 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa56c0ca180 con 0x7fa56c0cf3d0 2024-05-27T12:32:57.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.114+0000 7fa570d62640 1 --2- 172.21.15.55:0/1742464943 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa56c0cf3d0 0x7fa56c1592d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fa5600090b0 tx=0x7fa5600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:57.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.114+0000 7fa5697fa640 1 -- 172.21.15.55:0/1742464943 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa560037040 con 0x7fa56c0cf3d0 2024-05-27T12:32:57.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.114+0000 7fa5697fa640 1 -- 172.21.15.55:0/1742464943 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa560004030 con 0x7fa56c0cf3d0 2024-05-27T12:32:57.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.114+0000 7fa572fc6640 1 -- 172.21.15.55:0/1742464943 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa56c0ca460 con 0x7fa56c0cf3d0 2024-05-27T12:32:57.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.114+0000 7fa5697fa640 1 -- 172.21.15.55:0/1742464943 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa560004440 con 0x7fa56c0cf3d0 2024-05-27T12:32:57.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.114+0000 7fa572fc6640 1 -- 172.21.15.55:0/1742464943 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa56c159fc0 con 0x7fa56c0cf3d0 2024-05-27T12:32:57.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.115+0000 7fa572fc6640 1 -- 172.21.15.55:0/1742464943 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa56c075460 con 0x7fa56c0cf3d0 2024-05-27T12:32:57.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.116+0000 7fa5697fa640 1 -- 172.21.15.55:0/1742464943 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa56003a070 con 0x7fa56c0cf3d0 2024-05-27T12:32:57.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.116+0000 7fa5697fa640 1 --2- 172.21.15.55:0/1742464943 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fa55006c920 0x7fa55006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:57.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.116+0000 7fa5697fa640 1 -- 172.21.15.55:0/1742464943 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fa5600ac1f0 con 0x7fa56c0cf3d0 2024-05-27T12:32:57.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.116+0000 7fa56bfff640 1 --2- 172.21.15.55:0/1742464943 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fa55006c920 0x7fa55006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:57.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.117+0000 7fa56bfff640 1 --2- 172.21.15.55:0/1742464943 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fa55006c920 0x7fa55006ede0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa56c0b3230 tx=0x7fa558008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:57.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.121+0000 7fa5697fa640 1 -- 172.21.15.55:0/1742464943 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa560041020 con 0x7fa56c0cf3d0 2024-05-27T12:32:57.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.307+0000 7fa572fc6640 1 -- 172.21.15.55:0/1742464943 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fa56c0c8c70 con 0x7fa56c0cf3d0 2024-05-27T12:32:57.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.307+0000 7fa5697fa640 1 -- 172.21.15.55:0/1742464943 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) ==== 93+0+10 (secure 0 0 0) 0x7fa56007a740 con 0x7fa56c0cf3d0 2024-05-27T12:32:57.306 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-05-27T12:32:57.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.309+0000 7fa572fc6640 1 -- 172.21.15.55:0/1742464943 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fa55006c920 msgr2=0x7fa55006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:57.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.309+0000 7fa572fc6640 1 --2- 172.21.15.55:0/1742464943 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fa55006c920 0x7fa55006ede0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa56c0b3230 tx=0x7fa558008040 comp rx=0 tx=0).stop 2024-05-27T12:32:57.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.309+0000 7fa572fc6640 1 -- 172.21.15.55:0/1742464943 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa56c0cf3d0 msgr2=0x7fa56c1592d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:57.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.309+0000 7fa572fc6640 1 --2- 172.21.15.55:0/1742464943 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa56c0cf3d0 0x7fa56c1592d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fa5600090b0 tx=0x7fa5600046c0 comp rx=0 tx=0).stop 2024-05-27T12:32:57.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.309+0000 7fa572fc6640 1 -- 172.21.15.55:0/1742464943 shutdown_connections 2024-05-27T12:32:57.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.309+0000 7fa572fc6640 1 --2- 172.21.15.55:0/1742464943 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa56c15c750 0x7fa56c0c9730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:57.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.309+0000 7fa572fc6640 1 --2- 172.21.15.55:0/1742464943 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fa55006c920 0x7fa55006ede0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:57.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.309+0000 7fa572fc6640 1 --2- 172.21.15.55:0/1742464943 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa56c0d1180 0x7fa56c0b7c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:57.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.309+0000 7fa572fc6640 1 --2- 172.21.15.55:0/1742464943 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa56c0cf3d0 0x7fa56c1592d0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:57.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.309+0000 7fa572fc6640 1 -- 172.21.15.55:0/1742464943 >> 172.21.15.55:0/1742464943 conn(0x7fa56c0d2660 msgr2=0x7fa56c0c6de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:57.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.309+0000 7fa572fc6640 1 -- 172.21.15.55:0/1742464943 shutdown_connections 2024-05-27T12:32:57.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.309+0000 7fa572fc6640 1 -- 172.21.15.55:0/1742464943 wait complete. 2024-05-27T12:32:57.320 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-27T12:32:57.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.428+0000 7f860c99b640 1 Processor -- start 2024-05-27T12:32:57.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.428+0000 7f860c99b640 1 -- start start 2024-05-27T12:32:57.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.429+0000 7f860c99b640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f86080b8900 0x7f8608169610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:57.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.429+0000 7f860c99b640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f860815eee0 con 0x7f860815eb00 2024-05-27T12:32:57.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.429+0000 7f860c99b640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86080d4660 con 0x7f86080cfb40 2024-05-27T12:32:57.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.429+0000 7f860c99b640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f86080d5700 con 0x7f86080b8900 2024-05-27T12:32:57.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.429+0000 7f860659c640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f860815eb00 0x7f86080d3e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:36974/0 (socket says 172.21.15.55:36974) 2024-05-27T12:32:57.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.429+0000 7f860659c640 1 -- 172.21.15.55:0/3806815931 learned_addr learned my addr 172.21.15.55:0/3806815931 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-27T12:32:57.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.430+0000 7f8606d9d640 1 --2- 172.21.15.55:0/3806815931 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f86080b8900 0x7f8608169610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:57.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.430+0000 7f860559a640 1 -- 172.21.15.55:0/3806815931 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4244966215 0 0) 0x7f860815eee0 con 0x7f860815eb00 2024-05-27T12:32:57.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.430+0000 7f860559a640 1 -- 172.21.15.55:0/3806815931 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f85f0003520 con 0x7f860815eb00 2024-05-27T12:32:57.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.430+0000 7f860559a640 1 -- 172.21.15.55:0/3806815931 <== mon.1 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1825951790 0 0) 0x7f86080d4660 con 0x7f86080cfb40 2024-05-27T12:32:57.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.430+0000 7f860559a640 1 -- 172.21.15.55:0/3806815931 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f860815eee0 con 0x7f86080cfb40 2024-05-27T12:32:57.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.430+0000 7f860559a640 1 -- 172.21.15.55:0/3806815931 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3719048041 0 0) 0x7f85f0003520 con 0x7f860815eb00 2024-05-27T12:32:57.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.430+0000 7f860559a640 1 -- 172.21.15.55:0/3806815931 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f86080b8900 msgr2=0x7f8608169610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:32:57.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.430+0000 7f860559a640 1 --2- 172.21.15.55:0/3806815931 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f86080b8900 0x7f8608169610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:57.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.430+0000 7f860559a640 1 -- 172.21.15.55:0/3806815931 >> v1:172.21.15.72:6789/0 conn(0x7f86080cfb40 legacy=0x7f86080d1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:57.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.430+0000 7f860559a640 1 -- 172.21.15.55:0/3806815931 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86080d4940 con 0x7f860815eb00 2024-05-27T12:32:57.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.430+0000 7f860559a640 1 -- 172.21.15.55:0/3806815931 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 793017739 0 0) 0x7f85f8001670 con 0x7f860815eb00 2024-05-27T12:32:57.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.430+0000 7f8606d9d640 1 --2- 172.21.15.55:0/3806815931 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f86080b8900 0x7f8608169610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T12:32:57.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.430+0000 7f860559a640 1 -- 172.21.15.55:0/3806815931 >> v1:172.21.15.55:6789/0 conn(0x7f860815eb00 legacy=0x7f86080d3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:57.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.430+0000 7f860559a640 1 --2- 172.21.15.55:0/3806815931 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f85f0003b70 0x7f85f0003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:57.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.430+0000 7f860559a640 1 --2- 172.21.15.55:0/3806815931 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f86080b8900 0x7f85f0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:57.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.430+0000 7f860559a640 1 --2- 172.21.15.55:0/3806815931 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85f0004d40 0x7f85f00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:57.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.430+0000 7f860559a640 1 -- 172.21.15.55:0/3806815931 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f86080d5700 con 0x7f85f0004d40 2024-05-27T12:32:57.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.430+0000 7f860559a640 1 -- 172.21.15.55:0/3806815931 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f85f000ba70 con 0x7f85f0003b70 2024-05-27T12:32:57.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.430+0000 7f860559a640 1 -- 172.21.15.55:0/3806815931 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f85f000bc70 con 0x7f86080b8900 2024-05-27T12:32:57.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.430+0000 7f8606d9d640 1 --2- 172.21.15.55:0/3806815931 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85f0004d40 0x7f85f00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:57.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.430+0000 7f860659c640 1 --2- 172.21.15.55:0/3806815931 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f85f0003b70 0x7f85f0003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:57.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.430+0000 7f8605d9b640 1 --2- 172.21.15.55:0/3806815931 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f86080b8900 0x7f85f0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:57.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.430+0000 7f8606d9d640 1 -- 172.21.15.55:0/3806815931 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f86080b8900 msgr2=0x7f85f0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:32:57.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.430+0000 7f8606d9d640 1 --2- 172.21.15.55:0/3806815931 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f86080b8900 0x7f85f0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:57.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.430+0000 7f8606d9d640 1 -- 172.21.15.55:0/3806815931 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f85f0003b70 msgr2=0x7f85f0003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:32:57.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.430+0000 7f8606d9d640 1 --2- 172.21.15.55:0/3806815931 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f85f0003b70 0x7f85f0003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:57.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.430+0000 7f8606d9d640 1 -- 172.21.15.55:0/3806815931 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85f0003520 con 0x7f85f0004d40 2024-05-27T12:32:57.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.431+0000 7f8606d9d640 1 --2- 172.21.15.55:0/3806815931 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85f0004d40 0x7f85f00051c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f860000e350 tx=0x7f85f0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2be90bfaf2a9a64 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:57.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.431+0000 7f860559a640 1 -- 172.21.15.55:0/3806815931 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8600033070 con 0x7f85f0004d40 2024-05-27T12:32:57.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.431+0000 7f860559a640 1 -- 172.21.15.55:0/3806815931 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f860002f660 con 0x7f85f0004d40 2024-05-27T12:32:57.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.431+0000 7f860559a640 1 -- 172.21.15.55:0/3806815931 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8600009de0 con 0x7f85f0004d40 2024-05-27T12:32:57.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.432+0000 7f860c99b640 1 -- 172.21.15.55:0/3806815931 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85f0004d40 msgr2=0x7f85f00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:57.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.432+0000 7f860c99b640 1 --2- 172.21.15.55:0/3806815931 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85f0004d40 0x7f85f00051c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f860000e350 tx=0x7f85f0005830 comp rx=0 tx=0).stop 2024-05-27T12:32:57.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.432+0000 7f8606d9d640 1 -- 172.21.15.55:0/3806815931 reap_dead start 2024-05-27T12:32:57.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.432+0000 7f860c99b640 1 -- 172.21.15.55:0/3806815931 shutdown_connections 2024-05-27T12:32:57.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.432+0000 7f860c99b640 1 -- 172.21.15.55:0/3806815931 >> 172.21.15.55:0/3806815931 conn(0x7f8608067a50 msgr2=0x7f8608067e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:57.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.432+0000 7f860c99b640 1 -- 172.21.15.55:0/3806815931 shutdown_connections 2024-05-27T12:32:57.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.432+0000 7f860c99b640 1 -- 172.21.15.55:0/3806815931 wait complete. 2024-05-27T12:32:57.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.433+0000 7f860c99b640 1 Processor -- start 2024-05-27T12:32:57.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.433+0000 7f860c99b640 1 -- start start 2024-05-27T12:32:57.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.434+0000 7f860c99b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85f0004d40 0x7f86081463f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:57.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.434+0000 7f860c99b640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8608146930 0x7f86080b7480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:57.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.434+0000 7f860c99b640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86080b79c0 0x7f86080c8400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:57.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.434+0000 7f860c99b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f86080d51e0 con 0x7f85f0004d40 2024-05-27T12:32:57.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.434+0000 7f860c99b640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f86080d4f00 con 0x7f86080b79c0 2024-05-27T12:32:57.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.434+0000 7f860c99b640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f86080d1f40 con 0x7f8608146930 2024-05-27T12:32:57.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.434+0000 7f860659c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85f0004d40 0x7f86081463f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:57.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.434+0000 7f860659c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85f0004d40 0x7f86081463f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57674/0 (socket says 172.21.15.55:57674) 2024-05-27T12:32:57.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.434+0000 7f860659c640 1 -- 172.21.15.55:0/76445709 learned_addr learned my addr 172.21.15.55:0/76445709 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:32:57.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.434+0000 7f8605d9b640 1 --2- 172.21.15.55:0/76445709 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8608146930 0x7f86080b7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:57.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.434+0000 7f8606d9d640 1 --2- 172.21.15.55:0/76445709 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86080b79c0 0x7f86080c8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:57.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.434+0000 7f860659c640 1 -- 172.21.15.55:0/76445709 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8608146930 msgr2=0x7f86080b7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:57.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.434+0000 7f860659c640 1 --2- 172.21.15.55:0/76445709 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8608146930 0x7f86080b7480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:57.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.434+0000 7f860659c640 1 -- 172.21.15.55:0/76445709 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86080b79c0 msgr2=0x7f86080c8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:57.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.434+0000 7f860659c640 1 --2- 172.21.15.55:0/76445709 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86080b79c0 0x7f86080c8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:57.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.434+0000 7f860659c640 1 -- 172.21.15.55:0/76445709 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8608146dc0 con 0x7f85f0004d40 2024-05-27T12:32:57.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.435+0000 7f860659c640 1 --2- 172.21.15.55:0/76445709 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85f0004d40 0x7f86081463f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f85f80072c0 tx=0x7f85f8007780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:57.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.435+0000 7f85f6ffd640 1 -- 172.21.15.55:0/76445709 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85f8001670 con 0x7f85f0004d40 2024-05-27T12:32:57.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.435+0000 7f85f6ffd640 1 -- 172.21.15.55:0/76445709 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85f8018070 con 0x7f85f0004d40 2024-05-27T12:32:57.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.435+0000 7f85f6ffd640 1 -- 172.21.15.55:0/76445709 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85f800fb80 con 0x7f85f0004d40 2024-05-27T12:32:57.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.435+0000 7f860c99b640 1 -- 172.21.15.55:0/76445709 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8608147080 con 0x7f85f0004d40 2024-05-27T12:32:57.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.435+0000 7f860c99b640 1 -- 172.21.15.55:0/76445709 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8608147640 con 0x7f85f0004d40 2024-05-27T12:32:57.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.436+0000 7f860c99b640 1 -- 172.21.15.55:0/76445709 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8608068a70 con 0x7f85f0004d40 2024-05-27T12:32:57.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.436+0000 7f85f6ffd640 1 -- 172.21.15.55:0/76445709 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f85f800fd20 con 0x7f85f0004d40 2024-05-27T12:32:57.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.437+0000 7f85f6ffd640 1 --2- 172.21.15.55:0/76445709 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f85e806c8f0 0x7f85e806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:57.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.437+0000 7f85f6ffd640 1 -- 172.21.15.55:0/76445709 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f85f808b970 con 0x7f85f0004d40 2024-05-27T12:32:57.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.437+0000 7f8605d9b640 1 --2- 172.21.15.55:0/76445709 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f85e806c8f0 0x7f85e806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:57.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.437+0000 7f8605d9b640 1 --2- 172.21.15.55:0/76445709 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f85e806c8f0 0x7f85e806edb0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f860815d6b0 tx=0x7f85fc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:57.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.441+0000 7f85f6ffd640 1 -- 172.21.15.55:0/76445709 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f85f80597e0 con 0x7f85f0004d40 2024-05-27T12:32:57.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.630+0000 7f860c99b640 1 -- 172.21.15.55:0/76445709 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f86080c7fd0 con 0x7f85f0004d40 2024-05-27T12:32:57.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.631+0000 7f85f6ffd640 1 -- 172.21.15.55:0/76445709 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) ==== 104+0+11 (secure 0 0 0) 0x7f85f805dae0 con 0x7f85f0004d40 2024-05-27T12:32:57.630 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2024-05-27T12:32:57.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.633+0000 7f860c99b640 1 -- 172.21.15.55:0/76445709 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f85e806c8f0 msgr2=0x7f85e806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:57.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.633+0000 7f860c99b640 1 --2- 172.21.15.55:0/76445709 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f85e806c8f0 0x7f85e806edb0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f860815d6b0 tx=0x7f85fc009040 comp rx=0 tx=0).stop 2024-05-27T12:32:57.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.633+0000 7f860c99b640 1 -- 172.21.15.55:0/76445709 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85f0004d40 msgr2=0x7f86081463f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:57.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.633+0000 7f860c99b640 1 --2- 172.21.15.55:0/76445709 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85f0004d40 0x7f86081463f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f85f80072c0 tx=0x7f85f8007780 comp rx=0 tx=0).stop 2024-05-27T12:32:57.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.633+0000 7f860c99b640 1 -- 172.21.15.55:0/76445709 shutdown_connections 2024-05-27T12:32:57.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.633+0000 7f860c99b640 1 --2- 172.21.15.55:0/76445709 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f85e806c8f0 0x7f85e806edb0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:57.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.633+0000 7f860c99b640 1 --2- 172.21.15.55:0/76445709 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86080b79c0 0x7f86080c8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:57.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.633+0000 7f860c99b640 1 --2- 172.21.15.55:0/76445709 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8608146930 0x7f86080b7480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:57.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.633+0000 7f860c99b640 1 --2- 172.21.15.55:0/76445709 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85f0004d40 0x7f86081463f0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:57.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.633+0000 7f860c99b640 1 -- 172.21.15.55:0/76445709 >> 172.21.15.55:0/76445709 conn(0x7f8608067a50 msgr2=0x7f86080b95f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:57.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.633+0000 7f860c99b640 1 -- 172.21.15.55:0/76445709 shutdown_connections 2024-05-27T12:32:57.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.633+0000 7f860c99b640 1 -- 172.21.15.55:0/76445709 wait complete. 2024-05-27T12:32:57.643 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-27T12:32:57.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.750+0000 7f7ce479b640 1 Processor -- start 2024-05-27T12:32:57.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.750+0000 7f7ce479b640 1 -- start start 2024-05-27T12:32:57.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.751+0000 7f7ce479b640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7cdc147920 0x7f7cdc0b2610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:57.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.751+0000 7f7ce479b640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7cdc0ce020 con 0x7f7cdc06c0b0 2024-05-27T12:32:57.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.751+0000 7f7ce479b640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7cdc0ce300 con 0x7f7cdc0b2b50 2024-05-27T12:32:57.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.752+0000 7f7ce479b640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f7cdc0cec30 con 0x7f7cdc147920 2024-05-27T12:32:57.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.752+0000 7f7ce2d38640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f7cdc06c0b0 0x7f7cdc0b1070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:36988/0 (socket says 172.21.15.55:36988) 2024-05-27T12:32:57.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.752+0000 7f7ce2d38640 1 -- 172.21.15.55:0/1526404139 learned_addr learned my addr 172.21.15.55:0/1526404139 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-27T12:32:57.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.752+0000 7f7ce2537640 1 --2- 172.21.15.55:0/1526404139 >> v2:172.21.15.72:3300/0 conn(0x7f7cdc147920 0x7f7cdc0b2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:57.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.752+0000 7f7ce1535640 1 -- 172.21.15.55:0/1526404139 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1742047227 0 0) 0x7f7cdc0ce020 con 0x7f7cdc06c0b0 2024-05-27T12:32:57.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.752+0000 7f7ce1535640 1 -- 172.21.15.55:0/1526404139 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7cc8003520 con 0x7f7cdc06c0b0 2024-05-27T12:32:57.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.752+0000 7f7ce1535640 1 -- 172.21.15.55:0/1526404139 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3827359341 0 0) 0x7f7cc8003520 con 0x7f7cdc06c0b0 2024-05-27T12:32:57.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.752+0000 7f7ce1535640 1 -- 172.21.15.55:0/1526404139 >> v2:172.21.15.72:3300/0 conn(0x7f7cdc147920 msgr2=0x7f7cdc0b2610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:32:57.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.752+0000 7f7ce1535640 1 --2- 172.21.15.55:0/1526404139 >> v2:172.21.15.72:3300/0 conn(0x7f7cdc147920 0x7f7cdc0b2610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:57.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.752+0000 7f7ce1535640 1 -- 172.21.15.55:0/1526404139 >> v1:172.21.15.72:6789/0 conn(0x7f7cdc0b2b50 legacy=0x7f7cdc06b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:57.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.752+0000 7f7ce1535640 1 -- 172.21.15.55:0/1526404139 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cdc0ce5e0 con 0x7f7cdc06c0b0 2024-05-27T12:32:57.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.752+0000 7f7ce1535640 1 -- 172.21.15.55:0/1526404139 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 793017739 0 0) 0x7f7cd40019f0 con 0x7f7cdc06c0b0 2024-05-27T12:32:57.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.752+0000 7f7ce1535640 1 -- 172.21.15.55:0/1526404139 >> v1:172.21.15.55:6789/0 conn(0x7f7cdc06c0b0 legacy=0x7f7cdc0b1070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:57.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.752+0000 7f7ce1535640 1 --2- 172.21.15.55:0/1526404139 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7cc80039b0 0x7f7cc8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:57.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.752+0000 7f7ce1535640 1 --2- 172.21.15.55:0/1526404139 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7cc8004800 0x7f7cc8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:57.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.752+0000 7f7ce1535640 1 --2- 172.21.15.55:0/1526404139 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7cc80051c0 0x7f7cc800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:57.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.752+0000 7f7ce1535640 1 -- 172.21.15.55:0/1526404139 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f7cdc0cec30 con 0x7f7cc80051c0 2024-05-27T12:32:57.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.752+0000 7f7ce1535640 1 -- 172.21.15.55:0/1526404139 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f7cc800c060 con 0x7f7cc8004800 2024-05-27T12:32:57.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.752+0000 7f7ce1535640 1 -- 172.21.15.55:0/1526404139 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f7cc800c260 con 0x7f7cc80039b0 2024-05-27T12:32:57.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.752+0000 7f7ce2d38640 1 --2- 172.21.15.55:0/1526404139 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7cc80051c0 0x7f7cc800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:57.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.752+0000 7f7ce1d36640 1 --2- 172.21.15.55:0/1526404139 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7cc8004800 0x7f7cc8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:57.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.752+0000 7f7ce2537640 1 --2- 172.21.15.55:0/1526404139 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7cc80039b0 0x7f7cc8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:57.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.753+0000 7f7ce2d38640 1 -- 172.21.15.55:0/1526404139 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7cc80039b0 msgr2=0x7f7cc8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:32:57.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.753+0000 7f7ce2d38640 1 --2- 172.21.15.55:0/1526404139 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7cc80039b0 0x7f7cc8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:57.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.753+0000 7f7ce2d38640 1 -- 172.21.15.55:0/1526404139 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7cc8004800 msgr2=0x7f7cc8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:32:57.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.753+0000 7f7ce2d38640 1 --2- 172.21.15.55:0/1526404139 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7cc8004800 0x7f7cc8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:57.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.753+0000 7f7ce2d38640 1 -- 172.21.15.55:0/1526404139 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cc8003520 con 0x7f7cc80051c0 2024-05-27T12:32:57.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.753+0000 7f7ce2d38640 1 -- 172.21.15.55:0/1526404139 reap_dead start 2024-05-27T12:32:57.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.753+0000 7f7ce2d38640 1 --2- 172.21.15.55:0/1526404139 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7cc80051c0 0x7f7cc800b9c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7cd400a830 tx=0x7f7cc8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8442cb3a694fbff9 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:57.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.753+0000 7f7ce1535640 1 -- 172.21.15.55:0/1526404139 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cd400a480 con 0x7f7cc80051c0 2024-05-27T12:32:57.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.753+0000 7f7ce1535640 1 -- 172.21.15.55:0/1526404139 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7cd402f070 con 0x7f7cc80051c0 2024-05-27T12:32:57.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.753+0000 7f7ce1535640 1 -- 172.21.15.55:0/1526404139 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cd402bc90 con 0x7f7cc80051c0 2024-05-27T12:32:57.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.754+0000 7f7ce479b640 1 -- 172.21.15.55:0/1526404139 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7cc80051c0 msgr2=0x7f7cc800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:57.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.754+0000 7f7ce479b640 1 --2- 172.21.15.55:0/1526404139 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7cc80051c0 0x7f7cc800b9c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7cd400a830 tx=0x7f7cc8005830 comp rx=0 tx=0).stop 2024-05-27T12:32:57.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.754+0000 7f7ce479b640 1 -- 172.21.15.55:0/1526404139 shutdown_connections 2024-05-27T12:32:57.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.754+0000 7f7ce479b640 1 --2- 172.21.15.55:0/1526404139 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7cc80051c0 0x7f7cc800b9c0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:57.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.754+0000 7f7ce479b640 1 -- 172.21.15.55:0/1526404139 >> 172.21.15.55:0/1526404139 conn(0x7f7cdc0734b0 msgr2=0x7f7cdc09aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:57.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.754+0000 7f7ce479b640 1 -- 172.21.15.55:0/1526404139 shutdown_connections 2024-05-27T12:32:57.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.754+0000 7f7ce479b640 1 -- 172.21.15.55:0/1526404139 wait complete. 2024-05-27T12:32:57.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.755+0000 7f7ce479b640 1 Processor -- start 2024-05-27T12:32:57.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.755+0000 7f7ce479b640 1 -- start start 2024-05-27T12:32:57.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.756+0000 7f7ce479b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7cc80051c0 0x7f7cdc1f51a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:57.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.756+0000 7f7ce479b640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7cdc0b5ba0 0x7f7cdc15e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:57.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.756+0000 7f7ce479b640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7cdc1453f0 0x7f7cdc145870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:57.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.756+0000 7f7ce479b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f7cdc0b2610 con 0x7f7cc80051c0 2024-05-27T12:32:57.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.756+0000 7f7ce479b640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f7cdc147d00 con 0x7f7cdc0b5ba0 2024-05-27T12:32:57.759 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.756+0000 7f7ce479b640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f7cdc0b2790 con 0x7f7cdc1453f0 2024-05-27T12:32:57.759 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.756+0000 7f7ce2537640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7cc80051c0 0x7f7cdc1f51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:57.759 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.756+0000 7f7ce2537640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7cc80051c0 0x7f7cdc1f51a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57702/0 (socket says 172.21.15.55:57702) 2024-05-27T12:32:57.759 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.756+0000 7f7ce2537640 1 -- 172.21.15.55:0/2060918647 learned_addr learned my addr 172.21.15.55:0/2060918647 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:32:57.759 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.756+0000 7f7ce1d36640 1 --2- 172.21.15.55:0/2060918647 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7cdc0b5ba0 0x7f7cdc15e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:57.759 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.756+0000 7f7ce2d38640 1 --2- 172.21.15.55:0/2060918647 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7cdc1453f0 0x7f7cdc145870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:57.759 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.757+0000 7f7ce2537640 1 -- 172.21.15.55:0/2060918647 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7cdc1453f0 msgr2=0x7f7cdc145870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:57.759 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.757+0000 7f7ce2537640 1 --2- 172.21.15.55:0/2060918647 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7cdc1453f0 0x7f7cdc145870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:57.759 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.757+0000 7f7ce2537640 1 -- 172.21.15.55:0/2060918647 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7cdc0b5ba0 msgr2=0x7f7cdc15e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:57.759 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.757+0000 7f7ce2537640 1 --2- 172.21.15.55:0/2060918647 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7cdc0b5ba0 0x7f7cdc15e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:57.759 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.757+0000 7f7ce2537640 1 -- 172.21.15.55:0/2060918647 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cdc0b43a0 con 0x7f7cc80051c0 2024-05-27T12:32:57.759 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.757+0000 7f7ce2537640 1 --2- 172.21.15.55:0/2060918647 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7cc80051c0 0x7f7cdc1f51a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f7cd80118e0 tx=0x7f7cd8011da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:57.759 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.757+0000 7f7cd2ffd640 1 -- 172.21.15.55:0/2060918647 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cd800faf0 con 0x7f7cc80051c0 2024-05-27T12:32:57.760 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.757+0000 7f7cd2ffd640 1 -- 172.21.15.55:0/2060918647 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7cd800fc90 con 0x7f7cc80051c0 2024-05-27T12:32:57.760 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.757+0000 7f7ce479b640 1 -- 172.21.15.55:0/2060918647 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cdc0b6750 con 0x7f7cc80051c0 2024-05-27T12:32:57.760 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.757+0000 7f7cd2ffd640 1 -- 172.21.15.55:0/2060918647 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cd8014440 con 0x7f7cc80051c0 2024-05-27T12:32:57.760 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.757+0000 7f7ce479b640 1 -- 172.21.15.55:0/2060918647 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cdc0b4610 con 0x7f7cc80051c0 2024-05-27T12:32:57.760 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.758+0000 7f7ce479b640 1 -- 172.21.15.55:0/2060918647 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7cdc067a00 con 0x7f7cc80051c0 2024-05-27T12:32:57.760 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.758+0000 7f7cd2ffd640 1 -- 172.21.15.55:0/2060918647 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7cd8012040 con 0x7f7cc80051c0 2024-05-27T12:32:57.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.759+0000 7f7cd2ffd640 1 --2- 172.21.15.55:0/2060918647 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f7cc006c920 0x7f7cc006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:57.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.759+0000 7f7cd2ffd640 1 -- 172.21.15.55:0/2060918647 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f7cd808c120 con 0x7f7cc80051c0 2024-05-27T12:32:57.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.759+0000 7f7ce1d36640 1 --2- 172.21.15.55:0/2060918647 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f7cc006c920 0x7f7cc006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:57.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.760+0000 7f7ce1d36640 1 --2- 172.21.15.55:0/2060918647 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f7cc006c920 0x7f7cc006ede0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7ccc000c00 tx=0x7f7ccc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:57.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.763+0000 7f7cd2ffd640 1 -- 172.21.15.55:0/2060918647 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7cdc067a00 con 0x7f7cc80051c0 2024-05-27T12:32:57.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.949+0000 7f7ce479b640 1 -- 172.21.15.55:0/2060918647 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f7cdc068a70 con 0x7f7cc80051c0 2024-05-27T12:32:57.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.949+0000 7f7cd2ffd640 1 -- 172.21.15.55:0/2060918647 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) ==== 100+0+11 (secure 0 0 0) 0x7f7cd8019030 con 0x7f7cc80051c0 2024-05-27T12:32:57.948 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2024-05-27T12:32:57.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.951+0000 7f7ce479b640 1 -- 172.21.15.55:0/2060918647 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f7cc006c920 msgr2=0x7f7cc006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:57.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.951+0000 7f7ce479b640 1 --2- 172.21.15.55:0/2060918647 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f7cc006c920 0x7f7cc006ede0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7ccc000c00 tx=0x7f7ccc009040 comp rx=0 tx=0).stop 2024-05-27T12:32:57.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.951+0000 7f7ce479b640 1 -- 172.21.15.55:0/2060918647 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7cc80051c0 msgr2=0x7f7cdc1f51a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:57.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.951+0000 7f7ce479b640 1 --2- 172.21.15.55:0/2060918647 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7cc80051c0 0x7f7cdc1f51a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f7cd80118e0 tx=0x7f7cd8011da0 comp rx=0 tx=0).stop 2024-05-27T12:32:57.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.951+0000 7f7ce479b640 1 -- 172.21.15.55:0/2060918647 shutdown_connections 2024-05-27T12:32:57.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.951+0000 7f7ce479b640 1 --2- 172.21.15.55:0/2060918647 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7cdc1453f0 0x7f7cdc145870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:57.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.951+0000 7f7ce479b640 1 --2- 172.21.15.55:0/2060918647 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f7cc006c920 0x7f7cc006ede0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:57.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.951+0000 7f7ce479b640 1 --2- 172.21.15.55:0/2060918647 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7cdc0b5ba0 0x7f7cdc15e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:57.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.951+0000 7f7ce479b640 1 --2- 172.21.15.55:0/2060918647 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7cc80051c0 0x7f7cdc1f51a0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:57.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.951+0000 7f7ce479b640 1 -- 172.21.15.55:0/2060918647 >> 172.21.15.55:0/2060918647 conn(0x7f7cdc0734b0 msgr2=0x7f7cdc0b1270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:57.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.951+0000 7f7ce479b640 1 -- 172.21.15.55:0/2060918647 shutdown_connections 2024-05-27T12:32:57.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:57.951+0000 7f7ce479b640 1 -- 172.21.15.55:0/2060918647 wait complete. 2024-05-27T12:32:57.961 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-27T12:32:58.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.067+0000 7f9591544640 1 Processor -- start 2024-05-27T12:32:58.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.067+0000 7f9591544640 1 -- start start 2024-05-27T12:32:58.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.068+0000 7f9591544640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f958c0b3860 0x7f958c0b3db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:58.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.068+0000 7f9591544640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f958c1632f0 con 0x7f958c0b6370 2024-05-27T12:32:58.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.068+0000 7f9591544640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f958c1635d0 con 0x7f958c15ec00 2024-05-27T12:32:58.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.068+0000 7f9591544640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f958c0cf2e0 con 0x7f958c0b3860 2024-05-27T12:32:58.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.068+0000 7f958b7fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f958c0b6370 0x7f958c0d2980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:36990/0 (socket says 172.21.15.55:36990) 2024-05-27T12:32:58.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.068+0000 7f958b7fe640 1 -- 172.21.15.55:0/3489301096 learned_addr learned my addr 172.21.15.55:0/3489301096 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-27T12:32:58.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.068+0000 7f958a7fc640 1 --2- 172.21.15.55:0/3489301096 >> v2:172.21.15.72:3300/0 conn(0x7f958c0b3860 0x7f958c0b3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:58.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.068+0000 7f9589ffb640 1 -- 172.21.15.55:0/3489301096 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2242314522 0 0) 0x7f958c1632f0 con 0x7f958c0b6370 2024-05-27T12:32:58.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.068+0000 7f9589ffb640 1 -- 172.21.15.55:0/3489301096 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9578003520 con 0x7f958c0b6370 2024-05-27T12:32:58.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.069+0000 7f9589ffb640 1 -- 172.21.15.55:0/3489301096 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 647380709 0 0) 0x7f9578003520 con 0x7f958c0b6370 2024-05-27T12:32:58.071 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.069+0000 7f9589ffb640 1 -- 172.21.15.55:0/3489301096 >> v2:172.21.15.72:3300/0 conn(0x7f958c0b3860 msgr2=0x7f958c0b3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:32:58.071 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.069+0000 7f9589ffb640 1 --2- 172.21.15.55:0/3489301096 >> v2:172.21.15.72:3300/0 conn(0x7f958c0b3860 0x7f958c0b3db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:58.071 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.069+0000 7f9589ffb640 1 -- 172.21.15.55:0/3489301096 >> v1:172.21.15.72:6789/0 conn(0x7f958c15ec00 legacy=0x7f958c0cfd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:58.071 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.069+0000 7f9589ffb640 1 -- 172.21.15.55:0/3489301096 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f958c0cf530 con 0x7f958c0b6370 2024-05-27T12:32:58.071 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.069+0000 7f9589ffb640 1 -- 172.21.15.55:0/3489301096 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 793017739 0 0) 0x7f957c0019f0 con 0x7f958c0b6370 2024-05-27T12:32:58.071 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.069+0000 7f9589ffb640 1 -- 172.21.15.55:0/3489301096 >> v1:172.21.15.55:6789/0 conn(0x7f958c0b6370 legacy=0x7f958c0d2980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:58.071 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.069+0000 7f9589ffb640 1 --2- 172.21.15.55:0/3489301096 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9578003a90 0x7f9578003eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:58.071 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.069+0000 7f9589ffb640 1 --2- 172.21.15.55:0/3489301096 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9578004800 0x7f9578004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:58.071 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.069+0000 7f9589ffb640 1 --2- 172.21.15.55:0/3489301096 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9578005210 0x7f957800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:58.071 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.069+0000 7f9589ffb640 1 -- 172.21.15.55:0/3489301096 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f958c0cf2e0 con 0x7f9578004800 2024-05-27T12:32:58.071 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.069+0000 7f9589ffb640 1 -- 172.21.15.55:0/3489301096 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f957800c140 con 0x7f9578005210 2024-05-27T12:32:58.071 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.069+0000 7f9589ffb640 1 -- 172.21.15.55:0/3489301096 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f957800c340 con 0x7f9578003a90 2024-05-27T12:32:58.071 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.069+0000 7f958a7fc640 1 --2- 172.21.15.55:0/3489301096 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9578004800 0x7f9578004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:58.071 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.069+0000 7f958affd640 1 --2- 172.21.15.55:0/3489301096 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9578003a90 0x7f9578003eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:58.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.069+0000 7f958b7fe640 1 --2- 172.21.15.55:0/3489301096 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9578005210 0x7f957800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:58.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.069+0000 7f958a7fc640 1 -- 172.21.15.55:0/3489301096 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9578003a90 msgr2=0x7f9578003eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:32:58.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.069+0000 7f958a7fc640 1 --2- 172.21.15.55:0/3489301096 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9578003a90 0x7f9578003eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:58.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.069+0000 7f958a7fc640 1 -- 172.21.15.55:0/3489301096 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9578005210 msgr2=0x7f957800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:32:58.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.069+0000 7f958a7fc640 1 --2- 172.21.15.55:0/3489301096 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9578005210 0x7f957800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:58.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.069+0000 7f958a7fc640 1 -- 172.21.15.55:0/3489301096 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9578003520 con 0x7f9578004800 2024-05-27T12:32:58.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.069+0000 7f958b7fe640 1 -- 172.21.15.55:0/3489301096 reap_dead start 2024-05-27T12:32:58.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.070+0000 7f958a7fc640 1 --2- 172.21.15.55:0/3489301096 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9578004800 0x7f9578004c80 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f9574009a90 tx=0x7f9578005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b410ea54b4d5a5c server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:58.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.070+0000 7f9589ffb640 1 -- 172.21.15.55:0/3489301096 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9574036070 con 0x7f9578004800 2024-05-27T12:32:58.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.070+0000 7f9589ffb640 1 -- 172.21.15.55:0/3489301096 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9574031400 con 0x7f9578004800 2024-05-27T12:32:58.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.070+0000 7f9589ffb640 1 -- 172.21.15.55:0/3489301096 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9574009690 con 0x7f9578004800 2024-05-27T12:32:58.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.071+0000 7f9591544640 1 -- 172.21.15.55:0/3489301096 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9578004800 msgr2=0x7f9578004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:58.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.071+0000 7f9591544640 1 --2- 172.21.15.55:0/3489301096 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9578004800 0x7f9578004c80 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f9574009a90 tx=0x7f9578005830 comp rx=0 tx=0).stop 2024-05-27T12:32:58.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.071+0000 7f9591544640 1 -- 172.21.15.55:0/3489301096 shutdown_connections 2024-05-27T12:32:58.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.071+0000 7f9591544640 1 --2- 172.21.15.55:0/3489301096 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9578004800 0x7f9578004c80 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:58.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.071+0000 7f9591544640 1 -- 172.21.15.55:0/3489301096 >> 172.21.15.55:0/3489301096 conn(0x7f958c0d1370 msgr2=0x7f958c0d1780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:58.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.071+0000 7f9591544640 1 -- 172.21.15.55:0/3489301096 shutdown_connections 2024-05-27T12:32:58.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.071+0000 7f9591544640 1 -- 172.21.15.55:0/3489301096 wait complete. 2024-05-27T12:32:58.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.072+0000 7f9591544640 1 Processor -- start 2024-05-27T12:32:58.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.072+0000 7f9591544640 1 -- start start 2024-05-27T12:32:58.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.073+0000 7f9591544640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9578004800 0x7f958c160a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:58.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.073+0000 7f9591544640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f958c15f340 0x7f958c152e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:58.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.073+0000 7f9591544640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f958c0ce2c0 0x7f958c0b8f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:58.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.073+0000 7f9591544640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f958c15efe0 con 0x7f9578004800 2024-05-27T12:32:58.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.073+0000 7f9591544640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f958c0b3530 con 0x7f958c0ce2c0 2024-05-27T12:32:58.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.073+0000 7f9591544640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f958c15f160 con 0x7f958c15f340 2024-05-27T12:32:58.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.073+0000 7f958affd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9578004800 0x7f958c160a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:58.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.073+0000 7f958affd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9578004800 0x7f958c160a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57724/0 (socket says 172.21.15.55:57724) 2024-05-27T12:32:58.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.073+0000 7f958affd640 1 -- 172.21.15.55:0/4201407764 learned_addr learned my addr 172.21.15.55:0/4201407764 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:32:58.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.073+0000 7f958b7fe640 1 --2- 172.21.15.55:0/4201407764 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f958c0ce2c0 0x7f958c0b8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:58.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.073+0000 7f958a7fc640 1 --2- 172.21.15.55:0/4201407764 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f958c15f340 0x7f958c152e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:58.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.073+0000 7f958affd640 1 -- 172.21.15.55:0/4201407764 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f958c15f340 msgr2=0x7f958c152e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:58.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.073+0000 7f958affd640 1 --2- 172.21.15.55:0/4201407764 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f958c15f340 0x7f958c152e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:58.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.073+0000 7f958affd640 1 -- 172.21.15.55:0/4201407764 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f958c0ce2c0 msgr2=0x7f958c0b8f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:58.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.073+0000 7f958affd640 1 --2- 172.21.15.55:0/4201407764 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f958c0ce2c0 0x7f958c0b8f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:58.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.073+0000 7f958affd640 1 -- 172.21.15.55:0/4201407764 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f958c1533b0 con 0x7f9578004800 2024-05-27T12:32:58.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.073+0000 7f958affd640 1 --2- 172.21.15.55:0/4201407764 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9578004800 0x7f958c160a30 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f958400f5f0 tx=0x7f958400fab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:58.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.073+0000 7f95837fe640 1 -- 172.21.15.55:0/4201407764 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95840052e0 con 0x7f9578004800 2024-05-27T12:32:58.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.073+0000 7f95837fe640 1 -- 172.21.15.55:0/4201407764 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9584018070 con 0x7f9578004800 2024-05-27T12:32:58.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.073+0000 7f9591544640 1 -- 172.21.15.55:0/4201407764 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f958c15f990 con 0x7f9578004800 2024-05-27T12:32:58.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.073+0000 7f95837fe640 1 -- 172.21.15.55:0/4201407764 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9584003810 con 0x7f9578004800 2024-05-27T12:32:58.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.073+0000 7f9591544640 1 -- 172.21.15.55:0/4201407764 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f958c15ff50 con 0x7f9578004800 2024-05-27T12:32:58.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.075+0000 7f9591544640 1 -- 172.21.15.55:0/4201407764 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f958c15f720 con 0x7f9578004800 2024-05-27T12:32:58.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.075+0000 7f95837fe640 1 -- 172.21.15.55:0/4201407764 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f95840039b0 con 0x7f9578004800 2024-05-27T12:32:58.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.076+0000 7f95837fe640 1 --2- 172.21.15.55:0/4201407764 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f956c06c920 0x7f956c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:58.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.076+0000 7f95837fe640 1 -- 172.21.15.55:0/4201407764 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f958408b940 con 0x7f9578004800 2024-05-27T12:32:58.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.076+0000 7f958a7fc640 1 --2- 172.21.15.55:0/4201407764 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f956c06c920 0x7f956c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:58.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.076+0000 7f958a7fc640 1 --2- 172.21.15.55:0/4201407764 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f956c06c920 0x7f956c06ede0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9574033000 tx=0x7f9574008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:58.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.080+0000 7f95837fe640 1 -- 172.21.15.55:0/4201407764 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f958c1533b0 con 0x7f9578004800 2024-05-27T12:32:58.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.306+0000 7f9591544640 1 -- 172.21.15.55:0/4201407764 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f958c075460 con 0x7f9578004800 2024-05-27T12:32:58.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.307+0000 7f95837fe640 1 -- 172.21.15.55:0/4201407764 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5166 (secure 0 0 0) 0x7f9584059d70 con 0x7f9578004800 2024-05-27T12:32:58.306 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-27T12:32:58.306 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/1501264038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":1501264038},{"type":"v1","addr":"172.21.15.55:6834","nonce":1501264038}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/3311546358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":3311546358},{"type":"v1","addr":"172.21.15.55:6835","nonce":3311546358}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4282,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/138819105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6835","nonce":138819105},{"type":"v1","addr":"172.21.15.72:6837","nonce":138819105}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-27T12:32:41.727353+0000","modified":"2024-05-27T12:32:43.723059+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.72:6836/70510151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":70510151},{"type":"v1","addr":"172.21.15.72:6836","nonce":70510151}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4290,"qdb_cluster":[4290]},"id":1}]} 2024-05-27T12:32:58.306 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 6 2024-05-27T12:32:58.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.309+0000 7f9591544640 1 -- 172.21.15.55:0/4201407764 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f956c06c920 msgr2=0x7f956c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:58.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.309+0000 7f9591544640 1 --2- 172.21.15.55:0/4201407764 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f956c06c920 0x7f956c06ede0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9574033000 tx=0x7f9574008030 comp rx=0 tx=0).stop 2024-05-27T12:32:58.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.309+0000 7f9591544640 1 -- 172.21.15.55:0/4201407764 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9578004800 msgr2=0x7f958c160a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:58.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.309+0000 7f9591544640 1 --2- 172.21.15.55:0/4201407764 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9578004800 0x7f958c160a30 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f958400f5f0 tx=0x7f958400fab0 comp rx=0 tx=0).stop 2024-05-27T12:32:58.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.309+0000 7f9591544640 1 -- 172.21.15.55:0/4201407764 shutdown_connections 2024-05-27T12:32:58.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.309+0000 7f9591544640 1 --2- 172.21.15.55:0/4201407764 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f956c06c920 0x7f956c06ede0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:58.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.309+0000 7f9591544640 1 --2- 172.21.15.55:0/4201407764 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f958c0ce2c0 0x7f958c0b8f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:58.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.309+0000 7f9591544640 1 --2- 172.21.15.55:0/4201407764 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f958c15f340 0x7f958c152e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:58.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.309+0000 7f9591544640 1 --2- 172.21.15.55:0/4201407764 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9578004800 0x7f958c160a30 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:58.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.309+0000 7f9591544640 1 -- 172.21.15.55:0/4201407764 >> 172.21.15.55:0/4201407764 conn(0x7f958c0d1370 msgr2=0x7f958c0d1750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:58.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.309+0000 7f9591544640 1 -- 172.21.15.55:0/4201407764 shutdown_connections 2024-05-27T12:32:58.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.309+0000 7f9591544640 1 -- 172.21.15.55:0/4201407764 wait complete. 2024-05-27T12:32:58.319 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-27T12:32:58.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.425+0000 7f267b943640 1 Processor -- start 2024-05-27T12:32:58.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.425+0000 7f267b943640 1 -- start start 2024-05-27T12:32:58.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.426+0000 7f267b943640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f267415eaf0 0x7f26740d2910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:58.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.426+0000 7f267b943640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f26740d1990 0x7f26740b79c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:58.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.426+0000 7f267b943640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26740d3280 con 0x7f26740ba5e0 2024-05-27T12:32:58.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.426+0000 7f267b943640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f26740d3e90 con 0x7f26740d1990 2024-05-27T12:32:58.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.426+0000 7f267b943640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f26740d3560 con 0x7f267415eaf0 2024-05-27T12:32:58.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.426+0000 7f2679ee0640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f26740d1990 0x7f26740b79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:58.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.426+0000 7f2679ee0640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f26740d1990 0x7f26740b79c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57726/0 (socket says 172.21.15.55:57726) 2024-05-27T12:32:58.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.426+0000 7f2679ee0640 1 -- 172.21.15.55:0/3704706363 learned_addr learned my addr 172.21.15.55:0/3704706363 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:32:58.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.426+0000 7f2679ee0640 1 -- 172.21.15.55:0/3704706363 >> v2:172.21.15.72:3300/0 conn(0x7f267415eaf0 msgr2=0x7f26740d2910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:32:58.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.426+0000 7f26796df640 1 --2- 172.21.15.55:0/3704706363 >> v2:172.21.15.72:3300/0 conn(0x7f267415eaf0 0x7f26740d2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:58.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.426+0000 7f2679ee0640 1 --2- 172.21.15.55:0/3704706363 >> v2:172.21.15.72:3300/0 conn(0x7f267415eaf0 0x7f26740d2910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:58.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.426+0000 7f2679ee0640 1 -- 172.21.15.55:0/3704706363 >> v1:172.21.15.72:6789/0 conn(0x7f26740ba5e0 legacy=0x7f26740d1280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:32:58.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.426+0000 7f2679ee0640 1 -- 172.21.15.55:0/3704706363 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26740d3840 con 0x7f26740d1990 2024-05-27T12:32:58.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.426+0000 7f26796df640 1 --2- 172.21.15.55:0/3704706363 >> v2:172.21.15.72:3300/0 conn(0x7f267415eaf0 0x7f26740d2910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T12:32:58.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.427+0000 7f2679ee0640 1 --2- 172.21.15.55:0/3704706363 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f26740d1990 0x7f26740b79c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f26740b7480 tx=0x7f266c02a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90f8132159820c6e server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:58.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.427+0000 7f266bfff640 1 -- 172.21.15.55:0/3704706363 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f266c037070 con 0x7f26740d1990 2024-05-27T12:32:58.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.427+0000 7f266bfff640 1 -- 172.21.15.55:0/3704706363 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f266c032440 con 0x7f26740d1990 2024-05-27T12:32:58.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.427+0000 7f266bfff640 1 -- 172.21.15.55:0/3704706363 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f266c032810 con 0x7f26740d1990 2024-05-27T12:32:58.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.428+0000 7f267b943640 1 -- 172.21.15.55:0/3704706363 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f26740d1990 msgr2=0x7f26740b79c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:58.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.428+0000 7f267b943640 1 --2- 172.21.15.55:0/3704706363 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f26740d1990 0x7f26740b79c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f26740b7480 tx=0x7f266c02a2c0 comp rx=0 tx=0).stop 2024-05-27T12:32:58.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.428+0000 7f267b943640 1 -- 172.21.15.55:0/3704706363 shutdown_connections 2024-05-27T12:32:58.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.428+0000 7f267b943640 1 --2- 172.21.15.55:0/3704706363 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f26740d1990 0x7f26740b79c0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:58.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.428+0000 7f267b943640 1 --2- 172.21.15.55:0/3704706363 >> v2:172.21.15.72:3300/0 conn(0x7f267415eaf0 0x7f26740d2910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:58.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.428+0000 7f267b943640 1 -- 172.21.15.55:0/3704706363 >> 172.21.15.55:0/3704706363 conn(0x7f267406cdb0 msgr2=0x7f267406d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:58.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.428+0000 7f267b943640 1 -- 172.21.15.55:0/3704706363 shutdown_connections 2024-05-27T12:32:58.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.428+0000 7f267b943640 1 -- 172.21.15.55:0/3704706363 wait complete. 2024-05-27T12:32:58.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.429+0000 7f267b943640 1 Processor -- start 2024-05-27T12:32:58.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.429+0000 7f267b943640 1 -- start start 2024-05-27T12:32:58.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.430+0000 7f267b943640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f26740ba5e0 0x7f26740cd500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:58.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.430+0000 7f267b943640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f26740d1990 0x7f26740cc2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:58.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.430+0000 7f267b943640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f267415eaf0 0x7f26740ca650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:58.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.430+0000 7f267b943640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f267415f050 con 0x7f267415eaf0 2024-05-27T12:32:58.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.430+0000 7f267b943640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f267415eed0 con 0x7f26740d1990 2024-05-27T12:32:58.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.430+0000 7f267b943640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f26740d2e50 con 0x7f26740ba5e0 2024-05-27T12:32:58.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.430+0000 7f2679ee0640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f267415eaf0 0x7f26740ca650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:58.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.430+0000 7f2679ee0640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f267415eaf0 0x7f26740ca650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57742/0 (socket says 172.21.15.55:57742) 2024-05-27T12:32:58.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.430+0000 7f2679ee0640 1 -- 172.21.15.55:0/3738653457 learned_addr learned my addr 172.21.15.55:0/3738653457 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:32:58.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.430+0000 7f2678ede640 1 --2- 172.21.15.55:0/3738653457 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f26740d1990 0x7f26740cc2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:58.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.430+0000 7f26796df640 1 --2- 172.21.15.55:0/3738653457 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f26740ba5e0 0x7f26740cd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:58.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.430+0000 7f2679ee0640 1 -- 172.21.15.55:0/3738653457 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f26740ba5e0 msgr2=0x7f26740cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:58.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.430+0000 7f2679ee0640 1 --2- 172.21.15.55:0/3738653457 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f26740ba5e0 0x7f26740cd500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:58.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.430+0000 7f2679ee0640 1 -- 172.21.15.55:0/3738653457 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f26740d1990 msgr2=0x7f26740cc2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:58.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.430+0000 7f2679ee0640 1 --2- 172.21.15.55:0/3738653457 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f26740d1990 0x7f26740cc2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:58.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.430+0000 7f2679ee0640 1 -- 172.21.15.55:0/3738653457 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26740cdd50 con 0x7f267415eaf0 2024-05-27T12:32:58.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.430+0000 7f2678ede640 1 --2- 172.21.15.55:0/3738653457 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f26740d1990 0x7f26740cc2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T12:32:58.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.430+0000 7f2679ee0640 1 --2- 172.21.15.55:0/3738653457 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f267415eaf0 0x7f26740ca650 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f266c02a300 tx=0x7f266c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:58.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.430+0000 7f2669ffb640 1 -- 172.21.15.55:0/3738653457 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f266c037040 con 0x7f267415eaf0 2024-05-27T12:32:58.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.430+0000 7f2669ffb640 1 -- 172.21.15.55:0/3738653457 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f266c042070 con 0x7f267415eaf0 2024-05-27T12:32:58.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.430+0000 7f267b943640 1 -- 172.21.15.55:0/3738653457 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26740ce030 con 0x7f267415eaf0 2024-05-27T12:32:58.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.430+0000 7f2669ffb640 1 -- 172.21.15.55:0/3738653457 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f266c030c90 con 0x7f267415eaf0 2024-05-27T12:32:58.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.431+0000 7f267b943640 1 -- 172.21.15.55:0/3738653457 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26740cbde0 con 0x7f267415eaf0 2024-05-27T12:32:58.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.431+0000 7f267b943640 1 -- 172.21.15.55:0/3738653457 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2674075460 con 0x7f267415eaf0 2024-05-27T12:32:58.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.432+0000 7f2669ffb640 1 -- 172.21.15.55:0/3738653457 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f266c047460 con 0x7f267415eaf0 2024-05-27T12:32:58.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.432+0000 7f2669ffb640 1 --2- 172.21.15.55:0/3738653457 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f265806c8f0 0x7f265806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:58.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.433+0000 7f2669ffb640 1 -- 172.21.15.55:0/3738653457 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f266c0ac920 con 0x7f267415eaf0 2024-05-27T12:32:58.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.433+0000 7f26796df640 1 --2- 172.21.15.55:0/3738653457 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f265806c8f0 0x7f265806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:58.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.433+0000 7f26796df640 1 --2- 172.21.15.55:0/3738653457 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f265806c8f0 0x7f265806edb0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2670007510 tx=0x7f26700074a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:58.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.437+0000 7f2669ffb640 1 -- 172.21.15.55:0/3738653457 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f266c07ac20 con 0x7f267415eaf0 2024-05-27T12:32:58.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.622+0000 7f267b943640 1 -- 172.21.15.55:0/3738653457 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f267415d280 con 0x7f267415eaf0 2024-05-27T12:32:58.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.623+0000 7f2669ffb640 1 -- 172.21.15.55:0/3738653457 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16557 (secure 0 0 0) 0x7f266c07a520 con 0x7f267415eaf0 2024-05-27T12:32:58.623 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-27T12:32:58.623 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":23,"fsid":"c3ff4e3b-8dae-4856-9593-e5cc66c59982","created":"2024-05-27T12:32:17.019097+0000","modified":"2024-05-27T12:32:43.361598+0000","last_up_change":"2024-05-27T12:32:28.109744+0000","last_in_change":"2024-05-27T12:32:19.309872+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-27T12:32:29.277895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-27T12:32:39.442745+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-27T12:32:40.672118+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e607b598-061b-4b6f-92ff-95c20b330599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":807572567},{"type":"v1","addr":"172.21.15.55:6801","nonce":807572567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":807572567},{"type":"v1","addr":"172.21.15.55:6803","nonce":807572567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":807572567},{"type":"v1","addr":"172.21.15.55:6807","nonce":807572567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":807572567},{"type":"v1","addr":"172.21.15.55:6805","nonce":807572567}]},"public_addr":"172.21.15.55:6801/807572567","cluster_addr":"172.21.15.55:6803/807572567","heartbeat_back_addr":"172.21.15.55:6807/807572567","heartbeat_front_addr":"172.21.15.55:6805/807572567","state":["exists","up"]},{"osd":1,"uuid":"ba2b5b1d-71a9-4ecc-9a48-55aa7fe54261","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":3426897300},{"type":"v1","addr":"172.21.15.55:6825","nonce":3426897300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":3426897300},{"type":"v1","addr":"172.21.15.55:6827","nonce":3426897300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":3426897300},{"type":"v1","addr":"172.21.15.55:6831","nonce":3426897300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":3426897300},{"type":"v1","addr":"172.21.15.55:6829","nonce":3426897300}]},"public_addr":"172.21.15.55:6825/3426897300","cluster_addr":"172.21.15.55:6827/3426897300","heartbeat_back_addr":"172.21.15.55:6831/3426897300","heartbeat_front_addr":"172.21.15.55:6829/3426897300","state":["exists","up"]},{"osd":2,"uuid":"e6b81cc6-4ff1-45d0-87eb-9f04ccf986a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3510271725},{"type":"v1","addr":"172.21.15.55:6809","nonce":3510271725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3510271725},{"type":"v1","addr":"172.21.15.55:6811","nonce":3510271725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3510271725},{"type":"v1","addr":"172.21.15.55:6815","nonce":3510271725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3510271725},{"type":"v1","addr":"172.21.15.55:6813","nonce":3510271725}]},"public_addr":"172.21.15.55:6809/3510271725","cluster_addr":"172.21.15.55:6811/3510271725","heartbeat_back_addr":"172.21.15.55:6815/3510271725","heartbeat_front_addr":"172.21.15.55:6813/3510271725","state":["exists","up"]},{"osd":3,"uuid":"b6a34b75-807d-4693-b1c3-903cb4c618d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":1066693520},{"type":"v1","addr":"172.21.15.55:6817","nonce":1066693520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":1066693520},{"type":"v1","addr":"172.21.15.55:6819","nonce":1066693520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":1066693520},{"type":"v1","addr":"172.21.15.55:6823","nonce":1066693520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":1066693520},{"type":"v1","addr":"172.21.15.55:6821","nonce":1066693520}]},"public_addr":"172.21.15.55:6817/1066693520","cluster_addr":"172.21.15.55:6819/1066693520","heartbeat_back_addr":"172.21.15.55:6823/1066693520","heartbeat_front_addr":"172.21.15.55:6821/1066693520","state":["exists","up"]},{"osd":4,"uuid":"272ec937-56b4-4f0a-b2e1-b0bc189c9d79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":4190771237},{"type":"v1","addr":"172.21.15.72:6820","nonce":4190771237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":4190771237},{"type":"v1","addr":"172.21.15.72:6824","nonce":4190771237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":4190771237},{"type":"v1","addr":"172.21.15.72:6831","nonce":4190771237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":4190771237},{"type":"v1","addr":"172.21.15.72:6828","nonce":4190771237}]},"public_addr":"172.21.15.72:6820/4190771237","cluster_addr":"172.21.15.72:6824/4190771237","heartbeat_back_addr":"172.21.15.72:6831/4190771237","heartbeat_front_addr":"172.21.15.72:6828/4190771237","state":["exists","up"]},{"osd":5,"uuid":"56439854-72a0-4ef4-81ff-184a3d924a5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":2421889184},{"type":"v1","addr":"172.21.15.72:6801","nonce":2421889184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6803","nonce":2421889184},{"type":"v1","addr":"172.21.15.72:6805","nonce":2421889184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":2421889184},{"type":"v1","addr":"172.21.15.72:6813","nonce":2421889184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6807","nonce":2421889184},{"type":"v1","addr":"172.21.15.72:6809","nonce":2421889184}]},"public_addr":"172.21.15.72:6801/2421889184","cluster_addr":"172.21.15.72:6805/2421889184","heartbeat_back_addr":"172.21.15.72:6813/2421889184","heartbeat_front_addr":"172.21.15.72:6809/2421889184","state":["exists","up"]},{"osd":6,"uuid":"e248e2be-3b6e-49cf-8c8a-1a4152827582","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3796994599},{"type":"v1","addr":"172.21.15.72:6804","nonce":3796994599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":3796994599},{"type":"v1","addr":"172.21.15.72:6808","nonce":3796994599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":3796994599},{"type":"v1","addr":"172.21.15.72:6815","nonce":3796994599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":3796994599},{"type":"v1","addr":"172.21.15.72:6812","nonce":3796994599}]},"public_addr":"172.21.15.72:6804/3796994599","cluster_addr":"172.21.15.72:6808/3796994599","heartbeat_back_addr":"172.21.15.72:6815/3796994599","heartbeat_front_addr":"172.21.15.72:6812/3796994599","state":["exists","up"]},{"osd":7,"uuid":"505a62d3-322b-4629-b4fd-187a55563709","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":3024877895},{"type":"v1","addr":"172.21.15.72:6817","nonce":3024877895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":3024877895},{"type":"v1","addr":"172.21.15.72:6821","nonce":3024877895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6827","nonce":3024877895},{"type":"v1","addr":"172.21.15.72:6829","nonce":3024877895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6823","nonce":3024877895},{"type":"v1","addr":"172.21.15.72:6825","nonce":3024877895}]},"public_addr":"172.21.15.72:6817/3024877895","cluster_addr":"172.21.15.72:6821/3024877895","heartbeat_back_addr":"172.21.15.72:6829/3024877895","heartbeat_front_addr":"172.21.15.72:6825/3024877895","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.241014+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.450799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.465018+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.507647+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.534763+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.495895+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.427110+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.547466+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-27T12:32:58.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.625+0000 7f267b943640 1 -- 172.21.15.55:0/3738653457 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f265806c8f0 msgr2=0x7f265806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:58.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.625+0000 7f267b943640 1 --2- 172.21.15.55:0/3738653457 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f265806c8f0 0x7f265806edb0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2670007510 tx=0x7f26700074a0 comp rx=0 tx=0).stop 2024-05-27T12:32:58.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.625+0000 7f267b943640 1 -- 172.21.15.55:0/3738653457 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f267415eaf0 msgr2=0x7f26740ca650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:58.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.625+0000 7f267b943640 1 --2- 172.21.15.55:0/3738653457 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f267415eaf0 0x7f26740ca650 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f266c02a300 tx=0x7f266c0046c0 comp rx=0 tx=0).stop 2024-05-27T12:32:58.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.626+0000 7f267b943640 1 -- 172.21.15.55:0/3738653457 shutdown_connections 2024-05-27T12:32:58.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.626+0000 7f267b943640 1 --2- 172.21.15.55:0/3738653457 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f267415eaf0 0x7f26740ca650 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:58.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.626+0000 7f267b943640 1 --2- 172.21.15.55:0/3738653457 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f265806c8f0 0x7f265806edb0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:58.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.626+0000 7f267b943640 1 --2- 172.21.15.55:0/3738653457 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f26740d1990 0x7f26740cc2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:58.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.626+0000 7f267b943640 1 --2- 172.21.15.55:0/3738653457 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f26740ba5e0 0x7f26740cd500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:58.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.626+0000 7f267b943640 1 -- 172.21.15.55:0/3738653457 >> 172.21.15.55:0/3738653457 conn(0x7f267406cdb0 msgr2=0x7f26740c8380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:58.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.626+0000 7f267b943640 1 -- 172.21.15.55:0/3738653457 shutdown_connections 2024-05-27T12:32:58.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.626+0000 7f267b943640 1 -- 172.21.15.55:0/3738653457 wait complete. 2024-05-27T12:32:58.636 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-27T12:32:58.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.740+0000 7fe5ca88a640 1 Processor -- start 2024-05-27T12:32:58.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.740+0000 7fe5ca88a640 1 -- start start 2024-05-27T12:32:58.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.741+0000 7fe5ca88a640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe5c406d590 0x7fe5c40d3950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:58.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.741+0000 7fe5ca88a640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5c40cffe0 con 0x7fe5c40b79c0 2024-05-27T12:32:58.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.741+0000 7fe5ca88a640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5c40b39a0 con 0x7fe5c41620b0 2024-05-27T12:32:58.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.741+0000 7fe5ca88a640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fe5c40d56d0 con 0x7fe5c406d590 2024-05-27T12:32:58.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.741+0000 7fe5bbfff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fe5c40b79c0 0x7fe5c406ce80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:37002/0 (socket says 172.21.15.55:37002) 2024-05-27T12:32:58.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.741+0000 7fe5bbfff640 1 -- 172.21.15.55:0/2059550335 learned_addr learned my addr 172.21.15.55:0/2059550335 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-27T12:32:58.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.741+0000 7fe5c8e27640 1 --2- 172.21.15.55:0/2059550335 >> v2:172.21.15.72:3300/0 conn(0x7fe5c406d590 0x7fe5c40d3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:58.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.741+0000 7fe5c37fe640 1 -- 172.21.15.55:0/2059550335 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3713991061 0 0) 0x7fe5c40cffe0 con 0x7fe5c40b79c0 2024-05-27T12:32:58.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.741+0000 7fe5c37fe640 1 -- 172.21.15.55:0/2059550335 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe5b0003520 con 0x7fe5c40b79c0 2024-05-27T12:32:58.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.742+0000 7fe5c37fe640 1 -- 172.21.15.55:0/2059550335 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4287560135 0 0) 0x7fe5b0003520 con 0x7fe5c40b79c0 2024-05-27T12:32:58.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.742+0000 7fe5c37fe640 1 -- 172.21.15.55:0/2059550335 >> v2:172.21.15.72:3300/0 conn(0x7fe5c406d590 msgr2=0x7fe5c40d3950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:32:58.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.742+0000 7fe5c37fe640 1 --2- 172.21.15.55:0/2059550335 >> v2:172.21.15.72:3300/0 conn(0x7fe5c406d590 0x7fe5c40d3950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:58.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.742+0000 7fe5c37fe640 1 -- 172.21.15.55:0/2059550335 >> v1:172.21.15.72:6789/0 conn(0x7fe5c41620b0 legacy=0x7fe5c40cf8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:58.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.742+0000 7fe5c37fe640 1 -- 172.21.15.55:0/2059550335 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5c40b3c80 con 0x7fe5c40b79c0 2024-05-27T12:32:58.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.742+0000 7fe5c37fe640 1 -- 172.21.15.55:0/2059550335 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 793017739 0 0) 0x7fe5ac001670 con 0x7fe5c40b79c0 2024-05-27T12:32:58.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.742+0000 7fe5c37fe640 1 -- 172.21.15.55:0/2059550335 >> v1:172.21.15.55:6789/0 conn(0x7fe5c40b79c0 legacy=0x7fe5c406ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:58.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.742+0000 7fe5c37fe640 1 --2- 172.21.15.55:0/2059550335 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe5b0003a90 0x7fe5b0003eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:58.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.742+0000 7fe5c37fe640 1 --2- 172.21.15.55:0/2059550335 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe5b0004800 0x7fe5b0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:58.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.742+0000 7fe5c37fe640 1 --2- 172.21.15.55:0/2059550335 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe5b0005210 0x7fe5b000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:58.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.742+0000 7fe5c37fe640 1 -- 172.21.15.55:0/2059550335 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7fe5b000c110 con 0x7fe5b0005210 2024-05-27T12:32:58.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.742+0000 7fe5c37fe640 1 -- 172.21.15.55:0/2059550335 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fe5b000c2c0 con 0x7fe5b0003a90 2024-05-27T12:32:58.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.742+0000 7fe5c37fe640 1 -- 172.21.15.55:0/2059550335 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fe5b000c4c0 con 0x7fe5b0004800 2024-05-27T12:32:58.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.742+0000 7fe5c8e27640 1 --2- 172.21.15.55:0/2059550335 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe5b0005210 0x7fe5b000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:58.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.742+0000 7fe5c3fff640 1 --2- 172.21.15.55:0/2059550335 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe5b0003a90 0x7fe5b0003eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:58.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.742+0000 7fe5bbfff640 1 --2- 172.21.15.55:0/2059550335 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe5b0004800 0x7fe5b0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:58.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.742+0000 7fe5c8e27640 1 -- 172.21.15.55:0/2059550335 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe5b0004800 msgr2=0x7fe5b0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:32:58.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.742+0000 7fe5c8e27640 1 --2- 172.21.15.55:0/2059550335 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe5b0004800 0x7fe5b0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:58.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.742+0000 7fe5c8e27640 1 -- 172.21.15.55:0/2059550335 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe5b0003a90 msgr2=0x7fe5b0003eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:32:58.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.742+0000 7fe5c8e27640 1 --2- 172.21.15.55:0/2059550335 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe5b0003a90 0x7fe5b0003eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:58.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.742+0000 7fe5c8e27640 1 -- 172.21.15.55:0/2059550335 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5b0003520 con 0x7fe5b0005210 2024-05-27T12:32:58.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.743+0000 7fe5c8e27640 1 -- 172.21.15.55:0/2059550335 reap_dead start 2024-05-27T12:32:58.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.743+0000 7fe5c8e27640 1 --2- 172.21.15.55:0/2059550335 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe5b0005210 0x7fe5b000b9c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe5bc009f90 tx=0x7fe5b0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18b539a6e0e37a45 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:58.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.743+0000 7fe5c37fe640 1 -- 172.21.15.55:0/2059550335 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5bc035020 con 0x7fe5b0005210 2024-05-27T12:32:58.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.743+0000 7fe5c37fe640 1 -- 172.21.15.55:0/2059550335 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5bc003b90 con 0x7fe5b0005210 2024-05-27T12:32:58.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.743+0000 7fe5c37fe640 1 -- 172.21.15.55:0/2059550335 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5bc009c10 con 0x7fe5b0005210 2024-05-27T12:32:58.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.744+0000 7fe5ca88a640 1 -- 172.21.15.55:0/2059550335 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe5b0005210 msgr2=0x7fe5b000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:58.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.744+0000 7fe5ca88a640 1 --2- 172.21.15.55:0/2059550335 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe5b0005210 0x7fe5b000b9c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe5bc009f90 tx=0x7fe5b0005830 comp rx=0 tx=0).stop 2024-05-27T12:32:58.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.744+0000 7fe5ca88a640 1 -- 172.21.15.55:0/2059550335 shutdown_connections 2024-05-27T12:32:58.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.744+0000 7fe5ca88a640 1 --2- 172.21.15.55:0/2059550335 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe5b0005210 0x7fe5b000b9c0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:58.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.744+0000 7fe5ca88a640 1 -- 172.21.15.55:0/2059550335 >> 172.21.15.55:0/2059550335 conn(0x7fe5c40d1940 msgr2=0x7fe5c40d4890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:58.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.744+0000 7fe5ca88a640 1 -- 172.21.15.55:0/2059550335 shutdown_connections 2024-05-27T12:32:58.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.744+0000 7fe5ca88a640 1 -- 172.21.15.55:0/2059550335 wait complete. 2024-05-27T12:32:58.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.745+0000 7fe5ca88a640 1 Processor -- start 2024-05-27T12:32:58.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.745+0000 7fe5ca88a640 1 -- start start 2024-05-27T12:32:58.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.746+0000 7fe5ca88a640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe5b0005210 0x7fe5c4155870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:58.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.746+0000 7fe5ca88a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe5c4156770 0x7fe5c4154ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:58.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.746+0000 7fe5ca88a640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe5c40cd970 0x7fe5c40cddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:58.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.746+0000 7fe5ca88a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7fe5c40d3430 con 0x7fe5c4156770 2024-05-27T12:32:58.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.746+0000 7fe5ca88a640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fe5c40d3150 con 0x7fe5b0005210 2024-05-27T12:32:58.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.746+0000 7fe5ca88a640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fe5c40b7e50 con 0x7fe5c40cd970 2024-05-27T12:32:58.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.746+0000 7fe5bbfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe5c4156770 0x7fe5c4154ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:58.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.746+0000 7fe5bbfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe5c4156770 0x7fe5c4154ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57752/0 (socket says 172.21.15.55:57752) 2024-05-27T12:32:58.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.746+0000 7fe5bbfff640 1 -- 172.21.15.55:0/403185026 learned_addr learned my addr 172.21.15.55:0/403185026 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:32:58.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.746+0000 7fe5c3fff640 1 --2- 172.21.15.55:0/403185026 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe5b0005210 0x7fe5c4155870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:58.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.746+0000 7fe5c8e27640 1 --2- 172.21.15.55:0/403185026 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe5c40cd970 0x7fe5c40cddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:58.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.746+0000 7fe5bbfff640 1 -- 172.21.15.55:0/403185026 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe5c40cd970 msgr2=0x7fe5c40cddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:58.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.746+0000 7fe5bbfff640 1 --2- 172.21.15.55:0/403185026 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe5c40cd970 0x7fe5c40cddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:58.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.746+0000 7fe5bbfff640 1 -- 172.21.15.55:0/403185026 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe5b0005210 msgr2=0x7fe5c4155870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:58.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.746+0000 7fe5bbfff640 1 --2- 172.21.15.55:0/403185026 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe5b0005210 0x7fe5c4155870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:58.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.746+0000 7fe5bbfff640 1 -- 172.21.15.55:0/403185026 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5c4155db0 con 0x7fe5c4156770 2024-05-27T12:32:58.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.746+0000 7fe5c8e27640 1 --2- 172.21.15.55:0/403185026 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe5c40cd970 0x7fe5c40cddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T12:32:58.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.746+0000 7fe5bbfff640 1 --2- 172.21.15.55:0/403185026 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe5c4156770 0x7fe5c4154ee0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe5ac007290 tx=0x7fe5ac007750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:58.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.746+0000 7fe5c17fa640 1 -- 172.21.15.55:0/403185026 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5ac001620 con 0x7fe5c4156770 2024-05-27T12:32:58.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.746+0000 7fe5c17fa640 1 -- 172.21.15.55:0/403185026 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5ac018070 con 0x7fe5c4156770 2024-05-27T12:32:58.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.746+0000 7fe5ca88a640 1 -- 172.21.15.55:0/403185026 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5c40ca770 con 0x7fe5c4156770 2024-05-27T12:32:58.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.746+0000 7fe5c17fa640 1 -- 172.21.15.55:0/403185026 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5ac00fba0 con 0x7fe5c4156770 2024-05-27T12:32:58.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.746+0000 7fe5ca88a640 1 -- 172.21.15.55:0/403185026 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5c40cad30 con 0x7fe5c4156770 2024-05-27T12:32:58.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.747+0000 7fe5ca88a640 1 -- 172.21.15.55:0/403185026 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5c4075460 con 0x7fe5c4156770 2024-05-27T12:32:58.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.748+0000 7fe5c17fa640 1 -- 172.21.15.55:0/403185026 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe5ac00fd40 con 0x7fe5c4156770 2024-05-27T12:32:58.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.748+0000 7fe5c17fa640 1 --2- 172.21.15.55:0/403185026 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fe5a406c8f0 0x7fe5a406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:58.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.748+0000 7fe5c17fa640 1 -- 172.21.15.55:0/403185026 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fe5ac08b960 con 0x7fe5c4156770 2024-05-27T12:32:58.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.748+0000 7fe5c3fff640 1 --2- 172.21.15.55:0/403185026 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fe5a406c8f0 0x7fe5a406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:58.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.749+0000 7fe5c3fff640 1 --2- 172.21.15.55:0/403185026 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fe5a406c8f0 0x7fe5a406edb0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe5b4000c00 tx=0x7fe5b4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:58.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.753+0000 7fe5c17fa640 1 -- 172.21.15.55:0/403185026 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe5ac059e20 con 0x7fe5c4156770 2024-05-27T12:32:58.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.978+0000 7fe5ca88a640 1 -- 172.21.15.55:0/403185026 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe5c406db20 con 0x7fe5c4156770 2024-05-27T12:32:58.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.978+0000 7fe5c17fa640 1 -- 172.21.15.55:0/403185026 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5166 (secure 0 0 0) 0x7fe5ac059720 con 0x7fe5c4156770 2024-05-27T12:32:58.977 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-27T12:32:58.978 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/1501264038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":1501264038},{"type":"v1","addr":"172.21.15.55:6834","nonce":1501264038}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/3311546358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":3311546358},{"type":"v1","addr":"172.21.15.55:6835","nonce":3311546358}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4282,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/138819105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6835","nonce":138819105},{"type":"v1","addr":"172.21.15.72:6837","nonce":138819105}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-27T12:32:41.727353+0000","modified":"2024-05-27T12:32:43.723059+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.72:6836/70510151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":70510151},{"type":"v1","addr":"172.21.15.72:6836","nonce":70510151}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4290,"qdb_cluster":[4290]},"id":1}]} 2024-05-27T12:32:58.978 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 6 2024-05-27T12:32:58.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.980+0000 7fe5ca88a640 1 -- 172.21.15.55:0/403185026 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fe5a406c8f0 msgr2=0x7fe5a406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:58.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.980+0000 7fe5ca88a640 1 --2- 172.21.15.55:0/403185026 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fe5a406c8f0 0x7fe5a406edb0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe5b4000c00 tx=0x7fe5b4009040 comp rx=0 tx=0).stop 2024-05-27T12:32:58.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.980+0000 7fe5ca88a640 1 -- 172.21.15.55:0/403185026 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe5c4156770 msgr2=0x7fe5c4154ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:58.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.980+0000 7fe5ca88a640 1 --2- 172.21.15.55:0/403185026 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe5c4156770 0x7fe5c4154ee0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe5ac007290 tx=0x7fe5ac007750 comp rx=0 tx=0).stop 2024-05-27T12:32:58.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.980+0000 7fe5ca88a640 1 -- 172.21.15.55:0/403185026 shutdown_connections 2024-05-27T12:32:58.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.980+0000 7fe5ca88a640 1 --2- 172.21.15.55:0/403185026 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe5c40cd970 0x7fe5c40cddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:58.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.980+0000 7fe5ca88a640 1 --2- 172.21.15.55:0/403185026 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe5c4156770 0x7fe5c4154ee0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:58.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.980+0000 7fe5ca88a640 1 --2- 172.21.15.55:0/403185026 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fe5a406c8f0 0x7fe5a406edb0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:58.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.980+0000 7fe5ca88a640 1 --2- 172.21.15.55:0/403185026 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe5b0005210 0x7fe5c4155870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:58.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.980+0000 7fe5ca88a640 1 -- 172.21.15.55:0/403185026 >> 172.21.15.55:0/403185026 conn(0x7fe5c40d1940 msgr2=0x7fe5c40ceec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:58.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.980+0000 7fe5ca88a640 1 -- 172.21.15.55:0/403185026 shutdown_connections 2024-05-27T12:32:58.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:58.980+0000 7fe5ca88a640 1 -- 172.21.15.55:0/403185026 wait complete. 2024-05-27T12:32:59.393 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-27T12:32:41.727353+0000', 'modified': '2024-05-27T12:32:43.723059+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4290}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4290': {'gid': 4290, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.72:6836/70510151', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.72:6834', 'nonce': 70510151}, {'type': 'v1', 'addr': '172.21.15.72:6836', 'nonce': 70510151}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4290, 'qdb_cluster': [4290]} 2024-05-27T12:32:59.393 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-27T12:32:59.393 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-05-27T12:32:59.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.507+0000 7f50543ad640 1 Processor -- start 2024-05-27T12:32:59.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.507+0000 7f50543ad640 1 -- start start 2024-05-27T12:32:59.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.508+0000 7f50543ad640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f504c0b3540 0x7f504c140470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:59.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.508+0000 7f50543ad640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f504c15b520 con 0x7f504c071e40 2024-05-27T12:32:59.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.508+0000 7f50543ad640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f504c15b800 con 0x7f504c140090 2024-05-27T12:32:59.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.508+0000 7f50543ad640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f504c15c130 con 0x7f504c0b3540 2024-05-27T12:32:59.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.508+0000 7f505294a640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f504c071e40 0x7f504c06df40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:37006/0 (socket says 172.21.15.55:37006) 2024-05-27T12:32:59.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.508+0000 7f505294a640 1 -- 172.21.15.55:0/2156148220 learned_addr learned my addr 172.21.15.55:0/2156148220 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-27T12:32:59.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.508+0000 7f5051948640 1 --2- 172.21.15.55:0/2156148220 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f504c0b3540 0x7f504c140470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:59.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.508+0000 7f5051147640 1 -- 172.21.15.55:0/2156148220 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2113759061 0 0) 0x7f504c15b520 con 0x7f504c071e40 2024-05-27T12:32:59.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.508+0000 7f5051147640 1 -- 172.21.15.55:0/2156148220 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5034003440 con 0x7f504c071e40 2024-05-27T12:32:59.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.509+0000 7f5051147640 1 -- 172.21.15.55:0/2156148220 <== mon.1 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 797162861 0 0) 0x7f504c15b800 con 0x7f504c140090 2024-05-27T12:32:59.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.509+0000 7f5051147640 1 -- 172.21.15.55:0/2156148220 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f504c15b520 con 0x7f504c140090 2024-05-27T12:32:59.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.509+0000 7f5051948640 1 -- 172.21.15.55:0/2156148220 >> v1:172.21.15.72:6789/0 conn(0x7f504c140090 legacy=0x7f504c140e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:59.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.509+0000 7f5051948640 1 -- 172.21.15.55:0/2156148220 >> v1:172.21.15.55:6789/0 conn(0x7f504c071e40 legacy=0x7f504c06df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:59.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.509+0000 7f5051948640 1 -- 172.21.15.55:0/2156148220 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f504c15bae0 con 0x7f504c0b3540 2024-05-27T12:32:59.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.509+0000 7f5051948640 1 --2- 172.21.15.55:0/2156148220 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f504c0b3540 0x7f504c140470 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f50400097d0 tx=0x7f504002a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6da8f78129804704 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:59.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.510+0000 7f5051147640 1 -- 172.21.15.55:0/2156148220 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5040037070 con 0x7f504c0b3540 2024-05-27T12:32:59.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.510+0000 7f5051147640 1 -- 172.21.15.55:0/2156148220 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5040032440 con 0x7f504c0b3540 2024-05-27T12:32:59.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.510+0000 7f5051147640 1 -- 172.21.15.55:0/2156148220 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50400327f0 con 0x7f504c0b3540 2024-05-27T12:32:59.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.510+0000 7f50543ad640 1 -- 172.21.15.55:0/2156148220 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f504c0b3540 msgr2=0x7f504c140470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:59.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.510+0000 7f50543ad640 1 --2- 172.21.15.55:0/2156148220 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f504c0b3540 0x7f504c140470 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f50400097d0 tx=0x7f504002a210 comp rx=0 tx=0).stop 2024-05-27T12:32:59.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.510+0000 7f50543ad640 1 -- 172.21.15.55:0/2156148220 shutdown_connections 2024-05-27T12:32:59.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.510+0000 7f50543ad640 1 --2- 172.21.15.55:0/2156148220 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f504c0b3540 0x7f504c140470 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:59.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.510+0000 7f50543ad640 1 -- 172.21.15.55:0/2156148220 >> 172.21.15.55:0/2156148220 conn(0x7f504c067d70 msgr2=0x7f504c0b2270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:59.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.510+0000 7f50543ad640 1 -- 172.21.15.55:0/2156148220 shutdown_connections 2024-05-27T12:32:59.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.510+0000 7f50543ad640 1 -- 172.21.15.55:0/2156148220 wait complete. 2024-05-27T12:32:59.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.511+0000 7f50543ad640 1 Processor -- start 2024-05-27T12:32:59.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.511+0000 7f50543ad640 1 -- start start 2024-05-27T12:32:59.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.512+0000 7f50543ad640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f504c0b3540 0x7f504c0cf9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:59.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.512+0000 7f50543ad640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f504c140090 0x7f504c0b1200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:59.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.512+0000 7f50543ad640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f504c0b1740 0x7f504c1433a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:59.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.512+0000 7f50543ad640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f504c0722b0 con 0x7f504c0b1740 2024-05-27T12:32:59.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.512+0000 7f50543ad640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f504c141510 con 0x7f504c140090 2024-05-27T12:32:59.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.512+0000 7f50543ad640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f504c072430 con 0x7f504c0b3540 2024-05-27T12:32:59.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.512+0000 7f505294a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f504c0b1740 0x7f504c1433a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:59.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.512+0000 7f505294a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f504c0b1740 0x7f504c1433a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57754/0 (socket says 172.21.15.55:57754) 2024-05-27T12:32:59.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.512+0000 7f505294a640 1 -- 172.21.15.55:0/443522847 learned_addr learned my addr 172.21.15.55:0/443522847 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:32:59.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.512+0000 7f5051948640 1 --2- 172.21.15.55:0/443522847 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f504c140090 0x7f504c0b1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:59.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.512+0000 7f5052149640 1 --2- 172.21.15.55:0/443522847 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f504c0b3540 0x7f504c0cf9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:59.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.513+0000 7f505294a640 1 -- 172.21.15.55:0/443522847 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f504c0b3540 msgr2=0x7f504c0cf9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:59.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.513+0000 7f505294a640 1 --2- 172.21.15.55:0/443522847 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f504c0b3540 0x7f504c0cf9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:59.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.513+0000 7f505294a640 1 -- 172.21.15.55:0/443522847 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f504c140090 msgr2=0x7f504c0b1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:59.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.513+0000 7f505294a640 1 --2- 172.21.15.55:0/443522847 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f504c140090 0x7f504c0b1200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:59.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.513+0000 7f505294a640 1 -- 172.21.15.55:0/443522847 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f504c0ceae0 con 0x7f504c0b1740 2024-05-27T12:32:59.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.513+0000 7f505294a640 1 --2- 172.21.15.55:0/443522847 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f504c0b1740 0x7f504c1433a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f503c00cb40 tx=0x7f503c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:59.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.513+0000 7f504affd640 1 -- 172.21.15.55:0/443522847 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f503c017070 con 0x7f504c0b1740 2024-05-27T12:32:59.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.513+0000 7f504affd640 1 -- 172.21.15.55:0/443522847 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f503c00ac60 con 0x7f504c0b1740 2024-05-27T12:32:59.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.513+0000 7f504affd640 1 -- 172.21.15.55:0/443522847 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f503c012640 con 0x7f504c0b1740 2024-05-27T12:32:59.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.513+0000 7f50543ad640 1 -- 172.21.15.55:0/443522847 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f504c0cdd20 con 0x7f504c0b1740 2024-05-27T12:32:59.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.513+0000 7f50543ad640 1 -- 172.21.15.55:0/443522847 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f504c0ce2e0 con 0x7f504c0b1740 2024-05-27T12:32:59.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.515+0000 7f504affd640 1 -- 172.21.15.55:0/443522847 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f503c01a070 con 0x7f504c0b1740 2024-05-27T12:32:59.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.515+0000 7f504affd640 1 --2- 172.21.15.55:0/443522847 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f503806c920 0x7f503806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:59.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.515+0000 7f504affd640 1 -- 172.21.15.55:0/443522847 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f503c08b7b0 con 0x7f504c0b1740 2024-05-27T12:32:59.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.515+0000 7f5052149640 1 --2- 172.21.15.55:0/443522847 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f503806c920 0x7f503806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:59.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.516+0000 7f5052149640 1 --2- 172.21.15.55:0/443522847 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f503806c920 0x7f503806ede0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f50440011e0 tx=0x7f5044009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:59.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.516+0000 7f50571a0740 1 Processor -- start 2024-05-27T12:32:59.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.516+0000 7f50571a0740 1 -- start start 2024-05-27T12:32:59.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.517+0000 7f50571a0740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fd8ee08c20 0x55fd8ee09000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:59.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.517+0000 7f50571a0740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55fd8ee03ab0 0x55fd8ee07820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:59.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.517+0000 7f50571a0740 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55fd8ee07d60 0x55fd8ee081a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:59.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.517+0000 7f50571a0740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x55fd8ed6dc50 con 0x55fd8ee08c20 2024-05-27T12:32:59.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.517+0000 7f50571a0740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55fd8ed0a830 con 0x55fd8ee03ab0 2024-05-27T12:32:59.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.517+0000 7f50571a0740 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x55fd8ed69c10 con 0x55fd8ee07d60 2024-05-27T12:32:59.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.517+0000 7f5052149640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fd8ee08c20 0x55fd8ee09000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:59.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.517+0000 7f5052149640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fd8ee08c20 0x55fd8ee09000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57758/0 (socket says 172.21.15.55:57758) 2024-05-27T12:32:59.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.517+0000 7f505294a640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55fd8ee07d60 0x55fd8ee081a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:59.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.517+0000 7f5052149640 1 -- 172.21.15.55:0/915933698 learned_addr learned my addr 172.21.15.55:0/915933698 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:32:59.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.517+0000 7f5051948640 1 --2- 172.21.15.55:0/915933698 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55fd8ee03ab0 0x55fd8ee07820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:59.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.517+0000 7f5052149640 1 -- 172.21.15.55:0/915933698 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55fd8ee07d60 msgr2=0x55fd8ee081a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:32:59.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.518+0000 7f5052149640 1 --2- 172.21.15.55:0/915933698 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55fd8ee07d60 0x55fd8ee081a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:59.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.518+0000 7f5052149640 1 -- 172.21.15.55:0/915933698 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55fd8ee03ab0 msgr2=0x55fd8ee07820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:32:59.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.518+0000 7f5052149640 1 --2- 172.21.15.55:0/915933698 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55fd8ee03ab0 0x55fd8ee07820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:59.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.518+0000 7f5052149640 1 -- 172.21.15.55:0/915933698 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd8ea802d0 con 0x55fd8ee08c20 2024-05-27T12:32:59.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.518+0000 7f5052149640 1 --2- 172.21.15.55:0/915933698 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fd8ee08c20 0x55fd8ee09000 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f504400f9e0 tx=0x7f5044012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd6b899e888556ed server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:59.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.518+0000 7f5033fff640 1 -- 172.21.15.55:0/915933698 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5044025070 con 0x55fd8ee08c20 2024-05-27T12:32:59.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.518+0000 7f5033fff640 1 -- 172.21.15.55:0/915933698 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f504401b050 con 0x55fd8ee08c20 2024-05-27T12:32:59.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.518+0000 7f5033fff640 1 -- 172.21.15.55:0/915933698 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5044001d40 con 0x55fd8ee08c20 2024-05-27T12:32:59.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.519+0000 7f50571a0740 1 -- 172.21.15.55:0/915933698 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fd8ee08c20 msgr2=0x55fd8ee09000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:59.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.519+0000 7f50571a0740 1 --2- 172.21.15.55:0/915933698 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fd8ee08c20 0x55fd8ee09000 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f504400f9e0 tx=0x7f5044012000 comp rx=0 tx=0).stop 2024-05-27T12:32:59.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.519+0000 7f50571a0740 1 -- 172.21.15.55:0/915933698 shutdown_connections 2024-05-27T12:32:59.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.519+0000 7f50571a0740 1 --2- 172.21.15.55:0/915933698 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55fd8ee07d60 0x55fd8ee081a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:59.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.519+0000 7f50571a0740 1 --2- 172.21.15.55:0/915933698 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55fd8ee03ab0 0x55fd8ee07820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:59.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.519+0000 7f50571a0740 1 --2- 172.21.15.55:0/915933698 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fd8ee08c20 0x55fd8ee09000 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:59.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.519+0000 7f50571a0740 1 -- 172.21.15.55:0/915933698 >> 172.21.15.55:0/915933698 conn(0x55fd8ee05d20 msgr2=0x55fd8ee4e7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:59.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.519+0000 7f50571a0740 1 -- 172.21.15.55:0/915933698 shutdown_connections 2024-05-27T12:32:59.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.519+0000 7f50571a0740 1 -- 172.21.15.55:0/915933698 wait complete. 2024-05-27T12:32:59.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.519+0000 7f50571a0740 1 -- start start 2024-05-27T12:32:59.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.519+0000 7f50571a0740 1 Processor -- start 2024-05-27T12:32:59.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.520+0000 7f50571a0740 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55fd8ee07d60 0x55fd8ee1fc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:59.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.520+0000 7f50571a0740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fd8ee08c20 0x55fd8ee25580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:59.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.520+0000 7f50571a0740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55fd8ee290b0 0x55fd8ee29530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:59.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.520+0000 7f50571a0740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x55fd8ee347b0 con 0x55fd8ee08c20 2024-05-27T12:32:59.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.520+0000 7f50571a0740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x55fd8ed08470 con 0x55fd8ee290b0 2024-05-27T12:32:59.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.520+0000 7f50571a0740 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x55fd8ee33c30 con 0x55fd8ee07d60 2024-05-27T12:32:59.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.520+0000 7f50571a0740 10 client.0 _ll_register_callbacks cb 0x55fd8ed2df30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T12:32:59.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.520+0000 7f5051948640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fd8ee08c20 0x55fd8ee25580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:59.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.520+0000 7f5051948640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fd8ee08c20 0x55fd8ee25580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57764/0 (socket says 172.21.15.55:57764) 2024-05-27T12:32:59.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.521+0000 7f5051948640 1 -- 172.21.15.55:0/2595344915 learned_addr learned my addr 172.21.15.55:0/2595344915 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:32:59.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.521+0000 7f5052149640 1 --2- 172.21.15.55:0/2595344915 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55fd8ee07d60 0x55fd8ee1fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:59.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.521+0000 7f505294a640 1 --2- 172.21.15.55:0/2595344915 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55fd8ee290b0 0x55fd8ee29530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:59.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.521+0000 7f5051948640 1 -- 172.21.15.55:0/2595344915 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55fd8ee07d60 msgr2=0x55fd8ee1fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:32:59.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.521+0000 7f5051948640 1 --2- 172.21.15.55:0/2595344915 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55fd8ee07d60 0x55fd8ee1fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:59.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.521+0000 7f5051948640 1 -- 172.21.15.55:0/2595344915 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55fd8ee290b0 msgr2=0x55fd8ee29530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:32:59.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.521+0000 7f5051948640 1 --2- 172.21.15.55:0/2595344915 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55fd8ee290b0 0x55fd8ee29530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:59.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.521+0000 7f5051948640 1 -- 172.21.15.55:0/2595344915 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd8eb4a6b0 con 0x55fd8ee08c20 2024-05-27T12:32:59.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.521+0000 7f5051948640 1 --2- 172.21.15.55:0/2595344915 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fd8ee08c20 0x55fd8ee25580 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f5040009720 tx=0x7f5040004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c48fa90a554a72 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:59.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.521+0000 7f50317fa640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-05-27T12:32:59.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.521+0000 7f50317fa640 1 -- 172.21.15.55:0/2595344915 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5040037040 con 0x55fd8ee08c20 2024-05-27T12:32:59.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.521+0000 7f50317fa640 1 -- 172.21.15.55:0/2595344915 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f5040046430 con 0x55fd8ee08c20 2024-05-27T12:32:59.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.521+0000 7f50571a0740 1 -- 172.21.15.55:0/2595344915 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f504401b050 con 0x55fd8ee08c20 2024-05-27T12:32:59.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.521+0000 7f50317fa640 1 -- 172.21.15.55:0/2595344915 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7f5040006e10 con 0x55fd8ee08c20 2024-05-27T12:32:59.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.521+0000 7f50571a0740 10 client.4695 fetch_fsmap learned FSMap version 6 2024-05-27T12:32:59.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.521+0000 7f50571a0740 1 -- 172.21.15.55:0/2595344915 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x55fd8ee20980 con 0x55fd8ee08c20 2024-05-27T12:32:59.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.521+0000 7f50317fa640 1 -- 172.21.15.55:0/2595344915 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f504401b050 con 0x55fd8ee08c20 2024-05-27T12:32:59.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.522+0000 7f50317fa640 1 -- 172.21.15.55:0/2595344915 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 6) ==== 3494+0+0 (secure 0 0 0) 0x7f5040046630 con 0x55fd8ee08c20 2024-05-27T12:32:59.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.522+0000 7f50571a0740 10 client.4695 fetch_fsmap finished waiting for FSMap version 6 2024-05-27T12:32:59.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.522+0000 7f50571a0740 10 client.4695 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-27T12:32:59.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.522+0000 7f50571a0740 20 client.4695 populate_metadata read hostname 'smithi055' 2024-05-27T12:32:59.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.522+0000 7f50571a0740 1 --2- 172.21.15.55:0/2595344915 >> [v2:172.21.15.72:6834/70510151,v1:172.21.15.72:6836/70510151] conn(0x55fd8ee518a0 0x55fd8ee6d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:59.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.522+0000 7f50571a0740 4 client.4695 mds_command: new command op to 4290 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-27T12:32:59.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.522+0000 7f50571a0740 1 -- 172.21.15.55:0/2595344915 --> [v2:172.21.15.72:6834/70510151,v1:172.21.15.72:6836/70510151] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fd8ed7b670 con 0x55fd8ee518a0 2024-05-27T12:32:59.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.522+0000 7f5052149640 1 --2- 172.21.15.55:0/2595344915 >> [v2:172.21.15.72:6834/70510151,v1:172.21.15.72:6836/70510151] conn(0x55fd8ee518a0 0x55fd8ee6d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:59.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.522+0000 7f50317fa640 10 client.4695 ms_handle_connect on v2:172.21.15.72:6834/70510151 2024-05-27T12:32:59.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.522+0000 7f5052149640 1 --2- 172.21.15.55:0/2595344915 >> [v2:172.21.15.72:6834/70510151,v1:172.21.15.72:6836/70510151] conn(0x55fd8ee518a0 0x55fd8ee6d4d0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1b1b43e0499dddda server_cookie=6300ec4e1731e658 in_seq=0 out_seq=0 2024-05-27T12:32:59.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.523+0000 7f50317fa640 1 -- 172.21.15.55:0/2595344915 <== mds.0 v2:172.21.15.72:6834/70510151 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55fd8ed7b670 con 0x55fd8ee518a0 2024-05-27T12:32:59.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.523+0000 7f50317fa640 10 client.4695 handle_command_reply: tid=0 2024-05-27T12:32:59.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.523+0000 7f50571a0740 1 client.4695 shutdown 2024-05-27T12:32:59.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.523+0000 7f50571a0740 1 -- 172.21.15.55:0/2595344915 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fd8ee08c20 msgr2=0x55fd8ee25580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:59.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.523+0000 7f50571a0740 1 --2- 172.21.15.55:0/2595344915 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fd8ee08c20 0x55fd8ee25580 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f5040009720 tx=0x7f5040004730 comp rx=0 tx=0).stop 2024-05-27T12:32:59.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.523+0000 7f50571a0740 1 -- 172.21.15.55:0/2595344915 shutdown_connections 2024-05-27T12:32:59.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.523+0000 7f50571a0740 1 --2- 172.21.15.55:0/2595344915 >> [v2:172.21.15.72:6834/70510151,v1:172.21.15.72:6836/70510151] conn(0x55fd8ee518a0 0x55fd8ee6d4d0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:59.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.523+0000 7f50571a0740 1 --2- 172.21.15.55:0/2595344915 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55fd8ee290b0 0x55fd8ee29530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:59.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.523+0000 7f50571a0740 1 --2- 172.21.15.55:0/2595344915 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fd8ee08c20 0x55fd8ee25580 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:59.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.523+0000 7f50571a0740 1 --2- 172.21.15.55:0/2595344915 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55fd8ee07d60 0x55fd8ee1fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:59.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.523+0000 7f50317fa640 0 client.4695 ms_handle_reset on v2:172.21.15.72:6834/70510151 2024-05-27T12:32:59.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.523+0000 7f50571a0740 1 -- 172.21.15.55:0/2595344915 >> 172.21.15.55:0/2595344915 conn(0x55fd8ee03ab0 msgr2=0x55fd8ee09710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:59.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.523+0000 7f50571a0740 1 -- 172.21.15.55:0/2595344915 shutdown_connections 2024-05-27T12:32:59.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.524+0000 7f50571a0740 1 -- 172.21.15.55:0/2595344915 wait complete. 2024-05-27T12:32:59.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.524+0000 7f50571a0740 20 client.4695 trim_cache size 0 max 16384 2024-05-27T12:32:59.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.542+0000 7f50571a0740 1 Processor -- start 2024-05-27T12:32:59.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.542+0000 7f50571a0740 1 -- start start 2024-05-27T12:32:59.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.543+0000 7f50571a0740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fd8ee07d60 0x55fd8ee28610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:59.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.543+0000 7f50571a0740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55fd8ee08c20 0x55fd8ee727c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:59.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.543+0000 7f50571a0740 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55fd8ee290b0 0x55fd8ee72d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:59.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.543+0000 7f50571a0740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f504c1fc7e0 con 0x55fd8ee07d60 2024-05-27T12:32:59.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.543+0000 7f50571a0740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f504c1fb800 con 0x55fd8ee08c20 2024-05-27T12:32:59.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.543+0000 7f50571a0740 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f504c1fab90 con 0x55fd8ee290b0 2024-05-27T12:32:59.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.543+0000 7f5052149640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fd8ee07d60 0x55fd8ee28610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:59.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.543+0000 7f5052149640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fd8ee07d60 0x55fd8ee28610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57766/0 (socket says 172.21.15.55:57766) 2024-05-27T12:32:59.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.543+0000 7f5052149640 1 -- 172.21.15.55:0/321613391 learned_addr learned my addr 172.21.15.55:0/321613391 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:32:59.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.543+0000 7f5051948640 1 --2- 172.21.15.55:0/321613391 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55fd8ee08c20 0x55fd8ee727c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:59.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.543+0000 7f505294a640 1 --2- 172.21.15.55:0/321613391 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55fd8ee290b0 0x55fd8ee72d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:59.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.543+0000 7f5052149640 1 -- 172.21.15.55:0/321613391 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55fd8ee290b0 msgr2=0x55fd8ee72d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:32:59.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.543+0000 7f5052149640 1 --2- 172.21.15.55:0/321613391 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55fd8ee290b0 0x55fd8ee72d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:59.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.543+0000 7f5052149640 1 -- 172.21.15.55:0/321613391 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55fd8ee08c20 msgr2=0x55fd8ee727c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:32:59.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.543+0000 7f5052149640 1 --2- 172.21.15.55:0/321613391 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55fd8ee08c20 0x55fd8ee727c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:59.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.543+0000 7f5052149640 1 -- 172.21.15.55:0/321613391 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd8ee51ff0 con 0x55fd8ee07d60 2024-05-27T12:32:59.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.543+0000 7f5052149640 1 --2- 172.21.15.55:0/321613391 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fd8ee07d60 0x55fd8ee28610 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f5044014820 tx=0x7f5044015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e500c3a3966dfc0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:59.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.543+0000 7f50337fe640 1 -- 172.21.15.55:0/321613391 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5044025040 con 0x55fd8ee07d60 2024-05-27T12:32:59.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.543+0000 7f50337fe640 1 -- 172.21.15.55:0/321613391 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f504401b070 con 0x55fd8ee07d60 2024-05-27T12:32:59.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.543+0000 7f50337fe640 1 -- 172.21.15.55:0/321613391 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5044033480 con 0x55fd8ee07d60 2024-05-27T12:32:59.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.544+0000 7f50571a0740 1 -- 172.21.15.55:0/321613391 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fd8ee07d60 msgr2=0x55fd8ee28610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:59.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.544+0000 7f50571a0740 1 --2- 172.21.15.55:0/321613391 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fd8ee07d60 0x55fd8ee28610 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f5044014820 tx=0x7f5044015000 comp rx=0 tx=0).stop 2024-05-27T12:32:59.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.544+0000 7f50571a0740 1 -- 172.21.15.55:0/321613391 shutdown_connections 2024-05-27T12:32:59.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.544+0000 7f50571a0740 1 --2- 172.21.15.55:0/321613391 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55fd8ee290b0 0x55fd8ee72d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:59.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.544+0000 7f50571a0740 1 --2- 172.21.15.55:0/321613391 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55fd8ee08c20 0x55fd8ee727c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:59.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.544+0000 7f50571a0740 1 --2- 172.21.15.55:0/321613391 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fd8ee07d60 0x55fd8ee28610 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:59.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.544+0000 7f50571a0740 1 -- 172.21.15.55:0/321613391 >> 172.21.15.55:0/321613391 conn(0x55fd8ee03ab0 msgr2=0x55fd8ee25190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:59.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.544+0000 7f50571a0740 1 -- 172.21.15.55:0/321613391 shutdown_connections 2024-05-27T12:32:59.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.544+0000 7f50571a0740 1 -- 172.21.15.55:0/321613391 wait complete. 2024-05-27T12:32:59.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.544+0000 7f50571a0740 1 -- start start 2024-05-27T12:32:59.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.544+0000 7f50571a0740 1 Processor -- start 2024-05-27T12:32:59.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.545+0000 7f50571a0740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55fd8ee07d60 0x55fd8ee68690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:59.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.545+0000 7f50571a0740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fd8ee08c20 0x55fd8ee68bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:59.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.545+0000 7f50571a0740 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55fd8ee290b0 0x55fd8ee32a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:59.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.545+0000 7f50571a0740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x55fd8ee20f40 con 0x55fd8ee08c20 2024-05-27T12:32:59.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.545+0000 7f50571a0740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f504c1fb1b0 con 0x55fd8ee07d60 2024-05-27T12:32:59.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.545+0000 7f50571a0740 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x55fd8ee25b10 con 0x55fd8ee290b0 2024-05-27T12:32:59.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.545+0000 7f50571a0740 10 client.0 _ll_register_callbacks cb 0x7f5034003970 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T12:32:59.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.545+0000 7f5051948640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fd8ee08c20 0x55fd8ee68bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:59.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.546+0000 7f5051948640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fd8ee08c20 0x55fd8ee68bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57770/0 (socket says 172.21.15.55:57770) 2024-05-27T12:32:59.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.546+0000 7f5051948640 1 -- 172.21.15.55:0/3520917438 learned_addr learned my addr 172.21.15.55:0/3520917438 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:32:59.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.546+0000 7f5052149640 1 --2- 172.21.15.55:0/3520917438 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55fd8ee07d60 0x55fd8ee68690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:59.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.546+0000 7f505294a640 1 --2- 172.21.15.55:0/3520917438 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55fd8ee290b0 0x55fd8ee32a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:59.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.546+0000 7f5051948640 1 -- 172.21.15.55:0/3520917438 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55fd8ee290b0 msgr2=0x55fd8ee32a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:32:59.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.546+0000 7f5051948640 1 --2- 172.21.15.55:0/3520917438 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55fd8ee290b0 0x55fd8ee32a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:59.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.546+0000 7f5051948640 1 -- 172.21.15.55:0/3520917438 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55fd8ee07d60 msgr2=0x55fd8ee68690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:32:59.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.546+0000 7f5051948640 1 --2- 172.21.15.55:0/3520917438 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55fd8ee07d60 0x55fd8ee68690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:59.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.546+0000 7f5051948640 1 -- 172.21.15.55:0/3520917438 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd8ee681e0 con 0x55fd8ee08c20 2024-05-27T12:32:59.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.546+0000 7f5051948640 1 --2- 172.21.15.55:0/3520917438 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fd8ee08c20 0x55fd8ee68bd0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f5040009720 tx=0x7f5040009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=184b2c627d71968b server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:32:59.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.546+0000 7f50317fa640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-05-27T12:32:59.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.546+0000 7f50317fa640 1 -- 172.21.15.55:0/3520917438 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5040056070 con 0x55fd8ee08c20 2024-05-27T12:32:59.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.546+0000 7f50317fa640 1 -- 172.21.15.55:0/3520917438 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f5040004040 con 0x55fd8ee08c20 2024-05-27T12:32:59.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.546+0000 7f50571a0740 1 -- 172.21.15.55:0/3520917438 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f504401b070 con 0x55fd8ee08c20 2024-05-27T12:32:59.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.546+0000 7f50317fa640 1 -- 172.21.15.55:0/3520917438 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7f5040037040 con 0x55fd8ee08c20 2024-05-27T12:32:59.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.546+0000 7f50571a0740 10 client.4701 fetch_fsmap learned FSMap version 6 2024-05-27T12:32:59.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.546+0000 7f50571a0740 1 -- 172.21.15.55:0/3520917438 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x55fd8ee27e40 con 0x55fd8ee08c20 2024-05-27T12:32:59.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.546+0000 7f50317fa640 1 -- 172.21.15.55:0/3520917438 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f504401b070 con 0x55fd8ee08c20 2024-05-27T12:32:59.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.547+0000 7f50317fa640 1 -- 172.21.15.55:0/3520917438 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 6) ==== 3494+0+0 (secure 0 0 0) 0x7f5040004240 con 0x55fd8ee08c20 2024-05-27T12:32:59.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.547+0000 7f50571a0740 10 client.4701 fetch_fsmap finished waiting for FSMap version 6 2024-05-27T12:32:59.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.547+0000 7f50571a0740 10 client.4701 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-27T12:32:59.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.547+0000 7f50571a0740 20 client.4701 populate_metadata read hostname 'smithi055' 2024-05-27T12:32:59.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.547+0000 7f50571a0740 1 --2- 172.21.15.55:0/3520917438 >> [v2:172.21.15.72:6834/70510151,v1:172.21.15.72:6836/70510151] conn(0x55fd8ee2b670 0x55fd8ee2ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:32:59.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.547+0000 7f50571a0740 4 client.4701 mds_command: new command op to 4290 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-27T12:32:59.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.547+0000 7f50571a0740 1 -- 172.21.15.55:0/3520917438 --> [v2:172.21.15.72:6834/70510151,v1:172.21.15.72:6836/70510151] -- command(tid 0: {"prefix": "status"}) -- 0x55fd8ed754e0 con 0x55fd8ee2b670 2024-05-27T12:32:59.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.547+0000 7f5052149640 1 --2- 172.21.15.55:0/3520917438 >> [v2:172.21.15.72:6834/70510151,v1:172.21.15.72:6836/70510151] conn(0x55fd8ee2b670 0x55fd8ee2ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:32:59.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.547+0000 7f50317fa640 10 client.4701 ms_handle_connect on v2:172.21.15.72:6834/70510151 2024-05-27T12:32:59.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.547+0000 7f5052149640 1 --2- 172.21.15.55:0/3520917438 >> [v2:172.21.15.72:6834/70510151,v1:172.21.15.72:6836/70510151] conn(0x55fd8ee2b670 0x55fd8ee2ba50 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e8ff4f4b7f644f75 server_cookie=32e8a87ac5785c13 in_seq=0 out_seq=0 2024-05-27T12:32:59.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.547+0000 7f50317fa640 1 -- 172.21.15.55:0/3520917438 <== mds.0 v2:172.21.15.72:6834/70510151 1 ==== command_reply(tid 0: 0 ) ==== 8+0+324 (crc 0 0 0) 0x55fd8ed754e0 con 0x55fd8ee2b670 2024-05-27T12:32:59.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.547+0000 7f50317fa640 10 client.4701 handle_command_reply: tid=0 2024-05-27T12:32:59.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.547+0000 7f50571a0740 1 client.4701 shutdown 2024-05-27T12:32:59.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.547+0000 7f50571a0740 1 -- 172.21.15.55:0/3520917438 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fd8ee08c20 msgr2=0x55fd8ee68bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:59.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.547+0000 7f50571a0740 1 --2- 172.21.15.55:0/3520917438 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fd8ee08c20 0x55fd8ee68bd0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f5040009720 tx=0x7f5040009190 comp rx=0 tx=0).stop 2024-05-27T12:32:59.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.548+0000 7f50571a0740 1 -- 172.21.15.55:0/3520917438 shutdown_connections 2024-05-27T12:32:59.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.548+0000 7f50571a0740 1 --2- 172.21.15.55:0/3520917438 >> [v2:172.21.15.72:6834/70510151,v1:172.21.15.72:6836/70510151] conn(0x55fd8ee2b670 0x55fd8ee2ba50 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:59.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.548+0000 7f50571a0740 1 --2- 172.21.15.55:0/3520917438 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55fd8ee290b0 0x55fd8ee32a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:59.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.548+0000 7f50571a0740 1 --2- 172.21.15.55:0/3520917438 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fd8ee08c20 0x55fd8ee68bd0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:59.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.548+0000 7f50317fa640 0 client.4701 ms_handle_reset on v2:172.21.15.72:6834/70510151 2024-05-27T12:32:59.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.548+0000 7f50571a0740 1 --2- 172.21.15.55:0/3520917438 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55fd8ee07d60 0x55fd8ee68690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:59.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.548+0000 7f50571a0740 1 -- 172.21.15.55:0/3520917438 >> 172.21.15.55:0/3520917438 conn(0x55fd8ee03ab0 msgr2=0x55fd8ee28610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:59.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.548+0000 7f50571a0740 1 -- 172.21.15.55:0/3520917438 shutdown_connections 2024-05-27T12:32:59.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.548+0000 7f50571a0740 1 -- 172.21.15.55:0/3520917438 wait complete. 2024-05-27T12:32:59.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.548+0000 7f50571a0740 20 client.4701 trim_cache size 0 max 16384 2024-05-27T12:32:59.553 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-05-27T12:32:59.553 INFO:teuthology.orchestra.run.smithi055.stdout: "cluster_fsid": "c3ff4e3b-8dae-4856-9593-e5cc66c59982", 2024-05-27T12:32:59.553 INFO:teuthology.orchestra.run.smithi055.stdout: "whoami": 0, 2024-05-27T12:32:59.554 INFO:teuthology.orchestra.run.smithi055.stdout: "id": 4290, 2024-05-27T12:32:59.554 INFO:teuthology.orchestra.run.smithi055.stdout: "want_state": "up:active", 2024-05-27T12:32:59.554 INFO:teuthology.orchestra.run.smithi055.stdout: "state": "up:active", 2024-05-27T12:32:59.554 INFO:teuthology.orchestra.run.smithi055.stdout: "fs_name": "cephfs", 2024-05-27T12:32:59.554 INFO:teuthology.orchestra.run.smithi055.stdout: "rank_uptime": 17.197705257999999, 2024-05-27T12:32:59.554 INFO:teuthology.orchestra.run.smithi055.stdout: "mdsmap_epoch": 6, 2024-05-27T12:32:59.554 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch": 23, 2024-05-27T12:32:59.554 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch_barrier": 23, 2024-05-27T12:32:59.554 INFO:teuthology.orchestra.run.smithi055.stdout: "uptime": 24.647575772 2024-05-27T12:32:59.554 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-05-27T12:32:59.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.548+0000 7f50543ad640 1 -- 172.21.15.55:0/443522847 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f503806c920 msgr2=0x7f503806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:59.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.548+0000 7f50543ad640 1 --2- 172.21.15.55:0/443522847 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f503806c920 0x7f503806ede0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f50440011e0 tx=0x7f5044009040 comp rx=0 tx=0).stop 2024-05-27T12:32:59.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.548+0000 7f50543ad640 1 -- 172.21.15.55:0/443522847 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f504c0b1740 msgr2=0x7f504c1433a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:32:59.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.548+0000 7f50543ad640 1 --2- 172.21.15.55:0/443522847 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f504c0b1740 0x7f504c1433a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f503c00cb40 tx=0x7f503c00a060 comp rx=0 tx=0).stop 2024-05-27T12:32:59.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.548+0000 7f50543ad640 1 -- 172.21.15.55:0/443522847 shutdown_connections 2024-05-27T12:32:59.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.548+0000 7f50543ad640 1 --2- 172.21.15.55:0/443522847 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f504c0b1740 0x7f504c1433a0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:59.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.548+0000 7f50543ad640 1 --2- 172.21.15.55:0/443522847 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f503806c920 0x7f503806ede0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:59.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.548+0000 7f50543ad640 1 --2- 172.21.15.55:0/443522847 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f504c140090 0x7f504c0b1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:59.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.548+0000 7f50543ad640 1 --2- 172.21.15.55:0/443522847 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f504c0b3540 0x7f504c0cf9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:32:59.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.548+0000 7f50543ad640 1 -- 172.21.15.55:0/443522847 >> 172.21.15.55:0/443522847 conn(0x7f504c071e40 msgr2=0x7f504c15db10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:32:59.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.548+0000 7f50543ad640 1 -- 172.21.15.55:0/443522847 shutdown_connections 2024-05-27T12:32:59.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:32:59.548+0000 7f50543ad640 1 -- 172.21.15.55:0/443522847 wait complete. 2024-05-27T12:32:59.558 INFO:teuthology.run_tasks:Running task sequential... 2024-05-27T12:32:59.568 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-05-27T12:32:59.568 INFO:teuthology.task.sequential:In sequential, running task print... 2024-05-27T12:32:59.568 INFO:teuthology.task.print:Enabling mgr modules 2024-05-27T12:32:59.568 INFO:teuthology.run_tasks:Running task kclient... 2024-05-27T12:32:59.631 INFO:tasks.kclient:Mounting kernel clients... 2024-05-27T12:32:59.631 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-05-27T12:32:59.631 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T12:32:59.631 DEBUG:teuthology.orchestra.run.smithi055:> ip netns list 2024-05-27T12:32:59.648 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T12:32:59.648 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link delete ceph-brx 2024-05-27T12:32:59.716 INFO:teuthology.orchestra.run.smithi055.stderr:Cannot find device "ceph-brx" 2024-05-27T12:32:59.718 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-27T12:32:59.718 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T12:32:59.718 DEBUG:teuthology.orchestra.run.smithi055:> ip netns list 2024-05-27T12:32:59.775 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T12:32:59.775 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link delete ceph-brx 2024-05-27T12:32:59.841 INFO:teuthology.orchestra.run.smithi055.stderr:Cannot find device "ceph-brx" 2024-05-27T12:32:59.842 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-27T12:32:59.843 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T12:32:59.843 DEBUG:teuthology.orchestra.run.smithi072:> ip netns list 2024-05-27T12:32:59.862 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T12:32:59.862 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link delete ceph-brx 2024-05-27T12:32:59.934 INFO:teuthology.orchestra.run.smithi072.stderr:Cannot find device "ceph-brx" 2024-05-27T12:32:59.936 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-27T12:32:59.936 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T12:32:59.936 DEBUG:teuthology.orchestra.run.smithi072:> ip netns list 2024-05-27T12:32:59.994 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T12:32:59.994 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link delete ceph-brx 2024-05-27T12:33:00.062 INFO:teuthology.orchestra.run.smithi072.stderr:Cannot find device "ceph-brx" 2024-05-27T12:33:00.064 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-27T12:33:00.064 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2024-05-27T12:33:00.064 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-27T12:33:00.064 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-27T12:33:00.065 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-27T12:33:00.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:00.169+0000 7fa9bfabb640 1 Processor -- start 2024-05-27T12:33:00.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:00.170+0000 7fa9bfabb640 1 -- start start 2024-05-27T12:33:00.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:00.170+0000 7fa9bfabb640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa9b815ec00 0x7fa9b80b3db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:00.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:00.170+0000 7fa9bfabb640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa9b80b3860 0x7fa9b80cfd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:00.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:00.170+0000 7fa9bfabb640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa9b80b6370 0x7fa9b80b6800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:00.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:00.170+0000 7fa9bfabb640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7fa9b80cf2e0 con 0x7fa9b80b3860 2024-05-27T12:33:00.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:00.170+0000 7fa9bfabb640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fa9b81632f0 con 0x7fa9b815ec00 2024-05-27T12:33:00.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:00.170+0000 7fa9bfabb640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fa9b81635d0 con 0x7fa9b80b6370 2024-05-27T12:33:00.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:00.171+0000 7fa9bd056640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa9b80b3860 0x7fa9b80cfd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:00.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:00.171+0000 7fa9bd056640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa9b80b3860 0x7fa9b80cfd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57772/0 (socket says 172.21.15.55:57772) 2024-05-27T12:33:00.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:00.171+0000 7fa9bd056640 1 -- 172.21.15.55:0/2845475751 learned_addr learned my addr 172.21.15.55:0/2845475751 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:33:00.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:00.171+0000 7fa9bd857640 1 --2- 172.21.15.55:0/2845475751 >> v2:172.21.15.72:3300/0 conn(0x7fa9b815ec00 0x7fa9b80b3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:00.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:00.171+0000 7fa9be058640 1 --2- 172.21.15.55:0/2845475751 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa9b80b6370 0x7fa9b80b6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:00.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:00.171+0000 7fa9bd056640 1 -- 172.21.15.55:0/2845475751 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa9b80b6370 msgr2=0x7fa9b80b6800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:00.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:00.171+0000 7fa9bd056640 1 --2- 172.21.15.55:0/2845475751 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa9b80b6370 0x7fa9b80b6800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:00.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:00.171+0000 7fa9bd056640 1 -- 172.21.15.55:0/2845475751 >> v2:172.21.15.72:3300/0 conn(0x7fa9b815ec00 msgr2=0x7fa9b80b3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:00.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:00.171+0000 7fa9bd056640 1 --2- 172.21.15.55:0/2845475751 >> v2:172.21.15.72:3300/0 conn(0x7fa9b815ec00 0x7fa9b80b3db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:00.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:00.171+0000 7fa9bd056640 1 -- 172.21.15.55:0/2845475751 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9b80cf530 con 0x7fa9b80b3860 2024-05-27T12:33:00.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:00.171+0000 7fa9bd857640 1 --2- 172.21.15.55:0/2845475751 >> v2:172.21.15.72:3300/0 conn(0x7fa9b815ec00 0x7fa9b80b3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T12:33:00.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:00.172+0000 7fa9bd056640 1 --2- 172.21.15.55:0/2845475751 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9b80b3860 0x7fa9b80cfd30 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fa9b80b7310 tx=0x7fa9a802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a131dfc79df078b4 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:00.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:00.172+0000 7fa9bc855640 1 -- 172.21.15.55:0/2845475751 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9a8037070 con 0x7fa9b80b3860 2024-05-27T12:33:00.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:00.172+0000 7fa9bc855640 1 -- 172.21.15.55:0/2845475751 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9a8032440 con 0x7fa9b80b3860 2024-05-27T12:33:00.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:00.172+0000 7fa9bc855640 1 -- 172.21.15.55:0/2845475751 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9a8032810 con 0x7fa9b80b3860 2024-05-27T12:33:00.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:00.172+0000 7fa9bfabb640 1 -- 172.21.15.55:0/2845475751 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9b80b3860 msgr2=0x7fa9b80cfd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:00.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:00.172+0000 7fa9bfabb640 1 --2- 172.21.15.55:0/2845475751 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9b80b3860 0x7fa9b80cfd30 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fa9b80b7310 tx=0x7fa9a802a1e0 comp rx=0 tx=0).stop 2024-05-27T12:33:00.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:00.172+0000 7fa9bfabb640 1 -- 172.21.15.55:0/2845475751 shutdown_connections 2024-05-27T12:33:00.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:00.172+0000 7fa9bfabb640 1 --2- 172.21.15.55:0/2845475751 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa9b80b6370 0x7fa9b80b6800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:00.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:00.172+0000 7fa9bfabb640 1 --2- 172.21.15.55:0/2845475751 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9b80b3860 0x7fa9b80cfd30 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:00.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:00.172+0000 7fa9bfabb640 1 --2- 172.21.15.55:0/2845475751 >> v2:172.21.15.72:3300/0 conn(0x7fa9b815ec00 0x7fa9b80b3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:00.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:00.172+0000 7fa9bfabb640 1 -- 172.21.15.55:0/2845475751 >> 172.21.15.55:0/2845475751 conn(0x7fa9b80d1370 msgr2=0x7fa9b80d1780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:00.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:00.172+0000 7fa9bfabb640 1 -- 172.21.15.55:0/2845475751 shutdown_connections 2024-05-27T12:33:00.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:00.172+0000 7fa9bfabb640 1 -- 172.21.15.55:0/2845475751 wait complete. 2024-05-27T12:33:00.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:00.174+0000 7fa9bfabb640 1 Processor -- start 2024-05-27T12:33:00.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:00.174+0000 7fa9bfabb640 1 -- start start 2024-05-27T12:33:00.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:00.174+0000 7fa9bfabb640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9b80b3860 0x7fa9b80ccf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:00.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:00.174+0000 7fa9bfabb640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa9b80b6370 0x7fa9b80d2980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:00.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:00.174+0000 7fa9bfabb640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa9b815ec00 0x7fa9b80d2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:00.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:00.174+0000 7fa9bfabb640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7fa9b80b3530 con 0x7fa9b80b3860 2024-05-27T12:33:00.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:00.174+0000 7fa9bfabb640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fa9b80d0270 con 0x7fa9b80b6370 2024-05-27T12:33:00.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:00.174+0000 7fa9bfabb640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fa9b815efe0 con 0x7fa9b815ec00 2024-05-27T12:33:00.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:00.174+0000 7fa9bd857640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9b80b3860 0x7fa9b80ccf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:00.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:00.175+0000 7fa9bd857640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9b80b3860 0x7fa9b80ccf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57786/0 (socket says 172.21.15.55:57786) 2024-05-27T12:33:00.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:00.175+0000 7fa9bd857640 1 -- 172.21.15.55:0/2130473321 learned_addr learned my addr 172.21.15.55:0/2130473321 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:33:00.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:00.175+0000 7fa9be058640 1 --2- 172.21.15.55:0/2130473321 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa9b815ec00 0x7fa9b80d2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:00.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:00.175+0000 7fa9bd056640 1 --2- 172.21.15.55:0/2130473321 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa9b80b6370 0x7fa9b80d2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:00.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:00.175+0000 7fa9bd857640 1 -- 172.21.15.55:0/2130473321 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa9b815ec00 msgr2=0x7fa9b80d2ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:00.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:00.175+0000 7fa9bd857640 1 --2- 172.21.15.55:0/2130473321 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa9b815ec00 0x7fa9b80d2ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:00.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:00.175+0000 7fa9bd857640 1 -- 172.21.15.55:0/2130473321 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa9b80b6370 msgr2=0x7fa9b80d2980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:00.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:00.175+0000 7fa9bd857640 1 --2- 172.21.15.55:0/2130473321 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa9b80b6370 0x7fa9b80d2980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:00.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:00.175+0000 7fa9bd857640 1 -- 172.21.15.55:0/2130473321 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9b80cd7a0 con 0x7fa9b80b3860 2024-05-27T12:33:00.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:00.175+0000 7fa9bd857640 1 --2- 172.21.15.55:0/2130473321 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9b80b3860 0x7fa9b80ccf50 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa9b400d7d0 tx=0x7fa9b400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:00.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:00.175+0000 7fa9ae7fc640 1 -- 172.21.15.55:0/2130473321 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9b4004030 con 0x7fa9b80b3860 2024-05-27T12:33:00.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:00.175+0000 7fa9ae7fc640 1 -- 172.21.15.55:0/2130473321 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9b40041d0 con 0x7fa9b80b3860 2024-05-27T12:33:00.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:00.175+0000 7fa9ae7fc640 1 -- 172.21.15.55:0/2130473321 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9b40096a0 con 0x7fa9b80b3860 2024-05-27T12:33:00.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:00.175+0000 7fa9bfabb640 1 -- 172.21.15.55:0/2130473321 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9b80cda80 con 0x7fa9b80b3860 2024-05-27T12:33:00.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:00.175+0000 7fa9bfabb640 1 -- 172.21.15.55:0/2130473321 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9b80ce040 con 0x7fa9b80b3860 2024-05-27T12:33:00.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:00.176+0000 7fa9bfabb640 1 -- 172.21.15.55:0/2130473321 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9b806db20 con 0x7fa9b80b3860 2024-05-27T12:33:00.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:00.177+0000 7fa9ae7fc640 1 -- 172.21.15.55:0/2130473321 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa9b4009840 con 0x7fa9b80b3860 2024-05-27T12:33:00.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:00.177+0000 7fa9ae7fc640 1 --2- 172.21.15.55:0/2130473321 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fa99c06c920 0x7fa99c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:00.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:00.178+0000 7fa9ae7fc640 1 -- 172.21.15.55:0/2130473321 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fa9b408bd90 con 0x7fa9b80b3860 2024-05-27T12:33:00.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:00.178+0000 7fa9bd056640 1 --2- 172.21.15.55:0/2130473321 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fa99c06c920 0x7fa99c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:00.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:00.178+0000 7fa9bd056640 1 --2- 172.21.15.55:0/2130473321 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fa99c06c920 0x7fa99c06ede0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa9a8034000 tx=0x7fa9a802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:00.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:00.182+0000 7fa9ae7fc640 1 -- 172.21.15.55:0/2130473321 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa9b806db20 con 0x7fa9b80b3860 2024-05-27T12:33:00.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:00.404+0000 7fa9bfabb640 1 -- 172.21.15.55:0/2130473321 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fa9b8075460 con 0x7fa9b80b3860 2024-05-27T12:33:00.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:00.405+0000 7fa9ae7fc640 1 -- 172.21.15.55:0/2130473321 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) ==== 53+0+73 (secure 0 0 0) 0x7fa9b405a250 con 0x7fa9b80b3860 2024-05-27T12:33:00.404 INFO:teuthology.orchestra.run.smithi055.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-27T12:33:00.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:00.407+0000 7fa9bfabb640 1 -- 172.21.15.55:0/2130473321 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fa99c06c920 msgr2=0x7fa99c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:00.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:00.407+0000 7fa9bfabb640 1 --2- 172.21.15.55:0/2130473321 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fa99c06c920 0x7fa99c06ede0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa9a8034000 tx=0x7fa9a802e000 comp rx=0 tx=0).stop 2024-05-27T12:33:00.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:00.407+0000 7fa9bfabb640 1 -- 172.21.15.55:0/2130473321 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9b80b3860 msgr2=0x7fa9b80ccf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:00.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:00.407+0000 7fa9bfabb640 1 --2- 172.21.15.55:0/2130473321 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9b80b3860 0x7fa9b80ccf50 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa9b400d7d0 tx=0x7fa9b400dc90 comp rx=0 tx=0).stop 2024-05-27T12:33:00.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:00.407+0000 7fa9bfabb640 1 -- 172.21.15.55:0/2130473321 shutdown_connections 2024-05-27T12:33:00.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:00.407+0000 7fa9bfabb640 1 --2- 172.21.15.55:0/2130473321 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa9b815ec00 0x7fa9b80d2ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:00.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:00.407+0000 7fa9bfabb640 1 --2- 172.21.15.55:0/2130473321 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fa99c06c920 0x7fa99c06ede0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:00.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:00.407+0000 7fa9bfabb640 1 --2- 172.21.15.55:0/2130473321 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa9b80b6370 0x7fa9b80d2980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:00.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:00.407+0000 7fa9bfabb640 1 --2- 172.21.15.55:0/2130473321 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9b80b3860 0x7fa9b80ccf50 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:00.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:00.407+0000 7fa9bfabb640 1 -- 172.21.15.55:0/2130473321 >> 172.21.15.55:0/2130473321 conn(0x7fa9b80d1370 msgr2=0x7fa9b80b8d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:00.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:00.407+0000 7fa9bfabb640 1 -- 172.21.15.55:0/2130473321 shutdown_connections 2024-05-27T12:33:00.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:00.407+0000 7fa9bfabb640 1 -- 172.21.15.55:0/2130473321 wait complete. 2024-05-27T12:33:00.417 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-27T12:33:00.417 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-27T12:33:00.417 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi055.front.sepia.ceph.com 2024-05-27T12:33:00.417 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-27T12:33:00.417 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-27T12:33:00.417 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-27T12:33:00.417 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-27T12:33:00.417 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-27T12:33:00.417 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-27T12:33:00.418 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T12:33:00.418 DEBUG:teuthology.orchestra.run.smithi055:> ip addr 2024-05-27T12:33:00.434 INFO:teuthology.orchestra.run.smithi055.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-27T12:33:00.434 INFO:teuthology.orchestra.run.smithi055.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-27T12:33:00.434 INFO:teuthology.orchestra.run.smithi055.stdout: inet 127.0.0.1/8 scope host lo 2024-05-27T12:33:00.434 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-05-27T12:33:00.434 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 ::1/128 scope host 2024-05-27T12:33:00.434 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-05-27T12:33:00.434 INFO:teuthology.orchestra.run.smithi055.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-27T12:33:00.434 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d6 brd ff:ff:ff:ff:ff:ff 2024-05-27T12:33:00.434 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f0 2024-05-27T12:33:00.434 INFO:teuthology.orchestra.run.smithi055.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-27T12:33:00.434 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d7 brd ff:ff:ff:ff:ff:ff 2024-05-27T12:33:00.435 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f1 2024-05-27T12:33:00.435 INFO:teuthology.orchestra.run.smithi055.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-27T12:33:00.435 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:06 brd ff:ff:ff:ff:ff:ff 2024-05-27T12:33:00.435 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f0 2024-05-27T12:33:00.435 INFO:teuthology.orchestra.run.smithi055.stdout: inet 172.21.15.55/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-05-27T12:33:00.435 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft 42699sec preferred_lft 42699sec 2024-05-27T12:33:00.435 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::ae1f:6bff:fef8:2606/64 scope link noprefixroute 2024-05-27T12:33:00.435 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-05-27T12:33:00.435 INFO:teuthology.orchestra.run.smithi055.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-27T12:33:00.435 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:07 brd ff:ff:ff:ff:ff:ff 2024-05-27T12:33:00.435 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f1 2024-05-27T12:33:00.436 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-27T12:33:00.436 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-27T12:33:00.436 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2024-05-27T12:33:00.436 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link add name ceph-brx type bridge 2024-05-27T12:33:00.436 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip addr flush dev ceph-brx 2024-05-27T12:33:00.436 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link set ceph-brx up 2024-05-27T12:33:00.436 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-27T12:33:00.436 DEBUG:teuthology.orchestra.run.smithi055:> ') 2024-05-27T12:33:00.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:00 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-27T12:33:00.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-27T12:33:00.635 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T12:33:00.636 DEBUG:teuthology.orchestra.run.smithi055:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-27T12:33:00.662 INFO:teuthology.orchestra.run.smithi055.stdout:1 2024-05-27T12:33:00.664 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T12:33:00.664 DEBUG:teuthology.orchestra.run.smithi055:> route 2024-05-27T12:33:00.727 INFO:teuthology.orchestra.run.smithi055.stdout:Kernel IP routing table 2024-05-27T12:33:00.728 INFO:teuthology.orchestra.run.smithi055.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-27T12:33:00.728 INFO:teuthology.orchestra.run.smithi055.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-05-27T12:33:00.728 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-05-27T12:33:00.728 INFO:teuthology.orchestra.run.smithi055.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-27T12:33:00.728 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-27T12:33:00.728 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2024-05-27T12:33:00.728 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-05-27T12:33:00.728 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-05-27T12:33:00.729 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-05-27T12:33:00.729 DEBUG:teuthology.orchestra.run.smithi055:> ') 2024-05-27T12:33:00.818 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:00 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-27T12:33:01.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-27T12:33:01.020 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T12:33:01.020 DEBUG:teuthology.orchestra.run.smithi055:> ip netns list 2024-05-27T12:33:01.036 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T12:33:01.037 DEBUG:teuthology.orchestra.run.smithi055:> ip netns list-id 2024-05-27T12:33:01.093 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-27T12:33:01.093 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2024-05-27T12:33:01.093 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-27T12:33:01.093 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-05-27T12:33:01.093 DEBUG:teuthology.orchestra.run.smithi055:> ') 2024-05-27T12:33:01.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:01 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-27T12:33:01.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-27T12:33:01.214 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-05-27T12:33:01.214 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-27T12:33:01.214 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2024-05-27T12:33:01.214 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-05-27T12:33:01.214 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-27T12:33:01.214 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-05-27T12:33:01.214 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-05-27T12:33:01.214 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-05-27T12:33:01.214 DEBUG:teuthology.orchestra.run.smithi055:> ') 2024-05-27T12:33:01.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:01 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-27T12:33:01.345 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-27T12:33:01.352 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-27T12:33:01.352 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2024-05-27T12:33:01.352 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link set brx.0 up 2024-05-27T12:33:01.352 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link set dev brx.0 master ceph-brx 2024-05-27T12:33:01.352 DEBUG:teuthology.orchestra.run.smithi055:> ') 2024-05-27T12:33:01.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:01 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-27T12:33:01.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-27T12:33:01.432 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-27T12:33:01.432 DEBUG:teuthology.orchestra.run.smithi055:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-27T12:33:01.447 INFO:teuthology.orchestra.run.smithi055.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-27T12:33:01.448 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-27T12:33:01.448 DEBUG:teuthology.orchestra.run.smithi055:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-27T12:33:01.504 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-05-27T12:33:01.504 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T12:33:01.504 DEBUG:teuthology.orchestra.run.smithi055:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-27T12:33:01.600 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-27T12:33:01.600 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-27T12:33:01.600 INFO:teuthology.orchestra.run.smithi055.stdout:invalid new device string format 2024-05-27T12:33:01.716 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-27T12:33:01.716 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-27T12:33:01.716 INFO:teuthology.orchestra.run.smithi055.stdout:invalid new device string format 2024-05-27T12:33:01.716 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: resolved to: "172.21.15.55:3300,172.21.15.72:3300,172.21.15.72:3301" 2024-05-27T12:33:01.716 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-27T12:33:01.721 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-27T12:33:01.721 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-27T12:33:01.721 INFO:teuthology.orchestra.run.smithi055.stdout:invalid new device string format 2024-05-27T12:33:01.721 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: resolved to: "172.21.15.55:3300,172.21.15.72:3300,172.21.15.72:3301" 2024-05-27T12:33:01.721 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-27T12:33:01.722 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: resolved to: "172.21.15.55:6789,172.21.15.72:6789,172.21.15.72:6790" 2024-05-27T12:33:01.722 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.55:6789,172.21.15.72:6789,172.21.15.72:6790:/ 2024-05-27T12:33:01.722 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=c3ff4e3b-8dae-4856-9593-e5cc66c59982" will pass to kernel 2024-05-27T12:33:01.722 INFO:teuthology.orchestra.run.smithi055.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-05-27T12:33:01.723 INFO:teuthology.orchestra.run.smithi055.stdout: You just mounted a file system that supports labels which does not 2024-05-27T12:33:01.723 INFO:teuthology.orchestra.run.smithi055.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-27T12:33:01.723 INFO:teuthology.orchestra.run.smithi055.stdout: applications will generate AVC messages and not be allowed access to 2024-05-27T12:33:01.723 INFO:teuthology.orchestra.run.smithi055.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-27T12:33:01.726 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-27T12:33:01.726 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T12:33:01.726 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-27T12:33:01.752 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-27T12:33:01.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:01 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-27T12:33:01.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-27T12:33:01.858 INFO:teuthology.orchestra.run.smithi055.stdout:client4710 2024-05-27T12:33:01.858 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-05-27T12:33:01.858 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-27T12:33:01.875 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-27T12:33:01.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:01 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-27T12:33:01.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-27T12:33:01.979 INFO:teuthology.orchestra.run.smithi055.stdout:client4710 2024-05-27T12:33:01.979 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-27T12:33:02.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:02 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-27T12:33:02.037 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-27T12:33:02.043 INFO:teuthology.orchestra.run.smithi055.stdout:client4710 2024-05-27T12:33:02.043 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/c3ff4e3b-8dae-4856-9593-e5cc66c59982.client4710/status') 2024-05-27T12:33:02.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:02 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-27T12:33:02.110 INFO:teuthology.orchestra.run.smithi055.stdout:instance: client.4710 (3)192.168.0.1:0/1833366855 2024-05-27T12:33:02.110 INFO:teuthology.orchestra.run.smithi055.stdout:blocklisted: false 2024-05-27T12:33:02.110 INFO:teuthology.orchestra.run.smithi055.stderr:0+1 records in 2024-05-27T12:33:02.110 INFO:teuthology.orchestra.run.smithi055.stderr:0+1 records out 2024-05-27T12:33:02.110 INFO:teuthology.orchestra.run.smithi055.stderr:69 bytes copied, 2.7016e-05 s, 2.6 MB/s 2024-05-27T12:33:02.111 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-27T12:33:02.117 INFO:tasks.kclient:client.2 config is {'syntax': 'v1'} 2024-05-27T12:33:02.118 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-27T12:33:02.118 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-05-27T12:33:02.118 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-27T12:33:02.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:02.222+0000 7f2cd8249640 1 Processor -- start 2024-05-27T12:33:02.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:02.223+0000 7f2cd8249640 1 -- start start 2024-05-27T12:33:02.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:02.223+0000 7f2cd8249640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2cd015e960 0x7f2cd006e740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:02.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:02.223+0000 7f2cd8249640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2cd015ed40 con 0x7f2cd006ec80 2024-05-27T12:33:02.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:02.224+0000 7f2cd8249640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2cd0073a20 con 0x7f2cd006c940 2024-05-27T12:33:02.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:02.224+0000 7f2cd8249640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f2cd00b5170 con 0x7f2cd015e960 2024-05-27T12:33:02.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:02.224+0000 7f2cd57e4640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f2cd006ec80 0x7f2cd00ae780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:37010/0 (socket says 172.21.15.55:37010) 2024-05-27T12:33:02.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:02.224+0000 7f2cd57e4640 1 -- 172.21.15.55:0/2309003444 learned_addr learned my addr 172.21.15.55:0/2309003444 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-27T12:33:02.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:02.224+0000 7f2cd5fe5640 1 --2- 172.21.15.55:0/2309003444 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2cd015e960 0x7f2cd006e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:02.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:02.224+0000 7f2cd4fe3640 1 -- 172.21.15.55:0/2309003444 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 510117134 0 0) 0x7f2cd015ed40 con 0x7f2cd006ec80 2024-05-27T12:33:02.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:02.224+0000 7f2cd4fe3640 1 -- 172.21.15.55:0/2309003444 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2cb8003520 con 0x7f2cd006ec80 2024-05-27T12:33:02.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:02.224+0000 7f2cd4fe3640 1 -- 172.21.15.55:0/2309003444 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3270740838 0 0) 0x7f2cb8003520 con 0x7f2cd006ec80 2024-05-27T12:33:02.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:02.224+0000 7f2cd4fe3640 1 -- 172.21.15.55:0/2309003444 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2cd015e960 msgr2=0x7f2cd006e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:02.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:02.224+0000 7f2cd4fe3640 1 --2- 172.21.15.55:0/2309003444 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2cd015e960 0x7f2cd006e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:02.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:02.224+0000 7f2cd4fe3640 1 -- 172.21.15.55:0/2309003444 >> v1:172.21.15.72:6789/0 conn(0x7f2cd006c940 legacy=0x7f2cd00b5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:02.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:02.224+0000 7f2cd4fe3640 1 -- 172.21.15.55:0/2309003444 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cd00b4840 con 0x7f2cd006ec80 2024-05-27T12:33:02.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:02.224+0000 7f2cd4fe3640 1 -- 172.21.15.55:0/2309003444 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 793017739 0 0) 0x7f2cc4001670 con 0x7f2cd006ec80 2024-05-27T12:33:02.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:02.224+0000 7f2cd4fe3640 1 -- 172.21.15.55:0/2309003444 >> v1:172.21.15.55:6789/0 conn(0x7f2cd006ec80 legacy=0x7f2cd00ae780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:02.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:02.224+0000 7f2cd4fe3640 1 --2- 172.21.15.55:0/2309003444 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2cb8003ac0 0x7f2cb8003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:02.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:02.224+0000 7f2cd4fe3640 1 --2- 172.21.15.55:0/2309003444 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2cd015e960 0x7f2cb8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:02.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:02.224+0000 7f2cd4fe3640 1 --2- 172.21.15.55:0/2309003444 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2cb8004d40 0x7f2cb80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:02.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:02.224+0000 7f2cd4fe3640 1 -- 172.21.15.55:0/2309003444 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f2cd00b5170 con 0x7f2cb8003ac0 2024-05-27T12:33:02.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:02.224+0000 7f2cd4fe3640 1 -- 172.21.15.55:0/2309003444 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f2cb800bb50 con 0x7f2cb8004d40 2024-05-27T12:33:02.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:02.224+0000 7f2cd4fe3640 1 -- 172.21.15.55:0/2309003444 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f2cb800bd50 con 0x7f2cd015e960 2024-05-27T12:33:02.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:02.225+0000 7f2cd5fe5640 1 --2- 172.21.15.55:0/2309003444 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2cb8003ac0 0x7f2cb8003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:02.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:02.225+0000 7f2cd57e4640 1 --2- 172.21.15.55:0/2309003444 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2cd015e960 0x7f2cb8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:02.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:02.225+0000 7f2cd67e6640 1 --2- 172.21.15.55:0/2309003444 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2cb8004d40 0x7f2cb80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:02.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:02.225+0000 7f2cd5fe5640 1 -- 172.21.15.55:0/2309003444 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2cd015e960 msgr2=0x7f2cb8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:02.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:02.225+0000 7f2cd5fe5640 1 --2- 172.21.15.55:0/2309003444 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2cd015e960 0x7f2cb8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:02.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:02.225+0000 7f2cd5fe5640 1 -- 172.21.15.55:0/2309003444 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2cb8004d40 msgr2=0x7f2cb80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:02.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:02.225+0000 7f2cd5fe5640 1 --2- 172.21.15.55:0/2309003444 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2cb8004d40 0x7f2cb80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:02.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:02.225+0000 7f2cd5fe5640 1 -- 172.21.15.55:0/2309003444 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cb8003520 con 0x7f2cb8003ac0 2024-05-27T12:33:02.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:02.225+0000 7f2cd67e6640 1 --2- 172.21.15.55:0/2309003444 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2cb8004d40 0x7f2cb80051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T12:33:02.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:02.225+0000 7f2cd5fe5640 1 --2- 172.21.15.55:0/2309003444 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2cb8003ac0 0x7f2cb8003ec0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2cc8009ac0 tx=0x7f2cb8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6781088e72af171b server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:02.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:02.226+0000 7f2cd4fe3640 1 -- 172.21.15.55:0/2309003444 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cc8036070 con 0x7f2cb8003ac0 2024-05-27T12:33:02.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:02.226+0000 7f2cd4fe3640 1 -- 172.21.15.55:0/2309003444 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cc8031400 con 0x7f2cb8003ac0 2024-05-27T12:33:02.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:02.226+0000 7f2cd4fe3640 1 -- 172.21.15.55:0/2309003444 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cc8009690 con 0x7f2cb8003ac0 2024-05-27T12:33:02.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:02.226+0000 7f2cd8249640 1 -- 172.21.15.55:0/2309003444 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2cb8003ac0 msgr2=0x7f2cb8003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:02.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:02.226+0000 7f2cd8249640 1 --2- 172.21.15.55:0/2309003444 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2cb8003ac0 0x7f2cb8003ec0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2cc8009ac0 tx=0x7f2cb8005830 comp rx=0 tx=0).stop 2024-05-27T12:33:02.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:02.226+0000 7f2cd67e6640 1 -- 172.21.15.55:0/2309003444 reap_dead start 2024-05-27T12:33:02.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:02.226+0000 7f2cd8249640 1 -- 172.21.15.55:0/2309003444 shutdown_connections 2024-05-27T12:33:02.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:02.226+0000 7f2cd8249640 1 -- 172.21.15.55:0/2309003444 >> 172.21.15.55:0/2309003444 conn(0x7f2cd00727b0 msgr2=0x7f2cd0072bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:02.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:02.226+0000 7f2cd8249640 1 -- 172.21.15.55:0/2309003444 shutdown_connections 2024-05-27T12:33:02.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:02.226+0000 7f2cd8249640 1 -- 172.21.15.55:0/2309003444 wait complete. 2024-05-27T12:33:02.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:02.228+0000 7f2cd8249640 1 Processor -- start 2024-05-27T12:33:02.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:02.228+0000 7f2cd8249640 1 -- start start 2024-05-27T12:33:02.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:02.228+0000 7f2cd8249640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2cb8003ac0 0x7f2cd015ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:02.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:02.228+0000 7f2cd8249640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2cd0155b20 0x7f2cd0155fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:02.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:02.228+0000 7f2cd8249640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2cd0160d20 0x7f2cd01611d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:02.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:02.228+0000 7f2cd8249640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f2cd00af2f0 con 0x7f2cb8003ac0 2024-05-27T12:33:02.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:02.228+0000 7f2cd8249640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f2cd00b4e00 con 0x7f2cd0155b20 2024-05-27T12:33:02.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:02.228+0000 7f2cd8249640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f2cd00aee90 con 0x7f2cd0160d20 2024-05-27T12:33:02.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:02.228+0000 7f2cd5fe5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2cb8003ac0 0x7f2cd015ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:02.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:02.228+0000 7f2cd5fe5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2cb8003ac0 0x7f2cd015ef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57790/0 (socket says 172.21.15.55:57790) 2024-05-27T12:33:02.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:02.228+0000 7f2cd5fe5640 1 -- 172.21.15.55:0/2642779434 learned_addr learned my addr 172.21.15.55:0/2642779434 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:33:02.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:02.229+0000 7f2cd5fe5640 1 -- 172.21.15.55:0/2642779434 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2cd0160d20 msgr2=0x7f2cd01611d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:02.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:02.229+0000 7f2cd57e4640 1 --2- 172.21.15.55:0/2642779434 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2cd0155b20 0x7f2cd0155fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:02.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:02.229+0000 7f2cd67e6640 1 --2- 172.21.15.55:0/2642779434 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2cd0160d20 0x7f2cd01611d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:02.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:02.229+0000 7f2cd5fe5640 1 --2- 172.21.15.55:0/2642779434 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2cd0160d20 0x7f2cd01611d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:02.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:02.229+0000 7f2cd5fe5640 1 -- 172.21.15.55:0/2642779434 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2cd0155b20 msgr2=0x7f2cd0155fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:02.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:02.229+0000 7f2cd5fe5640 1 --2- 172.21.15.55:0/2642779434 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2cd0155b20 0x7f2cd0155fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:02.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:02.229+0000 7f2cd5fe5640 1 -- 172.21.15.55:0/2642779434 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cd01e8880 con 0x7f2cb8003ac0 2024-05-27T12:33:02.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:02.229+0000 7f2cd57e4640 1 --2- 172.21.15.55:0/2642779434 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2cd0155b20 0x7f2cd0155fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T12:33:02.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:02.229+0000 7f2cd67e6640 1 --2- 172.21.15.55:0/2642779434 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2cd0160d20 0x7f2cd01611d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T12:33:02.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:02.229+0000 7f2cd5fe5640 1 --2- 172.21.15.55:0/2642779434 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2cb8003ac0 0x7f2cd015ef30 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f2cc8009ac0 tx=0x7f2cc8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:02.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:02.229+0000 7f2cce7fc640 1 -- 172.21.15.55:0/2642779434 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cc8040020 con 0x7f2cb8003ac0 2024-05-27T12:33:02.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:02.229+0000 7f2cce7fc640 1 -- 172.21.15.55:0/2642779434 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cc8003bc0 con 0x7f2cb8003ac0 2024-05-27T12:33:02.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:02.229+0000 7f2cd8249640 1 -- 172.21.15.55:0/2642779434 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cd01564e0 con 0x7f2cb8003ac0 2024-05-27T12:33:02.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:02.229+0000 7f2cce7fc640 1 -- 172.21.15.55:0/2642779434 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cc8036040 con 0x7f2cb8003ac0 2024-05-27T12:33:02.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:02.229+0000 7f2cd8249640 1 -- 172.21.15.55:0/2642779434 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cd0161d50 con 0x7f2cb8003ac0 2024-05-27T12:33:02.234 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:02.230+0000 7f2cd8249640 1 -- 172.21.15.55:0/2642779434 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2cd01e8c80 con 0x7f2cb8003ac0 2024-05-27T12:33:02.234 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:02.231+0000 7f2cce7fc640 1 -- 172.21.15.55:0/2642779434 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2cc8043020 con 0x7f2cb8003ac0 2024-05-27T12:33:02.234 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:02.231+0000 7f2cce7fc640 1 --2- 172.21.15.55:0/2642779434 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f2cbc06c8f0 0x7f2cbc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:02.234 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:02.231+0000 7f2cce7fc640 1 -- 172.21.15.55:0/2642779434 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f2cc80abb40 con 0x7f2cb8003ac0 2024-05-27T12:33:02.234 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:02.231+0000 7f2cd57e4640 1 --2- 172.21.15.55:0/2642779434 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f2cbc06c8f0 0x7f2cbc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:02.234 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:02.232+0000 7f2cd57e4640 1 --2- 172.21.15.55:0/2642779434 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f2cbc06c8f0 0x7f2cbc06edb0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f2cd0162e30 tx=0x7f2cc4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:02.235 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:02.236+0000 7f2cce7fc640 1 -- 172.21.15.55:0/2642779434 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2cc804a070 con 0x7f2cb8003ac0 2024-05-27T12:33:02.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:02.460+0000 7f2cd8249640 1 -- 172.21.15.55:0/2642779434 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f2cd0075460 con 0x7f2cb8003ac0 2024-05-27T12:33:02.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:02.460+0000 7f2cce7fc640 1 -- 172.21.15.55:0/2642779434 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) ==== 53+0+73 (secure 0 0 0) 0x7f2cc80044e0 con 0x7f2cb8003ac0 2024-05-27T12:33:02.460 INFO:teuthology.orchestra.run.smithi055.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-27T12:33:02.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:02.462+0000 7f2cd8249640 1 -- 172.21.15.55:0/2642779434 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f2cbc06c8f0 msgr2=0x7f2cbc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:02.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:02.462+0000 7f2cd8249640 1 --2- 172.21.15.55:0/2642779434 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f2cbc06c8f0 0x7f2cbc06edb0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f2cd0162e30 tx=0x7f2cc4009040 comp rx=0 tx=0).stop 2024-05-27T12:33:02.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:02.462+0000 7f2cd8249640 1 -- 172.21.15.55:0/2642779434 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2cb8003ac0 msgr2=0x7f2cd015ef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:02.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:02.462+0000 7f2cd8249640 1 --2- 172.21.15.55:0/2642779434 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2cb8003ac0 0x7f2cd015ef30 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f2cc8009ac0 tx=0x7f2cc8004730 comp rx=0 tx=0).stop 2024-05-27T12:33:02.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:02.462+0000 7f2cd8249640 1 -- 172.21.15.55:0/2642779434 shutdown_connections 2024-05-27T12:33:02.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:02.462+0000 7f2cd8249640 1 --2- 172.21.15.55:0/2642779434 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2cd0160d20 0x7f2cd01611d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:02.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:02.463+0000 7f2cd8249640 1 --2- 172.21.15.55:0/2642779434 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f2cbc06c8f0 0x7f2cbc06edb0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:02.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:02.463+0000 7f2cd8249640 1 --2- 172.21.15.55:0/2642779434 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2cd0155b20 0x7f2cd0155fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:02.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:02.463+0000 7f2cd8249640 1 --2- 172.21.15.55:0/2642779434 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2cb8003ac0 0x7f2cd015ef30 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:02.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:02.463+0000 7f2cd8249640 1 -- 172.21.15.55:0/2642779434 >> 172.21.15.55:0/2642779434 conn(0x7f2cd00727b0 msgr2=0x7f2cd00b1050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:02.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:02.463+0000 7f2cd8249640 1 -- 172.21.15.55:0/2642779434 shutdown_connections 2024-05-27T12:33:02.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:02.463+0000 7f2cd8249640 1 -- 172.21.15.55:0/2642779434 wait complete. 2024-05-27T12:33:02.473 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-27T12:33:02.473 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-27T12:33:02.473 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi055.front.sepia.ceph.com 2024-05-27T12:33:02.473 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-05-27T12:33:02.473 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-05-27T12:33:02.473 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-27T12:33:02.473 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-27T12:33:02.473 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-27T12:33:02.473 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-05-27T12:33:02.474 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T12:33:02.474 DEBUG:teuthology.orchestra.run.smithi055:> ip addr 2024-05-27T12:33:02.490 INFO:teuthology.orchestra.run.smithi055.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-27T12:33:02.490 INFO:teuthology.orchestra.run.smithi055.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-27T12:33:02.490 INFO:teuthology.orchestra.run.smithi055.stdout: inet 127.0.0.1/8 scope host lo 2024-05-27T12:33:02.490 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-05-27T12:33:02.490 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 ::1/128 scope host 2024-05-27T12:33:02.490 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-05-27T12:33:02.490 INFO:teuthology.orchestra.run.smithi055.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-27T12:33:02.490 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d6 brd ff:ff:ff:ff:ff:ff 2024-05-27T12:33:02.491 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f0 2024-05-27T12:33:02.491 INFO:teuthology.orchestra.run.smithi055.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-27T12:33:02.491 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d7 brd ff:ff:ff:ff:ff:ff 2024-05-27T12:33:02.491 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f1 2024-05-27T12:33:02.491 INFO:teuthology.orchestra.run.smithi055.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-27T12:33:02.491 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:06 brd ff:ff:ff:ff:ff:ff 2024-05-27T12:33:02.491 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f0 2024-05-27T12:33:02.491 INFO:teuthology.orchestra.run.smithi055.stdout: inet 172.21.15.55/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-05-27T12:33:02.491 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft 42697sec preferred_lft 42697sec 2024-05-27T12:33:02.491 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::ae1f:6bff:fef8:2606/64 scope link noprefixroute 2024-05-27T12:33:02.491 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-05-27T12:33:02.491 INFO:teuthology.orchestra.run.smithi055.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-27T12:33:02.492 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:07 brd ff:ff:ff:ff:ff:ff 2024-05-27T12:33:02.492 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f1 2024-05-27T12:33:02.492 INFO:teuthology.orchestra.run.smithi055.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-27T12:33:02.492 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 2e:af:a5:b4:68:cc brd ff:ff:ff:ff:ff:ff 2024-05-27T12:33:02.492 INFO:teuthology.orchestra.run.smithi055.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-27T12:33:02.492 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-05-27T12:33:02.492 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::64fc:d3ff:fef6:6ed9/64 scope link 2024-05-27T12:33:02.492 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-05-27T12:33:02.492 INFO:teuthology.orchestra.run.smithi055.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-27T12:33:02.492 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 2e:af:a5:b4:68:cc brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-27T12:33:02.492 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::2caf:a5ff:feb4:68cc/64 scope link tentative 2024-05-27T12:33:02.492 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-05-27T12:33:02.493 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T12:33:02.493 DEBUG:teuthology.orchestra.run.smithi055:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-27T12:33:02.555 INFO:teuthology.orchestra.run.smithi055.stdout:1 2024-05-27T12:33:02.556 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T12:33:02.556 DEBUG:teuthology.orchestra.run.smithi055:> route 2024-05-27T12:33:02.613 INFO:teuthology.orchestra.run.smithi055.stdout:Kernel IP routing table 2024-05-27T12:33:02.613 INFO:teuthology.orchestra.run.smithi055.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-27T12:33:02.614 INFO:teuthology.orchestra.run.smithi055.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-05-27T12:33:02.614 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-05-27T12:33:02.614 INFO:teuthology.orchestra.run.smithi055.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-27T12:33:02.614 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-27T12:33:02.614 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2024-05-27T12:33:02.614 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-05-27T12:33:02.614 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-05-27T12:33:02.614 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-05-27T12:33:02.615 DEBUG:teuthology.orchestra.run.smithi055:> ') 2024-05-27T12:33:02.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:02 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-27T12:33:02.737 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-27T12:33:02.743 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T12:33:02.745 DEBUG:teuthology.orchestra.run.smithi055:> ip netns list 2024-05-27T12:33:02.761 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-27T12:33:02.762 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T12:33:02.762 DEBUG:teuthology.orchestra.run.smithi055:> ip netns list-id 2024-05-27T12:33:02.818 INFO:teuthology.orchestra.run.smithi055.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-05-27T12:33:02.818 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-27T12:33:02.819 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2024-05-27T12:33:02.819 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-27T12:33:02.819 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-05-27T12:33:02.819 DEBUG:teuthology.orchestra.run.smithi055:> ') 2024-05-27T12:33:02.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:02 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-27T12:33:02.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-27T12:33:02.937 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T12:33:02.938 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-05-27T12:33:02.963 INFO:teuthology.orchestra.run.smithi055.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-27T12:33:02.963 INFO:teuthology.orchestra.run.smithi055.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-27T12:33:02.963 INFO:teuthology.orchestra.run.smithi055.stdout: inet 127.0.0.1/8 scope host lo 2024-05-27T12:33:02.963 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-05-27T12:33:02.963 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 ::1/128 scope host 2024-05-27T12:33:02.963 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-05-27T12:33:02.963 INFO:teuthology.orchestra.run.smithi055.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-27T12:33:02.963 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 5e:d2:86:16:14:b6 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-05-27T12:33:02.964 INFO:teuthology.orchestra.run.smithi055.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-05-27T12:33:02.964 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-05-27T12:33:02.964 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::5cd2:86ff:fe16:14b6/64 scope link tentative 2024-05-27T12:33:02.964 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-05-27T12:33:02.965 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T12:33:02.965 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-05-27T12:33:03.030 INFO:teuthology.orchestra.run.smithi055.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-27T12:33:03.031 INFO:teuthology.orchestra.run.smithi055.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-27T12:33:03.031 INFO:teuthology.orchestra.run.smithi055.stdout: inet 127.0.0.1/8 scope host lo 2024-05-27T12:33:03.031 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-05-27T12:33:03.031 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 ::1/128 scope host 2024-05-27T12:33:03.031 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-05-27T12:33:03.031 INFO:teuthology.orchestra.run.smithi055.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-27T12:33:03.031 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 5e:d2:86:16:14:b6 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-05-27T12:33:03.031 INFO:teuthology.orchestra.run.smithi055.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-05-27T12:33:03.032 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-05-27T12:33:03.032 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::5cd2:86ff:fe16:14b6/64 scope link tentative 2024-05-27T12:33:03.032 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-05-27T12:33:03.033 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-05-27T12:33:03.033 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-27T12:33:03.033 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2024-05-27T12:33:03.033 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-05-27T12:33:03.033 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-05-27T12:33:03.034 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-05-27T12:33:03.034 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-05-27T12:33:03.034 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-05-27T12:33:03.034 DEBUG:teuthology.orchestra.run.smithi055:> ') 2024-05-27T12:33:03.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:03 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-27T12:33:03.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-27T12:33:03.189 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-27T12:33:03.189 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2024-05-27T12:33:03.189 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link set brx.1 up 2024-05-27T12:33:03.189 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link set dev brx.1 master ceph-brx 2024-05-27T12:33:03.189 DEBUG:teuthology.orchestra.run.smithi055:> ') 2024-05-27T12:33:03.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:03 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-27T12:33:03.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-27T12:33:03.269 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-27T12:33:03.269 DEBUG:teuthology.orchestra.run.smithi055:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-05-27T12:33:03.285 INFO:teuthology.orchestra.run.smithi055.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-05-27T12:33:03.285 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-27T12:33:03.285 DEBUG:teuthology.orchestra.run.smithi055:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-05-27T12:33:03.340 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-05-27T12:33:03.341 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T12:33:03.341 DEBUG:teuthology.orchestra.run.smithi055:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-05-27T12:33:03.426 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-05-27T12:33:03.426 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-05-27T12:33:03.426 INFO:teuthology.orchestra.run.smithi055.stdout:invalid new device string format 2024-05-27T12:33:03.435 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-05-27T12:33:03.435 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-05-27T12:33:03.435 INFO:teuthology.orchestra.run.smithi055.stdout:invalid new device string format 2024-05-27T12:33:03.435 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: resolved to: "172.21.15.55:3300,172.21.15.72:3300,172.21.15.72:3301" 2024-05-27T12:33:03.435 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-27T12:33:03.440 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-05-27T12:33:03.440 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-05-27T12:33:03.440 INFO:teuthology.orchestra.run.smithi055.stdout:invalid new device string format 2024-05-27T12:33:03.440 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: resolved to: "172.21.15.55:3300,172.21.15.72:3300,172.21.15.72:3301" 2024-05-27T12:33:03.440 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-27T12:33:03.441 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: resolved to: "172.21.15.55:6789,172.21.15.72:6789,172.21.15.72:6790" 2024-05-27T12:33:03.441 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.55:6789,172.21.15.72:6789,172.21.15.72:6790:/ 2024-05-27T12:33:03.441 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs,key=2,fsid=c3ff4e3b-8dae-4856-9593-e5cc66c59982" will pass to kernel 2024-05-27T12:33:03.441 INFO:teuthology.orchestra.run.smithi055.stdout:mount: /home/ubuntu/cephtest/mnt.2 does not contain SELinux labels. 2024-05-27T12:33:03.441 INFO:teuthology.orchestra.run.smithi055.stdout: You just mounted a file system that supports labels which does not 2024-05-27T12:33:03.441 INFO:teuthology.orchestra.run.smithi055.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-27T12:33:03.441 INFO:teuthology.orchestra.run.smithi055.stdout: applications will generate AVC messages and not be allowed access to 2024-05-27T12:33:03.441 INFO:teuthology.orchestra.run.smithi055.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-27T12:33:03.443 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-27T12:33:03.443 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T12:33:03.443 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-05-27T12:33:03.468 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-27T12:33:03.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:03 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-27T12:33:03.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-27T12:33:03.568 INFO:teuthology.orchestra.run.smithi055.stdout:client4672 2024-05-27T12:33:03.569 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-05-27T12:33:03.569 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-27T12:33:03.585 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-27T12:33:03.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:03 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-27T12:33:03.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-27T12:33:03.683 INFO:teuthology.orchestra.run.smithi055.stdout:client4672 2024-05-27T12:33:03.684 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-27T12:33:03.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:03 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-27T12:33:03.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-27T12:33:03.742 INFO:teuthology.orchestra.run.smithi055.stdout:client4672 2024-05-27T12:33:03.742 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/c3ff4e3b-8dae-4856-9593-e5cc66c59982.client4672/status') 2024-05-27T12:33:03.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:03 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-27T12:33:03.802 INFO:teuthology.orchestra.run.smithi055.stdout:instance: client.4672 (3)172.21.15.55:0/766567801 2024-05-27T12:33:03.802 INFO:teuthology.orchestra.run.smithi055.stdout:blocklisted: false 2024-05-27T12:33:03.802 INFO:teuthology.orchestra.run.smithi055.stderr:0+1 records in 2024-05-27T12:33:03.802 INFO:teuthology.orchestra.run.smithi055.stderr:0+1 records out 2024-05-27T12:33:03.802 INFO:teuthology.orchestra.run.smithi055.stderr:69 bytes copied, 2.4321e-05 s, 2.8 MB/s 2024-05-27T12:33:03.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-27T12:33:03.809 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2024-05-27T12:33:03.809 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-27T12:33:03.810 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-05-27T12:33:03.810 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-27T12:33:03.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:03.914+0000 7fc26ccbb640 1 Processor -- start 2024-05-27T12:33:03.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:03.914+0000 7fc26ccbb640 1 -- start start 2024-05-27T12:33:03.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:03.915+0000 7fc26ccbb640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc2680cf400 0x7fc2680cf840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:03.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:03.915+0000 7fc26ccbb640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc26806f450 con 0x7fc26815a250 2024-05-27T12:33:03.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:03.915+0000 7fc26ccbb640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc268160360 con 0x7fc2680c5710 2024-05-27T12:33:03.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:03.915+0000 7fc26ccbb640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7fc268160f70 con 0x7fc2680cf400 2024-05-27T12:33:03.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:03.915+0000 7fc265d9b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc2680cf400 0x7fc2680cf840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:03.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:03.915+0000 7fc26659c640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fc26815a250 0x7fc26806ed40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:48664/0 (socket says 172.21.15.55:48664) 2024-05-27T12:33:03.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:03.915+0000 7fc26659c640 1 -- 172.21.15.55:0/2880391592 learned_addr learned my addr 172.21.15.55:0/2880391592 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-27T12:33:03.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:03.915+0000 7fc265d9b640 1 -- 172.21.15.55:0/2880391592 >> v1:172.21.15.72:6789/0 conn(0x7fc2680c5710 legacy=0x7fc2680c5b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:03.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:03.915+0000 7fc265d9b640 1 -- 172.21.15.55:0/2880391592 >> v1:172.21.15.55:6789/0 conn(0x7fc26815a250 legacy=0x7fc26806ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:03.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:03.915+0000 7fc265d9b640 1 -- 172.21.15.55:0/2880391592 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc268160640 con 0x7fc2680cf400 2024-05-27T12:33:03.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:03.916+0000 7fc265d9b640 1 --2- 172.21.15.55:0/2880391592 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2680cf400 0x7fc2680cf840 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc25c0097a0 tx=0x7fc25c02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb35aa32b39e6b07 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:03.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:03.916+0000 7fc26559a640 1 -- 172.21.15.55:0/2880391592 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc25c037070 con 0x7fc2680cf400 2024-05-27T12:33:03.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:03.916+0000 7fc26559a640 1 -- 172.21.15.55:0/2880391592 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc25c032440 con 0x7fc2680cf400 2024-05-27T12:33:03.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:03.916+0000 7fc26559a640 1 -- 172.21.15.55:0/2880391592 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc25c032810 con 0x7fc2680cf400 2024-05-27T12:33:03.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:03.916+0000 7fc26ccbb640 1 -- 172.21.15.55:0/2880391592 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2680cf400 msgr2=0x7fc2680cf840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:03.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:03.916+0000 7fc26ccbb640 1 --2- 172.21.15.55:0/2880391592 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2680cf400 0x7fc2680cf840 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc25c0097a0 tx=0x7fc25c02a230 comp rx=0 tx=0).stop 2024-05-27T12:33:03.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:03.917+0000 7fc26ccbb640 1 -- 172.21.15.55:0/2880391592 shutdown_connections 2024-05-27T12:33:03.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:03.917+0000 7fc26ccbb640 1 --2- 172.21.15.55:0/2880391592 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2680cf400 0x7fc2680cf840 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:03.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:03.917+0000 7fc26ccbb640 1 -- 172.21.15.55:0/2880391592 >> 172.21.15.55:0/2880391592 conn(0x7fc2680b3830 msgr2=0x7fc2680b3c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:03.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:03.917+0000 7fc26ccbb640 1 -- 172.21.15.55:0/2880391592 shutdown_connections 2024-05-27T12:33:03.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:03.917+0000 7fc26ccbb640 1 -- 172.21.15.55:0/2880391592 wait complete. 2024-05-27T12:33:03.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:03.918+0000 7fc26ccbb640 1 Processor -- start 2024-05-27T12:33:03.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:03.918+0000 7fc26ccbb640 1 -- start start 2024-05-27T12:33:03.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:03.919+0000 7fc26ccbb640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2680c5710 0x7fc268156350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:03.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:03.919+0000 7fc26ccbb640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc2680cf400 0x7fc2681f2800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:03.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:03.919+0000 7fc26ccbb640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc26815a250 0x7fc2680c5b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:03.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:03.919+0000 7fc26ccbb640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7fc268160c00 con 0x7fc2680c5710 2024-05-27T12:33:03.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:03.919+0000 7fc26ccbb640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fc2680cfd80 con 0x7fc26815a250 2024-05-27T12:33:03.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:03.919+0000 7fc26ccbb640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fc26815a630 con 0x7fc2680cf400 2024-05-27T12:33:03.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:03.919+0000 7fc26659c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2680c5710 0x7fc268156350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:03.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:03.919+0000 7fc26659c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2680c5710 0x7fc268156350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51576/0 (socket says 172.21.15.55:51576) 2024-05-27T12:33:03.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:03.919+0000 7fc26659c640 1 -- 172.21.15.55:0/2979403272 learned_addr learned my addr 172.21.15.55:0/2979403272 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:33:03.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:03.919+0000 7fc266d9d640 1 --2- 172.21.15.55:0/2979403272 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc26815a250 0x7fc2680c5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:03.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:03.919+0000 7fc265d9b640 1 --2- 172.21.15.55:0/2979403272 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc2680cf400 0x7fc2681f2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:03.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:03.919+0000 7fc26659c640 1 -- 172.21.15.55:0/2979403272 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc2680cf400 msgr2=0x7fc2681f2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:03.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:03.919+0000 7fc26659c640 1 --2- 172.21.15.55:0/2979403272 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc2680cf400 0x7fc2681f2800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:03.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:03.919+0000 7fc26659c640 1 -- 172.21.15.55:0/2979403272 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc26815a250 msgr2=0x7fc2680c5b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:03.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:03.919+0000 7fc26659c640 1 --2- 172.21.15.55:0/2979403272 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc26815a250 0x7fc2680c5b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:03.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:03.919+0000 7fc26659c640 1 -- 172.21.15.55:0/2979403272 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc26813e8c0 con 0x7fc2680c5710 2024-05-27T12:33:03.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:03.919+0000 7fc266d9d640 1 --2- 172.21.15.55:0/2979403272 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc26815a250 0x7fc2680c5b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T12:33:03.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:03.919+0000 7fc26659c640 1 --2- 172.21.15.55:0/2979403272 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2680c5710 0x7fc268156350 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fc25800c480 tx=0x7fc25800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:03.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:03.920+0000 7fc256ffd640 1 -- 172.21.15.55:0/2979403272 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc258017070 con 0x7fc2680c5710 2024-05-27T12:33:03.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:03.920+0000 7fc256ffd640 1 -- 172.21.15.55:0/2979403272 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc258005ce0 con 0x7fc2680c5710 2024-05-27T12:33:03.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:03.920+0000 7fc26ccbb640 1 -- 172.21.15.55:0/2979403272 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc26814d490 con 0x7fc2680c5710 2024-05-27T12:33:03.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:03.920+0000 7fc256ffd640 1 -- 172.21.15.55:0/2979403272 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2580072f0 con 0x7fc2680c5710 2024-05-27T12:33:03.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:03.920+0000 7fc26ccbb640 1 -- 172.21.15.55:0/2979403272 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc26814da50 con 0x7fc2680c5710 2024-05-27T12:33:03.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:03.921+0000 7fc26ccbb640 1 -- 172.21.15.55:0/2979403272 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2680731c0 con 0x7fc2680c5710 2024-05-27T12:33:03.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:03.921+0000 7fc256ffd640 1 -- 172.21.15.55:0/2979403272 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc25801a070 con 0x7fc2680c5710 2024-05-27T12:33:03.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:03.922+0000 7fc256ffd640 1 --2- 172.21.15.55:0/2979403272 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fc24806c920 0x7fc24806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:03.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:03.922+0000 7fc256ffd640 1 -- 172.21.15.55:0/2979403272 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fc25808ad60 con 0x7fc2680c5710 2024-05-27T12:33:03.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:03.922+0000 7fc265d9b640 1 --2- 172.21.15.55:0/2979403272 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fc24806c920 0x7fc24806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:03.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:03.922+0000 7fc265d9b640 1 --2- 172.21.15.55:0/2979403272 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fc24806c920 0x7fc24806ede0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc25c034000 tx=0x7fc25c02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:03.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:03.926+0000 7fc256ffd640 1 -- 172.21.15.55:0/2979403272 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc2680731c0 con 0x7fc2680c5710 2024-05-27T12:33:04.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:04.149+0000 7fc26ccbb640 1 -- 172.21.15.55:0/2979403272 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fc268075460 con 0x7fc2680c5710 2024-05-27T12:33:04.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:04.149+0000 7fc256ffd640 1 -- 172.21.15.55:0/2979403272 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) ==== 53+0+73 (secure 0 0 0) 0x7fc258058bd0 con 0x7fc2680c5710 2024-05-27T12:33:04.148 INFO:teuthology.orchestra.run.smithi055.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-27T12:33:04.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:04.151+0000 7fc26ccbb640 1 -- 172.21.15.55:0/2979403272 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fc24806c920 msgr2=0x7fc24806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:04.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:04.151+0000 7fc26ccbb640 1 --2- 172.21.15.55:0/2979403272 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fc24806c920 0x7fc24806ede0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc25c034000 tx=0x7fc25c02e000 comp rx=0 tx=0).stop 2024-05-27T12:33:04.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:04.151+0000 7fc26ccbb640 1 -- 172.21.15.55:0/2979403272 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2680c5710 msgr2=0x7fc268156350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:04.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:04.151+0000 7fc26ccbb640 1 --2- 172.21.15.55:0/2979403272 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2680c5710 0x7fc268156350 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fc25800c480 tx=0x7fc25800c940 comp rx=0 tx=0).stop 2024-05-27T12:33:04.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:04.151+0000 7fc26ccbb640 1 -- 172.21.15.55:0/2979403272 shutdown_connections 2024-05-27T12:33:04.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:04.151+0000 7fc26ccbb640 1 --2- 172.21.15.55:0/2979403272 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fc24806c920 0x7fc24806ede0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:04.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:04.151+0000 7fc26ccbb640 1 --2- 172.21.15.55:0/2979403272 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc26815a250 0x7fc2680c5b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:04.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:04.151+0000 7fc26ccbb640 1 --2- 172.21.15.55:0/2979403272 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc2680cf400 0x7fc2681f2800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:04.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:04.151+0000 7fc26ccbb640 1 --2- 172.21.15.55:0/2979403272 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2680c5710 0x7fc268156350 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:04.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:04.151+0000 7fc26ccbb640 1 -- 172.21.15.55:0/2979403272 >> 172.21.15.55:0/2979403272 conn(0x7fc2680b3830 msgr2=0x7fc268071e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:04.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:04.151+0000 7fc26ccbb640 1 -- 172.21.15.55:0/2979403272 shutdown_connections 2024-05-27T12:33:04.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:04.151+0000 7fc26ccbb640 1 -- 172.21.15.55:0/2979403272 wait complete. 2024-05-27T12:33:04.161 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-27T12:33:04.161 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-27T12:33:04.161 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi072.front.sepia.ceph.com 2024-05-27T12:33:04.161 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-05-27T12:33:04.161 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-05-27T12:33:04.161 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-27T12:33:04.161 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-27T12:33:04.162 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-27T12:33:04.162 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-05-27T12:33:04.162 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T12:33:04.162 DEBUG:teuthology.orchestra.run.smithi072:> ip addr 2024-05-27T12:33:04.181 INFO:teuthology.orchestra.run.smithi072.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-27T12:33:04.181 INFO:teuthology.orchestra.run.smithi072.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-27T12:33:04.181 INFO:teuthology.orchestra.run.smithi072.stdout: inet 127.0.0.1/8 scope host lo 2024-05-27T12:33:04.181 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2024-05-27T12:33:04.181 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 ::1/128 scope host 2024-05-27T12:33:04.181 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2024-05-27T12:33:04.181 INFO:teuthology.orchestra.run.smithi072.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-27T12:33:04.182 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:d8:da:f4 brd ff:ff:ff:ff:ff:ff 2024-05-27T12:33:04.182 INFO:teuthology.orchestra.run.smithi072.stdout: altname enp7s0f0 2024-05-27T12:33:04.182 INFO:teuthology.orchestra.run.smithi072.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-27T12:33:04.182 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:d8:da:f5 brd ff:ff:ff:ff:ff:ff 2024-05-27T12:33:04.182 INFO:teuthology.orchestra.run.smithi072.stdout: altname enp7s0f1 2024-05-27T12:33:04.182 INFO:teuthology.orchestra.run.smithi072.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-27T12:33:04.182 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:8f:b7:64 brd ff:ff:ff:ff:ff:ff 2024-05-27T12:33:04.182 INFO:teuthology.orchestra.run.smithi072.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-27T12:33:04.182 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:8f:b7:65 brd ff:ff:ff:ff:ff:ff 2024-05-27T12:33:04.182 INFO:teuthology.orchestra.run.smithi072.stdout: inet 172.21.15.72/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-05-27T12:33:04.182 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft 42706sec preferred_lft 42706sec 2024-05-27T12:33:04.182 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::ec4:7aff:fe8f:b765/64 scope link 2024-05-27T12:33:04.182 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2024-05-27T12:33:04.183 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-27T12:33:04.183 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-27T12:33:04.183 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2024-05-27T12:33:04.183 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link add name ceph-brx type bridge 2024-05-27T12:33:04.183 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip addr flush dev ceph-brx 2024-05-27T12:33:04.183 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link set ceph-brx up 2024-05-27T12:33:04.183 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-27T12:33:04.183 DEBUG:teuthology.orchestra.run.smithi072:> ') 2024-05-27T12:33:04.278 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:33:04 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-27T12:33:04.383 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:33:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-27T12:33:04.390 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T12:33:04.390 DEBUG:teuthology.orchestra.run.smithi072:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-27T12:33:04.415 INFO:teuthology.orchestra.run.smithi072.stdout:1 2024-05-27T12:33:04.417 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T12:33:04.417 DEBUG:teuthology.orchestra.run.smithi072:> route 2024-05-27T12:33:04.520 INFO:teuthology.orchestra.run.smithi072.stdout:Kernel IP routing table 2024-05-27T12:33:04.520 INFO:teuthology.orchestra.run.smithi072.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-27T12:33:04.520 INFO:teuthology.orchestra.run.smithi072.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-27T12:33:04.521 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-27T12:33:04.521 INFO:teuthology.orchestra.run.smithi072.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-27T12:33:04.521 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-27T12:33:04.521 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2024-05-27T12:33:04.521 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-27T12:33:04.521 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-27T12:33:04.521 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-27T12:33:04.521 DEBUG:teuthology.orchestra.run.smithi072:> ') 2024-05-27T12:33:04.571 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:33:04 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-27T12:33:04.813 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:33:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-27T12:33:04.819 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T12:33:04.819 DEBUG:teuthology.orchestra.run.smithi072:> ip netns list 2024-05-27T12:33:04.835 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T12:33:04.835 DEBUG:teuthology.orchestra.run.smithi072:> ip netns list-id 2024-05-27T12:33:04.891 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-27T12:33:04.891 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2024-05-27T12:33:04.891 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-27T12:33:04.891 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-05-27T12:33:04.892 DEBUG:teuthology.orchestra.run.smithi072:> ') 2024-05-27T12:33:04.981 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:33:04 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-27T12:33:05.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:33:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-27T12:33:05.030 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-05-27T12:33:05.030 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-27T12:33:05.030 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2024-05-27T12:33:05.030 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-05-27T12:33:05.030 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-27T12:33:05.030 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-05-27T12:33:05.030 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-05-27T12:33:05.030 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-05-27T12:33:05.030 DEBUG:teuthology.orchestra.run.smithi072:> ') 2024-05-27T12:33:05.080 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:33:05 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-27T12:33:05.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:33:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-27T12:33:05.169 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-27T12:33:05.170 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2024-05-27T12:33:05.170 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link set brx.0 up 2024-05-27T12:33:05.170 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link set dev brx.0 master ceph-brx 2024-05-27T12:33:05.170 DEBUG:teuthology.orchestra.run.smithi072:> ') 2024-05-27T12:33:05.218 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:33:05 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-27T12:33:05.241 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:33:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-27T12:33:05.248 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-27T12:33:05.248 DEBUG:teuthology.orchestra.run.smithi072:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-05-27T12:33:05.263 INFO:teuthology.orchestra.run.smithi072.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-05-27T12:33:05.263 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-27T12:33:05.263 DEBUG:teuthology.orchestra.run.smithi072:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-05-27T12:33:05.318 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-05-27T12:33:05.318 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T12:33:05.318 DEBUG:teuthology.orchestra.run.smithi072:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-05-27T12:33:05.423 INFO:teuthology.orchestra.run.smithi072.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-05-27T12:33:05.423 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-05-27T12:33:05.423 INFO:teuthology.orchestra.run.smithi072.stdout:invalid new device string format 2024-05-27T12:33:05.547 INFO:teuthology.orchestra.run.smithi072.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-05-27T12:33:05.547 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-05-27T12:33:05.547 INFO:teuthology.orchestra.run.smithi072.stdout:invalid new device string format 2024-05-27T12:33:05.547 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: resolved to: "172.21.15.55:3300,172.21.15.72:3300,172.21.15.72:3301" 2024-05-27T12:33:05.547 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-27T12:33:05.552 INFO:teuthology.orchestra.run.smithi072.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-05-27T12:33:05.552 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-05-27T12:33:05.552 INFO:teuthology.orchestra.run.smithi072.stdout:invalid new device string format 2024-05-27T12:33:05.552 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: resolved to: "172.21.15.55:3300,172.21.15.72:3300,172.21.15.72:3301" 2024-05-27T12:33:05.552 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-27T12:33:05.552 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: resolved to: "172.21.15.55:6789,172.21.15.72:6789,172.21.15.72:6790" 2024-05-27T12:33:05.552 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.55:6789,172.21.15.72:6789,172.21.15.72:6790:/ 2024-05-27T12:33:05.552 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=c3ff4e3b-8dae-4856-9593-e5cc66c59982" will pass to kernel 2024-05-27T12:33:05.553 INFO:teuthology.orchestra.run.smithi072.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-05-27T12:33:05.553 INFO:teuthology.orchestra.run.smithi072.stdout: You just mounted a file system that supports labels which does not 2024-05-27T12:33:05.553 INFO:teuthology.orchestra.run.smithi072.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-27T12:33:05.553 INFO:teuthology.orchestra.run.smithi072.stdout: applications will generate AVC messages and not be allowed access to 2024-05-27T12:33:05.553 INFO:teuthology.orchestra.run.smithi072.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-27T12:33:05.555 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-27T12:33:05.555 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T12:33:05.555 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-05-27T12:33:05.580 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-27T12:33:05.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:33:05 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-27T12:33:05.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:33:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-27T12:33:05.675 INFO:teuthology.orchestra.run.smithi072.stdout:client4681 2024-05-27T12:33:05.676 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-05-27T12:33:05.676 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-27T12:33:05.691 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-27T12:33:05.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:33:05 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-27T12:33:05.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:33:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-27T12:33:05.787 INFO:teuthology.orchestra.run.smithi072.stdout:client4681 2024-05-27T12:33:05.788 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-27T12:33:05.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:33:05 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-27T12:33:05.838 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:33:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-27T12:33:05.844 INFO:teuthology.orchestra.run.smithi072.stdout:client4681 2024-05-27T12:33:05.844 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/c3ff4e3b-8dae-4856-9593-e5cc66c59982.client4681/status') 2024-05-27T12:33:05.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:33:05 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-27T12:33:05.903 INFO:teuthology.orchestra.run.smithi072.stdout:instance: client.4681 (3)192.168.0.1:0/942112363 2024-05-27T12:33:05.903 INFO:teuthology.orchestra.run.smithi072.stdout:blocklisted: false 2024-05-27T12:33:05.903 INFO:teuthology.orchestra.run.smithi072.stderr:0+1 records in 2024-05-27T12:33:05.903 INFO:teuthology.orchestra.run.smithi072.stderr:0+1 records out 2024-05-27T12:33:05.904 INFO:teuthology.orchestra.run.smithi072.stderr:68 bytes copied, 2.1649e-05 s, 3.1 MB/s 2024-05-27T12:33:05.904 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:33:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-27T12:33:05.910 INFO:tasks.kclient:client.3 config is {'syntax': 'v1'} 2024-05-27T12:33:05.911 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-27T12:33:05.911 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-05-27T12:33:05.911 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-27T12:33:06.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:06.028+0000 7f2bec708640 1 Processor -- start 2024-05-27T12:33:06.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:06.028+0000 7f2bec708640 1 -- start start 2024-05-27T12:33:06.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:06.029+0000 7f2bec708640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2be4144bb0 0x7f2be40cd180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:06.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:06.029+0000 7f2bec708640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2be40cd6c0 0x7f2be4071f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:06.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:06.029+0000 7f2bec708640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2be4072460 0x7f2be415f210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:06.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:06.029+0000 7f2bec708640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f2be4144f90 con 0x7f2be4144bb0 2024-05-27T12:33:06.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:06.029+0000 7f2bec708640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f2be40ce200 con 0x7f2be40cd6c0 2024-05-27T12:33:06.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:06.029+0000 7f2bec708640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f2be40cdc40 con 0x7f2be4072460 2024-05-27T12:33:06.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:06.029+0000 7f2bea4a4640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2be4144bb0 0x7f2be40cd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:06.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:06.029+0000 7f2bea4a4640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2be4144bb0 0x7f2be40cd180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51588/0 (socket says 172.21.15.55:51588) 2024-05-27T12:33:06.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:06.029+0000 7f2bea4a4640 1 -- 172.21.15.55:0/625454487 learned_addr learned my addr 172.21.15.55:0/625454487 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:33:06.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:06.029+0000 7f2be9ca3640 1 --2- 172.21.15.55:0/625454487 >> v2:172.21.15.72:3300/0 conn(0x7f2be40cd6c0 0x7f2be4071f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:06.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:06.029+0000 7f2beaca5640 1 --2- 172.21.15.55:0/625454487 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2be4072460 0x7f2be415f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:06.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:06.030+0000 7f2bea4a4640 1 -- 172.21.15.55:0/625454487 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2be4072460 msgr2=0x7f2be415f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:06.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:06.030+0000 7f2bea4a4640 1 --2- 172.21.15.55:0/625454487 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2be4072460 0x7f2be415f210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:06.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:06.030+0000 7f2bea4a4640 1 -- 172.21.15.55:0/625454487 >> v2:172.21.15.72:3300/0 conn(0x7f2be40cd6c0 msgr2=0x7f2be4071f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:06.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:06.030+0000 7f2bea4a4640 1 --2- 172.21.15.55:0/625454487 >> v2:172.21.15.72:3300/0 conn(0x7f2be40cd6c0 0x7f2be4071f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:06.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:06.030+0000 7f2bea4a4640 1 -- 172.21.15.55:0/625454487 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2be40cdf20 con 0x7f2be4144bb0 2024-05-27T12:33:06.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:06.030+0000 7f2bea4a4640 1 --2- 172.21.15.55:0/625454487 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2be4144bb0 0x7f2be40cd180 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f2be40700a0 tx=0x7f2bdc02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8d7a37e4704dcb server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:06.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:06.030+0000 7f2be94a2640 1 -- 172.21.15.55:0/625454487 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bdc037070 con 0x7f2be4144bb0 2024-05-27T12:33:06.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:06.031+0000 7f2be94a2640 1 -- 172.21.15.55:0/625454487 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2bdc032440 con 0x7f2be4144bb0 2024-05-27T12:33:06.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:06.031+0000 7f2be94a2640 1 -- 172.21.15.55:0/625454487 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bdc032810 con 0x7f2be4144bb0 2024-05-27T12:33:06.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:06.031+0000 7f2bec708640 1 -- 172.21.15.55:0/625454487 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2be4144bb0 msgr2=0x7f2be40cd180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:06.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:06.031+0000 7f2bec708640 1 --2- 172.21.15.55:0/625454487 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2be4144bb0 0x7f2be40cd180 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f2be40700a0 tx=0x7f2bdc02a1e0 comp rx=0 tx=0).stop 2024-05-27T12:33:06.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:06.031+0000 7f2bec708640 1 -- 172.21.15.55:0/625454487 shutdown_connections 2024-05-27T12:33:06.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:06.031+0000 7f2bec708640 1 --2- 172.21.15.55:0/625454487 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2be4072460 0x7f2be415f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:06.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:06.031+0000 7f2bec708640 1 --2- 172.21.15.55:0/625454487 >> v2:172.21.15.72:3300/0 conn(0x7f2be40cd6c0 0x7f2be4071f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:06.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:06.031+0000 7f2bec708640 1 --2- 172.21.15.55:0/625454487 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2be4144bb0 0x7f2be40cd180 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:06.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:06.031+0000 7f2bec708640 1 -- 172.21.15.55:0/625454487 >> 172.21.15.55:0/625454487 conn(0x7f2be40b3830 msgr2=0x7f2be40b3c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:06.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:06.031+0000 7f2bec708640 1 -- 172.21.15.55:0/625454487 shutdown_connections 2024-05-27T12:33:06.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:06.031+0000 7f2bec708640 1 -- 172.21.15.55:0/625454487 wait complete. 2024-05-27T12:33:06.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:06.032+0000 7f2bec708640 1 Processor -- start 2024-05-27T12:33:06.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:06.033+0000 7f2bec708640 1 -- start start 2024-05-27T12:33:06.034 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:06.033+0000 7f2bec708640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2be4072460 0x7f2be413f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:06.034 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:06.033+0000 7f2bec708640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2be40cd6c0 0x7f2be4158700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:06.034 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:06.033+0000 7f2bec708640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2be4144bb0 0x7f2be4157b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:06.034 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:06.033+0000 7f2bec708640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f2be4145330 con 0x7f2be4144bb0 2024-05-27T12:33:06.034 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:06.033+0000 7f2bec708640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f2be40ceb20 con 0x7f2be40cd6c0 2024-05-27T12:33:06.034 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:06.033+0000 7f2bec708640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f2be415f750 con 0x7f2be4072460 2024-05-27T12:33:06.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:06.033+0000 7f2beaca5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2be4144bb0 0x7f2be4157b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:06.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:06.033+0000 7f2beaca5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2be4144bb0 0x7f2be4157b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51592/0 (socket says 172.21.15.55:51592) 2024-05-27T12:33:06.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:06.033+0000 7f2be9ca3640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2be40cd6c0 0x7f2be4158700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:06.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:06.033+0000 7f2bea4a4640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2be4072460 0x7f2be413f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:06.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:06.033+0000 7f2beaca5640 1 -- 172.21.15.55:0/1838902443 learned_addr learned my addr 172.21.15.55:0/1838902443 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:33:06.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:06.034+0000 7f2be9ca3640 1 -- 172.21.15.55:0/1838902443 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2be4072460 msgr2=0x7f2be413f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:06.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:06.034+0000 7f2be9ca3640 1 --2- 172.21.15.55:0/1838902443 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2be4072460 0x7f2be413f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:06.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:06.034+0000 7f2be9ca3640 1 -- 172.21.15.55:0/1838902443 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2be4144bb0 msgr2=0x7f2be4157b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:06.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:06.034+0000 7f2be9ca3640 1 --2- 172.21.15.55:0/1838902443 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2be4144bb0 0x7f2be4157b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:06.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:06.034+0000 7f2be9ca3640 1 -- 172.21.15.55:0/1838902443 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2be4159110 con 0x7f2be40cd6c0 2024-05-27T12:33:06.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:06.034+0000 7f2be9ca3640 1 --2- 172.21.15.55:0/1838902443 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2be40cd6c0 0x7f2be4158700 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2bd800e850 tx=0x7f2bd800ed10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:06.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:06.034+0000 7f2be2ffd640 1 -- 172.21.15.55:0/1838902443 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bd8017070 con 0x7f2be40cd6c0 2024-05-27T12:33:06.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:06.034+0000 7f2be2ffd640 1 -- 172.21.15.55:0/1838902443 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2bd800c940 con 0x7f2be40cd6c0 2024-05-27T12:33:06.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:06.034+0000 7f2be2ffd640 1 -- 172.21.15.55:0/1838902443 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bd800cd10 con 0x7f2be40cd6c0 2024-05-27T12:33:06.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:06.034+0000 7f2bec708640 1 -- 172.21.15.55:0/1838902443 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2be41593f0 con 0x7f2be40cd6c0 2024-05-27T12:33:06.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:06.034+0000 7f2bec708640 1 -- 172.21.15.55:0/1838902443 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2be41599b0 con 0x7f2be40cd6c0 2024-05-27T12:33:06.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:06.035+0000 7f2bec708640 1 -- 172.21.15.55:0/1838902443 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2be4075460 con 0x7f2be40cd6c0 2024-05-27T12:33:06.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:06.036+0000 7f2be2ffd640 1 -- 172.21.15.55:0/1838902443 <== mon.1 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2bd801a070 con 0x7f2be40cd6c0 2024-05-27T12:33:06.037 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:06.036+0000 7f2be2ffd640 1 --2- 172.21.15.55:0/1838902443 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f2bd006c8f0 0x7f2bd006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:06.037 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:06.036+0000 7f2be2ffd640 1 -- 172.21.15.55:0/1838902443 <== mon.1 v2:172.21.15.72:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f2bd808bd80 con 0x7f2be40cd6c0 2024-05-27T12:33:06.037 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:06.036+0000 7f2bea4a4640 1 --2- 172.21.15.55:0/1838902443 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f2bd006c8f0 0x7f2bd006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:06.037 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:06.037+0000 7f2bea4a4640 1 --2- 172.21.15.55:0/1838902443 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f2bd006c8f0 0x7f2bd006edb0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2bdc034000 tx=0x7f2bdc03b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:06.040 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:06.041+0000 7f2be2ffd640 1 -- 172.21.15.55:0/1838902443 <== mon.1 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2bd8059ac0 con 0x7f2be40cd6c0 2024-05-27T12:33:06.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:06.265+0000 7f2bec708640 1 -- 172.21.15.55:0/1838902443 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f2be40b4ad0 con 0x7f2be40cd6c0 2024-05-27T12:33:06.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:06.265+0000 7f2be2ffd640 1 -- 172.21.15.55:0/1838902443 <== mon.1 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) ==== 53+0+73 (secure 0 0 0) 0x7f2bd805ddc0 con 0x7f2be40cd6c0 2024-05-27T12:33:06.265 INFO:teuthology.orchestra.run.smithi055.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-27T12:33:06.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:06.267+0000 7f2bec708640 1 -- 172.21.15.55:0/1838902443 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f2bd006c8f0 msgr2=0x7f2bd006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:06.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:06.267+0000 7f2bec708640 1 --2- 172.21.15.55:0/1838902443 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f2bd006c8f0 0x7f2bd006edb0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2bdc034000 tx=0x7f2bdc03b040 comp rx=0 tx=0).stop 2024-05-27T12:33:06.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:06.267+0000 7f2bec708640 1 -- 172.21.15.55:0/1838902443 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2be40cd6c0 msgr2=0x7f2be4158700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:06.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:06.267+0000 7f2bec708640 1 --2- 172.21.15.55:0/1838902443 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2be40cd6c0 0x7f2be4158700 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2bd800e850 tx=0x7f2bd800ed10 comp rx=0 tx=0).stop 2024-05-27T12:33:06.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:06.267+0000 7f2bec708640 1 -- 172.21.15.55:0/1838902443 shutdown_connections 2024-05-27T12:33:06.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:06.267+0000 7f2bec708640 1 --2- 172.21.15.55:0/1838902443 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2be4144bb0 0x7f2be4157b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:06.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:06.267+0000 7f2bec708640 1 --2- 172.21.15.55:0/1838902443 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f2bd006c8f0 0x7f2bd006edb0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:06.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:06.267+0000 7f2bec708640 1 --2- 172.21.15.55:0/1838902443 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2be40cd6c0 0x7f2be4158700 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:06.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:06.267+0000 7f2bec708640 1 --2- 172.21.15.55:0/1838902443 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2be4072460 0x7f2be413f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:06.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:06.267+0000 7f2bec708640 1 -- 172.21.15.55:0/1838902443 >> 172.21.15.55:0/1838902443 conn(0x7f2be40b3830 msgr2=0x7f2be4140d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:06.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:06.267+0000 7f2bec708640 1 -- 172.21.15.55:0/1838902443 shutdown_connections 2024-05-27T12:33:06.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:06.267+0000 7f2bec708640 1 -- 172.21.15.55:0/1838902443 wait complete. 2024-05-27T12:33:06.278 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-27T12:33:06.278 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-27T12:33:06.278 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi072.front.sepia.ceph.com 2024-05-27T12:33:06.278 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-05-27T12:33:06.279 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-05-27T12:33:06.279 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-27T12:33:06.279 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-27T12:33:06.279 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-27T12:33:06.279 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-05-27T12:33:06.279 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T12:33:06.280 DEBUG:teuthology.orchestra.run.smithi072:> ip addr 2024-05-27T12:33:06.297 INFO:teuthology.orchestra.run.smithi072.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-27T12:33:06.297 INFO:teuthology.orchestra.run.smithi072.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-27T12:33:06.297 INFO:teuthology.orchestra.run.smithi072.stdout: inet 127.0.0.1/8 scope host lo 2024-05-27T12:33:06.297 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2024-05-27T12:33:06.297 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 ::1/128 scope host 2024-05-27T12:33:06.297 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2024-05-27T12:33:06.298 INFO:teuthology.orchestra.run.smithi072.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-27T12:33:06.298 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:d8:da:f4 brd ff:ff:ff:ff:ff:ff 2024-05-27T12:33:06.298 INFO:teuthology.orchestra.run.smithi072.stdout: altname enp7s0f0 2024-05-27T12:33:06.298 INFO:teuthology.orchestra.run.smithi072.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-27T12:33:06.298 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:d8:da:f5 brd ff:ff:ff:ff:ff:ff 2024-05-27T12:33:06.298 INFO:teuthology.orchestra.run.smithi072.stdout: altname enp7s0f1 2024-05-27T12:33:06.299 INFO:teuthology.orchestra.run.smithi072.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-27T12:33:06.299 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:8f:b7:64 brd ff:ff:ff:ff:ff:ff 2024-05-27T12:33:06.299 INFO:teuthology.orchestra.run.smithi072.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-27T12:33:06.299 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:8f:b7:65 brd ff:ff:ff:ff:ff:ff 2024-05-27T12:33:06.299 INFO:teuthology.orchestra.run.smithi072.stdout: inet 172.21.15.72/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-05-27T12:33:06.299 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft 42704sec preferred_lft 42704sec 2024-05-27T12:33:06.299 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::ec4:7aff:fe8f:b765/64 scope link 2024-05-27T12:33:06.299 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2024-05-27T12:33:06.300 INFO:teuthology.orchestra.run.smithi072.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-27T12:33:06.300 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 16:76:e2:a1:14:7a brd ff:ff:ff:ff:ff:ff 2024-05-27T12:33:06.300 INFO:teuthology.orchestra.run.smithi072.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-27T12:33:06.300 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2024-05-27T12:33:06.300 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::80c5:8fff:fe46:27c8/64 scope link 2024-05-27T12:33:06.300 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2024-05-27T12:33:06.301 INFO:teuthology.orchestra.run.smithi072.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-27T12:33:06.301 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 16:76:e2:a1:14:7a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-27T12:33:06.301 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::1476:e2ff:fea1:147a/64 scope link tentative 2024-05-27T12:33:06.301 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2024-05-27T12:33:06.301 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T12:33:06.302 DEBUG:teuthology.orchestra.run.smithi072:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-27T12:33:06.361 INFO:teuthology.orchestra.run.smithi072.stdout:1 2024-05-27T12:33:06.363 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T12:33:06.363 DEBUG:teuthology.orchestra.run.smithi072:> route 2024-05-27T12:33:06.420 INFO:teuthology.orchestra.run.smithi072.stdout:Kernel IP routing table 2024-05-27T12:33:06.420 INFO:teuthology.orchestra.run.smithi072.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-27T12:33:06.420 INFO:teuthology.orchestra.run.smithi072.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-27T12:33:06.421 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-27T12:33:06.421 INFO:teuthology.orchestra.run.smithi072.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-27T12:33:06.421 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-27T12:33:06.421 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2024-05-27T12:33:06.421 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-27T12:33:06.421 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-27T12:33:06.421 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-27T12:33:06.421 DEBUG:teuthology.orchestra.run.smithi072:> ') 2024-05-27T12:33:06.509 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:33:06 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-27T12:33:06.542 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:33:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-27T12:33:06.548 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T12:33:06.548 DEBUG:teuthology.orchestra.run.smithi072:> ip netns list 2024-05-27T12:33:06.562 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-05-27T12:33:06.563 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T12:33:06.563 DEBUG:teuthology.orchestra.run.smithi072:> ip netns list-id 2024-05-27T12:33:06.617 INFO:teuthology.orchestra.run.smithi072.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-05-27T12:33:06.618 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-27T12:33:06.618 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2024-05-27T12:33:06.618 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-05-27T12:33:06.618 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-05-27T12:33:06.618 DEBUG:teuthology.orchestra.run.smithi072:> ') 2024-05-27T12:33:06.706 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:33:06 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-27T12:33:06.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:33:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-27T12:33:06.735 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T12:33:06.735 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-05-27T12:33:06.760 INFO:teuthology.orchestra.run.smithi072.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-27T12:33:06.760 INFO:teuthology.orchestra.run.smithi072.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-27T12:33:06.760 INFO:teuthology.orchestra.run.smithi072.stdout: inet 127.0.0.1/8 scope host lo 2024-05-27T12:33:06.760 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2024-05-27T12:33:06.760 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 ::1/128 scope host 2024-05-27T12:33:06.760 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2024-05-27T12:33:06.760 INFO:teuthology.orchestra.run.smithi072.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-27T12:33:06.760 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 9a:42:1c:fa:b6:3d brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-05-27T12:33:06.760 INFO:teuthology.orchestra.run.smithi072.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-05-27T12:33:06.760 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2024-05-27T12:33:06.760 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::9842:1cff:fefa:b63d/64 scope link tentative 2024-05-27T12:33:06.761 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2024-05-27T12:33:06.761 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T12:33:06.762 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-05-27T12:33:06.826 INFO:teuthology.orchestra.run.smithi072.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-27T12:33:06.826 INFO:teuthology.orchestra.run.smithi072.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-27T12:33:06.826 INFO:teuthology.orchestra.run.smithi072.stdout: inet 127.0.0.1/8 scope host lo 2024-05-27T12:33:06.826 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2024-05-27T12:33:06.826 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 ::1/128 scope host 2024-05-27T12:33:06.826 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2024-05-27T12:33:06.826 INFO:teuthology.orchestra.run.smithi072.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-27T12:33:06.826 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 9a:42:1c:fa:b6:3d brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-05-27T12:33:06.826 INFO:teuthology.orchestra.run.smithi072.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-05-27T12:33:06.826 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2024-05-27T12:33:06.827 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::9842:1cff:fefa:b63d/64 scope link tentative 2024-05-27T12:33:06.827 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2024-05-27T12:33:06.827 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-05-27T12:33:06.828 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-27T12:33:06.828 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2024-05-27T12:33:06.828 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-05-27T12:33:06.828 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-05-27T12:33:06.828 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-05-27T12:33:06.828 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-05-27T12:33:06.828 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-05-27T12:33:06.828 DEBUG:teuthology.orchestra.run.smithi072:> ') 2024-05-27T12:33:06.916 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:33:06 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-27T12:33:06.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:33:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-27T12:33:06.980 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-27T12:33:06.980 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2024-05-27T12:33:06.980 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link set brx.1 up 2024-05-27T12:33:06.980 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link set dev brx.1 master ceph-brx 2024-05-27T12:33:06.980 DEBUG:teuthology.orchestra.run.smithi072:> ') 2024-05-27T12:33:07.029 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:33:07 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-27T12:33:07.051 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:33:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-27T12:33:07.057 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-27T12:33:07.057 DEBUG:teuthology.orchestra.run.smithi072:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-05-27T12:33:07.085 INFO:teuthology.orchestra.run.smithi072.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-05-27T12:33:07.085 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-27T12:33:07.085 DEBUG:teuthology.orchestra.run.smithi072:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-05-27T12:33:07.140 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-05-27T12:33:07.141 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T12:33:07.141 DEBUG:teuthology.orchestra.run.smithi072:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-05-27T12:33:07.224 INFO:teuthology.orchestra.run.smithi072.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-05-27T12:33:07.224 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-05-27T12:33:07.224 INFO:teuthology.orchestra.run.smithi072.stdout:invalid new device string format 2024-05-27T12:33:07.232 INFO:teuthology.orchestra.run.smithi072.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-05-27T12:33:07.232 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-05-27T12:33:07.232 INFO:teuthology.orchestra.run.smithi072.stdout:invalid new device string format 2024-05-27T12:33:07.233 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: resolved to: "172.21.15.55:3300,172.21.15.72:3300,172.21.15.72:3301" 2024-05-27T12:33:07.233 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-27T12:33:07.237 INFO:teuthology.orchestra.run.smithi072.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-05-27T12:33:07.237 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-05-27T12:33:07.237 INFO:teuthology.orchestra.run.smithi072.stdout:invalid new device string format 2024-05-27T12:33:07.237 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: resolved to: "172.21.15.55:3300,172.21.15.72:3300,172.21.15.72:3301" 2024-05-27T12:33:07.237 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-27T12:33:07.238 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: resolved to: "172.21.15.55:6789,172.21.15.72:6789,172.21.15.72:6790" 2024-05-27T12:33:07.238 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.55:6789,172.21.15.72:6789,172.21.15.72:6790:/ 2024-05-27T12:33:07.238 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs,key=3,fsid=c3ff4e3b-8dae-4856-9593-e5cc66c59982" will pass to kernel 2024-05-27T12:33:07.238 INFO:teuthology.orchestra.run.smithi072.stdout:mount: /home/ubuntu/cephtest/mnt.3 does not contain SELinux labels. 2024-05-27T12:33:07.241 INFO:teuthology.orchestra.run.smithi072.stdout: You just mounted a file system that supports labels which does not 2024-05-27T12:33:07.241 INFO:teuthology.orchestra.run.smithi072.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-27T12:33:07.241 INFO:teuthology.orchestra.run.smithi072.stdout: applications will generate AVC messages and not be allowed access to 2024-05-27T12:33:07.241 INFO:teuthology.orchestra.run.smithi072.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-27T12:33:07.242 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-27T12:33:07.242 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T12:33:07.242 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-05-27T12:33:07.308 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-27T12:33:07.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:33:07 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-27T12:33:07.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:33:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-27T12:33:07.404 INFO:teuthology.orchestra.run.smithi072.stdout:client4734 2024-05-27T12:33:07.404 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-05-27T12:33:07.404 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-27T12:33:07.420 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-27T12:33:07.511 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:33:07 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-27T12:33:07.512 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:33:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-27T12:33:07.518 INFO:teuthology.orchestra.run.smithi072.stdout:client4734 2024-05-27T12:33:07.518 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-27T12:33:07.567 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:33:07 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-27T12:33:07.568 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:33:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-27T12:33:07.574 INFO:teuthology.orchestra.run.smithi072.stdout:client4734 2024-05-27T12:33:07.575 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/c3ff4e3b-8dae-4856-9593-e5cc66c59982.client4734/status') 2024-05-27T12:33:07.622 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:33:07 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-27T12:33:07.632 INFO:teuthology.orchestra.run.smithi072.stdout:instance: client.4734 (3)172.21.15.72:0/2740697670 2024-05-27T12:33:07.632 INFO:teuthology.orchestra.run.smithi072.stdout:blocklisted: false 2024-05-27T12:33:07.632 INFO:teuthology.orchestra.run.smithi072.stderr:0+1 records in 2024-05-27T12:33:07.632 INFO:teuthology.orchestra.run.smithi072.stderr:0+1 records out 2024-05-27T12:33:07.633 INFO:teuthology.orchestra.run.smithi072.stderr:70 bytes copied, 2.2221e-05 s, 3.2 MB/s 2024-05-27T12:33:07.633 INFO:teuthology.orchestra.run.smithi072.stderr:2024-05-27T12:33:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-27T12:33:07.640 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-05-27T12:33:07.657 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-27T12:33:07.749 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T12:33:07.752 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T12:33:07.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:07.775+0000 7f4de388a640 1 Processor -- start 2024-05-27T12:33:07.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:07.775+0000 7f4de388a640 1 -- start start 2024-05-27T12:33:07.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:07.776+0000 7f4de388a640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4ddc15ec00 0x7f4ddc0b3db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:07.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:07.776+0000 7f4de388a640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4ddc0b3860 0x7f4ddc0cfd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:07.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:07.776+0000 7f4de388a640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ddc1632f0 con 0x7f4ddc0b6370 2024-05-27T12:33:07.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:07.776+0000 7f4de388a640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f4ddc0cf2e0 con 0x7f4ddc15ec00 2024-05-27T12:33:07.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:07.776+0000 7f4de388a640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f4ddc1635d0 con 0x7f4ddc0b3860 2024-05-27T12:33:07.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:07.776+0000 7f4de0e25640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4ddc0b3860 0x7f4ddc0cfd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:07.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:07.776+0000 7f4de1626640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4ddc15ec00 0x7f4ddc0b3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:07.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:07.776+0000 7f4de0e25640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4ddc0b3860 0x7f4ddc0cfd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.55:58262/0 (socket says 172.21.15.55:58262) 2024-05-27T12:33:07.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:07.776+0000 7f4de1e27640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f4ddc0b6370 0x7f4ddc0d2980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.55:47970/0 (socket says 172.21.15.55:47970) 2024-05-27T12:33:07.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:07.776+0000 7f4de0e25640 1 -- 172.21.15.55:0/1785782096 learned_addr learned my addr 172.21.15.55:0/1785782096 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:33:07.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:07.777+0000 7f4de0e25640 1 -- 172.21.15.55:0/1785782096 >> v2:172.21.15.72:3300/0 conn(0x7f4ddc15ec00 msgr2=0x7f4ddc0b3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:07.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:07.777+0000 7f4de0e25640 1 --2- 172.21.15.55:0/1785782096 >> v2:172.21.15.72:3300/0 conn(0x7f4ddc15ec00 0x7f4ddc0b3db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:07.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:07.777+0000 7f4dd3fff640 1 -- 172.21.15.55:0/1785782096 <== mon.1 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1503571774 0 0) 0x7f4ddc1632f0 con 0x7f4ddc0b6370 2024-05-27T12:33:07.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:07.777+0000 7f4de0e25640 1 -- 172.21.15.55:0/1785782096 >> v1:172.21.15.72:6789/0 conn(0x7f4ddc0b6370 legacy=0x7f4ddc0d2980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:07.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:07.777+0000 7f4de0e25640 1 -- 172.21.15.55:0/1785782096 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ddc0cf530 con 0x7f4ddc0b3860 2024-05-27T12:33:07.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:07.777+0000 7f4de1626640 1 --2- 172.21.15.55:0/1785782096 >> v2:172.21.15.72:3300/0 conn(0x7f4ddc15ec00 0x7f4ddc0b3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T12:33:07.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:07.778+0000 7f4de0e25640 1 --2- 172.21.15.55:0/1785782096 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4ddc0b3860 0x7f4ddc0cfd30 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f4dcc009870 tx=0x7f4dcc02a250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ebc93de822dd610e server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:07.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:07.778+0000 7f4dd3fff640 1 -- 172.21.15.55:0/1785782096 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dcc037070 con 0x7f4ddc0b3860 2024-05-27T12:33:07.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:07.778+0000 7f4dd3fff640 1 -- 172.21.15.55:0/1785782096 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4dcc032440 con 0x7f4ddc0b3860 2024-05-27T12:33:07.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:07.778+0000 7f4dd3fff640 1 -- 172.21.15.55:0/1785782096 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dcc032810 con 0x7f4ddc0b3860 2024-05-27T12:33:07.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:07.778+0000 7f4de388a640 1 -- 172.21.15.55:0/1785782096 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4ddc0b3860 msgr2=0x7f4ddc0cfd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:07.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:07.778+0000 7f4de388a640 1 --2- 172.21.15.55:0/1785782096 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4ddc0b3860 0x7f4ddc0cfd30 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f4dcc009870 tx=0x7f4dcc02a250 comp rx=0 tx=0).stop 2024-05-27T12:33:07.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:07.778+0000 7f4de388a640 1 -- 172.21.15.55:0/1785782096 shutdown_connections 2024-05-27T12:33:07.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:07.778+0000 7f4de388a640 1 --2- 172.21.15.55:0/1785782096 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4ddc0b3860 0x7f4ddc0cfd30 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:07.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:07.778+0000 7f4de388a640 1 --2- 172.21.15.55:0/1785782096 >> v2:172.21.15.72:3300/0 conn(0x7f4ddc15ec00 0x7f4ddc0b3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:07.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:07.778+0000 7f4de388a640 1 -- 172.21.15.55:0/1785782096 >> 172.21.15.55:0/1785782096 conn(0x7f4ddc0d1370 msgr2=0x7f4ddc0d1780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:07.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:07.779+0000 7f4de388a640 1 -- 172.21.15.55:0/1785782096 shutdown_connections 2024-05-27T12:33:07.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:07.779+0000 7f4de388a640 1 -- 172.21.15.55:0/1785782096 wait complete. 2024-05-27T12:33:07.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:07.780+0000 7f4de388a640 1 Processor -- start 2024-05-27T12:33:07.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:07.780+0000 7f4de388a640 1 -- start start 2024-05-27T12:33:07.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:07.781+0000 7f4de388a640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ddc0b3860 0x7f4ddc14bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:07.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:07.781+0000 7f4de388a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4ddc0b6370 0x7f4ddc0b4730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:07.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:07.781+0000 7f4de388a640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4ddc15ec00 0x7f4ddc0b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:07.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:07.781+0000 7f4de388a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f4ddc0b3530 con 0x7f4ddc0b6370 2024-05-27T12:33:07.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:07.781+0000 7f4de388a640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f4ddc0d0270 con 0x7f4ddc0b3860 2024-05-27T12:33:07.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:07.781+0000 7f4de388a640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f4ddc15efe0 con 0x7f4ddc15ec00 2024-05-27T12:33:07.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:07.781+0000 7f4de0e25640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4ddc0b6370 0x7f4ddc0b4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:07.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:07.781+0000 7f4de0e25640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4ddc0b6370 0x7f4ddc0b4730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51608/0 (socket says 172.21.15.55:51608) 2024-05-27T12:33:07.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:07.781+0000 7f4de0e25640 1 -- 172.21.15.55:0/1565439358 learned_addr learned my addr 172.21.15.55:0/1565439358 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:33:07.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:07.781+0000 7f4de1626640 1 --2- 172.21.15.55:0/1565439358 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ddc0b3860 0x7f4ddc14bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:07.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:07.781+0000 7f4de1e27640 1 --2- 172.21.15.55:0/1565439358 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4ddc15ec00 0x7f4ddc0b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:07.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:07.781+0000 7f4de0e25640 1 -- 172.21.15.55:0/1565439358 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4ddc15ec00 msgr2=0x7f4ddc0b4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:07.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:07.781+0000 7f4de0e25640 1 --2- 172.21.15.55:0/1565439358 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4ddc15ec00 0x7f4ddc0b4c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:07.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:07.781+0000 7f4de0e25640 1 -- 172.21.15.55:0/1565439358 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ddc0b3860 msgr2=0x7f4ddc14bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:07.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:07.781+0000 7f4de0e25640 1 --2- 172.21.15.55:0/1565439358 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ddc0b3860 0x7f4ddc14bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:07.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:07.781+0000 7f4de0e25640 1 -- 172.21.15.55:0/1565439358 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ddc0b52a0 con 0x7f4ddc0b6370 2024-05-27T12:33:07.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:07.781+0000 7f4de1e27640 1 --2- 172.21.15.55:0/1565439358 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4ddc15ec00 0x7f4ddc0b4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T12:33:07.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:07.781+0000 7f4de1626640 1 --2- 172.21.15.55:0/1565439358 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ddc0b3860 0x7f4ddc14bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T12:33:07.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:07.781+0000 7f4de0e25640 1 --2- 172.21.15.55:0/1565439358 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4ddc0b6370 0x7f4ddc0b4730 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f4dcc000c00 tx=0x7f4dcc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:07.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:07.782+0000 7f4dd1ffb640 1 -- 172.21.15.55:0/1565439358 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dcc037040 con 0x7f4ddc0b6370 2024-05-27T12:33:07.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:07.782+0000 7f4dd1ffb640 1 -- 172.21.15.55:0/1565439358 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4dcc042070 con 0x7f4ddc0b6370 2024-05-27T12:33:07.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:07.782+0000 7f4de388a640 1 -- 172.21.15.55:0/1565439358 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ddc0b5580 con 0x7f4ddc0b6370 2024-05-27T12:33:07.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:07.782+0000 7f4dd1ffb640 1 -- 172.21.15.55:0/1565439358 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dcc030880 con 0x7f4ddc0b6370 2024-05-27T12:33:07.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:07.782+0000 7f4de388a640 1 -- 172.21.15.55:0/1565439358 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ddc0ccd30 con 0x7f4ddc0b6370 2024-05-27T12:33:07.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:07.783+0000 7f4de388a640 1 -- 172.21.15.55:0/1565439358 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ddc06db20 con 0x7f4ddc0b6370 2024-05-27T12:33:07.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:07.783+0000 7f4dd1ffb640 1 -- 172.21.15.55:0/1565439358 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4dcc030a20 con 0x7f4ddc0b6370 2024-05-27T12:33:07.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:07.784+0000 7f4dd1ffb640 1 --2- 172.21.15.55:0/1565439358 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f4dc006c8f0 0x7f4dc006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:07.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:07.784+0000 7f4dd1ffb640 1 -- 172.21.15.55:0/1565439358 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f4dcc0ac250 con 0x7f4ddc0b6370 2024-05-27T12:33:07.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:07.784+0000 7f4de1626640 1 --2- 172.21.15.55:0/1565439358 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f4dc006c8f0 0x7f4dc006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:07.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:07.785+0000 7f4de1626640 1 --2- 172.21.15.55:0/1565439358 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f4dc006c8f0 0x7f4dc006edb0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f4dd8009560 tx=0x7f4dd8009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:07.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:07.788+0000 7f4dd1ffb640 1 -- 172.21.15.55:0/1565439358 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4ddc06db20 con 0x7f4ddc0b6370 2024-05-27T12:33:07.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:07.974+0000 7f4de388a640 1 -- 172.21.15.55:0/1565439358 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4ddc075460 con 0x7f4ddc0b6370 2024-05-27T12:33:07.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:07.975+0000 7f4dd1ffb640 1 -- 172.21.15.55:0/1565439358 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16557 (secure 0 0 0) 0x7f4dcc07a030 con 0x7f4ddc0b6370 2024-05-27T12:33:07.975 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-27T12:33:07.975 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":23,"fsid":"c3ff4e3b-8dae-4856-9593-e5cc66c59982","created":"2024-05-27T12:32:17.019097+0000","modified":"2024-05-27T12:32:43.361598+0000","last_up_change":"2024-05-27T12:32:28.109744+0000","last_in_change":"2024-05-27T12:32:19.309872+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-27T12:32:29.277895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-27T12:32:39.442745+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-27T12:32:40.672118+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e607b598-061b-4b6f-92ff-95c20b330599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":807572567},{"type":"v1","addr":"172.21.15.55:6801","nonce":807572567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":807572567},{"type":"v1","addr":"172.21.15.55:6803","nonce":807572567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":807572567},{"type":"v1","addr":"172.21.15.55:6807","nonce":807572567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":807572567},{"type":"v1","addr":"172.21.15.55:6805","nonce":807572567}]},"public_addr":"172.21.15.55:6801/807572567","cluster_addr":"172.21.15.55:6803/807572567","heartbeat_back_addr":"172.21.15.55:6807/807572567","heartbeat_front_addr":"172.21.15.55:6805/807572567","state":["exists","up"]},{"osd":1,"uuid":"ba2b5b1d-71a9-4ecc-9a48-55aa7fe54261","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":3426897300},{"type":"v1","addr":"172.21.15.55:6825","nonce":3426897300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":3426897300},{"type":"v1","addr":"172.21.15.55:6827","nonce":3426897300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":3426897300},{"type":"v1","addr":"172.21.15.55:6831","nonce":3426897300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":3426897300},{"type":"v1","addr":"172.21.15.55:6829","nonce":3426897300}]},"public_addr":"172.21.15.55:6825/3426897300","cluster_addr":"172.21.15.55:6827/3426897300","heartbeat_back_addr":"172.21.15.55:6831/3426897300","heartbeat_front_addr":"172.21.15.55:6829/3426897300","state":["exists","up"]},{"osd":2,"uuid":"e6b81cc6-4ff1-45d0-87eb-9f04ccf986a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3510271725},{"type":"v1","addr":"172.21.15.55:6809","nonce":3510271725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3510271725},{"type":"v1","addr":"172.21.15.55:6811","nonce":3510271725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3510271725},{"type":"v1","addr":"172.21.15.55:6815","nonce":3510271725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3510271725},{"type":"v1","addr":"172.21.15.55:6813","nonce":3510271725}]},"public_addr":"172.21.15.55:6809/3510271725","cluster_addr":"172.21.15.55:6811/3510271725","heartbeat_back_addr":"172.21.15.55:6815/3510271725","heartbeat_front_addr":"172.21.15.55:6813/3510271725","state":["exists","up"]},{"osd":3,"uuid":"b6a34b75-807d-4693-b1c3-903cb4c618d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":1066693520},{"type":"v1","addr":"172.21.15.55:6817","nonce":1066693520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":1066693520},{"type":"v1","addr":"172.21.15.55:6819","nonce":1066693520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":1066693520},{"type":"v1","addr":"172.21.15.55:6823","nonce":1066693520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":1066693520},{"type":"v1","addr":"172.21.15.55:6821","nonce":1066693520}]},"public_addr":"172.21.15.55:6817/1066693520","cluster_addr":"172.21.15.55:6819/1066693520","heartbeat_back_addr":"172.21.15.55:6823/1066693520","heartbeat_front_addr":"172.21.15.55:6821/1066693520","state":["exists","up"]},{"osd":4,"uuid":"272ec937-56b4-4f0a-b2e1-b0bc189c9d79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":4190771237},{"type":"v1","addr":"172.21.15.72:6820","nonce":4190771237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":4190771237},{"type":"v1","addr":"172.21.15.72:6824","nonce":4190771237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":4190771237},{"type":"v1","addr":"172.21.15.72:6831","nonce":4190771237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":4190771237},{"type":"v1","addr":"172.21.15.72:6828","nonce":4190771237}]},"public_addr":"172.21.15.72:6820/4190771237","cluster_addr":"172.21.15.72:6824/4190771237","heartbeat_back_addr":"172.21.15.72:6831/4190771237","heartbeat_front_addr":"172.21.15.72:6828/4190771237","state":["exists","up"]},{"osd":5,"uuid":"56439854-72a0-4ef4-81ff-184a3d924a5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":2421889184},{"type":"v1","addr":"172.21.15.72:6801","nonce":2421889184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6803","nonce":2421889184},{"type":"v1","addr":"172.21.15.72:6805","nonce":2421889184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":2421889184},{"type":"v1","addr":"172.21.15.72:6813","nonce":2421889184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6807","nonce":2421889184},{"type":"v1","addr":"172.21.15.72:6809","nonce":2421889184}]},"public_addr":"172.21.15.72:6801/2421889184","cluster_addr":"172.21.15.72:6805/2421889184","heartbeat_back_addr":"172.21.15.72:6813/2421889184","heartbeat_front_addr":"172.21.15.72:6809/2421889184","state":["exists","up"]},{"osd":6,"uuid":"e248e2be-3b6e-49cf-8c8a-1a4152827582","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3796994599},{"type":"v1","addr":"172.21.15.72:6804","nonce":3796994599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":3796994599},{"type":"v1","addr":"172.21.15.72:6808","nonce":3796994599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":3796994599},{"type":"v1","addr":"172.21.15.72:6815","nonce":3796994599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":3796994599},{"type":"v1","addr":"172.21.15.72:6812","nonce":3796994599}]},"public_addr":"172.21.15.72:6804/3796994599","cluster_addr":"172.21.15.72:6808/3796994599","heartbeat_back_addr":"172.21.15.72:6815/3796994599","heartbeat_front_addr":"172.21.15.72:6812/3796994599","state":["exists","up"]},{"osd":7,"uuid":"505a62d3-322b-4629-b4fd-187a55563709","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":3024877895},{"type":"v1","addr":"172.21.15.72:6817","nonce":3024877895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":3024877895},{"type":"v1","addr":"172.21.15.72:6821","nonce":3024877895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6827","nonce":3024877895},{"type":"v1","addr":"172.21.15.72:6829","nonce":3024877895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6823","nonce":3024877895},{"type":"v1","addr":"172.21.15.72:6825","nonce":3024877895}]},"public_addr":"172.21.15.72:6817/3024877895","cluster_addr":"172.21.15.72:6821/3024877895","heartbeat_back_addr":"172.21.15.72:6829/3024877895","heartbeat_front_addr":"172.21.15.72:6825/3024877895","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.241014+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.450799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.465018+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.507647+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.534763+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.495895+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.427110+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.547466+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-27T12:33:07.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:07.977+0000 7f4de388a640 1 -- 172.21.15.55:0/1565439358 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f4dc006c8f0 msgr2=0x7f4dc006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:07.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:07.977+0000 7f4de388a640 1 --2- 172.21.15.55:0/1565439358 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f4dc006c8f0 0x7f4dc006edb0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f4dd8009560 tx=0x7f4dd8009190 comp rx=0 tx=0).stop 2024-05-27T12:33:07.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:07.977+0000 7f4de388a640 1 -- 172.21.15.55:0/1565439358 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4ddc0b6370 msgr2=0x7f4ddc0b4730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:07.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:07.977+0000 7f4de388a640 1 --2- 172.21.15.55:0/1565439358 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4ddc0b6370 0x7f4ddc0b4730 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f4dcc000c00 tx=0x7f4dcc0046c0 comp rx=0 tx=0).stop 2024-05-27T12:33:07.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:07.977+0000 7f4de388a640 1 -- 172.21.15.55:0/1565439358 shutdown_connections 2024-05-27T12:33:07.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:07.977+0000 7f4de388a640 1 --2- 172.21.15.55:0/1565439358 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4ddc15ec00 0x7f4ddc0b4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:07.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:07.977+0000 7f4de388a640 1 --2- 172.21.15.55:0/1565439358 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4ddc0b6370 0x7f4ddc0b4730 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:07.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:07.977+0000 7f4de388a640 1 --2- 172.21.15.55:0/1565439358 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f4dc006c8f0 0x7f4dc006edb0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:07.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:07.977+0000 7f4de388a640 1 --2- 172.21.15.55:0/1565439358 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ddc0b3860 0x7f4ddc14bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:07.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:07.977+0000 7f4de388a640 1 -- 172.21.15.55:0/1565439358 >> 172.21.15.55:0/1565439358 conn(0x7f4ddc0d1370 msgr2=0x7f4ddc0b8680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:07.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:07.977+0000 7f4de388a640 1 -- 172.21.15.55:0/1565439358 shutdown_connections 2024-05-27T12:33:07.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:07.977+0000 7f4de388a640 1 -- 172.21.15.55:0/1565439358 wait complete. 2024-05-27T12:33:07.988 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-27T12:32:29.277895+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-27T12:32:39.442745+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-27T12:32:40.672118+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-27T12:33:07.988 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-27T12:33:08.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.097+0000 7f87c0010640 1 Processor -- start 2024-05-27T12:33:08.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.097+0000 7f87c0010640 1 -- start start 2024-05-27T12:33:08.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.098+0000 7f87c0010640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f87b815eb00 0x7f87b80cfb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:08.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.098+0000 7f87c0010640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f87b80d1f40 0x7f87b80b78f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:08.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.098+0000 7f87c0010640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87b815eee0 con 0x7f87b80d3e50 2024-05-27T12:33:08.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.098+0000 7f87c0010640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f87b80d5700 con 0x7f87b80d1f40 2024-05-27T12:33:08.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.098+0000 7f87c0010640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f87b80d4660 con 0x7f87b815eb00 2024-05-27T12:33:08.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.098+0000 7f87be5ad640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f87b80d1f40 0x7f87b80b78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:08.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.098+0000 7f87bd5ab640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f87b80d3e50 0x7f87b80d1830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:48670/0 (socket says 172.21.15.55:48670) 2024-05-27T12:33:08.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.098+0000 7f87bd5ab640 1 -- 172.21.15.55:0/3863580900 learned_addr learned my addr 172.21.15.55:0/3863580900 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-27T12:33:08.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.099+0000 7f87bddac640 1 --2- 172.21.15.55:0/3863580900 >> v2:172.21.15.72:3300/0 conn(0x7f87b815eb00 0x7f87b80cfb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:08.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.099+0000 7f87be5ad640 1 -- 172.21.15.55:0/3863580900 >> v2:172.21.15.72:3300/0 conn(0x7f87b815eb00 msgr2=0x7f87b80cfb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:08.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.099+0000 7f87be5ad640 1 --2- 172.21.15.55:0/3863580900 >> v2:172.21.15.72:3300/0 conn(0x7f87b815eb00 0x7f87b80cfb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:08.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.099+0000 7f87be5ad640 1 -- 172.21.15.55:0/3863580900 >> v1:172.21.15.55:6789/0 conn(0x7f87b80d3e50 legacy=0x7f87b80d1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:08.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.099+0000 7f87be5ad640 1 -- 172.21.15.55:0/3863580900 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87b80d4940 con 0x7f87b80d1f40 2024-05-27T12:33:08.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.099+0000 7f87bcdaa640 1 -- 172.21.15.55:0/3863580900 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 966695319 0 0) 0x7f87b815eee0 con 0x7f87b80d3e50 2024-05-27T12:33:08.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.100+0000 7f87be5ad640 1 --2- 172.21.15.55:0/3863580900 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87b80d1f40 0x7f87b80b78f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f87b806dcf0 tx=0x7f87b002a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58fc6d78e4fdf1da server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:08.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.100+0000 7f87bcdaa640 1 -- 172.21.15.55:0/3863580900 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87b0007740 con 0x7f87b80d1f40 2024-05-27T12:33:08.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.100+0000 7f87bcdaa640 1 -- 172.21.15.55:0/3863580900 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87b00078e0 con 0x7f87b80d1f40 2024-05-27T12:33:08.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.100+0000 7f87bcdaa640 1 -- 172.21.15.55:0/3863580900 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87b0007cb0 con 0x7f87b80d1f40 2024-05-27T12:33:08.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.101+0000 7f87c0010640 1 -- 172.21.15.55:0/3863580900 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87b80d1f40 msgr2=0x7f87b80b78f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:08.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.101+0000 7f87c0010640 1 --2- 172.21.15.55:0/3863580900 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87b80d1f40 0x7f87b80b78f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f87b806dcf0 tx=0x7f87b002a710 comp rx=0 tx=0).stop 2024-05-27T12:33:08.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.101+0000 7f87c0010640 1 -- 172.21.15.55:0/3863580900 shutdown_connections 2024-05-27T12:33:08.101 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.101+0000 7f87c0010640 1 --2- 172.21.15.55:0/3863580900 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87b80d1f40 0x7f87b80b78f0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:08.101 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.101+0000 7f87c0010640 1 --2- 172.21.15.55:0/3863580900 >> v2:172.21.15.72:3300/0 conn(0x7f87b815eb00 0x7f87b80cfb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:08.101 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.101+0000 7f87c0010640 1 -- 172.21.15.55:0/3863580900 >> 172.21.15.55:0/3863580900 conn(0x7f87b8067a50 msgr2=0x7f87b8067e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:08.101 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.101+0000 7f87c0010640 1 -- 172.21.15.55:0/3863580900 shutdown_connections 2024-05-27T12:33:08.101 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.101+0000 7f87c0010640 1 -- 172.21.15.55:0/3863580900 wait complete. 2024-05-27T12:33:08.101 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.102+0000 7f87c0010640 1 Processor -- start 2024-05-27T12:33:08.101 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.102+0000 7f87c0010640 1 -- start start 2024-05-27T12:33:08.103 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.103+0000 7f87c0010640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f87b80d1f40 0x7f87b814d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:08.103 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.103+0000 7f87c0010640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87b80d3e50 0x7f87b815b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:08.103 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.103+0000 7f87c0010640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87b815eb00 0x7f87b815bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:08.103 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.103+0000 7f87c0010640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f87b80d51e0 con 0x7f87b80d3e50 2024-05-27T12:33:08.103 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.103+0000 7f87c0010640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f87b80d4f00 con 0x7f87b815eb00 2024-05-27T12:33:08.103 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.103+0000 7f87c0010640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f87b80d42c0 con 0x7f87b80d1f40 2024-05-27T12:33:08.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.103+0000 7f87bd5ab640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87b80d3e50 0x7f87b815b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:08.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.103+0000 7f87bd5ab640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87b80d3e50 0x7f87b815b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51634/0 (socket says 172.21.15.55:51634) 2024-05-27T12:33:08.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.103+0000 7f87bd5ab640 1 -- 172.21.15.55:0/3707059019 learned_addr learned my addr 172.21.15.55:0/3707059019 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:33:08.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.103+0000 7f87bddac640 1 --2- 172.21.15.55:0/3707059019 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f87b80d1f40 0x7f87b814d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:08.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.103+0000 7f87be5ad640 1 --2- 172.21.15.55:0/3707059019 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87b815eb00 0x7f87b815bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:08.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.103+0000 7f87bd5ab640 1 -- 172.21.15.55:0/3707059019 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f87b80d1f40 msgr2=0x7f87b814d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:08.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.103+0000 7f87bd5ab640 1 --2- 172.21.15.55:0/3707059019 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f87b80d1f40 0x7f87b814d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:08.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.103+0000 7f87bd5ab640 1 -- 172.21.15.55:0/3707059019 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87b815eb00 msgr2=0x7f87b815bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:08.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.103+0000 7f87bd5ab640 1 --2- 172.21.15.55:0/3707059019 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87b815eb00 0x7f87b815bf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:08.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.103+0000 7f87bd5ab640 1 -- 172.21.15.55:0/3707059019 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87b80cb0a0 con 0x7f87b80d3e50 2024-05-27T12:33:08.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.103+0000 7f87be5ad640 1 --2- 172.21.15.55:0/3707059019 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87b815eb00 0x7f87b815bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T12:33:08.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.103+0000 7f87bd5ab640 1 --2- 172.21.15.55:0/3707059019 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87b80d3e50 0x7f87b815b9d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f87ac00c4d0 tx=0x7f87ac00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:08.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.104+0000 7f87aa7fc640 1 -- 172.21.15.55:0/3707059019 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87ac018070 con 0x7f87b80d3e50 2024-05-27T12:33:08.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.104+0000 7f87aa7fc640 1 -- 172.21.15.55:0/3707059019 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87ac007500 con 0x7f87b80d3e50 2024-05-27T12:33:08.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.104+0000 7f87aa7fc640 1 -- 172.21.15.55:0/3707059019 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87ac004a20 con 0x7f87b80d3e50 2024-05-27T12:33:08.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.104+0000 7f87c0010640 1 -- 172.21.15.55:0/3707059019 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87b814dab0 con 0x7f87b80d3e50 2024-05-27T12:33:08.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.104+0000 7f87c0010640 1 -- 172.21.15.55:0/3707059019 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87b815c930 con 0x7f87b80d3e50 2024-05-27T12:33:08.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.105+0000 7f87c0010640 1 -- 172.21.15.55:0/3707059019 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87b8068a70 con 0x7f87b80d3e50 2024-05-27T12:33:08.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.105+0000 7f87aa7fc640 1 -- 172.21.15.55:0/3707059019 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f87ac004bc0 con 0x7f87b80d3e50 2024-05-27T12:33:08.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.106+0000 7f87aa7fc640 1 --2- 172.21.15.55:0/3707059019 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f879c06c920 0x7f879c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:08.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.106+0000 7f87aa7fc640 1 -- 172.21.15.55:0/3707059019 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f87ac08ad50 con 0x7f87b80d3e50 2024-05-27T12:33:08.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.106+0000 7f87bddac640 1 --2- 172.21.15.55:0/3707059019 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f879c06c920 0x7f879c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:08.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.107+0000 7f87bddac640 1 --2- 172.21.15.55:0/3707059019 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f879c06c920 0x7f879c06ede0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f87b80d1b10 tx=0x7f87b4009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:08.109 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.110+0000 7f87aa7fc640 1 -- 172.21.15.55:0/3707059019 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f87ac058b20 con 0x7f87b80d3e50 2024-05-27T12:33:08.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.294+0000 7f87c0010640 1 -- 172.21.15.55:0/3707059019 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f87b814d880 con 0x7f87b80d3e50 2024-05-27T12:33:08.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.295+0000 7f87aa7fc640 1 -- 172.21.15.55:0/3707059019 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) ==== 93+0+10 (secure 0 0 0) 0x7f87ac05ce20 con 0x7f87b80d3e50 2024-05-27T12:33:08.294 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-05-27T12:33:08.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.297+0000 7f87c0010640 1 -- 172.21.15.55:0/3707059019 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f879c06c920 msgr2=0x7f879c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:08.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.297+0000 7f87c0010640 1 --2- 172.21.15.55:0/3707059019 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f879c06c920 0x7f879c06ede0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f87b80d1b10 tx=0x7f87b4009190 comp rx=0 tx=0).stop 2024-05-27T12:33:08.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.297+0000 7f87c0010640 1 -- 172.21.15.55:0/3707059019 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87b80d3e50 msgr2=0x7f87b815b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:08.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.297+0000 7f87c0010640 1 --2- 172.21.15.55:0/3707059019 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87b80d3e50 0x7f87b815b9d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f87ac00c4d0 tx=0x7f87ac00c990 comp rx=0 tx=0).stop 2024-05-27T12:33:08.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.297+0000 7f87c0010640 1 -- 172.21.15.55:0/3707059019 shutdown_connections 2024-05-27T12:33:08.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.297+0000 7f87c0010640 1 --2- 172.21.15.55:0/3707059019 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f879c06c920 0x7f879c06ede0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:08.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.297+0000 7f87c0010640 1 --2- 172.21.15.55:0/3707059019 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87b815eb00 0x7f87b815bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:08.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.297+0000 7f87c0010640 1 --2- 172.21.15.55:0/3707059019 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87b80d3e50 0x7f87b815b9d0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:08.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.297+0000 7f87c0010640 1 --2- 172.21.15.55:0/3707059019 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f87b80d1f40 0x7f87b814d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:08.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.297+0000 7f87c0010640 1 -- 172.21.15.55:0/3707059019 >> 172.21.15.55:0/3707059019 conn(0x7f87b8067a50 msgr2=0x7f87b80b7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:08.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.297+0000 7f87c0010640 1 -- 172.21.15.55:0/3707059019 shutdown_connections 2024-05-27T12:33:08.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.297+0000 7f87c0010640 1 -- 172.21.15.55:0/3707059019 wait complete. 2024-05-27T12:33:08.307 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-27T12:33:08.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.417+0000 7f3eb2a35640 1 Processor -- start 2024-05-27T12:33:08.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.417+0000 7f3eb2a35640 1 -- start start 2024-05-27T12:33:08.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.418+0000 7f3eb2a35640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3eac15eaf0 0x7f3eac0b1b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:08.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.418+0000 7f3eb2a35640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3eac0b24e0 0x7f3eac0b2900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:08.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.418+0000 7f3eb2a35640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3eac06b930 0x7f3eac06bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:08.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.418+0000 7f3eb2a35640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f3eac1635f0 con 0x7f3eac06b930 2024-05-27T12:33:08.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.418+0000 7f3eb2a35640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f3eac0b0af0 con 0x7f3eac0b24e0 2024-05-27T12:33:08.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.418+0000 7f3eb2a35640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f3eac0b2e40 con 0x7f3eac15eaf0 2024-05-27T12:33:08.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.418+0000 7f3eb0fd2640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3eac06b930 0x7f3eac06bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:08.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.418+0000 7f3eb0fd2640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3eac06b930 0x7f3eac06bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51644/0 (socket says 172.21.15.55:51644) 2024-05-27T12:33:08.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.418+0000 7f3eb0fd2640 1 -- 172.21.15.55:0/533542275 learned_addr learned my addr 172.21.15.55:0/533542275 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:33:08.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.418+0000 7f3ea3fff640 1 --2- 172.21.15.55:0/533542275 >> v2:172.21.15.72:3300/0 conn(0x7f3eac0b24e0 0x7f3eac0b2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:08.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.418+0000 7f3eabfff640 1 --2- 172.21.15.55:0/533542275 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3eac15eaf0 0x7f3eac0b1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:08.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.418+0000 7f3eb0fd2640 1 -- 172.21.15.55:0/533542275 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3eac15eaf0 msgr2=0x7f3eac0b1b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:08.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.418+0000 7f3eb0fd2640 1 --2- 172.21.15.55:0/533542275 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3eac15eaf0 0x7f3eac0b1b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:08.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.418+0000 7f3eb0fd2640 1 -- 172.21.15.55:0/533542275 >> v2:172.21.15.72:3300/0 conn(0x7f3eac0b24e0 msgr2=0x7f3eac0b2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:08.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.418+0000 7f3eb0fd2640 1 --2- 172.21.15.55:0/533542275 >> v2:172.21.15.72:3300/0 conn(0x7f3eac0b24e0 0x7f3eac0b2900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:08.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.418+0000 7f3eb0fd2640 1 -- 172.21.15.55:0/533542275 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3eac0b0d40 con 0x7f3eac06b930 2024-05-27T12:33:08.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.419+0000 7f3eb0fd2640 1 --2- 172.21.15.55:0/533542275 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3eac06b930 0x7f3eac06bdc0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f3eac071640 tx=0x7f3ea402a750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36ae63390b2f94dd server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:08.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.419+0000 7f3eab7fe640 1 -- 172.21.15.55:0/533542275 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ea4036070 con 0x7f3eac06b930 2024-05-27T12:33:08.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.419+0000 7f3eab7fe640 1 -- 172.21.15.55:0/533542275 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ea4031600 con 0x7f3eac06b930 2024-05-27T12:33:08.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.419+0000 7f3eab7fe640 1 -- 172.21.15.55:0/533542275 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ea40319d0 con 0x7f3eac06b930 2024-05-27T12:33:08.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.420+0000 7f3eb2a35640 1 -- 172.21.15.55:0/533542275 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3eac06b930 msgr2=0x7f3eac06bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:08.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.420+0000 7f3eb2a35640 1 --2- 172.21.15.55:0/533542275 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3eac06b930 0x7f3eac06bdc0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f3eac071640 tx=0x7f3ea402a750 comp rx=0 tx=0).stop 2024-05-27T12:33:08.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.420+0000 7f3eb2a35640 1 -- 172.21.15.55:0/533542275 shutdown_connections 2024-05-27T12:33:08.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.420+0000 7f3eb2a35640 1 --2- 172.21.15.55:0/533542275 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3eac06b930 0x7f3eac06bdc0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:08.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.420+0000 7f3eb2a35640 1 --2- 172.21.15.55:0/533542275 >> v2:172.21.15.72:3300/0 conn(0x7f3eac0b24e0 0x7f3eac0b2900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:08.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.420+0000 7f3eb2a35640 1 --2- 172.21.15.55:0/533542275 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3eac15eaf0 0x7f3eac0b1b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:08.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.420+0000 7f3eb2a35640 1 -- 172.21.15.55:0/533542275 >> 172.21.15.55:0/533542275 conn(0x7f3eac0733d0 msgr2=0x7f3eac09aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:08.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.420+0000 7f3eb2a35640 1 -- 172.21.15.55:0/533542275 shutdown_connections 2024-05-27T12:33:08.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.420+0000 7f3eb2a35640 1 -- 172.21.15.55:0/533542275 wait complete. 2024-05-27T12:33:08.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.421+0000 7f3eb2a35640 1 Processor -- start 2024-05-27T12:33:08.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.421+0000 7f3eb2a35640 1 -- start start 2024-05-27T12:33:08.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.422+0000 7f3eb2a35640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3eac06b930 0x7f3eac0c7f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:08.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.422+0000 7f3eb2a35640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3eac0b24e0 0x7f3eac158940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:08.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.422+0000 7f3eb2a35640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3eac15eaf0 0x7f3eac161760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:08.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.422+0000 7f3eb2a35640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f3eac0b15e0 con 0x7f3eac15eaf0 2024-05-27T12:33:08.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.422+0000 7f3eb2a35640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f3eac0b1300 con 0x7f3eac0b24e0 2024-05-27T12:33:08.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.422+0000 7f3eb2a35640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f3eac15eed0 con 0x7f3eac06b930 2024-05-27T12:33:08.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.422+0000 7f3eb0fd2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3eac15eaf0 0x7f3eac161760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:08.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.422+0000 7f3eb0fd2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3eac15eaf0 0x7f3eac161760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51648/0 (socket says 172.21.15.55:51648) 2024-05-27T12:33:08.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.422+0000 7f3eb0fd2640 1 -- 172.21.15.55:0/638079404 learned_addr learned my addr 172.21.15.55:0/638079404 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:33:08.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.422+0000 7f3eabfff640 1 --2- 172.21.15.55:0/638079404 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3eac06b930 0x7f3eac0c7f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:08.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.422+0000 7f3ea3fff640 1 --2- 172.21.15.55:0/638079404 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3eac0b24e0 0x7f3eac158940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:08.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.422+0000 7f3eb0fd2640 1 -- 172.21.15.55:0/638079404 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3eac06b930 msgr2=0x7f3eac0c7f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:08.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.423+0000 7f3eb0fd2640 1 --2- 172.21.15.55:0/638079404 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3eac06b930 0x7f3eac0c7f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:08.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.423+0000 7f3eb0fd2640 1 -- 172.21.15.55:0/638079404 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3eac0b24e0 msgr2=0x7f3eac158940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:08.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.423+0000 7f3eb0fd2640 1 --2- 172.21.15.55:0/638079404 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3eac0b24e0 0x7f3eac158940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:08.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.423+0000 7f3eb0fd2640 1 -- 172.21.15.55:0/638079404 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3eac160cc0 con 0x7f3eac15eaf0 2024-05-27T12:33:08.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.423+0000 7f3eb0fd2640 1 --2- 172.21.15.55:0/638079404 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3eac15eaf0 0x7f3eac161760 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f3ea4009f70 tx=0x7f3ea4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:08.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.423+0000 7f3ea97fa640 1 -- 172.21.15.55:0/638079404 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ea4041020 con 0x7f3eac15eaf0 2024-05-27T12:33:08.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.423+0000 7f3ea97fa640 1 -- 172.21.15.55:0/638079404 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ea40077a0 con 0x7f3eac15eaf0 2024-05-27T12:33:08.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.423+0000 7f3eb2a35640 1 -- 172.21.15.55:0/638079404 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3eac159490 con 0x7f3eac15eaf0 2024-05-27T12:33:08.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.423+0000 7f3ea97fa640 1 -- 172.21.15.55:0/638079404 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ea4036040 con 0x7f3eac15eaf0 2024-05-27T12:33:08.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.423+0000 7f3eb2a35640 1 -- 172.21.15.55:0/638079404 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3eac0705b0 con 0x7f3eac15eaf0 2024-05-27T12:33:08.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.424+0000 7f3eb2a35640 1 -- 172.21.15.55:0/638079404 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3eac075460 con 0x7f3eac15eaf0 2024-05-27T12:33:08.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.425+0000 7f3ea97fa640 1 -- 172.21.15.55:0/638079404 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3ea4044020 con 0x7f3eac15eaf0 2024-05-27T12:33:08.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.425+0000 7f3ea97fa640 1 --2- 172.21.15.55:0/638079404 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f3e8c06c8f0 0x7f3e8c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:08.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.425+0000 7f3ea97fa640 1 -- 172.21.15.55:0/638079404 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f3ea40ac5a0 con 0x7f3eac15eaf0 2024-05-27T12:33:08.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.425+0000 7f3eabfff640 1 --2- 172.21.15.55:0/638079404 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f3e8c06c8f0 0x7f3e8c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:08.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.426+0000 7f3eabfff640 1 --2- 172.21.15.55:0/638079404 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f3e8c06c8f0 0x7f3e8c06edb0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3e9c009aa0 tx=0x7f3e9c009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:08.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.432+0000 7f3ea97fa640 1 -- 172.21.15.55:0/638079404 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3ea404b030 con 0x7f3eac15eaf0 2024-05-27T12:33:08.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.618+0000 7f3eb2a35640 1 -- 172.21.15.55:0/638079404 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f3eac0ce930 con 0x7f3eac15eaf0 2024-05-27T12:33:08.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.618+0000 7f3ea97fa640 1 -- 172.21.15.55:0/638079404 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) ==== 104+0+11 (secure 0 0 0) 0x7f3ea407a380 con 0x7f3eac15eaf0 2024-05-27T12:33:08.618 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2024-05-27T12:33:08.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.621+0000 7f3eb2a35640 1 -- 172.21.15.55:0/638079404 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f3e8c06c8f0 msgr2=0x7f3e8c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:08.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.621+0000 7f3eb2a35640 1 --2- 172.21.15.55:0/638079404 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f3e8c06c8f0 0x7f3e8c06edb0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3e9c009aa0 tx=0x7f3e9c009190 comp rx=0 tx=0).stop 2024-05-27T12:33:08.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.621+0000 7f3eb2a35640 1 -- 172.21.15.55:0/638079404 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3eac15eaf0 msgr2=0x7f3eac161760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:08.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.621+0000 7f3eb2a35640 1 --2- 172.21.15.55:0/638079404 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3eac15eaf0 0x7f3eac161760 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f3ea4009f70 tx=0x7f3ea4004a40 comp rx=0 tx=0).stop 2024-05-27T12:33:08.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.621+0000 7f3eb2a35640 1 -- 172.21.15.55:0/638079404 shutdown_connections 2024-05-27T12:33:08.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.621+0000 7f3eb2a35640 1 --2- 172.21.15.55:0/638079404 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3eac15eaf0 0x7f3eac161760 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:08.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.621+0000 7f3eb2a35640 1 --2- 172.21.15.55:0/638079404 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f3e8c06c8f0 0x7f3e8c06edb0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:08.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.621+0000 7f3eb2a35640 1 --2- 172.21.15.55:0/638079404 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3eac0b24e0 0x7f3eac158940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:08.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.621+0000 7f3eb2a35640 1 --2- 172.21.15.55:0/638079404 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3eac06b930 0x7f3eac0c7f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:08.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.621+0000 7f3eb2a35640 1 -- 172.21.15.55:0/638079404 >> 172.21.15.55:0/638079404 conn(0x7f3eac0733d0 msgr2=0x7f3eac15c810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:08.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.621+0000 7f3eb2a35640 1 -- 172.21.15.55:0/638079404 shutdown_connections 2024-05-27T12:33:08.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.621+0000 7f3eb2a35640 1 -- 172.21.15.55:0/638079404 wait complete. 2024-05-27T12:33:08.631 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-27T12:33:08.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.741+0000 7f48b2042640 1 Processor -- start 2024-05-27T12:33:08.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.741+0000 7f48b2042640 1 -- start start 2024-05-27T12:33:08.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.742+0000 7f48b2042640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f48ac15eaf0 0x7f48ac0b1b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:08.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.742+0000 7f48b2042640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f48ac06c040 0x7f48ac0b2930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:08.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.742+0000 7f48b2042640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48ac0b0d40 con 0x7f48ac0b24e0 2024-05-27T12:33:08.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.742+0000 7f48b2042640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f48ac1635f0 con 0x7f48ac15eaf0 2024-05-27T12:33:08.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.742+0000 7f48b2042640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f48ac0b2e70 con 0x7f48ac06c040 2024-05-27T12:33:08.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.742+0000 7f48ab7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f48ac15eaf0 0x7f48ac0b1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:08.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.742+0000 7f48ab7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f48ac15eaf0 0x7f48ac0b1b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51660/0 (socket says 172.21.15.55:51660) 2024-05-27T12:33:08.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.742+0000 7f48ab7fe640 1 -- 172.21.15.55:0/1626754241 learned_addr learned my addr 172.21.15.55:0/1626754241 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:33:08.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.742+0000 7f48abfff640 1 --2- 172.21.15.55:0/1626754241 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f48ac06c040 0x7f48ac0b2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:08.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.742+0000 7f48ab7fe640 1 -- 172.21.15.55:0/1626754241 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f48ac06c040 msgr2=0x7f48ac0b2930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:08.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.742+0000 7f48ab7fe640 1 --2- 172.21.15.55:0/1626754241 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f48ac06c040 0x7f48ac0b2930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:08.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.742+0000 7f48ab7fe640 1 -- 172.21.15.55:0/1626754241 >> v1:172.21.15.72:6789/0 conn(0x7f48ac0b24e0 legacy=0x7f48ac06b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:08.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.743+0000 7f48ab7fe640 1 -- 172.21.15.55:0/1626754241 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48ac0b1020 con 0x7f48ac15eaf0 2024-05-27T12:33:08.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.743+0000 7f48ab7fe640 1 --2- 172.21.15.55:0/1626754241 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f48ac15eaf0 0x7f48ac0b1b00 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f4894009870 tx=0x7f489402a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db63e030869b110c server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:08.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.743+0000 7f48aa7fc640 1 -- 172.21.15.55:0/1626754241 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4894037070 con 0x7f48ac15eaf0 2024-05-27T12:33:08.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.743+0000 7f48aa7fc640 1 -- 172.21.15.55:0/1626754241 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f489402ae50 con 0x7f48ac15eaf0 2024-05-27T12:33:08.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.743+0000 7f48aa7fc640 1 -- 172.21.15.55:0/1626754241 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4894032860 con 0x7f48ac15eaf0 2024-05-27T12:33:08.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.744+0000 7f48b2042640 1 -- 172.21.15.55:0/1626754241 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f48ac15eaf0 msgr2=0x7f48ac0b1b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:08.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.744+0000 7f48b2042640 1 --2- 172.21.15.55:0/1626754241 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f48ac15eaf0 0x7f48ac0b1b00 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f4894009870 tx=0x7f489402a300 comp rx=0 tx=0).stop 2024-05-27T12:33:08.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.744+0000 7f48b2042640 1 -- 172.21.15.55:0/1626754241 shutdown_connections 2024-05-27T12:33:08.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.744+0000 7f48b2042640 1 --2- 172.21.15.55:0/1626754241 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f48ac06c040 0x7f48ac0b2930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:08.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.744+0000 7f48b2042640 1 --2- 172.21.15.55:0/1626754241 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f48ac15eaf0 0x7f48ac0b1b00 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:08.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.744+0000 7f48b2042640 1 -- 172.21.15.55:0/1626754241 >> 172.21.15.55:0/1626754241 conn(0x7f48ac0733d0 msgr2=0x7f48ac09aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:08.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.744+0000 7f48b2042640 1 -- 172.21.15.55:0/1626754241 shutdown_connections 2024-05-27T12:33:08.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.744+0000 7f48b2042640 1 -- 172.21.15.55:0/1626754241 wait complete. 2024-05-27T12:33:08.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.745+0000 7f48b2042640 1 Processor -- start 2024-05-27T12:33:08.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.746+0000 7f48b2042640 1 -- start start 2024-05-27T12:33:08.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.746+0000 7f48b2042640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f48ac06c040 0x7f48ac1596c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:08.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.746+0000 7f48b2042640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f48ac0b24e0 0x7f48ac161960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:08.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.746+0000 7f48b2042640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f48ac15eaf0 0x7f48ac0b6480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:08.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.746+0000 7f48b2042640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f48ac0b15e0 con 0x7f48ac06c040 2024-05-27T12:33:08.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.746+0000 7f48b2042640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f48ac0b0af0 con 0x7f48ac15eaf0 2024-05-27T12:33:08.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.746+0000 7f48b2042640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f48ac15eed0 con 0x7f48ac0b24e0 2024-05-27T12:33:08.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.746+0000 7f48ab7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f48ac06c040 0x7f48ac1596c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:08.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.746+0000 7f48ab7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f48ac06c040 0x7f48ac1596c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51664/0 (socket says 172.21.15.55:51664) 2024-05-27T12:33:08.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.747+0000 7f48ab7fe640 1 -- 172.21.15.55:0/2288488570 learned_addr learned my addr 172.21.15.55:0/2288488570 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:33:08.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.747+0000 7f48aaffd640 1 --2- 172.21.15.55:0/2288488570 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f48ac0b24e0 0x7f48ac161960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:08.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.747+0000 7f48abfff640 1 --2- 172.21.15.55:0/2288488570 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f48ac15eaf0 0x7f48ac0b6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:08.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.747+0000 7f48ab7fe640 1 -- 172.21.15.55:0/2288488570 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f48ac0b24e0 msgr2=0x7f48ac161960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:08.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.747+0000 7f48ab7fe640 1 --2- 172.21.15.55:0/2288488570 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f48ac0b24e0 0x7f48ac161960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:08.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.747+0000 7f48ab7fe640 1 -- 172.21.15.55:0/2288488570 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f48ac15eaf0 msgr2=0x7f48ac0b6480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:08.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.747+0000 7f48ab7fe640 1 --2- 172.21.15.55:0/2288488570 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f48ac15eaf0 0x7f48ac0b6480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:08.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.747+0000 7f48ab7fe640 1 -- 172.21.15.55:0/2288488570 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48ac15fcb0 con 0x7f48ac06c040 2024-05-27T12:33:08.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.747+0000 7f48abfff640 1 --2- 172.21.15.55:0/2288488570 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f48ac15eaf0 0x7f48ac0b6480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T12:33:08.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.747+0000 7f48ab7fe640 1 --2- 172.21.15.55:0/2288488570 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f48ac06c040 0x7f48ac1596c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f489402a340 tx=0x7f48940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:08.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.747+0000 7f48a3fff640 1 -- 172.21.15.55:0/2288488570 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4894041020 con 0x7f48ac06c040 2024-05-27T12:33:08.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.747+0000 7f48a3fff640 1 -- 172.21.15.55:0/2288488570 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f489403c890 con 0x7f48ac06c040 2024-05-27T12:33:08.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.747+0000 7f48b2042640 1 -- 172.21.15.55:0/2288488570 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48ac15ff90 con 0x7f48ac06c040 2024-05-27T12:33:08.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.747+0000 7f48a3fff640 1 -- 172.21.15.55:0/2288488570 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4894037040 con 0x7f48ac06c040 2024-05-27T12:33:08.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.747+0000 7f48b2042640 1 -- 172.21.15.55:0/2288488570 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48ac160550 con 0x7f48ac06c040 2024-05-27T12:33:08.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.748+0000 7f48b2042640 1 -- 172.21.15.55:0/2288488570 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48ac0cfb30 con 0x7f48ac06c040 2024-05-27T12:33:08.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.749+0000 7f48a3fff640 1 -- 172.21.15.55:0/2288488570 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4894044020 con 0x7f48ac06c040 2024-05-27T12:33:08.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.749+0000 7f48a3fff640 1 --2- 172.21.15.55:0/2288488570 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f488c06c8f0 0x7f488c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:08.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.749+0000 7f48a3fff640 1 -- 172.21.15.55:0/2288488570 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f48940ac4f0 con 0x7f48ac06c040 2024-05-27T12:33:08.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.750+0000 7f48aaffd640 1 --2- 172.21.15.55:0/2288488570 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f488c06c8f0 0x7f488c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:08.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.750+0000 7f48aaffd640 1 --2- 172.21.15.55:0/2288488570 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f488c06c8f0 0x7f488c06edb0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f48ac067ab0 tx=0x7f489c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:08.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.754+0000 7f48a3fff640 1 -- 172.21.15.55:0/2288488570 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f48ac0cfb30 con 0x7f48ac06c040 2024-05-27T12:33:08.937 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.938+0000 7f48b2042640 1 -- 172.21.15.55:0/2288488570 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f48ac075460 con 0x7f48ac06c040 2024-05-27T12:33:08.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.938+0000 7f48a3fff640 1 -- 172.21.15.55:0/2288488570 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) ==== 100+0+11 (secure 0 0 0) 0x7f489404b030 con 0x7f48ac06c040 2024-05-27T12:33:08.938 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2024-05-27T12:33:08.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.940+0000 7f48b2042640 1 -- 172.21.15.55:0/2288488570 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f488c06c8f0 msgr2=0x7f488c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:08.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.940+0000 7f48b2042640 1 --2- 172.21.15.55:0/2288488570 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f488c06c8f0 0x7f488c06edb0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f48ac067ab0 tx=0x7f489c009040 comp rx=0 tx=0).stop 2024-05-27T12:33:08.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.940+0000 7f48b2042640 1 -- 172.21.15.55:0/2288488570 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f48ac06c040 msgr2=0x7f48ac1596c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:08.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.940+0000 7f48b2042640 1 --2- 172.21.15.55:0/2288488570 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f48ac06c040 0x7f48ac1596c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f489402a340 tx=0x7f48940046c0 comp rx=0 tx=0).stop 2024-05-27T12:33:08.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.941+0000 7f48b2042640 1 -- 172.21.15.55:0/2288488570 shutdown_connections 2024-05-27T12:33:08.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.941+0000 7f48b2042640 1 --2- 172.21.15.55:0/2288488570 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f488c06c8f0 0x7f488c06edb0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:08.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.941+0000 7f48b2042640 1 --2- 172.21.15.55:0/2288488570 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f48ac15eaf0 0x7f48ac0b6480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:08.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.941+0000 7f48b2042640 1 --2- 172.21.15.55:0/2288488570 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f48ac0b24e0 0x7f48ac161960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:08.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.941+0000 7f48b2042640 1 --2- 172.21.15.55:0/2288488570 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f48ac06c040 0x7f48ac1596c0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:08.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.941+0000 7f48b2042640 1 -- 172.21.15.55:0/2288488570 >> 172.21.15.55:0/2288488570 conn(0x7f48ac0733d0 msgr2=0x7f48ac0ce170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:08.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.941+0000 7f48b2042640 1 -- 172.21.15.55:0/2288488570 shutdown_connections 2024-05-27T12:33:08.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:08.941+0000 7f48b2042640 1 -- 172.21.15.55:0/2288488570 wait complete. 2024-05-27T12:33:08.951 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-27T12:33:09.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.056+0000 7fbc1c176640 1 Processor -- start 2024-05-27T12:33:09.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.056+0000 7fbc1c176640 1 -- start start 2024-05-27T12:33:09.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.057+0000 7fbc1c176640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbc140d0560 0x7fbc140d09a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:09.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.057+0000 7fbc1c176640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc140cd410 con 0x7fbc1409aa30 2024-05-27T12:33:09.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.057+0000 7fbc1c176640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc140d1020 con 0x7fbc140cdbb0 2024-05-27T12:33:09.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.057+0000 7fbc1c176640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fbc140d1300 con 0x7fbc140d0560 2024-05-27T12:33:09.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.057+0000 7fbc19f12640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fbc1409aa30 0x7fbc1409ae10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:48684/0 (socket says 172.21.15.55:48684) 2024-05-27T12:33:09.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.057+0000 7fbc19f12640 1 -- 172.21.15.55:0/702193754 learned_addr learned my addr 172.21.15.55:0/702193754 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-27T12:33:09.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.057+0000 7fbc19711640 1 --2- 172.21.15.55:0/702193754 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbc140d0560 0x7fbc140d09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:09.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.057+0000 7fbc18f10640 1 -- 172.21.15.55:0/702193754 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3115418268 0 0) 0x7fbc10001110 con 0x7fbc1409aa30 2024-05-27T12:33:09.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.057+0000 7fbc18f10640 1 -- 172.21.15.55:0/702193754 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbc00003520 con 0x7fbc1409aa30 2024-05-27T12:33:09.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.058+0000 7fbc18f10640 1 -- 172.21.15.55:0/702193754 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4082311567 0 0) 0x7fbc00003520 con 0x7fbc1409aa30 2024-05-27T12:33:09.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.058+0000 7fbc18f10640 1 -- 172.21.15.55:0/702193754 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbc140d0560 msgr2=0x7fbc140d09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:09.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.058+0000 7fbc18f10640 1 --2- 172.21.15.55:0/702193754 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbc140d0560 0x7fbc140d09a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:09.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.058+0000 7fbc18f10640 1 -- 172.21.15.55:0/702193754 >> v1:172.21.15.72:6789/0 conn(0x7fbc140cdbb0 legacy=0x7fbc140ce040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:09.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.058+0000 7fbc18f10640 1 -- 172.21.15.55:0/702193754 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc140d15e0 con 0x7fbc1409aa30 2024-05-27T12:33:09.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.058+0000 7fbc18f10640 1 -- 172.21.15.55:0/702193754 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 793017739 0 0) 0x7fbc10001840 con 0x7fbc1409aa30 2024-05-27T12:33:09.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.058+0000 7fbc18f10640 1 -- 172.21.15.55:0/702193754 >> v1:172.21.15.55:6789/0 conn(0x7fbc1409aa30 legacy=0x7fbc1409ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:09.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.058+0000 7fbc18f10640 1 --2- 172.21.15.55:0/702193754 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbc140d0560 0x7fbc00003ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:09.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.058+0000 7fbc18f10640 1 --2- 172.21.15.55:0/702193754 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbc00004040 0x7fbc00004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:09.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.058+0000 7fbc18f10640 1 --2- 172.21.15.55:0/702193754 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc00004d40 0x7fbc000051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:09.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.058+0000 7fbc18f10640 1 -- 172.21.15.55:0/702193754 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7fbc140d1300 con 0x7fbc00004d40 2024-05-27T12:33:09.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.058+0000 7fbc18f10640 1 -- 172.21.15.55:0/702193754 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fbc0000bbb0 con 0x7fbc00004040 2024-05-27T12:33:09.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.058+0000 7fbc18f10640 1 -- 172.21.15.55:0/702193754 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fbc0000bdb0 con 0x7fbc140d0560 2024-05-27T12:33:09.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.058+0000 7fbc1a713640 1 --2- 172.21.15.55:0/702193754 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc00004d40 0x7fbc000051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:09.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.058+0000 7fbc19f12640 1 --2- 172.21.15.55:0/702193754 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbc140d0560 0x7fbc00003ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:09.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.058+0000 7fbc19711640 1 --2- 172.21.15.55:0/702193754 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbc00004040 0x7fbc00004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:09.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.058+0000 7fbc1a713640 1 -- 172.21.15.55:0/702193754 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbc140d0560 msgr2=0x7fbc00003ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:09.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.058+0000 7fbc1a713640 1 --2- 172.21.15.55:0/702193754 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbc140d0560 0x7fbc00003ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:09.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.058+0000 7fbc1a713640 1 -- 172.21.15.55:0/702193754 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbc00004040 msgr2=0x7fbc00004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:09.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.058+0000 7fbc1a713640 1 --2- 172.21.15.55:0/702193754 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbc00004040 0x7fbc00004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:09.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.058+0000 7fbc1a713640 1 -- 172.21.15.55:0/702193754 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc00003520 con 0x7fbc00004d40 2024-05-27T12:33:09.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.059+0000 7fbc1a713640 1 --2- 172.21.15.55:0/702193754 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc00004d40 0x7fbc000051c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fbc0c001e50 tx=0x7fbc00005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10075746e3c8e19e server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:09.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.059+0000 7fbc18f10640 1 -- 172.21.15.55:0/702193754 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc0c001a70 con 0x7fbc00004d40 2024-05-27T12:33:09.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.059+0000 7fbc18f10640 1 -- 172.21.15.55:0/702193754 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc0c003970 con 0x7fbc00004d40 2024-05-27T12:33:09.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.059+0000 7fbc18f10640 1 -- 172.21.15.55:0/702193754 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc0c003d60 con 0x7fbc00004d40 2024-05-27T12:33:09.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.060+0000 7fbc1c176640 1 -- 172.21.15.55:0/702193754 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc00004d40 msgr2=0x7fbc000051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:09.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.060+0000 7fbc1c176640 1 --2- 172.21.15.55:0/702193754 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc00004d40 0x7fbc000051c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fbc0c001e50 tx=0x7fbc00005830 comp rx=0 tx=0).stop 2024-05-27T12:33:09.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.060+0000 7fbc1a713640 1 -- 172.21.15.55:0/702193754 reap_dead start 2024-05-27T12:33:09.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.060+0000 7fbc1c176640 1 -- 172.21.15.55:0/702193754 shutdown_connections 2024-05-27T12:33:09.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.060+0000 7fbc1c176640 1 -- 172.21.15.55:0/702193754 >> 172.21.15.55:0/702193754 conn(0x7fbc140d2660 msgr2=0x7fbc140d2a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:09.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.060+0000 7fbc1c176640 1 -- 172.21.15.55:0/702193754 shutdown_connections 2024-05-27T12:33:09.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.060+0000 7fbc1c176640 1 -- 172.21.15.55:0/702193754 wait complete. 2024-05-27T12:33:09.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.062+0000 7fbc1c176640 1 Processor -- start 2024-05-27T12:33:09.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.062+0000 7fbc1c176640 1 -- start start 2024-05-27T12:33:09.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.063+0000 7fbc1c176640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbc00004d40 0x7fbc140c99e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:09.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.063+0000 7fbc1c176640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbc1414eac0 0x7fbc140c71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:09.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.063+0000 7fbc1c176640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc140c76e0 0x7fbc140c7b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:09.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.063+0000 7fbc1c176640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7fbc1415cd30 con 0x7fbc140c76e0 2024-05-27T12:33:09.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.063+0000 7fbc1c176640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fbc1415d340 con 0x7fbc00004d40 2024-05-27T12:33:09.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.063+0000 7fbc1c176640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fbc1415ceb0 con 0x7fbc1414eac0 2024-05-27T12:33:09.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.063+0000 7fbc1a713640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc140c76e0 0x7fbc140c7b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:09.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.063+0000 7fbc1a713640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc140c76e0 0x7fbc140c7b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51688/0 (socket says 172.21.15.55:51688) 2024-05-27T12:33:09.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.063+0000 7fbc1a713640 1 -- 172.21.15.55:0/383232811 learned_addr learned my addr 172.21.15.55:0/383232811 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:33:09.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.063+0000 7fbc19f12640 1 --2- 172.21.15.55:0/383232811 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbc00004d40 0x7fbc140c99e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:09.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.063+0000 7fbc19711640 1 --2- 172.21.15.55:0/383232811 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbc1414eac0 0x7fbc140c71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:09.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.063+0000 7fbc1a713640 1 -- 172.21.15.55:0/383232811 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbc1414eac0 msgr2=0x7fbc140c71a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:09.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.063+0000 7fbc1a713640 1 --2- 172.21.15.55:0/383232811 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbc1414eac0 0x7fbc140c71a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:09.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.063+0000 7fbc1a713640 1 -- 172.21.15.55:0/383232811 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbc00004d40 msgr2=0x7fbc140c99e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:09.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.063+0000 7fbc1a713640 1 --2- 172.21.15.55:0/383232811 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbc00004d40 0x7fbc140c99e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:09.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.063+0000 7fbc1a713640 1 -- 172.21.15.55:0/383232811 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc140cc6d0 con 0x7fbc140c76e0 2024-05-27T12:33:09.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.064+0000 7fbc19711640 1 --2- 172.21.15.55:0/383232811 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbc1414eac0 0x7fbc140c71a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T12:33:09.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.064+0000 7fbc1a713640 1 --2- 172.21.15.55:0/383232811 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc140c76e0 0x7fbc140c7b40 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fbc0c001f40 tx=0x7fbc0c0014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:09.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.064+0000 7fbc0a7fc640 1 -- 172.21.15.55:0/383232811 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc0c001a70 con 0x7fbc140c76e0 2024-05-27T12:33:09.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.064+0000 7fbc0a7fc640 1 -- 172.21.15.55:0/383232811 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc0c040070 con 0x7fbc140c76e0 2024-05-27T12:33:09.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.064+0000 7fbc1c176640 1 -- 172.21.15.55:0/383232811 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc140cc9b0 con 0x7fbc140c76e0 2024-05-27T12:33:09.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.064+0000 7fbc0a7fc640 1 -- 172.21.15.55:0/383232811 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc0c005520 con 0x7fbc140c76e0 2024-05-27T12:33:09.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.064+0000 7fbc1c176640 1 -- 172.21.15.55:0/383232811 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc140b5b60 con 0x7fbc140c76e0 2024-05-27T12:33:09.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.065+0000 7fbc1c176640 1 -- 172.21.15.55:0/383232811 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc14075460 con 0x7fbc140c76e0 2024-05-27T12:33:09.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.065+0000 7fbc0a7fc640 1 -- 172.21.15.55:0/383232811 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbc0c03a070 con 0x7fbc140c76e0 2024-05-27T12:33:09.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.066+0000 7fbc0a7fc640 1 --2- 172.21.15.55:0/383232811 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fbbf806c8f0 0x7fbbf806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:09.067 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.066+0000 7fbc0a7fc640 1 -- 172.21.15.55:0/383232811 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fbc0c0ab470 con 0x7fbc140c76e0 2024-05-27T12:33:09.067 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.066+0000 7fbc19f12640 1 --2- 172.21.15.55:0/383232811 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fbbf806c8f0 0x7fbbf806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:09.067 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.067+0000 7fbc19f12640 1 --2- 172.21.15.55:0/383232811 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fbbf806c8f0 0x7fbbf806edb0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fbc10001050 tx=0x7fbc10000f80 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:09.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.070+0000 7fbc0a7fc640 1 -- 172.21.15.55:0/383232811 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fbc0c0798a0 con 0x7fbc140c76e0 2024-05-27T12:33:09.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.256+0000 7fbc1c176640 1 -- 172.21.15.55:0/383232811 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbc140c5f30 con 0x7fbc140c76e0 2024-05-27T12:33:09.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.257+0000 7fbc0a7fc640 1 -- 172.21.15.55:0/383232811 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16557 (secure 0 0 0) 0x7fbc0c0791a0 con 0x7fbc140c76e0 2024-05-27T12:33:09.256 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-27T12:33:09.256 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":23,"fsid":"c3ff4e3b-8dae-4856-9593-e5cc66c59982","created":"2024-05-27T12:32:17.019097+0000","modified":"2024-05-27T12:32:43.361598+0000","last_up_change":"2024-05-27T12:32:28.109744+0000","last_in_change":"2024-05-27T12:32:19.309872+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-27T12:32:29.277895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-27T12:32:39.442745+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-27T12:32:40.672118+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e607b598-061b-4b6f-92ff-95c20b330599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":807572567},{"type":"v1","addr":"172.21.15.55:6801","nonce":807572567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":807572567},{"type":"v1","addr":"172.21.15.55:6803","nonce":807572567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":807572567},{"type":"v1","addr":"172.21.15.55:6807","nonce":807572567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":807572567},{"type":"v1","addr":"172.21.15.55:6805","nonce":807572567}]},"public_addr":"172.21.15.55:6801/807572567","cluster_addr":"172.21.15.55:6803/807572567","heartbeat_back_addr":"172.21.15.55:6807/807572567","heartbeat_front_addr":"172.21.15.55:6805/807572567","state":["exists","up"]},{"osd":1,"uuid":"ba2b5b1d-71a9-4ecc-9a48-55aa7fe54261","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":3426897300},{"type":"v1","addr":"172.21.15.55:6825","nonce":3426897300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":3426897300},{"type":"v1","addr":"172.21.15.55:6827","nonce":3426897300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":3426897300},{"type":"v1","addr":"172.21.15.55:6831","nonce":3426897300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":3426897300},{"type":"v1","addr":"172.21.15.55:6829","nonce":3426897300}]},"public_addr":"172.21.15.55:6825/3426897300","cluster_addr":"172.21.15.55:6827/3426897300","heartbeat_back_addr":"172.21.15.55:6831/3426897300","heartbeat_front_addr":"172.21.15.55:6829/3426897300","state":["exists","up"]},{"osd":2,"uuid":"e6b81cc6-4ff1-45d0-87eb-9f04ccf986a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3510271725},{"type":"v1","addr":"172.21.15.55:6809","nonce":3510271725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3510271725},{"type":"v1","addr":"172.21.15.55:6811","nonce":3510271725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3510271725},{"type":"v1","addr":"172.21.15.55:6815","nonce":3510271725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3510271725},{"type":"v1","addr":"172.21.15.55:6813","nonce":3510271725}]},"public_addr":"172.21.15.55:6809/3510271725","cluster_addr":"172.21.15.55:6811/3510271725","heartbeat_back_addr":"172.21.15.55:6815/3510271725","heartbeat_front_addr":"172.21.15.55:6813/3510271725","state":["exists","up"]},{"osd":3,"uuid":"b6a34b75-807d-4693-b1c3-903cb4c618d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":1066693520},{"type":"v1","addr":"172.21.15.55:6817","nonce":1066693520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":1066693520},{"type":"v1","addr":"172.21.15.55:6819","nonce":1066693520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":1066693520},{"type":"v1","addr":"172.21.15.55:6823","nonce":1066693520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":1066693520},{"type":"v1","addr":"172.21.15.55:6821","nonce":1066693520}]},"public_addr":"172.21.15.55:6817/1066693520","cluster_addr":"172.21.15.55:6819/1066693520","heartbeat_back_addr":"172.21.15.55:6823/1066693520","heartbeat_front_addr":"172.21.15.55:6821/1066693520","state":["exists","up"]},{"osd":4,"uuid":"272ec937-56b4-4f0a-b2e1-b0bc189c9d79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":4190771237},{"type":"v1","addr":"172.21.15.72:6820","nonce":4190771237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":4190771237},{"type":"v1","addr":"172.21.15.72:6824","nonce":4190771237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":4190771237},{"type":"v1","addr":"172.21.15.72:6831","nonce":4190771237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":4190771237},{"type":"v1","addr":"172.21.15.72:6828","nonce":4190771237}]},"public_addr":"172.21.15.72:6820/4190771237","cluster_addr":"172.21.15.72:6824/4190771237","heartbeat_back_addr":"172.21.15.72:6831/4190771237","heartbeat_front_addr":"172.21.15.72:6828/4190771237","state":["exists","up"]},{"osd":5,"uuid":"56439854-72a0-4ef4-81ff-184a3d924a5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":2421889184},{"type":"v1","addr":"172.21.15.72:6801","nonce":2421889184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6803","nonce":2421889184},{"type":"v1","addr":"172.21.15.72:6805","nonce":2421889184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":2421889184},{"type":"v1","addr":"172.21.15.72:6813","nonce":2421889184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6807","nonce":2421889184},{"type":"v1","addr":"172.21.15.72:6809","nonce":2421889184}]},"public_addr":"172.21.15.72:6801/2421889184","cluster_addr":"172.21.15.72:6805/2421889184","heartbeat_back_addr":"172.21.15.72:6813/2421889184","heartbeat_front_addr":"172.21.15.72:6809/2421889184","state":["exists","up"]},{"osd":6,"uuid":"e248e2be-3b6e-49cf-8c8a-1a4152827582","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3796994599},{"type":"v1","addr":"172.21.15.72:6804","nonce":3796994599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":3796994599},{"type":"v1","addr":"172.21.15.72:6808","nonce":3796994599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":3796994599},{"type":"v1","addr":"172.21.15.72:6815","nonce":3796994599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":3796994599},{"type":"v1","addr":"172.21.15.72:6812","nonce":3796994599}]},"public_addr":"172.21.15.72:6804/3796994599","cluster_addr":"172.21.15.72:6808/3796994599","heartbeat_back_addr":"172.21.15.72:6815/3796994599","heartbeat_front_addr":"172.21.15.72:6812/3796994599","state":["exists","up"]},{"osd":7,"uuid":"505a62d3-322b-4629-b4fd-187a55563709","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":3024877895},{"type":"v1","addr":"172.21.15.72:6817","nonce":3024877895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":3024877895},{"type":"v1","addr":"172.21.15.72:6821","nonce":3024877895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6827","nonce":3024877895},{"type":"v1","addr":"172.21.15.72:6829","nonce":3024877895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6823","nonce":3024877895},{"type":"v1","addr":"172.21.15.72:6825","nonce":3024877895}]},"public_addr":"172.21.15.72:6817/3024877895","cluster_addr":"172.21.15.72:6821/3024877895","heartbeat_back_addr":"172.21.15.72:6829/3024877895","heartbeat_front_addr":"172.21.15.72:6825/3024877895","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.241014+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.450799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.465018+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.507647+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.534763+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.495895+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.427110+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.547466+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-27T12:33:09.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.259+0000 7fbc1c176640 1 -- 172.21.15.55:0/383232811 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fbbf806c8f0 msgr2=0x7fbbf806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:09.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.259+0000 7fbc1c176640 1 --2- 172.21.15.55:0/383232811 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fbbf806c8f0 0x7fbbf806edb0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fbc10001050 tx=0x7fbc10000f80 comp rx=0 tx=0).stop 2024-05-27T12:33:09.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.259+0000 7fbc1c176640 1 -- 172.21.15.55:0/383232811 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc140c76e0 msgr2=0x7fbc140c7b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:09.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.259+0000 7fbc1c176640 1 --2- 172.21.15.55:0/383232811 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc140c76e0 0x7fbc140c7b40 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fbc0c001f40 tx=0x7fbc0c0014a0 comp rx=0 tx=0).stop 2024-05-27T12:33:09.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.259+0000 7fbc1c176640 1 -- 172.21.15.55:0/383232811 shutdown_connections 2024-05-27T12:33:09.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.259+0000 7fbc1c176640 1 --2- 172.21.15.55:0/383232811 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc140c76e0 0x7fbc140c7b40 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:09.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.259+0000 7fbc1c176640 1 --2- 172.21.15.55:0/383232811 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbc1414eac0 0x7fbc140c71a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:09.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.259+0000 7fbc1c176640 1 --2- 172.21.15.55:0/383232811 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fbbf806c8f0 0x7fbbf806edb0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:09.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.259+0000 7fbc1c176640 1 --2- 172.21.15.55:0/383232811 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbc00004d40 0x7fbc140c99e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:09.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.259+0000 7fbc1c176640 1 -- 172.21.15.55:0/383232811 >> 172.21.15.55:0/383232811 conn(0x7fbc140d2660 msgr2=0x7fbc141599f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:09.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.259+0000 7fbc1c176640 1 -- 172.21.15.55:0/383232811 shutdown_connections 2024-05-27T12:33:09.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.259+0000 7fbc1c176640 1 -- 172.21.15.55:0/383232811 wait complete. 2024-05-27T12:33:09.270 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-27T12:32:29.277895+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-27T12:32:39.442745+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-27T12:32:40.672118+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-27T12:33:09.270 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-27T12:33:09.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.379+0000 7f3101708640 1 Processor -- start 2024-05-27T12:33:09.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.379+0000 7f3101708640 1 -- start start 2024-05-27T12:33:09.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.380+0000 7f3101708640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f30fc15eb60 0x7f30fc06d930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:09.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.380+0000 7f3101708640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f30fc09b980 0x7f30fc0d1390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:09.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.380+0000 7f3101708640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f30fc09aa30 0x7f30fc09aec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:09.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.380+0000 7f3101708640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f30fc0d1cc0 con 0x7f30fc15eb60 2024-05-27T12:33:09.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.380+0000 7f3101708640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f30fc06cb70 con 0x7f30fc09b980 2024-05-27T12:33:09.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.380+0000 7f3101708640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f30fc06ce50 con 0x7f30fc09aa30 2024-05-27T12:33:09.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.380+0000 7f30faffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f30fc15eb60 0x7f30fc06d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:09.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.380+0000 7f30faffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f30fc15eb60 0x7f30fc06d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51704/0 (socket says 172.21.15.55:51704) 2024-05-27T12:33:09.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.380+0000 7f30faffd640 1 -- 172.21.15.55:0/588294098 learned_addr learned my addr 172.21.15.55:0/588294098 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:33:09.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.380+0000 7f30fa7fc640 1 --2- 172.21.15.55:0/588294098 >> v2:172.21.15.72:3300/0 conn(0x7f30fc09b980 0x7f30fc0d1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:09.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.380+0000 7f30fb7fe640 1 --2- 172.21.15.55:0/588294098 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f30fc09aa30 0x7f30fc09aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:09.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.380+0000 7f30faffd640 1 -- 172.21.15.55:0/588294098 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f30fc09aa30 msgr2=0x7f30fc09aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:09.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.380+0000 7f30faffd640 1 --2- 172.21.15.55:0/588294098 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f30fc09aa30 0x7f30fc09aec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:09.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.380+0000 7f30faffd640 1 -- 172.21.15.55:0/588294098 >> v2:172.21.15.72:3300/0 conn(0x7f30fc09b980 msgr2=0x7f30fc0d1390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:09.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.380+0000 7f30faffd640 1 --2- 172.21.15.55:0/588294098 >> v2:172.21.15.72:3300/0 conn(0x7f30fc09b980 0x7f30fc0d1390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:09.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.380+0000 7f30faffd640 1 -- 172.21.15.55:0/588294098 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30fc06d130 con 0x7f30fc15eb60 2024-05-27T12:33:09.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.381+0000 7f30faffd640 1 --2- 172.21.15.55:0/588294098 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30fc15eb60 0x7f30fc06d930 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f30fc0d01f0 tx=0x7f30ec02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbe4227d0d9abd0d server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:09.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.381+0000 7f30f9ffb640 1 -- 172.21.15.55:0/588294098 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30ec037070 con 0x7f30fc15eb60 2024-05-27T12:33:09.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.381+0000 7f30f9ffb640 1 -- 172.21.15.55:0/588294098 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30ec032440 con 0x7f30fc15eb60 2024-05-27T12:33:09.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.381+0000 7f30f9ffb640 1 -- 172.21.15.55:0/588294098 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30ec032810 con 0x7f30fc15eb60 2024-05-27T12:33:09.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.382+0000 7f3101708640 1 -- 172.21.15.55:0/588294098 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30fc15eb60 msgr2=0x7f30fc06d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:09.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.382+0000 7f3101708640 1 --2- 172.21.15.55:0/588294098 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30fc15eb60 0x7f30fc06d930 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f30fc0d01f0 tx=0x7f30ec02a140 comp rx=0 tx=0).stop 2024-05-27T12:33:09.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.382+0000 7f3101708640 1 -- 172.21.15.55:0/588294098 shutdown_connections 2024-05-27T12:33:09.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.382+0000 7f3101708640 1 --2- 172.21.15.55:0/588294098 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f30fc09aa30 0x7f30fc09aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:09.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.382+0000 7f3101708640 1 --2- 172.21.15.55:0/588294098 >> v2:172.21.15.72:3300/0 conn(0x7f30fc09b980 0x7f30fc0d1390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:09.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.382+0000 7f3101708640 1 --2- 172.21.15.55:0/588294098 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30fc15eb60 0x7f30fc06d930 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:09.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.382+0000 7f3101708640 1 -- 172.21.15.55:0/588294098 >> 172.21.15.55:0/588294098 conn(0x7f30fc0b4160 msgr2=0x7f30fc0b4570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:09.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.382+0000 7f3101708640 1 -- 172.21.15.55:0/588294098 shutdown_connections 2024-05-27T12:33:09.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.382+0000 7f3101708640 1 -- 172.21.15.55:0/588294098 wait complete. 2024-05-27T12:33:09.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.383+0000 7f3101708640 1 Processor -- start 2024-05-27T12:33:09.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.383+0000 7f3101708640 1 -- start start 2024-05-27T12:33:09.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.384+0000 7f3101708640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f30fc09aa30 0x7f30fc155760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:09.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.384+0000 7f3101708640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f30fc09b980 0x7f30fc156c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:09.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.384+0000 7f3101708640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30fc15eb60 0x7f30fc1f8050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:09.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.384+0000 7f3101708640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f30fc0d18d0 con 0x7f30fc15eb60 2024-05-27T12:33:09.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.384+0000 7f3101708640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f30fc06de70 con 0x7f30fc09b980 2024-05-27T12:33:09.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.384+0000 7f3101708640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f30fc0d1a50 con 0x7f30fc09aa30 2024-05-27T12:33:09.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.384+0000 7f30fb7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30fc15eb60 0x7f30fc1f8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:09.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.384+0000 7f30fb7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30fc15eb60 0x7f30fc1f8050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51710/0 (socket says 172.21.15.55:51710) 2024-05-27T12:33:09.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.384+0000 7f30fb7fe640 1 -- 172.21.15.55:0/2047659607 learned_addr learned my addr 172.21.15.55:0/2047659607 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:33:09.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.384+0000 7f30faffd640 1 --2- 172.21.15.55:0/2047659607 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f30fc09aa30 0x7f30fc155760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:09.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.384+0000 7f30fa7fc640 1 --2- 172.21.15.55:0/2047659607 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f30fc09b980 0x7f30fc156c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:09.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.384+0000 7f30fb7fe640 1 -- 172.21.15.55:0/2047659607 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f30fc09aa30 msgr2=0x7f30fc155760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:09.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.384+0000 7f30fb7fe640 1 --2- 172.21.15.55:0/2047659607 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f30fc09aa30 0x7f30fc155760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:09.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.384+0000 7f30fb7fe640 1 -- 172.21.15.55:0/2047659607 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f30fc09b980 msgr2=0x7f30fc156c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:09.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.384+0000 7f30fb7fe640 1 --2- 172.21.15.55:0/2047659607 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f30fc09b980 0x7f30fc156c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:09.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.384+0000 7f30fb7fe640 1 -- 172.21.15.55:0/2047659607 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30fc1f89c0 con 0x7f30fc15eb60 2024-05-27T12:33:09.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.384+0000 7f30fb7fe640 1 --2- 172.21.15.55:0/2047659607 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30fc15eb60 0x7f30fc1f8050 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f30f4007d50 tx=0x7f30f400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:09.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.385+0000 7f30e37fe640 1 -- 172.21.15.55:0/2047659607 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30f4014420 con 0x7f30fc15eb60 2024-05-27T12:33:09.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.385+0000 7f30e37fe640 1 -- 172.21.15.55:0/2047659607 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30f4019070 con 0x7f30fc15eb60 2024-05-27T12:33:09.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.385+0000 7f30e37fe640 1 -- 172.21.15.55:0/2047659607 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30f4014820 con 0x7f30fc15eb60 2024-05-27T12:33:09.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.385+0000 7f3101708640 1 -- 172.21.15.55:0/2047659607 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30fc1f8ca0 con 0x7f30fc15eb60 2024-05-27T12:33:09.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.385+0000 7f3101708640 1 -- 172.21.15.55:0/2047659607 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30fc151ae0 con 0x7f30fc15eb60 2024-05-27T12:33:09.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.386+0000 7f3101708640 1 -- 172.21.15.55:0/2047659607 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30fc151ce0 con 0x7f30fc15eb60 2024-05-27T12:33:09.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.386+0000 7f30e37fe640 1 -- 172.21.15.55:0/2047659607 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f30f40149c0 con 0x7f30fc15eb60 2024-05-27T12:33:09.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.387+0000 7f30e37fe640 1 --2- 172.21.15.55:0/2047659607 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f30e806c8f0 0x7f30e806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:09.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.387+0000 7f30e37fe640 1 -- 172.21.15.55:0/2047659607 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f30f408c0e0 con 0x7f30fc15eb60 2024-05-27T12:33:09.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.387+0000 7f30faffd640 1 --2- 172.21.15.55:0/2047659607 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f30e806c8f0 0x7f30e806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:09.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.387+0000 7f30faffd640 1 --2- 172.21.15.55:0/2047659607 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f30e806c8f0 0x7f30e806edb0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f30ec034000 tx=0x7f30ec02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:09.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.391+0000 7f30e37fe640 1 -- 172.21.15.55:0/2047659607 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f30fc151ce0 con 0x7f30fc15eb60 2024-05-27T12:33:09.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.577+0000 7f3101708640 1 -- 172.21.15.55:0/2047659607 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f30fc06e1a0 con 0x7f30fc15eb60 2024-05-27T12:33:09.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.577+0000 7f30e37fe640 1 -- 172.21.15.55:0/2047659607 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) ==== 93+0+10 (secure 0 0 0) 0x7f30f4059f50 con 0x7f30fc15eb60 2024-05-27T12:33:09.577 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-05-27T12:33:09.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.580+0000 7f3101708640 1 -- 172.21.15.55:0/2047659607 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f30e806c8f0 msgr2=0x7f30e806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:09.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.580+0000 7f3101708640 1 --2- 172.21.15.55:0/2047659607 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f30e806c8f0 0x7f30e806edb0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f30ec034000 tx=0x7f30ec02e000 comp rx=0 tx=0).stop 2024-05-27T12:33:09.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.580+0000 7f3101708640 1 -- 172.21.15.55:0/2047659607 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30fc15eb60 msgr2=0x7f30fc1f8050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:09.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.580+0000 7f3101708640 1 --2- 172.21.15.55:0/2047659607 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30fc15eb60 0x7f30fc1f8050 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f30f4007d50 tx=0x7f30f400e4b0 comp rx=0 tx=0).stop 2024-05-27T12:33:09.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.580+0000 7f3101708640 1 -- 172.21.15.55:0/2047659607 shutdown_connections 2024-05-27T12:33:09.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.580+0000 7f3101708640 1 --2- 172.21.15.55:0/2047659607 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30fc15eb60 0x7f30fc1f8050 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:09.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.580+0000 7f3101708640 1 --2- 172.21.15.55:0/2047659607 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f30e806c8f0 0x7f30e806edb0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:09.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.580+0000 7f3101708640 1 --2- 172.21.15.55:0/2047659607 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f30fc09b980 0x7f30fc156c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:09.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.580+0000 7f3101708640 1 --2- 172.21.15.55:0/2047659607 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f30fc09aa30 0x7f30fc155760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:09.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.580+0000 7f3101708640 1 -- 172.21.15.55:0/2047659607 >> 172.21.15.55:0/2047659607 conn(0x7f30fc0b4160 msgr2=0x7f30fc15dc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:09.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.580+0000 7f3101708640 1 -- 172.21.15.55:0/2047659607 shutdown_connections 2024-05-27T12:33:09.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.580+0000 7f3101708640 1 -- 172.21.15.55:0/2047659607 wait complete. 2024-05-27T12:33:09.590 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-27T12:33:09.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.698+0000 7f08b7bfe640 1 Processor -- start 2024-05-27T12:33:09.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.698+0000 7f08b7bfe640 1 -- start start 2024-05-27T12:33:09.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.699+0000 7f08b7bfe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f08b015eb00 0x7f08b00cfb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:09.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.699+0000 7f08b7bfe640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f08b00d3e50 0x7f08b00d1830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:09.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.699+0000 7f08b7bfe640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08b015eee0 con 0x7f08b00d1d70 2024-05-27T12:33:09.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.699+0000 7f08b7bfe640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f08b00d5700 con 0x7f08b015eb00 2024-05-27T12:33:09.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.699+0000 7f08b7bfe640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f08b00d21a0 con 0x7f08b00d3e50 2024-05-27T12:33:09.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.699+0000 7f08b599a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f08b015eb00 0x7f08b00cfb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:09.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.699+0000 7f08b619b640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f08b00d1d70 0x7f08b00d2910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:48686/0 (socket says 172.21.15.55:48686) 2024-05-27T12:33:09.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.699+0000 7f08b619b640 1 -- 172.21.15.55:0/1714634685 learned_addr learned my addr 172.21.15.55:0/1714634685 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-27T12:33:09.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.699+0000 7f08b599a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f08b015eb00 0x7f08b00cfb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51726/0 (socket says 172.21.15.55:51726) 2024-05-27T12:33:09.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.700+0000 7f08b5199640 1 --2- 172.21.15.55:0/1714634685 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f08b00d3e50 0x7f08b00d1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:09.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.700+0000 7f08b599a640 1 -- 172.21.15.55:0/1714634685 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f08b00d3e50 msgr2=0x7f08b00d1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:09.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.700+0000 7f08b599a640 1 --2- 172.21.15.55:0/1714634685 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f08b00d3e50 0x7f08b00d1830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:09.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.700+0000 7f08b599a640 1 -- 172.21.15.55:0/1714634685 >> v1:172.21.15.55:6789/0 conn(0x7f08b00d1d70 legacy=0x7f08b00d2910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:09.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.700+0000 7f08b599a640 1 -- 172.21.15.55:0/1714634685 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08b00d4660 con 0x7f08b015eb00 2024-05-27T12:33:09.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.700+0000 7f08b4998640 1 -- 172.21.15.55:0/1714634685 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2081569035 0 0) 0x7f08b015eee0 con 0x7f08b00d1d70 2024-05-27T12:33:09.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.700+0000 7f08b599a640 1 --2- 172.21.15.55:0/1714634685 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f08b015eb00 0x7f08b00cfb40 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f08a80097d0 tx=0x7f08a802a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df7527028ad74592 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:09.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.701+0000 7f08b4998640 1 -- 172.21.15.55:0/1714634685 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08a8037070 con 0x7f08b015eb00 2024-05-27T12:33:09.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.701+0000 7f08b4998640 1 -- 172.21.15.55:0/1714634685 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08a8032440 con 0x7f08b015eb00 2024-05-27T12:33:09.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.701+0000 7f08b4998640 1 -- 172.21.15.55:0/1714634685 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08a8032810 con 0x7f08b015eb00 2024-05-27T12:33:09.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.701+0000 7f08b7bfe640 1 -- 172.21.15.55:0/1714634685 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f08b015eb00 msgr2=0x7f08b00cfb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:09.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.701+0000 7f08b7bfe640 1 --2- 172.21.15.55:0/1714634685 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f08b015eb00 0x7f08b00cfb40 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f08a80097d0 tx=0x7f08a802a250 comp rx=0 tx=0).stop 2024-05-27T12:33:09.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.701+0000 7f08b7bfe640 1 -- 172.21.15.55:0/1714634685 shutdown_connections 2024-05-27T12:33:09.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.701+0000 7f08b7bfe640 1 --2- 172.21.15.55:0/1714634685 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f08b00d3e50 0x7f08b00d1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:09.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.701+0000 7f08b7bfe640 1 --2- 172.21.15.55:0/1714634685 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f08b015eb00 0x7f08b00cfb40 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:09.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.701+0000 7f08b7bfe640 1 -- 172.21.15.55:0/1714634685 >> 172.21.15.55:0/1714634685 conn(0x7f08b0067a50 msgr2=0x7f08b0067e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:09.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.701+0000 7f08b7bfe640 1 -- 172.21.15.55:0/1714634685 shutdown_connections 2024-05-27T12:33:09.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.701+0000 7f08b7bfe640 1 -- 172.21.15.55:0/1714634685 wait complete. 2024-05-27T12:33:09.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.702+0000 7f08b7bfe640 1 Processor -- start 2024-05-27T12:33:09.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.703+0000 7f08b7bfe640 1 -- start start 2024-05-27T12:33:09.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.703+0000 7f08b7bfe640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f08b00d1d70 0x7f08b01f7810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:09.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.703+0000 7f08b7bfe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f08b00d3e50 0x7f08b00ca580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:09.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.703+0000 7f08b7bfe640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f08b015eb00 0x7f08b00caac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:09.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.703+0000 7f08b7bfe640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f08b00d4f00 con 0x7f08b00d3e50 2024-05-27T12:33:09.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.703+0000 7f08b7bfe640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f08b00d4c20 con 0x7f08b00d1d70 2024-05-27T12:33:09.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.703+0000 7f08b7bfe640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f08b00d51e0 con 0x7f08b015eb00 2024-05-27T12:33:09.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.703+0000 7f08b5199640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f08b00d3e50 0x7f08b00ca580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:09.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.703+0000 7f08b5199640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f08b00d3e50 0x7f08b00ca580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51736/0 (socket says 172.21.15.55:51736) 2024-05-27T12:33:09.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.703+0000 7f08b5199640 1 -- 172.21.15.55:0/203997337 learned_addr learned my addr 172.21.15.55:0/203997337 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:33:09.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.704+0000 7f08b599a640 1 --2- 172.21.15.55:0/203997337 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f08b00d1d70 0x7f08b01f7810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:09.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.704+0000 7f08b619b640 1 --2- 172.21.15.55:0/203997337 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f08b015eb00 0x7f08b00caac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:09.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.704+0000 7f08b5199640 1 -- 172.21.15.55:0/203997337 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f08b015eb00 msgr2=0x7f08b00caac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:09.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.704+0000 7f08b5199640 1 --2- 172.21.15.55:0/203997337 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f08b015eb00 0x7f08b00caac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:09.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.704+0000 7f08b5199640 1 -- 172.21.15.55:0/203997337 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f08b00d1d70 msgr2=0x7f08b01f7810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:09.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.704+0000 7f08b5199640 1 --2- 172.21.15.55:0/203997337 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f08b00d1d70 0x7f08b01f7810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:09.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.704+0000 7f08b5199640 1 -- 172.21.15.55:0/203997337 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08b00cb0d0 con 0x7f08b00d3e50 2024-05-27T12:33:09.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.704+0000 7f08b599a640 1 --2- 172.21.15.55:0/203997337 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f08b00d1d70 0x7f08b01f7810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T12:33:09.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.704+0000 7f08b5199640 1 --2- 172.21.15.55:0/203997337 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f08b00d3e50 0x7f08b00ca580 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f08a400d800 tx=0x7f08a400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:09.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.704+0000 7f08ae7fc640 1 -- 172.21.15.55:0/203997337 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08a400b6c0 con 0x7f08b00d3e50 2024-05-27T12:33:09.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.704+0000 7f08ae7fc640 1 -- 172.21.15.55:0/203997337 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08a4019070 con 0x7f08b00d3e50 2024-05-27T12:33:09.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.704+0000 7f08b7bfe640 1 -- 172.21.15.55:0/203997337 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08b015f8f0 con 0x7f08b00d3e50 2024-05-27T12:33:09.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.704+0000 7f08ae7fc640 1 -- 172.21.15.55:0/203997337 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08a400ba80 con 0x7f08b00d3e50 2024-05-27T12:33:09.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.704+0000 7f08b7bfe640 1 -- 172.21.15.55:0/203997337 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08b015feb0 con 0x7f08b00d3e50 2024-05-27T12:33:09.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.705+0000 7f08b7bfe640 1 -- 172.21.15.55:0/203997337 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08b0068a70 con 0x7f08b00d3e50 2024-05-27T12:33:09.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.705+0000 7f08ae7fc640 1 -- 172.21.15.55:0/203997337 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f08a400bc20 con 0x7f08b00d3e50 2024-05-27T12:33:09.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.706+0000 7f08ae7fc640 1 --2- 172.21.15.55:0/203997337 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f089c06c8f0 0x7f089c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:09.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.706+0000 7f08ae7fc640 1 -- 172.21.15.55:0/203997337 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f08a408c120 con 0x7f08b00d3e50 2024-05-27T12:33:09.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.706+0000 7f08b599a640 1 --2- 172.21.15.55:0/203997337 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f089c06c8f0 0x7f089c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:09.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.707+0000 7f08b599a640 1 --2- 172.21.15.55:0/203997337 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f089c06c8f0 0x7f089c06edb0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f08a8034000 tx=0x7f08a802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:09.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.710+0000 7f08ae7fc640 1 -- 172.21.15.55:0/203997337 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f08a405a460 con 0x7f08b00d3e50 2024-05-27T12:33:09.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.894+0000 7f08b7bfe640 1 -- 172.21.15.55:0/203997337 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f08b00ba1b0 con 0x7f08b00d3e50 2024-05-27T12:33:09.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.895+0000 7f08ae7fc640 1 -- 172.21.15.55:0/203997337 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) ==== 104+0+11 (secure 0 0 0) 0x7f08a4059d60 con 0x7f08b00d3e50 2024-05-27T12:33:09.894 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2024-05-27T12:33:09.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.896+0000 7f08b7bfe640 1 -- 172.21.15.55:0/203997337 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f089c06c8f0 msgr2=0x7f089c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:09.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.896+0000 7f08b7bfe640 1 --2- 172.21.15.55:0/203997337 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f089c06c8f0 0x7f089c06edb0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f08a8034000 tx=0x7f08a802e000 comp rx=0 tx=0).stop 2024-05-27T12:33:09.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.896+0000 7f08b7bfe640 1 -- 172.21.15.55:0/203997337 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f08b00d3e50 msgr2=0x7f08b00ca580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:09.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.896+0000 7f08b7bfe640 1 --2- 172.21.15.55:0/203997337 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f08b00d3e50 0x7f08b00ca580 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f08a400d800 tx=0x7f08a400dcc0 comp rx=0 tx=0).stop 2024-05-27T12:33:09.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.897+0000 7f08b7bfe640 1 -- 172.21.15.55:0/203997337 shutdown_connections 2024-05-27T12:33:09.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.897+0000 7f08b7bfe640 1 --2- 172.21.15.55:0/203997337 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f08b015eb00 0x7f08b00caac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:09.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.897+0000 7f08b7bfe640 1 --2- 172.21.15.55:0/203997337 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f08b00d3e50 0x7f08b00ca580 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:09.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.897+0000 7f08b7bfe640 1 --2- 172.21.15.55:0/203997337 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f089c06c8f0 0x7f089c06edb0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:09.899 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.897+0000 7f08b7bfe640 1 --2- 172.21.15.55:0/203997337 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f08b00d1d70 0x7f08b01f7810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:09.899 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.897+0000 7f08b7bfe640 1 -- 172.21.15.55:0/203997337 >> 172.21.15.55:0/203997337 conn(0x7f08b0067a50 msgr2=0x7f08b00d2910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:09.899 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.897+0000 7f08b7bfe640 1 -- 172.21.15.55:0/203997337 shutdown_connections 2024-05-27T12:33:09.899 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:09.897+0000 7f08b7bfe640 1 -- 172.21.15.55:0/203997337 wait complete. 2024-05-27T12:33:09.906 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-27T12:33:10.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.014+0000 7f2f85915640 1 Processor -- start 2024-05-27T12:33:10.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.014+0000 7f2f85915640 1 -- start start 2024-05-27T12:33:10.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.015+0000 7f2f85915640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2f80153aa0 0x7f2f800b29c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:10.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.015+0000 7f2f85915640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f8015d040 con 0x7f2f8006c040 2024-05-27T12:33:10.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.015+0000 7f2f85915640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f8015d320 con 0x7f2f800b2390 2024-05-27T12:33:10.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.015+0000 7f2f85915640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f2f800b2f00 con 0x7f2f80153aa0 2024-05-27T12:33:10.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.015+0000 7f2f7f7fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f2f8006c040 0x7f2f800cd2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:48698/0 (socket says 172.21.15.55:48698) 2024-05-27T12:33:10.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.015+0000 7f2f7f7fe640 1 -- 172.21.15.55:0/3462481602 learned_addr learned my addr 172.21.15.55:0/3462481602 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-27T12:33:10.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.016+0000 7f2f7effd640 1 --2- 172.21.15.55:0/3462481602 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2f80153aa0 0x7f2f800b29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:10.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.016+0000 7f2f7dffb640 1 -- 172.21.15.55:0/3462481602 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2097510436 0 0) 0x7f2f8015d040 con 0x7f2f8006c040 2024-05-27T12:33:10.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.016+0000 7f2f7dffb640 1 -- 172.21.15.55:0/3462481602 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2f68003520 con 0x7f2f8006c040 2024-05-27T12:33:10.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.016+0000 7f2f7dffb640 1 -- 172.21.15.55:0/3462481602 <== mon.1 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1170739411 0 0) 0x7f2f8015d320 con 0x7f2f800b2390 2024-05-27T12:33:10.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.016+0000 7f2f7dffb640 1 -- 172.21.15.55:0/3462481602 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2f8015d040 con 0x7f2f800b2390 2024-05-27T12:33:10.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.016+0000 7f2f7dffb640 1 -- 172.21.15.55:0/3462481602 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 577623834 0 0) 0x7f2f68003520 con 0x7f2f8006c040 2024-05-27T12:33:10.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.016+0000 7f2f7dffb640 1 -- 172.21.15.55:0/3462481602 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2f80153aa0 msgr2=0x7f2f800b29c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:10.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.016+0000 7f2f7dffb640 1 --2- 172.21.15.55:0/3462481602 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2f80153aa0 0x7f2f800b29c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:10.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.016+0000 7f2f7dffb640 1 -- 172.21.15.55:0/3462481602 >> v1:172.21.15.72:6789/0 conn(0x7f2f800b2390 legacy=0x7f2f8006b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:10.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.016+0000 7f2f7dffb640 1 -- 172.21.15.55:0/3462481602 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f8015d600 con 0x7f2f8006c040 2024-05-27T12:33:10.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.016+0000 7f2f7dffb640 1 -- 172.21.15.55:0/3462481602 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 793017739 0 0) 0x7f2f70001670 con 0x7f2f8006c040 2024-05-27T12:33:10.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.016+0000 7f2f7dffb640 1 -- 172.21.15.55:0/3462481602 >> v1:172.21.15.55:6789/0 conn(0x7f2f8006c040 legacy=0x7f2f800cd2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:10.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.016+0000 7f2f7dffb640 1 --2- 172.21.15.55:0/3462481602 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2f80153aa0 0x7f2f68003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:10.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.016+0000 7f2f7dffb640 1 --2- 172.21.15.55:0/3462481602 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f680040d0 0x7f2f68004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:10.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.016+0000 7f2f7dffb640 1 --2- 172.21.15.55:0/3462481602 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f68004d40 0x7f2f680051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:10.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.016+0000 7f2f7dffb640 1 -- 172.21.15.55:0/3462481602 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f2f800b2f00 con 0x7f2f68004d40 2024-05-27T12:33:10.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.016+0000 7f2f7dffb640 1 -- 172.21.15.55:0/3462481602 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f2f6800baa0 con 0x7f2f680040d0 2024-05-27T12:33:10.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.016+0000 7f2f7dffb640 1 -- 172.21.15.55:0/3462481602 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f2f6800bca0 con 0x7f2f80153aa0 2024-05-27T12:33:10.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.016+0000 7f2f7f7fe640 1 --2- 172.21.15.55:0/3462481602 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f68004d40 0x7f2f680051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:10.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.016+0000 7f2f7effd640 1 --2- 172.21.15.55:0/3462481602 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2f80153aa0 0x7f2f68003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:10.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.016+0000 7f2f7e7fc640 1 --2- 172.21.15.55:0/3462481602 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f680040d0 0x7f2f68004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:10.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.017+0000 7f2f7effd640 1 -- 172.21.15.55:0/3462481602 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f680040d0 msgr2=0x7f2f68004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:10.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.017+0000 7f2f7effd640 1 --2- 172.21.15.55:0/3462481602 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f680040d0 0x7f2f68004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:10.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.017+0000 7f2f7effd640 1 -- 172.21.15.55:0/3462481602 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f68004d40 msgr2=0x7f2f680051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:10.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.017+0000 7f2f7effd640 1 --2- 172.21.15.55:0/3462481602 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f68004d40 0x7f2f680051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:10.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.017+0000 7f2f7effd640 1 -- 172.21.15.55:0/3462481602 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f68003520 con 0x7f2f80153aa0 2024-05-27T12:33:10.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.017+0000 7f2f7f7fe640 1 --2- 172.21.15.55:0/3462481602 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f68004d40 0x7f2f680051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T12:33:10.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.017+0000 7f2f7effd640 1 --2- 172.21.15.55:0/3462481602 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2f80153aa0 0x7f2f68003b70 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f2f78009ac0 tx=0x7f2f68005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=920360fb6f9d1c84 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:10.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.018+0000 7f2f7dffb640 1 -- 172.21.15.55:0/3462481602 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f78036070 con 0x7f2f80153aa0 2024-05-27T12:33:10.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.018+0000 7f2f7dffb640 1 -- 172.21.15.55:0/3462481602 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f78031400 con 0x7f2f80153aa0 2024-05-27T12:33:10.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.018+0000 7f2f7dffb640 1 -- 172.21.15.55:0/3462481602 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f78009690 con 0x7f2f80153aa0 2024-05-27T12:33:10.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.018+0000 7f2f85915640 1 -- 172.21.15.55:0/3462481602 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2f80153aa0 msgr2=0x7f2f68003b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:10.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.018+0000 7f2f85915640 1 --2- 172.21.15.55:0/3462481602 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2f80153aa0 0x7f2f68003b70 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f2f78009ac0 tx=0x7f2f68005830 comp rx=0 tx=0).stop 2024-05-27T12:33:10.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.018+0000 7f2f7f7fe640 1 -- 172.21.15.55:0/3462481602 reap_dead start 2024-05-27T12:33:10.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.018+0000 7f2f85915640 1 -- 172.21.15.55:0/3462481602 shutdown_connections 2024-05-27T12:33:10.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.018+0000 7f2f85915640 1 -- 172.21.15.55:0/3462481602 >> 172.21.15.55:0/3462481602 conn(0x7f2f800733d0 msgr2=0x7f2f8009aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:10.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.018+0000 7f2f85915640 1 -- 172.21.15.55:0/3462481602 shutdown_connections 2024-05-27T12:33:10.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.018+0000 7f2f85915640 1 -- 172.21.15.55:0/3462481602 wait complete. 2024-05-27T12:33:10.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.019+0000 7f2f85915640 1 Processor -- start 2024-05-27T12:33:10.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.020+0000 7f2f85915640 1 -- start start 2024-05-27T12:33:10.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.020+0000 7f2f85915640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f80153aa0 0x7f2f800cfb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:10.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.020+0000 7f2f85915640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2f800d00a0 0x7f2f800c55f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:10.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.020+0000 7f2f85915640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f80152cc0 0x7f2f800c5b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:10.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.020+0000 7f2f85915640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f2f800b29c0 con 0x7f2f80153aa0 2024-05-27T12:33:10.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.020+0000 7f2f85915640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f2f8015cd30 con 0x7f2f80152cc0 2024-05-27T12:33:10.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.020+0000 7f2f85915640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f2f800b2b40 con 0x7f2f800d00a0 2024-05-27T12:33:10.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.020+0000 7f2f7effd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f80153aa0 0x7f2f800cfb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:10.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.020+0000 7f2f7effd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f80153aa0 0x7f2f800cfb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51754/0 (socket says 172.21.15.55:51754) 2024-05-27T12:33:10.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.020+0000 7f2f7effd640 1 -- 172.21.15.55:0/395883355 learned_addr learned my addr 172.21.15.55:0/395883355 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:33:10.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.021+0000 7f2f7e7fc640 1 --2- 172.21.15.55:0/395883355 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2f800d00a0 0x7f2f800c55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:10.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.021+0000 7f2f7f7fe640 1 --2- 172.21.15.55:0/395883355 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f80152cc0 0x7f2f800c5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:10.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.021+0000 7f2f7effd640 1 -- 172.21.15.55:0/395883355 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2f800d00a0 msgr2=0x7f2f800c55f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:10.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.021+0000 7f2f7effd640 1 --2- 172.21.15.55:0/395883355 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2f800d00a0 0x7f2f800c55f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:10.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.021+0000 7f2f7effd640 1 -- 172.21.15.55:0/395883355 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f80152cc0 msgr2=0x7f2f800c5b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:10.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.021+0000 7f2f7effd640 1 --2- 172.21.15.55:0/395883355 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f80152cc0 0x7f2f800c5b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:10.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.021+0000 7f2f7effd640 1 -- 172.21.15.55:0/395883355 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f800d11c0 con 0x7f2f80153aa0 2024-05-27T12:33:10.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.021+0000 7f2f7effd640 1 --2- 172.21.15.55:0/395883355 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f80153aa0 0x7f2f800cfb60 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f2f78034040 tx=0x7f2f78004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:10.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.021+0000 7f2f67fff640 1 -- 172.21.15.55:0/395883355 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f78040020 con 0x7f2f80153aa0 2024-05-27T12:33:10.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.021+0000 7f2f67fff640 1 -- 172.21.15.55:0/395883355 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f78003a40 con 0x7f2f80153aa0 2024-05-27T12:33:10.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.021+0000 7f2f85915640 1 -- 172.21.15.55:0/395883355 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f800c6140 con 0x7f2f80153aa0 2024-05-27T12:33:10.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.021+0000 7f2f67fff640 1 -- 172.21.15.55:0/395883355 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f78036040 con 0x7f2f80153aa0 2024-05-27T12:33:10.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.021+0000 7f2f85915640 1 -- 172.21.15.55:0/395883355 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f800cf360 con 0x7f2f80153aa0 2024-05-27T12:33:10.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.022+0000 7f2f85915640 1 -- 172.21.15.55:0/395883355 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f800c6660 con 0x7f2f80153aa0 2024-05-27T12:33:10.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.022+0000 7f2f67fff640 1 -- 172.21.15.55:0/395883355 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2f78043020 con 0x7f2f80153aa0 2024-05-27T12:33:10.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.023+0000 7f2f67fff640 1 --2- 172.21.15.55:0/395883355 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f2f6c06c920 0x7f2f6c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:10.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.023+0000 7f2f67fff640 1 -- 172.21.15.55:0/395883355 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f2f780abfb0 con 0x7f2f80153aa0 2024-05-27T12:33:10.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.023+0000 7f2f7e7fc640 1 --2- 172.21.15.55:0/395883355 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f2f6c06c920 0x7f2f6c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:10.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.024+0000 7f2f7e7fc640 1 --2- 172.21.15.55:0/395883355 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f2f6c06c920 0x7f2f6c06ede0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2f801613f0 tx=0x7f2f74009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:10.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.027+0000 7f2f67fff640 1 -- 172.21.15.55:0/395883355 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2f800c6660 con 0x7f2f80153aa0 2024-05-27T12:33:10.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.210+0000 7f2f85915640 1 -- 172.21.15.55:0/395883355 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f2f80075460 con 0x7f2f80153aa0 2024-05-27T12:33:10.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.211+0000 7f2f67fff640 1 -- 172.21.15.55:0/395883355 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) ==== 100+0+11 (secure 0 0 0) 0x7f2f7804a030 con 0x7f2f80153aa0 2024-05-27T12:33:10.210 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2024-05-27T12:33:10.212 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.212+0000 7f2f85915640 1 -- 172.21.15.55:0/395883355 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f2f6c06c920 msgr2=0x7f2f6c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:10.212 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.212+0000 7f2f85915640 1 --2- 172.21.15.55:0/395883355 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f2f6c06c920 0x7f2f6c06ede0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2f801613f0 tx=0x7f2f74009040 comp rx=0 tx=0).stop 2024-05-27T12:33:10.212 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.212+0000 7f2f85915640 1 -- 172.21.15.55:0/395883355 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f80153aa0 msgr2=0x7f2f800cfb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:10.212 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.212+0000 7f2f85915640 1 --2- 172.21.15.55:0/395883355 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f80153aa0 0x7f2f800cfb60 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f2f78034040 tx=0x7f2f78004730 comp rx=0 tx=0).stop 2024-05-27T12:33:10.212 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.212+0000 7f2f85915640 1 -- 172.21.15.55:0/395883355 shutdown_connections 2024-05-27T12:33:10.212 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.212+0000 7f2f85915640 1 --2- 172.21.15.55:0/395883355 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f2f6c06c920 0x7f2f6c06ede0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:10.212 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.212+0000 7f2f85915640 1 --2- 172.21.15.55:0/395883355 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f80152cc0 0x7f2f800c5b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:10.212 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.212+0000 7f2f85915640 1 --2- 172.21.15.55:0/395883355 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2f800d00a0 0x7f2f800c55f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:10.212 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.212+0000 7f2f85915640 1 --2- 172.21.15.55:0/395883355 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f80153aa0 0x7f2f800cfb60 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:10.212 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.212+0000 7f2f85915640 1 -- 172.21.15.55:0/395883355 >> 172.21.15.55:0/395883355 conn(0x7f2f800733d0 msgr2=0x7f2f800b44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:10.212 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.212+0000 7f2f85915640 1 -- 172.21.15.55:0/395883355 shutdown_connections 2024-05-27T12:33:10.213 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.212+0000 7f2f85915640 1 -- 172.21.15.55:0/395883355 wait complete. 2024-05-27T12:33:10.222 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-27T12:33:10.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.327+0000 7f5fb4722640 1 Processor -- start 2024-05-27T12:33:10.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.327+0000 7f5fb4722640 1 -- start start 2024-05-27T12:33:10.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.328+0000 7f5fb4722640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5fac15eaf0 0x7f5fac0d2910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:10.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.328+0000 7f5fb4722640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5fac0ba5e0 0x7f5fac0d1280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:10.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.328+0000 7f5fb4722640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5fac0d4320 0x7f5fac0d17c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:10.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.328+0000 7f5fb4722640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f5fac0d3e90 con 0x7f5fac0d4320 2024-05-27T12:33:10.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.328+0000 7f5fb4722640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f5fac0d3280 con 0x7f5fac15eaf0 2024-05-27T12:33:10.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.328+0000 7f5fb4722640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f5fac0d3560 con 0x7f5fac0ba5e0 2024-05-27T12:33:10.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.328+0000 7f5fb2cbf640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5fac0d4320 0x7f5fac0d17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:10.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.328+0000 7f5fb2cbf640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5fac0d4320 0x7f5fac0d17c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51760/0 (socket says 172.21.15.55:51760) 2024-05-27T12:33:10.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.328+0000 7f5fb2cbf640 1 -- 172.21.15.55:0/4055180910 learned_addr learned my addr 172.21.15.55:0/4055180910 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:33:10.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.328+0000 7f5fb24be640 1 --2- 172.21.15.55:0/4055180910 >> v2:172.21.15.72:3300/0 conn(0x7f5fac15eaf0 0x7f5fac0d2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:10.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.328+0000 7f5fb2cbf640 1 -- 172.21.15.55:0/4055180910 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5fac0ba5e0 msgr2=0x7f5fac0d1280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:10.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.328+0000 7f5fb1cbd640 1 --2- 172.21.15.55:0/4055180910 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5fac0ba5e0 0x7f5fac0d1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:10.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.328+0000 7f5fb2cbf640 1 --2- 172.21.15.55:0/4055180910 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5fac0ba5e0 0x7f5fac0d1280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:10.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.328+0000 7f5fb2cbf640 1 -- 172.21.15.55:0/4055180910 >> v2:172.21.15.72:3300/0 conn(0x7f5fac15eaf0 msgr2=0x7f5fac0d2910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:10.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.328+0000 7f5fb2cbf640 1 --2- 172.21.15.55:0/4055180910 >> v2:172.21.15.72:3300/0 conn(0x7f5fac15eaf0 0x7f5fac0d2910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:10.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.328+0000 7f5fb2cbf640 1 -- 172.21.15.55:0/4055180910 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fac0d3840 con 0x7f5fac0d4320 2024-05-27T12:33:10.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.328+0000 7f5fb24be640 1 --2- 172.21.15.55:0/4055180910 >> v2:172.21.15.72:3300/0 conn(0x7f5fac15eaf0 0x7f5fac0d2910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T12:33:10.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.328+0000 7f5fb1cbd640 1 --2- 172.21.15.55:0/4055180910 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5fac0ba5e0 0x7f5fac0d1280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T12:33:10.330 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.329+0000 7f5fb2cbf640 1 --2- 172.21.15.55:0/4055180910 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5fac0d4320 0x7f5fac0d17c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f5fac0b7480 tx=0x7f5fa402a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a03c7d8b45d9521 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:10.330 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.329+0000 7f5fb14bc640 1 -- 172.21.15.55:0/4055180910 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fa4036070 con 0x7f5fac0d4320 2024-05-27T12:33:10.330 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.329+0000 7f5fb14bc640 1 -- 172.21.15.55:0/4055180910 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fa4031600 con 0x7f5fac0d4320 2024-05-27T12:33:10.330 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.329+0000 7f5fb14bc640 1 -- 172.21.15.55:0/4055180910 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fa40319d0 con 0x7f5fac0d4320 2024-05-27T12:33:10.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.330+0000 7f5fb4722640 1 -- 172.21.15.55:0/4055180910 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5fac0d4320 msgr2=0x7f5fac0d17c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:10.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.330+0000 7f5fb4722640 1 --2- 172.21.15.55:0/4055180910 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5fac0d4320 0x7f5fac0d17c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f5fac0b7480 tx=0x7f5fa402a730 comp rx=0 tx=0).stop 2024-05-27T12:33:10.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.330+0000 7f5fb4722640 1 -- 172.21.15.55:0/4055180910 shutdown_connections 2024-05-27T12:33:10.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.330+0000 7f5fb4722640 1 --2- 172.21.15.55:0/4055180910 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5fac0d4320 0x7f5fac0d17c0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:10.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.330+0000 7f5fb4722640 1 --2- 172.21.15.55:0/4055180910 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5fac0ba5e0 0x7f5fac0d1280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:10.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.330+0000 7f5fb4722640 1 --2- 172.21.15.55:0/4055180910 >> v2:172.21.15.72:3300/0 conn(0x7f5fac15eaf0 0x7f5fac0d2910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:10.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.330+0000 7f5fb4722640 1 -- 172.21.15.55:0/4055180910 >> 172.21.15.55:0/4055180910 conn(0x7f5fac06cdb0 msgr2=0x7f5fac06d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:10.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.330+0000 7f5fb4722640 1 -- 172.21.15.55:0/4055180910 shutdown_connections 2024-05-27T12:33:10.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.330+0000 7f5fb4722640 1 -- 172.21.15.55:0/4055180910 wait complete. 2024-05-27T12:33:10.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.331+0000 7f5fb4722640 1 Processor -- start 2024-05-27T12:33:10.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.331+0000 7f5fb4722640 1 -- start start 2024-05-27T12:33:10.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.332+0000 7f5fb4722640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5fac0ba5e0 0x7f5fac14bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:10.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.332+0000 7f5fb4722640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5fac0d4320 0x7f5fac0cb960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:10.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.332+0000 7f5fb4722640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5fac15eaf0 0x7f5fac0cdd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:10.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.332+0000 7f5fb4722640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f5fac15f050 con 0x7f5fac0ba5e0 2024-05-27T12:33:10.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.332+0000 7f5fb4722640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f5fac15eed0 con 0x7f5fac15eaf0 2024-05-27T12:33:10.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.332+0000 7f5fb4722640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f5fac0d2e50 con 0x7f5fac0d4320 2024-05-27T12:33:10.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.332+0000 7f5fb24be640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5fac0ba5e0 0x7f5fac14bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:10.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.332+0000 7f5fb24be640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5fac0ba5e0 0x7f5fac14bd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51776/0 (socket says 172.21.15.55:51776) 2024-05-27T12:33:10.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.332+0000 7f5fb24be640 1 -- 172.21.15.55:0/1702701288 learned_addr learned my addr 172.21.15.55:0/1702701288 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:33:10.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.332+0000 7f5fb1cbd640 1 --2- 172.21.15.55:0/1702701288 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5fac0d4320 0x7f5fac0cb960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:10.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.332+0000 7f5fb2cbf640 1 --2- 172.21.15.55:0/1702701288 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5fac15eaf0 0x7f5fac0cdd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:10.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.332+0000 7f5fb24be640 1 -- 172.21.15.55:0/1702701288 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5fac0d4320 msgr2=0x7f5fac0cb960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:10.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.332+0000 7f5fb24be640 1 --2- 172.21.15.55:0/1702701288 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5fac0d4320 0x7f5fac0cb960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:10.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.332+0000 7f5fb24be640 1 -- 172.21.15.55:0/1702701288 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5fac15eaf0 msgr2=0x7f5fac0cdd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:10.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.332+0000 7f5fb24be640 1 --2- 172.21.15.55:0/1702701288 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5fac15eaf0 0x7f5fac0cdd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:10.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.332+0000 7f5fb24be640 1 -- 172.21.15.55:0/1702701288 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fac0cbea0 con 0x7f5fac0ba5e0 2024-05-27T12:33:10.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.332+0000 7f5fb24be640 1 --2- 172.21.15.55:0/1702701288 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5fac0ba5e0 0x7f5fac14bd10 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f5fa800c7f0 tx=0x7f5fa800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:10.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.333+0000 7f5fa2ffd640 1 -- 172.21.15.55:0/1702701288 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fa8015070 con 0x7f5fac0ba5e0 2024-05-27T12:33:10.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.333+0000 7f5fa2ffd640 1 -- 172.21.15.55:0/1702701288 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fa8007820 con 0x7f5fac0ba5e0 2024-05-27T12:33:10.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.333+0000 7f5fb4722640 1 -- 172.21.15.55:0/1702701288 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fac0cc140 con 0x7f5fac0ba5e0 2024-05-27T12:33:10.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.333+0000 7f5fa2ffd640 1 -- 172.21.15.55:0/1702701288 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fa8007bd0 con 0x7f5fac0ba5e0 2024-05-27T12:33:10.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.333+0000 7f5fb4722640 1 -- 172.21.15.55:0/1702701288 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fac0cc700 con 0x7f5fac0ba5e0 2024-05-27T12:33:10.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.334+0000 7f5fb4722640 1 -- 172.21.15.55:0/1702701288 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5fac075460 con 0x7f5fac0ba5e0 2024-05-27T12:33:10.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.334+0000 7f5fa2ffd640 1 -- 172.21.15.55:0/1702701288 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5fa8018070 con 0x7f5fac0ba5e0 2024-05-27T12:33:10.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.335+0000 7f5fa2ffd640 1 --2- 172.21.15.55:0/1702701288 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f5f9006c8f0 0x7f5f9006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:10.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.335+0000 7f5fa2ffd640 1 -- 172.21.15.55:0/1702701288 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f5fa808bb80 con 0x7f5fac0ba5e0 2024-05-27T12:33:10.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.335+0000 7f5fb1cbd640 1 --2- 172.21.15.55:0/1702701288 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f5f9006c8f0 0x7f5f9006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:10.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.335+0000 7f5fb1cbd640 1 --2- 172.21.15.55:0/1702701288 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f5f9006c8f0 0x7f5f9006edb0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f5fac161c80 tx=0x7f5f9c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:10.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.339+0000 7f5fa2ffd640 1 -- 172.21.15.55:0/1702701288 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5fa80599f0 con 0x7f5fac0ba5e0 2024-05-27T12:33:10.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.525+0000 7f5fb4722640 1 -- 172.21.15.55:0/1702701288 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5fac06d3a0 con 0x7f5fac0ba5e0 2024-05-27T12:33:10.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.526+0000 7f5fa2ffd640 1 -- 172.21.15.55:0/1702701288 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16557 (secure 0 0 0) 0x7f5fa805dcf0 con 0x7f5fac0ba5e0 2024-05-27T12:33:10.526 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-27T12:33:10.526 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":23,"fsid":"c3ff4e3b-8dae-4856-9593-e5cc66c59982","created":"2024-05-27T12:32:17.019097+0000","modified":"2024-05-27T12:32:43.361598+0000","last_up_change":"2024-05-27T12:32:28.109744+0000","last_in_change":"2024-05-27T12:32:19.309872+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-27T12:32:29.277895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-27T12:32:39.442745+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-27T12:32:40.672118+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e607b598-061b-4b6f-92ff-95c20b330599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":807572567},{"type":"v1","addr":"172.21.15.55:6801","nonce":807572567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":807572567},{"type":"v1","addr":"172.21.15.55:6803","nonce":807572567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":807572567},{"type":"v1","addr":"172.21.15.55:6807","nonce":807572567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":807572567},{"type":"v1","addr":"172.21.15.55:6805","nonce":807572567}]},"public_addr":"172.21.15.55:6801/807572567","cluster_addr":"172.21.15.55:6803/807572567","heartbeat_back_addr":"172.21.15.55:6807/807572567","heartbeat_front_addr":"172.21.15.55:6805/807572567","state":["exists","up"]},{"osd":1,"uuid":"ba2b5b1d-71a9-4ecc-9a48-55aa7fe54261","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":3426897300},{"type":"v1","addr":"172.21.15.55:6825","nonce":3426897300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":3426897300},{"type":"v1","addr":"172.21.15.55:6827","nonce":3426897300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":3426897300},{"type":"v1","addr":"172.21.15.55:6831","nonce":3426897300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":3426897300},{"type":"v1","addr":"172.21.15.55:6829","nonce":3426897300}]},"public_addr":"172.21.15.55:6825/3426897300","cluster_addr":"172.21.15.55:6827/3426897300","heartbeat_back_addr":"172.21.15.55:6831/3426897300","heartbeat_front_addr":"172.21.15.55:6829/3426897300","state":["exists","up"]},{"osd":2,"uuid":"e6b81cc6-4ff1-45d0-87eb-9f04ccf986a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3510271725},{"type":"v1","addr":"172.21.15.55:6809","nonce":3510271725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3510271725},{"type":"v1","addr":"172.21.15.55:6811","nonce":3510271725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3510271725},{"type":"v1","addr":"172.21.15.55:6815","nonce":3510271725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3510271725},{"type":"v1","addr":"172.21.15.55:6813","nonce":3510271725}]},"public_addr":"172.21.15.55:6809/3510271725","cluster_addr":"172.21.15.55:6811/3510271725","heartbeat_back_addr":"172.21.15.55:6815/3510271725","heartbeat_front_addr":"172.21.15.55:6813/3510271725","state":["exists","up"]},{"osd":3,"uuid":"b6a34b75-807d-4693-b1c3-903cb4c618d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":1066693520},{"type":"v1","addr":"172.21.15.55:6817","nonce":1066693520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":1066693520},{"type":"v1","addr":"172.21.15.55:6819","nonce":1066693520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":1066693520},{"type":"v1","addr":"172.21.15.55:6823","nonce":1066693520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":1066693520},{"type":"v1","addr":"172.21.15.55:6821","nonce":1066693520}]},"public_addr":"172.21.15.55:6817/1066693520","cluster_addr":"172.21.15.55:6819/1066693520","heartbeat_back_addr":"172.21.15.55:6823/1066693520","heartbeat_front_addr":"172.21.15.55:6821/1066693520","state":["exists","up"]},{"osd":4,"uuid":"272ec937-56b4-4f0a-b2e1-b0bc189c9d79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":4190771237},{"type":"v1","addr":"172.21.15.72:6820","nonce":4190771237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":4190771237},{"type":"v1","addr":"172.21.15.72:6824","nonce":4190771237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":4190771237},{"type":"v1","addr":"172.21.15.72:6831","nonce":4190771237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":4190771237},{"type":"v1","addr":"172.21.15.72:6828","nonce":4190771237}]},"public_addr":"172.21.15.72:6820/4190771237","cluster_addr":"172.21.15.72:6824/4190771237","heartbeat_back_addr":"172.21.15.72:6831/4190771237","heartbeat_front_addr":"172.21.15.72:6828/4190771237","state":["exists","up"]},{"osd":5,"uuid":"56439854-72a0-4ef4-81ff-184a3d924a5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":2421889184},{"type":"v1","addr":"172.21.15.72:6801","nonce":2421889184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6803","nonce":2421889184},{"type":"v1","addr":"172.21.15.72:6805","nonce":2421889184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":2421889184},{"type":"v1","addr":"172.21.15.72:6813","nonce":2421889184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6807","nonce":2421889184},{"type":"v1","addr":"172.21.15.72:6809","nonce":2421889184}]},"public_addr":"172.21.15.72:6801/2421889184","cluster_addr":"172.21.15.72:6805/2421889184","heartbeat_back_addr":"172.21.15.72:6813/2421889184","heartbeat_front_addr":"172.21.15.72:6809/2421889184","state":["exists","up"]},{"osd":6,"uuid":"e248e2be-3b6e-49cf-8c8a-1a4152827582","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3796994599},{"type":"v1","addr":"172.21.15.72:6804","nonce":3796994599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":3796994599},{"type":"v1","addr":"172.21.15.72:6808","nonce":3796994599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":3796994599},{"type":"v1","addr":"172.21.15.72:6815","nonce":3796994599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":3796994599},{"type":"v1","addr":"172.21.15.72:6812","nonce":3796994599}]},"public_addr":"172.21.15.72:6804/3796994599","cluster_addr":"172.21.15.72:6808/3796994599","heartbeat_back_addr":"172.21.15.72:6815/3796994599","heartbeat_front_addr":"172.21.15.72:6812/3796994599","state":["exists","up"]},{"osd":7,"uuid":"505a62d3-322b-4629-b4fd-187a55563709","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":3024877895},{"type":"v1","addr":"172.21.15.72:6817","nonce":3024877895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":3024877895},{"type":"v1","addr":"172.21.15.72:6821","nonce":3024877895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6827","nonce":3024877895},{"type":"v1","addr":"172.21.15.72:6829","nonce":3024877895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6823","nonce":3024877895},{"type":"v1","addr":"172.21.15.72:6825","nonce":3024877895}]},"public_addr":"172.21.15.72:6817/3024877895","cluster_addr":"172.21.15.72:6821/3024877895","heartbeat_back_addr":"172.21.15.72:6829/3024877895","heartbeat_front_addr":"172.21.15.72:6825/3024877895","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.241014+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.450799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.465018+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.507647+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.534763+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.495895+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.427110+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.547466+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-27T12:33:10.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.528+0000 7f5fb4722640 1 -- 172.21.15.55:0/1702701288 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f5f9006c8f0 msgr2=0x7f5f9006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:10.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.528+0000 7f5fb4722640 1 --2- 172.21.15.55:0/1702701288 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f5f9006c8f0 0x7f5f9006edb0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f5fac161c80 tx=0x7f5f9c008040 comp rx=0 tx=0).stop 2024-05-27T12:33:10.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.528+0000 7f5fb4722640 1 -- 172.21.15.55:0/1702701288 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5fac0ba5e0 msgr2=0x7f5fac14bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:10.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.528+0000 7f5fb4722640 1 --2- 172.21.15.55:0/1702701288 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5fac0ba5e0 0x7f5fac14bd10 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f5fa800c7f0 tx=0x7f5fa800ccb0 comp rx=0 tx=0).stop 2024-05-27T12:33:10.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.528+0000 7f5fb4722640 1 -- 172.21.15.55:0/1702701288 shutdown_connections 2024-05-27T12:33:10.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.528+0000 7f5fb4722640 1 --2- 172.21.15.55:0/1702701288 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f5f9006c8f0 0x7f5f9006edb0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:10.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.528+0000 7f5fb4722640 1 --2- 172.21.15.55:0/1702701288 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5fac15eaf0 0x7f5fac0cdd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:10.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.528+0000 7f5fb4722640 1 --2- 172.21.15.55:0/1702701288 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5fac0d4320 0x7f5fac0cb960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:10.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.528+0000 7f5fb4722640 1 --2- 172.21.15.55:0/1702701288 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5fac0ba5e0 0x7f5fac14bd10 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:10.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.528+0000 7f5fb4722640 1 -- 172.21.15.55:0/1702701288 >> 172.21.15.55:0/1702701288 conn(0x7f5fac06cdb0 msgr2=0x7f5fac15d210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:10.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.528+0000 7f5fb4722640 1 -- 172.21.15.55:0/1702701288 shutdown_connections 2024-05-27T12:33:10.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.528+0000 7f5fb4722640 1 -- 172.21.15.55:0/1702701288 wait complete. 2024-05-27T12:33:10.539 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-27T12:32:29.277895+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-27T12:32:39.442745+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-27T12:32:40.672118+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-27T12:33:10.539 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-27T12:33:10.646 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.647+0000 7f06f7459640 1 Processor -- start 2024-05-27T12:33:10.646 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.647+0000 7f06f7459640 1 -- start start 2024-05-27T12:33:10.648 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.648+0000 7f06f7459640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f06f015cb20 0x7f06f00d12e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:10.648 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.648+0000 7f06f7459640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f06f00b1f90 0x7f06f00cdb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:10.648 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.648+0000 7f06f7459640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f06f00b23d0 0x7f06f00ce060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:10.648 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.648+0000 7f06f7459640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f06f00ce5a0 con 0x7f06f015cb20 2024-05-27T12:33:10.648 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.648+0000 7f06f7459640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f06f009b790 con 0x7f06f00b23d0 2024-05-27T12:33:10.648 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.648+0000 7f06f7459640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f06f009ba70 con 0x7f06f00b1f90 2024-05-27T12:33:10.648 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.648+0000 7f06f51f5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f06f015cb20 0x7f06f00d12e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:10.648 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.648+0000 7f06f51f5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f06f015cb20 0x7f06f00d12e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51788/0 (socket says 172.21.15.55:51788) 2024-05-27T12:33:10.648 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.648+0000 7f06f51f5640 1 -- 172.21.15.55:0/4075219987 learned_addr learned my addr 172.21.15.55:0/4075219987 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:33:10.648 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.648+0000 7f06f49f4640 1 --2- 172.21.15.55:0/4075219987 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f06f00b1f90 0x7f06f00cdb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:10.648 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.648+0000 7f06f59f6640 1 --2- 172.21.15.55:0/4075219987 >> v2:172.21.15.72:3300/0 conn(0x7f06f00b23d0 0x7f06f00ce060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:10.649 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.649+0000 7f06f51f5640 1 -- 172.21.15.55:0/4075219987 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f06f00b1f90 msgr2=0x7f06f00cdb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:10.649 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.649+0000 7f06f51f5640 1 --2- 172.21.15.55:0/4075219987 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f06f00b1f90 0x7f06f00cdb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:10.649 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.649+0000 7f06f51f5640 1 -- 172.21.15.55:0/4075219987 >> v2:172.21.15.72:3300/0 conn(0x7f06f00b23d0 msgr2=0x7f06f00ce060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:10.649 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.649+0000 7f06f51f5640 1 --2- 172.21.15.55:0/4075219987 >> v2:172.21.15.72:3300/0 conn(0x7f06f00b23d0 0x7f06f00ce060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:10.649 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.649+0000 7f06f51f5640 1 -- 172.21.15.55:0/4075219987 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06f009bd50 con 0x7f06f015cb20 2024-05-27T12:33:10.649 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.649+0000 7f06f59f6640 1 --2- 172.21.15.55:0/4075219987 >> v2:172.21.15.72:3300/0 conn(0x7f06f00b23d0 0x7f06f00ce060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T12:33:10.650 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.649+0000 7f06f51f5640 1 --2- 172.21.15.55:0/4075219987 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06f015cb20 0x7f06f00d12e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f06f0073f70 tx=0x7f06ec02a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e53fe47ef668c700 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:10.650 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.649+0000 7f06e7fff640 1 -- 172.21.15.55:0/4075219987 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06ec037070 con 0x7f06f015cb20 2024-05-27T12:33:10.650 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.650+0000 7f06e7fff640 1 -- 172.21.15.55:0/4075219987 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06ec02ae00 con 0x7f06f015cb20 2024-05-27T12:33:10.650 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.650+0000 7f06e7fff640 1 -- 172.21.15.55:0/4075219987 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06ec032660 con 0x7f06f015cb20 2024-05-27T12:33:10.651 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.650+0000 7f06f7459640 1 -- 172.21.15.55:0/4075219987 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06f015cb20 msgr2=0x7f06f00d12e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:10.651 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.650+0000 7f06f7459640 1 --2- 172.21.15.55:0/4075219987 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06f015cb20 0x7f06f00d12e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f06f0073f70 tx=0x7f06ec02a0b0 comp rx=0 tx=0).stop 2024-05-27T12:33:10.651 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.650+0000 7f06f7459640 1 -- 172.21.15.55:0/4075219987 shutdown_connections 2024-05-27T12:33:10.651 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.650+0000 7f06f7459640 1 --2- 172.21.15.55:0/4075219987 >> v2:172.21.15.72:3300/0 conn(0x7f06f00b23d0 0x7f06f00ce060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:10.651 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.650+0000 7f06f7459640 1 --2- 172.21.15.55:0/4075219987 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f06f00b1f90 0x7f06f00cdb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:10.651 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.650+0000 7f06f7459640 1 --2- 172.21.15.55:0/4075219987 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06f015cb20 0x7f06f00d12e0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:10.651 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.650+0000 7f06f7459640 1 -- 172.21.15.55:0/4075219987 >> 172.21.15.55:0/4075219987 conn(0x7f06f00b4160 msgr2=0x7f06f00b4570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:10.651 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.650+0000 7f06f7459640 1 -- 172.21.15.55:0/4075219987 shutdown_connections 2024-05-27T12:33:10.651 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.650+0000 7f06f7459640 1 -- 172.21.15.55:0/4075219987 wait complete. 2024-05-27T12:33:10.651 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.651+0000 7f06f7459640 1 Processor -- start 2024-05-27T12:33:10.651 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.651+0000 7f06f7459640 1 -- start start 2024-05-27T12:33:10.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.652+0000 7f06f7459640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06f00b1f90 0x7f06f00c8400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:10.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.652+0000 7f06f7459640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f06f00b23d0 0x7f06f015a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:10.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.652+0000 7f06f7459640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f06f015cb20 0x7f06f0156320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:10.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.652+0000 7f06f7459640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f06f00d0240 con 0x7f06f00b1f90 2024-05-27T12:33:10.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.652+0000 7f06f7459640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f06f009b410 con 0x7f06f00b23d0 2024-05-27T12:33:10.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.652+0000 7f06f7459640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f06f00d03c0 con 0x7f06f015cb20 2024-05-27T12:33:10.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.652+0000 7f06f51f5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06f00b1f90 0x7f06f00c8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:10.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.652+0000 7f06f51f5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06f00b1f90 0x7f06f00c8400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51790/0 (socket says 172.21.15.55:51790) 2024-05-27T12:33:10.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.652+0000 7f06f51f5640 1 -- 172.21.15.55:0/4206263953 learned_addr learned my addr 172.21.15.55:0/4206263953 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:33:10.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.652+0000 7f06f49f4640 1 --2- 172.21.15.55:0/4206263953 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f06f00b23d0 0x7f06f015a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:10.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.652+0000 7f06f59f6640 1 --2- 172.21.15.55:0/4206263953 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f06f015cb20 0x7f06f0156320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:10.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.653+0000 7f06f51f5640 1 -- 172.21.15.55:0/4206263953 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f06f015cb20 msgr2=0x7f06f0156320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:10.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.653+0000 7f06f51f5640 1 --2- 172.21.15.55:0/4206263953 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f06f015cb20 0x7f06f0156320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:10.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.653+0000 7f06f51f5640 1 -- 172.21.15.55:0/4206263953 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f06f00b23d0 msgr2=0x7f06f015a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:10.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.653+0000 7f06f51f5640 1 --2- 172.21.15.55:0/4206263953 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f06f00b23d0 0x7f06f015a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:10.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.653+0000 7f06f51f5640 1 -- 172.21.15.55:0/4206263953 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06f015cfa0 con 0x7f06f00b1f90 2024-05-27T12:33:10.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.653+0000 7f06f51f5640 1 --2- 172.21.15.55:0/4206263953 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06f00b1f90 0x7f06f00c8400 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f06ec000c00 tx=0x7f06ec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:10.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.653+0000 7f06e5ffb640 1 -- 172.21.15.55:0/4206263953 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06ec042070 con 0x7f06f00b1f90 2024-05-27T12:33:10.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.653+0000 7f06e5ffb640 1 -- 172.21.15.55:0/4206263953 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06ec03e670 con 0x7f06f00b1f90 2024-05-27T12:33:10.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.653+0000 7f06f7459640 1 -- 172.21.15.55:0/4206263953 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06f015d280 con 0x7f06f00b1f90 2024-05-27T12:33:10.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.653+0000 7f06e5ffb640 1 -- 172.21.15.55:0/4206263953 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06ec037040 con 0x7f06f00b1f90 2024-05-27T12:33:10.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.653+0000 7f06f7459640 1 -- 172.21.15.55:0/4206263953 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06f015d840 con 0x7f06f00b1f90 2024-05-27T12:33:10.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.654+0000 7f06f7459640 1 -- 172.21.15.55:0/4206263953 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06f0068a70 con 0x7f06f00b1f90 2024-05-27T12:33:10.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.655+0000 7f06e5ffb640 1 -- 172.21.15.55:0/4206263953 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f06ec03a040 con 0x7f06f00b1f90 2024-05-27T12:33:10.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.655+0000 7f06e5ffb640 1 --2- 172.21.15.55:0/4206263953 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f06d406c8f0 0x7f06d406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:10.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.656+0000 7f06e5ffb640 1 -- 172.21.15.55:0/4206263953 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f06ec0abe30 con 0x7f06f00b1f90 2024-05-27T12:33:10.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.656+0000 7f06f49f4640 1 --2- 172.21.15.55:0/4206263953 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f06d406c8f0 0x7f06d406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:10.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.656+0000 7f06f49f4640 1 --2- 172.21.15.55:0/4206263953 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f06d406c8f0 0x7f06d406edb0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f06f015bd40 tx=0x7f06e0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:10.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.660+0000 7f06e5ffb640 1 -- 172.21.15.55:0/4206263953 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f06ec079c90 con 0x7f06f00b1f90 2024-05-27T12:33:10.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.845+0000 7f06f7459640 1 -- 172.21.15.55:0/4206263953 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f06f00b4e80 con 0x7f06f00b1f90 2024-05-27T12:33:10.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.846+0000 7f06e5ffb640 1 -- 172.21.15.55:0/4206263953 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) ==== 93+0+10 (secure 0 0 0) 0x7f06ec07df90 con 0x7f06f00b1f90 2024-05-27T12:33:10.845 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-05-27T12:33:10.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.848+0000 7f06f7459640 1 -- 172.21.15.55:0/4206263953 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f06d406c8f0 msgr2=0x7f06d406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:10.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.848+0000 7f06f7459640 1 --2- 172.21.15.55:0/4206263953 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f06d406c8f0 0x7f06d406edb0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f06f015bd40 tx=0x7f06e0008040 comp rx=0 tx=0).stop 2024-05-27T12:33:10.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.848+0000 7f06f7459640 1 -- 172.21.15.55:0/4206263953 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06f00b1f90 msgr2=0x7f06f00c8400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:10.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.848+0000 7f06f7459640 1 --2- 172.21.15.55:0/4206263953 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06f00b1f90 0x7f06f00c8400 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f06ec000c00 tx=0x7f06ec0046c0 comp rx=0 tx=0).stop 2024-05-27T12:33:10.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.848+0000 7f06f7459640 1 -- 172.21.15.55:0/4206263953 shutdown_connections 2024-05-27T12:33:10.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.848+0000 7f06f7459640 1 --2- 172.21.15.55:0/4206263953 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f06f015cb20 0x7f06f0156320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:10.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.848+0000 7f06f7459640 1 --2- 172.21.15.55:0/4206263953 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f06d406c8f0 0x7f06d406edb0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:10.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.848+0000 7f06f7459640 1 --2- 172.21.15.55:0/4206263953 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f06f00b23d0 0x7f06f015a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:10.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.848+0000 7f06f7459640 1 --2- 172.21.15.55:0/4206263953 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06f00b1f90 0x7f06f00c8400 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:10.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.848+0000 7f06f7459640 1 -- 172.21.15.55:0/4206263953 >> 172.21.15.55:0/4206263953 conn(0x7f06f00b4160 msgr2=0x7f06f0071540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:10.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.848+0000 7f06f7459640 1 -- 172.21.15.55:0/4206263953 shutdown_connections 2024-05-27T12:33:10.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.848+0000 7f06f7459640 1 -- 172.21.15.55:0/4206263953 wait complete. 2024-05-27T12:33:10.858 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-27T12:33:10.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.966+0000 7f2f7a108640 1 Processor -- start 2024-05-27T12:33:10.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.966+0000 7f2f7a108640 1 -- start start 2024-05-27T12:33:10.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.967+0000 7f2f7a108640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2f740cfb40 0x7f2f740d1830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:10.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.967+0000 7f2f7a108640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2f740d1d70 0x7f2f740b78f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:10.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.967+0000 7f2f7a108640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f740d2180 con 0x7f2f7415eb00 2024-05-27T12:33:10.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.967+0000 7f2f7a108640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f2f740d5700 con 0x7f2f740cfb40 2024-05-27T12:33:10.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.967+0000 7f2f7a108640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f2f7415eee0 con 0x7f2f740d1d70 2024-05-27T12:33:10.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.967+0000 7f2f72ffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2f740cfb40 0x7f2f740d1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:10.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.967+0000 7f2f72ffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2f740cfb40 0x7f2f740d1830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51796/0 (socket says 172.21.15.55:51796) 2024-05-27T12:33:10.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.967+0000 7f2f72ffd640 1 -- 172.21.15.55:0/1898490424 learned_addr learned my addr 172.21.15.55:0/1898490424 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:33:10.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.967+0000 7f2f73fff640 1 --2- 172.21.15.55:0/1898490424 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2f740d1d70 0x7f2f740b78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:10.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.967+0000 7f2f72ffd640 1 -- 172.21.15.55:0/1898490424 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2f740d1d70 msgr2=0x7f2f740b78f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:10.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.967+0000 7f2f72ffd640 1 --2- 172.21.15.55:0/1898490424 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2f740d1d70 0x7f2f740b78f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:10.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.967+0000 7f2f72ffd640 1 -- 172.21.15.55:0/1898490424 >> v1:172.21.15.72:6789/0 conn(0x7f2f7415eb00 legacy=0x7f2f740d3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:10.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.967+0000 7f2f72ffd640 1 -- 172.21.15.55:0/1898490424 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f740d4660 con 0x7f2f740cfb40 2024-05-27T12:33:10.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.967+0000 7f2f73fff640 1 --2- 172.21.15.55:0/1898490424 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2f740d1d70 0x7f2f740b78f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T12:33:10.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.968+0000 7f2f72ffd640 1 --2- 172.21.15.55:0/1898490424 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f740cfb40 0x7f2f740d1830 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f2f68009870 tx=0x7f2f6802a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47ebfd4f0cd7f635 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:10.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.968+0000 7f2f727fc640 1 -- 172.21.15.55:0/1898490424 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f68037070 con 0x7f2f740cfb40 2024-05-27T12:33:10.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.968+0000 7f2f727fc640 1 -- 172.21.15.55:0/1898490424 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f6802ae50 con 0x7f2f740cfb40 2024-05-27T12:33:10.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.968+0000 7f2f727fc640 1 -- 172.21.15.55:0/1898490424 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f68032860 con 0x7f2f740cfb40 2024-05-27T12:33:10.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.969+0000 7f2f7a108640 1 -- 172.21.15.55:0/1898490424 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f740cfb40 msgr2=0x7f2f740d1830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:10.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.969+0000 7f2f7a108640 1 --2- 172.21.15.55:0/1898490424 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f740cfb40 0x7f2f740d1830 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f2f68009870 tx=0x7f2f6802a300 comp rx=0 tx=0).stop 2024-05-27T12:33:10.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.969+0000 7f2f7a108640 1 -- 172.21.15.55:0/1898490424 shutdown_connections 2024-05-27T12:33:10.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.969+0000 7f2f7a108640 1 --2- 172.21.15.55:0/1898490424 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2f740d1d70 0x7f2f740b78f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:10.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.969+0000 7f2f7a108640 1 --2- 172.21.15.55:0/1898490424 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f740cfb40 0x7f2f740d1830 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:10.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.969+0000 7f2f7a108640 1 -- 172.21.15.55:0/1898490424 >> 172.21.15.55:0/1898490424 conn(0x7f2f74067a50 msgr2=0x7f2f74067e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:10.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.969+0000 7f2f7a108640 1 -- 172.21.15.55:0/1898490424 shutdown_connections 2024-05-27T12:33:10.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.969+0000 7f2f7a108640 1 -- 172.21.15.55:0/1898490424 wait complete. 2024-05-27T12:33:10.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.970+0000 7f2f7a108640 1 Processor -- start 2024-05-27T12:33:10.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.970+0000 7f2f7a108640 1 -- start start 2024-05-27T12:33:10.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.971+0000 7f2f7a108640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f740cfb40 0x7f2f74154080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:10.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.971+0000 7f2f7a108640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2f740d1d70 0x7f2f740c9e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:10.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.971+0000 7f2f7a108640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f7415eb00 0x7f2f740ca3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:10.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.971+0000 7f2f7a108640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f2f740d4f00 con 0x7f2f740cfb40 2024-05-27T12:33:10.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.971+0000 7f2f7a108640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f2f740d4c20 con 0x7f2f7415eb00 2024-05-27T12:33:10.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.971+0000 7f2f7a108640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f2f740d51e0 con 0x7f2f740d1d70 2024-05-27T12:33:10.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.971+0000 7f2f737fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f740cfb40 0x7f2f74154080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:10.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.971+0000 7f2f737fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f740cfb40 0x7f2f74154080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51804/0 (socket says 172.21.15.55:51804) 2024-05-27T12:33:10.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.971+0000 7f2f737fe640 1 -- 172.21.15.55:0/427449530 learned_addr learned my addr 172.21.15.55:0/427449530 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:33:10.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.971+0000 7f2f72ffd640 1 --2- 172.21.15.55:0/427449530 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2f740d1d70 0x7f2f740c9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:10.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.971+0000 7f2f73fff640 1 --2- 172.21.15.55:0/427449530 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f7415eb00 0x7f2f740ca3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:10.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.971+0000 7f2f737fe640 1 -- 172.21.15.55:0/427449530 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2f740d1d70 msgr2=0x7f2f740c9e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:10.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.971+0000 7f2f737fe640 1 --2- 172.21.15.55:0/427449530 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2f740d1d70 0x7f2f740c9e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:10.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.971+0000 7f2f737fe640 1 -- 172.21.15.55:0/427449530 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f7415eb00 msgr2=0x7f2f740ca3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:10.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.971+0000 7f2f737fe640 1 --2- 172.21.15.55:0/427449530 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f7415eb00 0x7f2f740ca3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:10.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.971+0000 7f2f737fe640 1 -- 172.21.15.55:0/427449530 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f740caa20 con 0x7f2f740cfb40 2024-05-27T12:33:10.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.971+0000 7f2f72ffd640 1 --2- 172.21.15.55:0/427449530 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2f740d1d70 0x7f2f740c9e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T12:33:10.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.971+0000 7f2f737fe640 1 --2- 172.21.15.55:0/427449530 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f740cfb40 0x7f2f74154080 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f2f6400c400 tx=0x7f2f6400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:10.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.971+0000 7f2f5bfff640 1 -- 172.21.15.55:0/427449530 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f640052d0 con 0x7f2f740cfb40 2024-05-27T12:33:10.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.971+0000 7f2f5bfff640 1 -- 172.21.15.55:0/427449530 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f64005490 con 0x7f2f740cfb40 2024-05-27T12:33:10.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.971+0000 7f2f7a108640 1 -- 172.21.15.55:0/427449530 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f740cad00 con 0x7f2f740cfb40 2024-05-27T12:33:10.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.972+0000 7f2f5bfff640 1 -- 172.21.15.55:0/427449530 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f64007260 con 0x7f2f740cfb40 2024-05-27T12:33:10.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.972+0000 7f2f7a108640 1 -- 172.21.15.55:0/427449530 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f740ccf00 con 0x7f2f740cfb40 2024-05-27T12:33:10.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.972+0000 7f2f7a108640 1 -- 172.21.15.55:0/427449530 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f74068a70 con 0x7f2f740cfb40 2024-05-27T12:33:10.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.973+0000 7f2f5bfff640 1 -- 172.21.15.55:0/427449530 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2f64007400 con 0x7f2f740cfb40 2024-05-27T12:33:10.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.973+0000 7f2f5bfff640 1 --2- 172.21.15.55:0/427449530 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f2f6006c920 0x7f2f6006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:10.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.974+0000 7f2f5bfff640 1 -- 172.21.15.55:0/427449530 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f2f6408b040 con 0x7f2f740cfb40 2024-05-27T12:33:10.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.974+0000 7f2f72ffd640 1 --2- 172.21.15.55:0/427449530 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f2f6006c920 0x7f2f6006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:10.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.974+0000 7f2f72ffd640 1 --2- 172.21.15.55:0/427449530 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f2f6006c920 0x7f2f6006ede0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f2f68034000 tx=0x7f2f6802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:10.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:10.978+0000 7f2f5bfff640 1 -- 172.21.15.55:0/427449530 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2f740d2180 con 0x7f2f740cfb40 2024-05-27T12:33:11.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.163+0000 7f2f7a108640 1 -- 172.21.15.55:0/427449530 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f2f740754c0 con 0x7f2f740cfb40 2024-05-27T12:33:11.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.164+0000 7f2f5bfff640 1 -- 172.21.15.55:0/427449530 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) ==== 104+0+11 (secure 0 0 0) 0x7f2f64059500 con 0x7f2f740cfb40 2024-05-27T12:33:11.163 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2024-05-27T12:33:11.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.166+0000 7f2f7a108640 1 -- 172.21.15.55:0/427449530 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f2f6006c920 msgr2=0x7f2f6006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:11.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.166+0000 7f2f7a108640 1 --2- 172.21.15.55:0/427449530 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f2f6006c920 0x7f2f6006ede0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f2f68034000 tx=0x7f2f6802e000 comp rx=0 tx=0).stop 2024-05-27T12:33:11.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.166+0000 7f2f7a108640 1 -- 172.21.15.55:0/427449530 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f740cfb40 msgr2=0x7f2f74154080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:11.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.166+0000 7f2f7a108640 1 --2- 172.21.15.55:0/427449530 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f740cfb40 0x7f2f74154080 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f2f6400c400 tx=0x7f2f6400c8c0 comp rx=0 tx=0).stop 2024-05-27T12:33:11.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.166+0000 7f2f7a108640 1 -- 172.21.15.55:0/427449530 shutdown_connections 2024-05-27T12:33:11.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.166+0000 7f2f7a108640 1 --2- 172.21.15.55:0/427449530 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f2f6006c920 0x7f2f6006ede0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:11.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.166+0000 7f2f7a108640 1 --2- 172.21.15.55:0/427449530 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f7415eb00 0x7f2f740ca3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:11.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.166+0000 7f2f7a108640 1 --2- 172.21.15.55:0/427449530 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2f740d1d70 0x7f2f740c9e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:11.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.166+0000 7f2f7a108640 1 --2- 172.21.15.55:0/427449530 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f740cfb40 0x7f2f74154080 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:11.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.166+0000 7f2f7a108640 1 -- 172.21.15.55:0/427449530 >> 172.21.15.55:0/427449530 conn(0x7f2f74067a50 msgr2=0x7f2f740b8330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:11.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.166+0000 7f2f7a108640 1 -- 172.21.15.55:0/427449530 shutdown_connections 2024-05-27T12:33:11.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.166+0000 7f2f7a108640 1 -- 172.21.15.55:0/427449530 wait complete. 2024-05-27T12:33:11.176 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-27T12:33:11.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.284+0000 7fc0c19f7640 1 Processor -- start 2024-05-27T12:33:11.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.284+0000 7fc0c19f7640 1 -- start start 2024-05-27T12:33:11.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.285+0000 7fc0c19f7640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc0bc15eb60 0x7fc0bc06d930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:11.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.285+0000 7fc0c19f7640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0bc06cb70 con 0x7fc0bc09aa30 2024-05-27T12:33:11.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.285+0000 7fc0c19f7640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0bc06ce50 con 0x7fc0bc09b980 2024-05-27T12:33:11.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.285+0000 7fc0c19f7640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7fc0bc0d1aa0 con 0x7fc0bc15eb60 2024-05-27T12:33:11.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.285+0000 7fc0baffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc0bc15eb60 0x7fc0bc06d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:11.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.285+0000 7fc0bb7fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fc0bc09aa30 0x7fc0bc0cccc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:48710/0 (socket says 172.21.15.55:48710) 2024-05-27T12:33:11.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.285+0000 7fc0bb7fe640 1 -- 172.21.15.55:0/4025825936 learned_addr learned my addr 172.21.15.55:0/4025825936 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-27T12:33:11.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.285+0000 7fc0baffd640 1 -- 172.21.15.55:0/4025825936 >> v1:172.21.15.72:6789/0 conn(0x7fc0bc09b980 legacy=0x7fc0bc0d1390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:11.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.285+0000 7fc0baffd640 1 -- 172.21.15.55:0/4025825936 >> v1:172.21.15.55:6789/0 conn(0x7fc0bc09aa30 legacy=0x7fc0bc0cccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:11.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.286+0000 7fc0baffd640 1 -- 172.21.15.55:0/4025825936 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0bc06d130 con 0x7fc0bc15eb60 2024-05-27T12:33:11.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.286+0000 7fc0b9ffb640 1 -- 172.21.15.55:0/4025825936 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3821692855 0 0) 0x7fc0bc06cb70 con 0x7fc0bc09aa30 2024-05-27T12:33:11.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.286+0000 7fc0baffd640 1 --2- 172.21.15.55:0/4025825936 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc0bc15eb60 0x7fc0bc06d930 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fc0ac009d90 tx=0x7fc0ac02a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8570b755c06813a2 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:11.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.286+0000 7fc0b9ffb640 1 -- 172.21.15.55:0/4025825936 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0ac031600 con 0x7fc0bc15eb60 2024-05-27T12:33:11.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.286+0000 7fc0b9ffb640 1 -- 172.21.15.55:0/4025825936 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0ac0317a0 con 0x7fc0bc15eb60 2024-05-27T12:33:11.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.286+0000 7fc0b9ffb640 1 -- 172.21.15.55:0/4025825936 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0ac031b70 con 0x7fc0bc15eb60 2024-05-27T12:33:11.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.287+0000 7fc0c19f7640 1 -- 172.21.15.55:0/4025825936 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc0bc15eb60 msgr2=0x7fc0bc06d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:11.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.287+0000 7fc0c19f7640 1 --2- 172.21.15.55:0/4025825936 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc0bc15eb60 0x7fc0bc06d930 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fc0ac009d90 tx=0x7fc0ac02a610 comp rx=0 tx=0).stop 2024-05-27T12:33:11.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.287+0000 7fc0c19f7640 1 -- 172.21.15.55:0/4025825936 shutdown_connections 2024-05-27T12:33:11.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.287+0000 7fc0c19f7640 1 --2- 172.21.15.55:0/4025825936 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc0bc15eb60 0x7fc0bc06d930 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:11.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.287+0000 7fc0c19f7640 1 -- 172.21.15.55:0/4025825936 >> 172.21.15.55:0/4025825936 conn(0x7fc0bc0b4160 msgr2=0x7fc0bc0b4570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:11.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.287+0000 7fc0c19f7640 1 -- 172.21.15.55:0/4025825936 shutdown_connections 2024-05-27T12:33:11.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.287+0000 7fc0c19f7640 1 -- 172.21.15.55:0/4025825936 wait complete. 2024-05-27T12:33:11.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.288+0000 7fc0c19f7640 1 Processor -- start 2024-05-27T12:33:11.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.288+0000 7fc0c19f7640 1 -- start start 2024-05-27T12:33:11.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.289+0000 7fc0c19f7640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc0bc09aa30 0x7fc0bc1f8920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:11.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.289+0000 7fc0c19f7640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc0bc09b980 0x7fc0bc1ee780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:11.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.289+0000 7fc0c19f7640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc0bc15eb60 0x7fc0bc15d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:11.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.289+0000 7fc0c19f7640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7fc0bc06de70 con 0x7fc0bc09b980 2024-05-27T12:33:11.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.289+0000 7fc0c19f7640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fc0bc0d1cc0 con 0x7fc0bc09aa30 2024-05-27T12:33:11.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.289+0000 7fc0c19f7640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fc0bc0cd3d0 con 0x7fc0bc15eb60 2024-05-27T12:33:11.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.289+0000 7fc0ba7fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc0bc09b980 0x7fc0bc1ee780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:11.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.289+0000 7fc0ba7fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc0bc09b980 0x7fc0bc1ee780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51824/0 (socket says 172.21.15.55:51824) 2024-05-27T12:33:11.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.289+0000 7fc0ba7fc640 1 -- 172.21.15.55:0/2648860545 learned_addr learned my addr 172.21.15.55:0/2648860545 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:33:11.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.289+0000 7fc0baffd640 1 --2- 172.21.15.55:0/2648860545 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc0bc09aa30 0x7fc0bc1f8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:11.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.289+0000 7fc0bb7fe640 1 --2- 172.21.15.55:0/2648860545 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc0bc15eb60 0x7fc0bc15d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:11.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.290+0000 7fc0ba7fc640 1 -- 172.21.15.55:0/2648860545 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc0bc15eb60 msgr2=0x7fc0bc15d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:11.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.290+0000 7fc0ba7fc640 1 --2- 172.21.15.55:0/2648860545 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc0bc15eb60 0x7fc0bc15d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:11.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.290+0000 7fc0ba7fc640 1 -- 172.21.15.55:0/2648860545 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc0bc09aa30 msgr2=0x7fc0bc1f8920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:11.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.290+0000 7fc0ba7fc640 1 --2- 172.21.15.55:0/2648860545 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc0bc09aa30 0x7fc0bc1f8920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:11.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.290+0000 7fc0ba7fc640 1 -- 172.21.15.55:0/2648860545 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0bc1f4d70 con 0x7fc0bc09b980 2024-05-27T12:33:11.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.290+0000 7fc0ba7fc640 1 --2- 172.21.15.55:0/2648860545 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc0bc09b980 0x7fc0bc1ee780 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fc0a400c400 tx=0x7fc0a400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:11.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.290+0000 7fc0b3fff640 1 -- 172.21.15.55:0/2648860545 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0a4011790 con 0x7fc0bc09b980 2024-05-27T12:33:11.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.290+0000 7fc0b3fff640 1 -- 172.21.15.55:0/2648860545 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0a4017070 con 0x7fc0bc09b980 2024-05-27T12:33:11.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.290+0000 7fc0c19f7640 1 -- 172.21.15.55:0/2648860545 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0bc1f5050 con 0x7fc0bc09b980 2024-05-27T12:33:11.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.290+0000 7fc0b3fff640 1 -- 172.21.15.55:0/2648860545 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0a4011bb0 con 0x7fc0bc09b980 2024-05-27T12:33:11.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.290+0000 7fc0c19f7640 1 -- 172.21.15.55:0/2648860545 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0bc1f5610 con 0x7fc0bc09b980 2024-05-27T12:33:11.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.291+0000 7fc0c19f7640 1 -- 172.21.15.55:0/2648860545 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0bc0c6260 con 0x7fc0bc09b980 2024-05-27T12:33:11.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.292+0000 7fc0b3fff640 1 -- 172.21.15.55:0/2648860545 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc0a401c460 con 0x7fc0bc09b980 2024-05-27T12:33:11.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.292+0000 7fc0b3fff640 1 --2- 172.21.15.55:0/2648860545 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fc09c06c8f0 0x7fc09c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:11.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.292+0000 7fc0b3fff640 1 -- 172.21.15.55:0/2648860545 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fc0a408b960 con 0x7fc0bc09b980 2024-05-27T12:33:11.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.292+0000 7fc0baffd640 1 --2- 172.21.15.55:0/2648860545 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fc09c06c8f0 0x7fc09c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:11.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.293+0000 7fc0baffd640 1 --2- 172.21.15.55:0/2648860545 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fc09c06c8f0 0x7fc09c06edb0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fc0ac034000 tx=0x7fc0ac02f000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:11.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.297+0000 7fc0b3fff640 1 -- 172.21.15.55:0/2648860545 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc0bc0c6260 con 0x7fc0bc09b980 2024-05-27T12:33:11.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.488+0000 7fc0c19f7640 1 -- 172.21.15.55:0/2648860545 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fc0bc068a70 con 0x7fc0bc09b980 2024-05-27T12:33:11.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.488+0000 7fc0b3fff640 1 -- 172.21.15.55:0/2648860545 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) ==== 100+0+11 (secure 0 0 0) 0x7fc0a4059d90 con 0x7fc0bc09b980 2024-05-27T12:33:11.488 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2024-05-27T12:33:11.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.490+0000 7fc0c19f7640 1 -- 172.21.15.55:0/2648860545 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fc09c06c8f0 msgr2=0x7fc09c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:11.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.490+0000 7fc0c19f7640 1 --2- 172.21.15.55:0/2648860545 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fc09c06c8f0 0x7fc09c06edb0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fc0ac034000 tx=0x7fc0ac02f000 comp rx=0 tx=0).stop 2024-05-27T12:33:11.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.490+0000 7fc0c19f7640 1 -- 172.21.15.55:0/2648860545 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc0bc09b980 msgr2=0x7fc0bc1ee780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:11.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.490+0000 7fc0c19f7640 1 --2- 172.21.15.55:0/2648860545 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc0bc09b980 0x7fc0bc1ee780 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fc0a400c400 tx=0x7fc0a400c8c0 comp rx=0 tx=0).stop 2024-05-27T12:33:11.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.491+0000 7fc0c19f7640 1 -- 172.21.15.55:0/2648860545 shutdown_connections 2024-05-27T12:33:11.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.491+0000 7fc0c19f7640 1 --2- 172.21.15.55:0/2648860545 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc0bc15eb60 0x7fc0bc15d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:11.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.491+0000 7fc0c19f7640 1 --2- 172.21.15.55:0/2648860545 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc0bc09b980 0x7fc0bc1ee780 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:11.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.491+0000 7fc0c19f7640 1 --2- 172.21.15.55:0/2648860545 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fc09c06c8f0 0x7fc09c06edb0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:11.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.491+0000 7fc0c19f7640 1 --2- 172.21.15.55:0/2648860545 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc0bc09aa30 0x7fc0bc1f8920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:11.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.491+0000 7fc0c19f7640 1 -- 172.21.15.55:0/2648860545 >> 172.21.15.55:0/2648860545 conn(0x7fc0bc0b4160 msgr2=0x7fc0bc074bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:11.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.491+0000 7fc0c19f7640 1 -- 172.21.15.55:0/2648860545 shutdown_connections 2024-05-27T12:33:11.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.491+0000 7fc0c19f7640 1 -- 172.21.15.55:0/2648860545 wait complete. 2024-05-27T12:33:11.501 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-27T12:33:11.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.606+0000 7f552b9ed640 1 Processor -- start 2024-05-27T12:33:11.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.606+0000 7f552b9ed640 1 -- start start 2024-05-27T12:33:11.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.607+0000 7f552b9ed640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5524071f20 0x7f5524072380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:11.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.607+0000 7f552b9ed640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f55240cf040 0x7f55240cf4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:11.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.607+0000 7f552b9ed640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55240ce200 con 0x7f5524144bb0 2024-05-27T12:33:11.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.607+0000 7f552b9ed640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f5524144f90 con 0x7f5524071f20 2024-05-27T12:33:11.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.607+0000 7f552b9ed640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f55240728c0 con 0x7f55240cf040 2024-05-27T12:33:11.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.607+0000 7f5528f88640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5524071f20 0x7f5524072380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:11.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.607+0000 7f5529789640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f5524144bb0 0x7f55240cd180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:48718/0 (socket says 172.21.15.55:48718) 2024-05-27T12:33:11.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.607+0000 7f5529789640 1 -- 172.21.15.55:0/3621749109 learned_addr learned my addr 172.21.15.55:0/3621749109 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-27T12:33:11.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.607+0000 7f5529f8a640 1 --2- 172.21.15.55:0/3621749109 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f55240cf040 0x7f55240cf4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:11.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.607+0000 7f5528f88640 1 -- 172.21.15.55:0/3621749109 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f55240cf040 msgr2=0x7f55240cf4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:11.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.607+0000 7f5528f88640 1 --2- 172.21.15.55:0/3621749109 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f55240cf040 0x7f55240cf4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:11.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.607+0000 7f5528f88640 1 -- 172.21.15.55:0/3621749109 >> v1:172.21.15.55:6789/0 conn(0x7f5524144bb0 legacy=0x7f55240cd180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:11.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.607+0000 7f5523fff640 1 -- 172.21.15.55:0/3621749109 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 348083148 0 0) 0x7f55240ce200 con 0x7f5524144bb0 2024-05-27T12:33:11.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.607+0000 7f5528f88640 1 -- 172.21.15.55:0/3621749109 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55240cdc40 con 0x7f5524071f20 2024-05-27T12:33:11.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.608+0000 7f5528f88640 1 --2- 172.21.15.55:0/3621749109 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5524071f20 0x7f5524072380 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f55180097a0 tx=0x7f551802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8635aed443fd5a7d server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:11.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.608+0000 7f5523fff640 1 -- 172.21.15.55:0/3621749109 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5518037070 con 0x7f5524071f20 2024-05-27T12:33:11.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.608+0000 7f5523fff640 1 -- 172.21.15.55:0/3621749109 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5518032440 con 0x7f5524071f20 2024-05-27T12:33:11.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.608+0000 7f5523fff640 1 -- 172.21.15.55:0/3621749109 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5518032810 con 0x7f5524071f20 2024-05-27T12:33:11.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.609+0000 7f552b9ed640 1 -- 172.21.15.55:0/3621749109 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5524071f20 msgr2=0x7f5524072380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:11.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.609+0000 7f552b9ed640 1 --2- 172.21.15.55:0/3621749109 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5524071f20 0x7f5524072380 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f55180097a0 tx=0x7f551802a180 comp rx=0 tx=0).stop 2024-05-27T12:33:11.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.609+0000 7f552b9ed640 1 -- 172.21.15.55:0/3621749109 shutdown_connections 2024-05-27T12:33:11.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.609+0000 7f552b9ed640 1 --2- 172.21.15.55:0/3621749109 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f55240cf040 0x7f55240cf4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:11.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.609+0000 7f552b9ed640 1 --2- 172.21.15.55:0/3621749109 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5524071f20 0x7f5524072380 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:11.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.609+0000 7f552b9ed640 1 -- 172.21.15.55:0/3621749109 >> 172.21.15.55:0/3621749109 conn(0x7f55240b3830 msgr2=0x7f55240b3c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:11.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.609+0000 7f552b9ed640 1 -- 172.21.15.55:0/3621749109 shutdown_connections 2024-05-27T12:33:11.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.609+0000 7f552b9ed640 1 -- 172.21.15.55:0/3621749109 wait complete. 2024-05-27T12:33:11.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.610+0000 7f552b9ed640 1 Processor -- start 2024-05-27T12:33:11.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.610+0000 7f552b9ed640 1 -- start start 2024-05-27T12:33:11.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.611+0000 7f552b9ed640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5524071f20 0x7f55241f4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:11.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.611+0000 7f552b9ed640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55240cf040 0x7f5524143460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:11.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.611+0000 7f552b9ed640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5524144bb0 0x7f55241dc800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:11.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.611+0000 7f552b9ed640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f55240ceb20 con 0x7f55240cf040 2024-05-27T12:33:11.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.611+0000 7f552b9ed640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f55240ce840 con 0x7f5524071f20 2024-05-27T12:33:11.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.611+0000 7f552b9ed640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f5524145330 con 0x7f5524144bb0 2024-05-27T12:33:11.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.611+0000 7f5528f88640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55240cf040 0x7f5524143460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:11.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.611+0000 7f5528f88640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55240cf040 0x7f5524143460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51838/0 (socket says 172.21.15.55:51838) 2024-05-27T12:33:11.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.611+0000 7f5528f88640 1 -- 172.21.15.55:0/319338443 learned_addr learned my addr 172.21.15.55:0/319338443 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:33:11.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.611+0000 7f5529789640 1 --2- 172.21.15.55:0/319338443 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5524071f20 0x7f55241f4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:11.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.611+0000 7f5529f8a640 1 --2- 172.21.15.55:0/319338443 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5524144bb0 0x7f55241dc800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:11.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.612+0000 7f5528f88640 1 -- 172.21.15.55:0/319338443 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5524144bb0 msgr2=0x7f55241dc800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:11.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.612+0000 7f5528f88640 1 --2- 172.21.15.55:0/319338443 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5524144bb0 0x7f55241dc800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:11.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.612+0000 7f5528f88640 1 -- 172.21.15.55:0/319338443 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5524071f20 msgr2=0x7f55241f4d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:11.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.612+0000 7f5528f88640 1 --2- 172.21.15.55:0/319338443 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5524071f20 0x7f55241f4d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:11.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.612+0000 7f5528f88640 1 -- 172.21.15.55:0/319338443 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55241f5290 con 0x7f55240cf040 2024-05-27T12:33:11.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.612+0000 7f5529f8a640 1 --2- 172.21.15.55:0/319338443 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5524144bb0 0x7f55241dc800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T12:33:11.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.612+0000 7f5528f88640 1 --2- 172.21.15.55:0/319338443 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55240cf040 0x7f5524143460 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f5518035040 tx=0x7f55180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:11.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.612+0000 7f5521ffb640 1 -- 172.21.15.55:0/319338443 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5518037040 con 0x7f55240cf040 2024-05-27T12:33:11.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.612+0000 7f5521ffb640 1 -- 172.21.15.55:0/319338443 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5518030770 con 0x7f55240cf040 2024-05-27T12:33:11.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.612+0000 7f552b9ed640 1 -- 172.21.15.55:0/319338443 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55240a9930 con 0x7f55240cf040 2024-05-27T12:33:11.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.612+0000 7f5521ffb640 1 -- 172.21.15.55:0/319338443 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5518030b80 con 0x7f55240cf040 2024-05-27T12:33:11.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.612+0000 7f552b9ed640 1 -- 172.21.15.55:0/319338443 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55240a9ef0 con 0x7f55240cf040 2024-05-27T12:33:11.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.613+0000 7f552b9ed640 1 -- 172.21.15.55:0/319338443 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5524075460 con 0x7f55240cf040 2024-05-27T12:33:11.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.614+0000 7f5521ffb640 1 -- 172.21.15.55:0/319338443 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5518044020 con 0x7f55240cf040 2024-05-27T12:33:11.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.614+0000 7f5521ffb640 1 --2- 172.21.15.55:0/319338443 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f551006c8f0 0x7f551006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:11.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.614+0000 7f5521ffb640 1 -- 172.21.15.55:0/319338443 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f55180ac070 con 0x7f55240cf040 2024-05-27T12:33:11.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.614+0000 7f5529789640 1 --2- 172.21.15.55:0/319338443 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f551006c8f0 0x7f551006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:11.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.615+0000 7f5529789640 1 --2- 172.21.15.55:0/319338443 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f551006c8f0 0x7f551006edb0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f551c007fd0 tx=0x7f551c007de0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:11.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.618+0000 7f5521ffb640 1 -- 172.21.15.55:0/319338443 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f55241f5290 con 0x7f55240cf040 2024-05-27T12:33:11.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.806+0000 7f552b9ed640 1 -- 172.21.15.55:0/319338443 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f552406cf70 con 0x7f55240cf040 2024-05-27T12:33:11.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.807+0000 7f5521ffb640 1 -- 172.21.15.55:0/319338443 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16557 (secure 0 0 0) 0x7f5518032e20 con 0x7f55240cf040 2024-05-27T12:33:11.807 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-27T12:33:11.807 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":23,"fsid":"c3ff4e3b-8dae-4856-9593-e5cc66c59982","created":"2024-05-27T12:32:17.019097+0000","modified":"2024-05-27T12:32:43.361598+0000","last_up_change":"2024-05-27T12:32:28.109744+0000","last_in_change":"2024-05-27T12:32:19.309872+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-27T12:32:29.277895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-27T12:32:39.442745+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-27T12:32:40.672118+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e607b598-061b-4b6f-92ff-95c20b330599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":807572567},{"type":"v1","addr":"172.21.15.55:6801","nonce":807572567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":807572567},{"type":"v1","addr":"172.21.15.55:6803","nonce":807572567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":807572567},{"type":"v1","addr":"172.21.15.55:6807","nonce":807572567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":807572567},{"type":"v1","addr":"172.21.15.55:6805","nonce":807572567}]},"public_addr":"172.21.15.55:6801/807572567","cluster_addr":"172.21.15.55:6803/807572567","heartbeat_back_addr":"172.21.15.55:6807/807572567","heartbeat_front_addr":"172.21.15.55:6805/807572567","state":["exists","up"]},{"osd":1,"uuid":"ba2b5b1d-71a9-4ecc-9a48-55aa7fe54261","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":3426897300},{"type":"v1","addr":"172.21.15.55:6825","nonce":3426897300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":3426897300},{"type":"v1","addr":"172.21.15.55:6827","nonce":3426897300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":3426897300},{"type":"v1","addr":"172.21.15.55:6831","nonce":3426897300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":3426897300},{"type":"v1","addr":"172.21.15.55:6829","nonce":3426897300}]},"public_addr":"172.21.15.55:6825/3426897300","cluster_addr":"172.21.15.55:6827/3426897300","heartbeat_back_addr":"172.21.15.55:6831/3426897300","heartbeat_front_addr":"172.21.15.55:6829/3426897300","state":["exists","up"]},{"osd":2,"uuid":"e6b81cc6-4ff1-45d0-87eb-9f04ccf986a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3510271725},{"type":"v1","addr":"172.21.15.55:6809","nonce":3510271725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3510271725},{"type":"v1","addr":"172.21.15.55:6811","nonce":3510271725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3510271725},{"type":"v1","addr":"172.21.15.55:6815","nonce":3510271725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3510271725},{"type":"v1","addr":"172.21.15.55:6813","nonce":3510271725}]},"public_addr":"172.21.15.55:6809/3510271725","cluster_addr":"172.21.15.55:6811/3510271725","heartbeat_back_addr":"172.21.15.55:6815/3510271725","heartbeat_front_addr":"172.21.15.55:6813/3510271725","state":["exists","up"]},{"osd":3,"uuid":"b6a34b75-807d-4693-b1c3-903cb4c618d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":1066693520},{"type":"v1","addr":"172.21.15.55:6817","nonce":1066693520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":1066693520},{"type":"v1","addr":"172.21.15.55:6819","nonce":1066693520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":1066693520},{"type":"v1","addr":"172.21.15.55:6823","nonce":1066693520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":1066693520},{"type":"v1","addr":"172.21.15.55:6821","nonce":1066693520}]},"public_addr":"172.21.15.55:6817/1066693520","cluster_addr":"172.21.15.55:6819/1066693520","heartbeat_back_addr":"172.21.15.55:6823/1066693520","heartbeat_front_addr":"172.21.15.55:6821/1066693520","state":["exists","up"]},{"osd":4,"uuid":"272ec937-56b4-4f0a-b2e1-b0bc189c9d79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":4190771237},{"type":"v1","addr":"172.21.15.72:6820","nonce":4190771237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":4190771237},{"type":"v1","addr":"172.21.15.72:6824","nonce":4190771237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":4190771237},{"type":"v1","addr":"172.21.15.72:6831","nonce":4190771237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":4190771237},{"type":"v1","addr":"172.21.15.72:6828","nonce":4190771237}]},"public_addr":"172.21.15.72:6820/4190771237","cluster_addr":"172.21.15.72:6824/4190771237","heartbeat_back_addr":"172.21.15.72:6831/4190771237","heartbeat_front_addr":"172.21.15.72:6828/4190771237","state":["exists","up"]},{"osd":5,"uuid":"56439854-72a0-4ef4-81ff-184a3d924a5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":2421889184},{"type":"v1","addr":"172.21.15.72:6801","nonce":2421889184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6803","nonce":2421889184},{"type":"v1","addr":"172.21.15.72:6805","nonce":2421889184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":2421889184},{"type":"v1","addr":"172.21.15.72:6813","nonce":2421889184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6807","nonce":2421889184},{"type":"v1","addr":"172.21.15.72:6809","nonce":2421889184}]},"public_addr":"172.21.15.72:6801/2421889184","cluster_addr":"172.21.15.72:6805/2421889184","heartbeat_back_addr":"172.21.15.72:6813/2421889184","heartbeat_front_addr":"172.21.15.72:6809/2421889184","state":["exists","up"]},{"osd":6,"uuid":"e248e2be-3b6e-49cf-8c8a-1a4152827582","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3796994599},{"type":"v1","addr":"172.21.15.72:6804","nonce":3796994599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":3796994599},{"type":"v1","addr":"172.21.15.72:6808","nonce":3796994599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":3796994599},{"type":"v1","addr":"172.21.15.72:6815","nonce":3796994599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":3796994599},{"type":"v1","addr":"172.21.15.72:6812","nonce":3796994599}]},"public_addr":"172.21.15.72:6804/3796994599","cluster_addr":"172.21.15.72:6808/3796994599","heartbeat_back_addr":"172.21.15.72:6815/3796994599","heartbeat_front_addr":"172.21.15.72:6812/3796994599","state":["exists","up"]},{"osd":7,"uuid":"505a62d3-322b-4629-b4fd-187a55563709","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":3024877895},{"type":"v1","addr":"172.21.15.72:6817","nonce":3024877895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":3024877895},{"type":"v1","addr":"172.21.15.72:6821","nonce":3024877895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6827","nonce":3024877895},{"type":"v1","addr":"172.21.15.72:6829","nonce":3024877895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6823","nonce":3024877895},{"type":"v1","addr":"172.21.15.72:6825","nonce":3024877895}]},"public_addr":"172.21.15.72:6817/3024877895","cluster_addr":"172.21.15.72:6821/3024877895","heartbeat_back_addr":"172.21.15.72:6829/3024877895","heartbeat_front_addr":"172.21.15.72:6825/3024877895","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.241014+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.450799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.465018+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.507647+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.534763+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.495895+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.427110+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.547466+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-27T12:33:11.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.810+0000 7f552b9ed640 1 -- 172.21.15.55:0/319338443 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f551006c8f0 msgr2=0x7f551006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:11.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.810+0000 7f552b9ed640 1 --2- 172.21.15.55:0/319338443 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f551006c8f0 0x7f551006edb0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f551c007fd0 tx=0x7f551c007de0 comp rx=0 tx=0).stop 2024-05-27T12:33:11.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.810+0000 7f552b9ed640 1 -- 172.21.15.55:0/319338443 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55240cf040 msgr2=0x7f5524143460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:11.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.810+0000 7f552b9ed640 1 --2- 172.21.15.55:0/319338443 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55240cf040 0x7f5524143460 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f5518035040 tx=0x7f55180046c0 comp rx=0 tx=0).stop 2024-05-27T12:33:11.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.810+0000 7f552b9ed640 1 -- 172.21.15.55:0/319338443 shutdown_connections 2024-05-27T12:33:11.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.810+0000 7f552b9ed640 1 --2- 172.21.15.55:0/319338443 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5524144bb0 0x7f55241dc800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:11.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.810+0000 7f552b9ed640 1 --2- 172.21.15.55:0/319338443 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55240cf040 0x7f5524143460 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:11.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.810+0000 7f552b9ed640 1 --2- 172.21.15.55:0/319338443 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f551006c8f0 0x7f551006edb0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:11.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.810+0000 7f552b9ed640 1 --2- 172.21.15.55:0/319338443 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5524071f20 0x7f55241f4d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:11.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.810+0000 7f552b9ed640 1 -- 172.21.15.55:0/319338443 >> 172.21.15.55:0/319338443 conn(0x7f55240b3830 msgr2=0x7f55240cf900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:11.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.810+0000 7f552b9ed640 1 -- 172.21.15.55:0/319338443 shutdown_connections 2024-05-27T12:33:11.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.810+0000 7f552b9ed640 1 -- 172.21.15.55:0/319338443 wait complete. 2024-05-27T12:33:11.820 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-27T12:32:29.277895+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-27T12:32:39.442745+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-27T12:32:40.672118+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-27T12:33:11.820 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-27T12:33:11.927 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.928+0000 7fcf84d30640 1 Processor -- start 2024-05-27T12:33:11.927 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.928+0000 7fcf84d30640 1 -- start start 2024-05-27T12:33:11.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.929+0000 7fcf84d30640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcf8006bba0 0x7fcf800b1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:11.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.929+0000 7fcf84d30640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf800ce090 con 0x7fcf800d21e0 2024-05-27T12:33:11.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.929+0000 7fcf84d30640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf800ce370 con 0x7fcf8006bf80 2024-05-27T12:33:11.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.929+0000 7fcf84d30640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7fcf800ce650 con 0x7fcf8006bba0 2024-05-27T12:33:11.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.929+0000 7fcf7e59c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcf8006bba0 0x7fcf800b1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:11.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.929+0000 7fcf7ed9d640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fcf800d21e0 0x7fcf80145770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:48728/0 (socket says 172.21.15.55:48728) 2024-05-27T12:33:11.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.929+0000 7fcf7ed9d640 1 -- 172.21.15.55:0/2799974621 learned_addr learned my addr 172.21.15.55:0/2799974621 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-27T12:33:11.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.929+0000 7fcf7e59c640 1 -- 172.21.15.55:0/2799974621 >> v1:172.21.15.72:6789/0 conn(0x7fcf8006bf80 legacy=0x7fcf800d1ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:11.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.930+0000 7fcf7e59c640 1 -- 172.21.15.55:0/2799974621 >> v1:172.21.15.55:6789/0 conn(0x7fcf800d21e0 legacy=0x7fcf80145770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:11.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.930+0000 7fcf7d59a640 1 -- 172.21.15.55:0/2799974621 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 221922883 0 0) 0x7fcf800ce090 con 0x7fcf800d21e0 2024-05-27T12:33:11.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.930+0000 7fcf7e59c640 1 -- 172.21.15.55:0/2799974621 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf800ce930 con 0x7fcf8006bba0 2024-05-27T12:33:11.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.930+0000 7fcf7e59c640 1 --2- 172.21.15.55:0/2799974621 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcf8006bba0 0x7fcf800b1ab0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fcf70009d90 tx=0x7fcf7002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90b5ef1e6df61a4c server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:11.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.930+0000 7fcf7d59a640 1 -- 172.21.15.55:0/2799974621 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf70007740 con 0x7fcf8006bba0 2024-05-27T12:33:11.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.930+0000 7fcf7d59a640 1 -- 172.21.15.55:0/2799974621 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf700078e0 con 0x7fcf8006bba0 2024-05-27T12:33:11.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.930+0000 7fcf7d59a640 1 -- 172.21.15.55:0/2799974621 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf70007cb0 con 0x7fcf8006bba0 2024-05-27T12:33:11.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.931+0000 7fcf84d30640 1 -- 172.21.15.55:0/2799974621 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcf8006bba0 msgr2=0x7fcf800b1ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:11.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.931+0000 7fcf84d30640 1 --2- 172.21.15.55:0/2799974621 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcf8006bba0 0x7fcf800b1ab0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fcf70009d90 tx=0x7fcf7002a660 comp rx=0 tx=0).stop 2024-05-27T12:33:11.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.931+0000 7fcf84d30640 1 -- 172.21.15.55:0/2799974621 shutdown_connections 2024-05-27T12:33:11.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.931+0000 7fcf84d30640 1 --2- 172.21.15.55:0/2799974621 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcf8006bba0 0x7fcf800b1ab0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:11.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.931+0000 7fcf84d30640 1 -- 172.21.15.55:0/2799974621 >> 172.21.15.55:0/2799974621 conn(0x7fcf800734b0 msgr2=0x7fcf8009aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:11.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.931+0000 7fcf84d30640 1 -- 172.21.15.55:0/2799974621 shutdown_connections 2024-05-27T12:33:11.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.931+0000 7fcf84d30640 1 -- 172.21.15.55:0/2799974621 wait complete. 2024-05-27T12:33:11.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.932+0000 7fcf84d30640 1 Processor -- start 2024-05-27T12:33:11.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.932+0000 7fcf84d30640 1 -- start start 2024-05-27T12:33:11.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.933+0000 7fcf84d30640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf8006bba0 0x7fcf8015d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:11.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.933+0000 7fcf84d30640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcf8006bf80 0x7fcf801f2d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:11.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.933+0000 7fcf84d30640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcf800d21e0 0x7fcf800afa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:11.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.933+0000 7fcf84d30640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7fcf800b2650 con 0x7fcf800d21e0 2024-05-27T12:33:11.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.933+0000 7fcf84d30640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fcf800cdd60 con 0x7fcf8006bba0 2024-05-27T12:33:11.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.933+0000 7fcf84d30640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fcf800ccc60 con 0x7fcf8006bf80 2024-05-27T12:33:11.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.933+0000 7fcf7ed9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcf800d21e0 0x7fcf800afa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:11.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.933+0000 7fcf7ed9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcf800d21e0 0x7fcf800afa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51854/0 (socket says 172.21.15.55:51854) 2024-05-27T12:33:11.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.933+0000 7fcf7ed9d640 1 -- 172.21.15.55:0/1178830857 learned_addr learned my addr 172.21.15.55:0/1178830857 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:33:11.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.933+0000 7fcf7e59c640 1 --2- 172.21.15.55:0/1178830857 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf8006bba0 0x7fcf8015d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:11.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.933+0000 7fcf7dd9b640 1 --2- 172.21.15.55:0/1178830857 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcf8006bf80 0x7fcf801f2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:11.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.934+0000 7fcf7ed9d640 1 -- 172.21.15.55:0/1178830857 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcf8006bf80 msgr2=0x7fcf801f2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:11.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.934+0000 7fcf7ed9d640 1 --2- 172.21.15.55:0/1178830857 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcf8006bf80 0x7fcf801f2d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:11.935 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.934+0000 7fcf7ed9d640 1 -- 172.21.15.55:0/1178830857 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf8006bba0 msgr2=0x7fcf8015d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:11.935 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.934+0000 7fcf7ed9d640 1 --2- 172.21.15.55:0/1178830857 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf8006bba0 0x7fcf8015d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:11.935 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.934+0000 7fcf7ed9d640 1 -- 172.21.15.55:0/1178830857 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf8015e9f0 con 0x7fcf800d21e0 2024-05-27T12:33:11.935 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.934+0000 7fcf7ed9d640 1 --2- 172.21.15.55:0/1178830857 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcf800d21e0 0x7fcf800afa90 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fcf7800c410 tx=0x7fcf7800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:11.935 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.934+0000 7fcf76ffd640 1 -- 172.21.15.55:0/1178830857 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf780074e0 con 0x7fcf800d21e0 2024-05-27T12:33:11.935 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.934+0000 7fcf76ffd640 1 -- 172.21.15.55:0/1178830857 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf780047e0 con 0x7fcf800d21e0 2024-05-27T12:33:11.935 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.934+0000 7fcf84d30640 1 -- 172.21.15.55:0/1178830857 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf8015ecd0 con 0x7fcf800d21e0 2024-05-27T12:33:11.935 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.934+0000 7fcf76ffd640 1 -- 172.21.15.55:0/1178830857 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf78004bd0 con 0x7fcf800d21e0 2024-05-27T12:33:11.935 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.934+0000 7fcf84d30640 1 -- 172.21.15.55:0/1178830857 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf8015f290 con 0x7fcf800d21e0 2024-05-27T12:33:11.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.935+0000 7fcf84d30640 1 -- 172.21.15.55:0/1178830857 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf80068a70 con 0x7fcf800d21e0 2024-05-27T12:33:11.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.936+0000 7fcf76ffd640 1 -- 172.21.15.55:0/1178830857 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fcf78011070 con 0x7fcf800d21e0 2024-05-27T12:33:11.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.936+0000 7fcf76ffd640 1 --2- 172.21.15.55:0/1178830857 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fcf6006c8f0 0x7fcf6006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:11.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.936+0000 7fcf76ffd640 1 -- 172.21.15.55:0/1178830857 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fcf7808b590 con 0x7fcf800d21e0 2024-05-27T12:33:11.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.936+0000 7fcf7e59c640 1 --2- 172.21.15.55:0/1178830857 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fcf6006c8f0 0x7fcf6006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:11.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.937+0000 7fcf7e59c640 1 --2- 172.21.15.55:0/1178830857 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fcf6006c8f0 0x7fcf6006edb0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fcf70034000 tx=0x7fcf7002f000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:11.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:11.940+0000 7fcf76ffd640 1 -- 172.21.15.55:0/1178830857 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fcf78059370 con 0x7fcf800d21e0 2024-05-27T12:33:12.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.123+0000 7fcf84d30640 1 -- 172.21.15.55:0/1178830857 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fcf8006c7f0 con 0x7fcf800d21e0 2024-05-27T12:33:12.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.124+0000 7fcf76ffd640 1 -- 172.21.15.55:0/1178830857 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) ==== 93+0+10 (secure 0 0 0) 0x7fcf7805d670 con 0x7fcf800d21e0 2024-05-27T12:33:12.123 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-05-27T12:33:12.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.126+0000 7fcf84d30640 1 -- 172.21.15.55:0/1178830857 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fcf6006c8f0 msgr2=0x7fcf6006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:12.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.126+0000 7fcf84d30640 1 --2- 172.21.15.55:0/1178830857 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fcf6006c8f0 0x7fcf6006edb0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fcf70034000 tx=0x7fcf7002f000 comp rx=0 tx=0).stop 2024-05-27T12:33:12.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.126+0000 7fcf84d30640 1 -- 172.21.15.55:0/1178830857 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcf800d21e0 msgr2=0x7fcf800afa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:12.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.126+0000 7fcf84d30640 1 --2- 172.21.15.55:0/1178830857 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcf800d21e0 0x7fcf800afa90 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fcf7800c410 tx=0x7fcf7800c8d0 comp rx=0 tx=0).stop 2024-05-27T12:33:12.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.126+0000 7fcf84d30640 1 -- 172.21.15.55:0/1178830857 shutdown_connections 2024-05-27T12:33:12.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.126+0000 7fcf84d30640 1 --2- 172.21.15.55:0/1178830857 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcf800d21e0 0x7fcf800afa90 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:12.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.126+0000 7fcf84d30640 1 --2- 172.21.15.55:0/1178830857 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcf8006bf80 0x7fcf801f2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:12.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.126+0000 7fcf84d30640 1 --2- 172.21.15.55:0/1178830857 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fcf6006c8f0 0x7fcf6006edb0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:12.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.126+0000 7fcf84d30640 1 --2- 172.21.15.55:0/1178830857 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf8006bba0 0x7fcf8015d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:12.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.126+0000 7fcf84d30640 1 -- 172.21.15.55:0/1178830857 >> 172.21.15.55:0/1178830857 conn(0x7fcf800734b0 msgr2=0x7fcf8006fb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:12.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.126+0000 7fcf84d30640 1 -- 172.21.15.55:0/1178830857 shutdown_connections 2024-05-27T12:33:12.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.126+0000 7fcf84d30640 1 -- 172.21.15.55:0/1178830857 wait complete. 2024-05-27T12:33:12.136 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-27T12:33:12.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.244+0000 7f256fb7d640 1 Processor -- start 2024-05-27T12:33:12.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.245+0000 7f256fb7d640 1 -- start start 2024-05-27T12:33:12.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.245+0000 7f256fb7d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f25680ba540 0x7f25680b78e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:12.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.245+0000 7f256fb7d640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f25680b7e20 0x7f25680b9380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:12.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.245+0000 7f256fb7d640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25680d2fc0 con 0x7f256815eb70 2024-05-27T12:33:12.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.245+0000 7f256fb7d640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f25680b8ef0 con 0x7f25680ba540 2024-05-27T12:33:12.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.245+0000 7f256fb7d640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f25680b82e0 con 0x7f25680b7e20 2024-05-27T12:33:12.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.246+0000 7f256d118640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f25680ba540 0x7f25680b78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:12.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.246+0000 7f256d919640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f256815eb70 0x7f25680d28b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:48742/0 (socket says 172.21.15.55:48742) 2024-05-27T12:33:12.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.246+0000 7f256d919640 1 -- 172.21.15.55:0/3576100672 learned_addr learned my addr 172.21.15.55:0/3576100672 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-27T12:33:12.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.246+0000 7f256e11a640 1 --2- 172.21.15.55:0/3576100672 >> v2:172.21.15.72:3300/0 conn(0x7f25680b7e20 0x7f25680b9380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:12.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.246+0000 7f256d118640 1 -- 172.21.15.55:0/3576100672 >> v2:172.21.15.72:3300/0 conn(0x7f25680b7e20 msgr2=0x7f25680b9380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:12.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.246+0000 7f256d118640 1 --2- 172.21.15.55:0/3576100672 >> v2:172.21.15.72:3300/0 conn(0x7f25680b7e20 0x7f25680b9380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:12.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.246+0000 7f256d118640 1 -- 172.21.15.55:0/3576100672 >> v1:172.21.15.55:6789/0 conn(0x7f256815eb70 legacy=0x7f25680d28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:12.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.246+0000 7f256d118640 1 -- 172.21.15.55:0/3576100672 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25680b85c0 con 0x7f25680ba540 2024-05-27T12:33:12.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.247+0000 7f256d118640 1 --2- 172.21.15.55:0/3576100672 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25680ba540 0x7f25680b78e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f25680b6ae0 tx=0x7f255c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a8cdd15c1db4c4 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:12.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.247+0000 7f256c917640 1 -- 172.21.15.55:0/3576100672 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f255c037070 con 0x7f25680ba540 2024-05-27T12:33:12.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.247+0000 7f256c917640 1 -- 172.21.15.55:0/3576100672 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f255c032440 con 0x7f25680ba540 2024-05-27T12:33:12.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.247+0000 7f256c917640 1 -- 172.21.15.55:0/3576100672 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f255c032810 con 0x7f25680ba540 2024-05-27T12:33:12.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.247+0000 7f256fb7d640 1 -- 172.21.15.55:0/3576100672 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25680ba540 msgr2=0x7f25680b78e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:12.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.247+0000 7f256fb7d640 1 --2- 172.21.15.55:0/3576100672 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25680ba540 0x7f25680b78e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f25680b6ae0 tx=0x7f255c02a1a0 comp rx=0 tx=0).stop 2024-05-27T12:33:12.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.247+0000 7f256fb7d640 1 -- 172.21.15.55:0/3576100672 shutdown_connections 2024-05-27T12:33:12.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.247+0000 7f256fb7d640 1 --2- 172.21.15.55:0/3576100672 >> v2:172.21.15.72:3300/0 conn(0x7f25680b7e20 0x7f25680b9380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:12.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.247+0000 7f256fb7d640 1 --2- 172.21.15.55:0/3576100672 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25680ba540 0x7f25680b78e0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:12.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.247+0000 7f256fb7d640 1 -- 172.21.15.55:0/3576100672 >> 172.21.15.55:0/3576100672 conn(0x7f2568067a50 msgr2=0x7f2568067e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:12.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.247+0000 7f256fb7d640 1 -- 172.21.15.55:0/3576100672 shutdown_connections 2024-05-27T12:33:12.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.247+0000 7f256fb7d640 1 -- 172.21.15.55:0/3576100672 wait complete. 2024-05-27T12:33:12.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.249+0000 7f256fb7d640 1 Processor -- start 2024-05-27T12:33:12.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.249+0000 7f256fb7d640 1 -- start start 2024-05-27T12:33:12.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.249+0000 7f256fb7d640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25680b7e20 0x7f25681f4450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:12.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.249+0000 7f256fb7d640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f25680ba540 0x7f256815f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:12.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.249+0000 7f256fb7d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f256815eb70 0x7f256815f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:12.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.249+0000 7f256fb7d640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f256815ef50 con 0x7f256815eb70 2024-05-27T12:33:12.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.249+0000 7f256fb7d640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f25680b8b80 con 0x7f25680b7e20 2024-05-27T12:33:12.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.249+0000 7f256fb7d640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f25680b98c0 con 0x7f25680ba540 2024-05-27T12:33:12.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.249+0000 7f256e11a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f256815eb70 0x7f256815f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:12.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.249+0000 7f256e11a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f256815eb70 0x7f256815f610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51872/0 (socket says 172.21.15.55:51872) 2024-05-27T12:33:12.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.249+0000 7f256e11a640 1 -- 172.21.15.55:0/3105290467 learned_addr learned my addr 172.21.15.55:0/3105290467 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:33:12.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.250+0000 7f256d919640 1 --2- 172.21.15.55:0/3105290467 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25680b7e20 0x7f25681f4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:12.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.250+0000 7f256d118640 1 --2- 172.21.15.55:0/3105290467 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f25680ba540 0x7f256815f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:12.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.250+0000 7f256e11a640 1 -- 172.21.15.55:0/3105290467 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f25680ba540 msgr2=0x7f256815f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:12.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.250+0000 7f256e11a640 1 --2- 172.21.15.55:0/3105290467 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f25680ba540 0x7f256815f0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:12.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.250+0000 7f256e11a640 1 -- 172.21.15.55:0/3105290467 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25680b7e20 msgr2=0x7f25681f4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:12.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.250+0000 7f256e11a640 1 --2- 172.21.15.55:0/3105290467 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25680b7e20 0x7f25681f4450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:12.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.250+0000 7f256e11a640 1 -- 172.21.15.55:0/3105290467 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2568153a50 con 0x7f256815eb70 2024-05-27T12:33:12.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.250+0000 7f256e11a640 1 --2- 172.21.15.55:0/3105290467 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f256815eb70 0x7f256815f610 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f2558007e60 tx=0x7f255800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:12.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.250+0000 7f25667fc640 1 -- 172.21.15.55:0/3105290467 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2558014620 con 0x7f256815eb70 2024-05-27T12:33:12.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.250+0000 7f25667fc640 1 -- 172.21.15.55:0/3105290467 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2558019070 con 0x7f256815eb70 2024-05-27T12:33:12.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.250+0000 7f256fb7d640 1 -- 172.21.15.55:0/3105290467 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2568161b90 con 0x7f256815eb70 2024-05-27T12:33:12.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.250+0000 7f25667fc640 1 -- 172.21.15.55:0/3105290467 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2558014a00 con 0x7f256815eb70 2024-05-27T12:33:12.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.250+0000 7f256fb7d640 1 -- 172.21.15.55:0/3105290467 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2568141d10 con 0x7f256815eb70 2024-05-27T12:33:12.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.251+0000 7f256fb7d640 1 -- 172.21.15.55:0/3105290467 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2568075460 con 0x7f256815eb70 2024-05-27T12:33:12.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.252+0000 7f25667fc640 1 -- 172.21.15.55:0/3105290467 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2558014ba0 con 0x7f256815eb70 2024-05-27T12:33:12.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.252+0000 7f25667fc640 1 --2- 172.21.15.55:0/3105290467 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f255406c8f0 0x7f255406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:12.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.252+0000 7f25667fc640 1 -- 172.21.15.55:0/3105290467 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f255808c410 con 0x7f256815eb70 2024-05-27T12:33:12.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.252+0000 7f256d919640 1 --2- 172.21.15.55:0/3105290467 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f255406c8f0 0x7f255406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:12.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.253+0000 7f256d919640 1 --2- 172.21.15.55:0/3105290467 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f255406c8f0 0x7f255406edb0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2560000f60 tx=0x7f2560009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:12.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.256+0000 7f25667fc640 1 -- 172.21.15.55:0/3105290467 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f255805a840 con 0x7f256815eb70 2024-05-27T12:33:12.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.440+0000 7f256fb7d640 1 -- 172.21.15.55:0/3105290467 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f2568157ec0 con 0x7f256815eb70 2024-05-27T12:33:12.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.441+0000 7f25667fc640 1 -- 172.21.15.55:0/3105290467 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) ==== 104+0+11 (secure 0 0 0) 0x7f255805a140 con 0x7f256815eb70 2024-05-27T12:33:12.440 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2024-05-27T12:33:12.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.442+0000 7f256fb7d640 1 -- 172.21.15.55:0/3105290467 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f255406c8f0 msgr2=0x7f255406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:12.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.442+0000 7f256fb7d640 1 --2- 172.21.15.55:0/3105290467 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f255406c8f0 0x7f255406edb0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2560000f60 tx=0x7f2560009040 comp rx=0 tx=0).stop 2024-05-27T12:33:12.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.442+0000 7f256fb7d640 1 -- 172.21.15.55:0/3105290467 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f256815eb70 msgr2=0x7f256815f610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:12.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.442+0000 7f256fb7d640 1 --2- 172.21.15.55:0/3105290467 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f256815eb70 0x7f256815f610 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f2558007e60 tx=0x7f255800e4b0 comp rx=0 tx=0).stop 2024-05-27T12:33:12.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.442+0000 7f256fb7d640 1 -- 172.21.15.55:0/3105290467 shutdown_connections 2024-05-27T12:33:12.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.442+0000 7f256fb7d640 1 --2- 172.21.15.55:0/3105290467 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f256815eb70 0x7f256815f610 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:12.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.442+0000 7f256fb7d640 1 --2- 172.21.15.55:0/3105290467 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f25680ba540 0x7f256815f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:12.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.442+0000 7f256fb7d640 1 --2- 172.21.15.55:0/3105290467 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f255406c8f0 0x7f255406edb0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:12.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.442+0000 7f256fb7d640 1 --2- 172.21.15.55:0/3105290467 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25680b7e20 0x7f25681f4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:12.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.442+0000 7f256fb7d640 1 -- 172.21.15.55:0/3105290467 >> 172.21.15.55:0/3105290467 conn(0x7f2568067a50 msgr2=0x7f25680cf1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:12.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.442+0000 7f256fb7d640 1 -- 172.21.15.55:0/3105290467 shutdown_connections 2024-05-27T12:33:12.443 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.442+0000 7f256fb7d640 1 -- 172.21.15.55:0/3105290467 wait complete. 2024-05-27T12:33:12.452 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-27T12:33:12.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.561+0000 7f89daa2a640 1 Processor -- start 2024-05-27T12:33:12.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.561+0000 7f89daa2a640 1 -- start start 2024-05-27T12:33:12.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.562+0000 7f89daa2a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f89d40cfb40 0x7f89d40d1830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:12.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.562+0000 7f89daa2a640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f89d40d1d70 0x7f89d40b78f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:12.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.562+0000 7f89daa2a640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89d40d2180 con 0x7f89d415eb00 2024-05-27T12:33:12.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.562+0000 7f89daa2a640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f89d40d5700 con 0x7f89d40cfb40 2024-05-27T12:33:12.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.562+0000 7f89daa2a640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f89d415eee0 con 0x7f89d40d1d70 2024-05-27T12:33:12.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.562+0000 7f89d37fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f89d40cfb40 0x7f89d40d1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:12.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.562+0000 7f89d37fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f89d40cfb40 0x7f89d40d1830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51882/0 (socket says 172.21.15.55:51882) 2024-05-27T12:33:12.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.562+0000 7f89d37fe640 1 -- 172.21.15.55:0/78948803 learned_addr learned my addr 172.21.15.55:0/78948803 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:33:12.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.562+0000 7f89d8fc7640 1 --2- 172.21.15.55:0/78948803 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f89d40d1d70 0x7f89d40b78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:12.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.562+0000 7f89d37fe640 1 -- 172.21.15.55:0/78948803 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f89d40d1d70 msgr2=0x7f89d40b78f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:12.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.562+0000 7f89d37fe640 1 --2- 172.21.15.55:0/78948803 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f89d40d1d70 0x7f89d40b78f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:12.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.562+0000 7f89d37fe640 1 -- 172.21.15.55:0/78948803 >> v1:172.21.15.72:6789/0 conn(0x7f89d415eb00 legacy=0x7f89d40d3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:12.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.562+0000 7f89d37fe640 1 -- 172.21.15.55:0/78948803 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89d40d4660 con 0x7f89d40cfb40 2024-05-27T12:33:12.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.563+0000 7f89d37fe640 1 --2- 172.21.15.55:0/78948803 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89d40cfb40 0x7f89d40d1830 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f89c8009870 tx=0x7f89c802a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d00db683286f9a5 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:12.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.563+0000 7f89d2ffd640 1 -- 172.21.15.55:0/78948803 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89c8037070 con 0x7f89d40cfb40 2024-05-27T12:33:12.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.563+0000 7f89d2ffd640 1 -- 172.21.15.55:0/78948803 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89c802ae50 con 0x7f89d40cfb40 2024-05-27T12:33:12.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.563+0000 7f89d2ffd640 1 -- 172.21.15.55:0/78948803 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89c8032860 con 0x7f89d40cfb40 2024-05-27T12:33:12.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.563+0000 7f89daa2a640 1 -- 172.21.15.55:0/78948803 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89d40cfb40 msgr2=0x7f89d40d1830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:12.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.563+0000 7f89daa2a640 1 --2- 172.21.15.55:0/78948803 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89d40cfb40 0x7f89d40d1830 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f89c8009870 tx=0x7f89c802a300 comp rx=0 tx=0).stop 2024-05-27T12:33:12.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.563+0000 7f89daa2a640 1 -- 172.21.15.55:0/78948803 shutdown_connections 2024-05-27T12:33:12.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.563+0000 7f89daa2a640 1 --2- 172.21.15.55:0/78948803 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f89d40d1d70 0x7f89d40b78f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:12.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.563+0000 7f89daa2a640 1 --2- 172.21.15.55:0/78948803 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89d40cfb40 0x7f89d40d1830 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:12.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.563+0000 7f89daa2a640 1 -- 172.21.15.55:0/78948803 >> 172.21.15.55:0/78948803 conn(0x7f89d4067a50 msgr2=0x7f89d4067e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:12.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.563+0000 7f89daa2a640 1 -- 172.21.15.55:0/78948803 shutdown_connections 2024-05-27T12:33:12.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.564+0000 7f89daa2a640 1 -- 172.21.15.55:0/78948803 wait complete. 2024-05-27T12:33:12.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.565+0000 7f89daa2a640 1 Processor -- start 2024-05-27T12:33:12.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.565+0000 7f89daa2a640 1 -- start start 2024-05-27T12:33:12.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.566+0000 7f89daa2a640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f89d40cfb40 0x7f89d40cab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:12.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.566+0000 7f89daa2a640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f89d40d1d70 0x7f89d4161320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:12.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.566+0000 7f89daa2a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89d415eb00 0x7f89d4161860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:12.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.566+0000 7f89daa2a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f89d40d4f00 con 0x7f89d415eb00 2024-05-27T12:33:12.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.566+0000 7f89daa2a640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f89d40d4c20 con 0x7f89d40d1d70 2024-05-27T12:33:12.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.566+0000 7f89daa2a640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f89d40d51e0 con 0x7f89d40cfb40 2024-05-27T12:33:12.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.566+0000 7f89d8fc7640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89d415eb00 0x7f89d4161860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:12.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.566+0000 7f89d8fc7640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89d415eb00 0x7f89d4161860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51890/0 (socket says 172.21.15.55:51890) 2024-05-27T12:33:12.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.566+0000 7f89d8fc7640 1 -- 172.21.15.55:0/416816435 learned_addr learned my addr 172.21.15.55:0/416816435 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:33:12.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.566+0000 7f89d37fe640 1 --2- 172.21.15.55:0/416816435 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f89d40d1d70 0x7f89d4161320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:12.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.566+0000 7f89d3fff640 1 --2- 172.21.15.55:0/416816435 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f89d40cfb40 0x7f89d40cab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:12.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.566+0000 7f89d8fc7640 1 -- 172.21.15.55:0/416816435 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f89d40cfb40 msgr2=0x7f89d40cab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:12.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.566+0000 7f89d8fc7640 1 --2- 172.21.15.55:0/416816435 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f89d40cfb40 0x7f89d40cab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:12.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.566+0000 7f89d8fc7640 1 -- 172.21.15.55:0/416816435 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f89d40d1d70 msgr2=0x7f89d4161320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:12.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.566+0000 7f89d8fc7640 1 --2- 172.21.15.55:0/416816435 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f89d40d1d70 0x7f89d4161320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:12.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.566+0000 7f89d8fc7640 1 -- 172.21.15.55:0/416816435 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89d4160280 con 0x7f89d415eb00 2024-05-27T12:33:12.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.566+0000 7f89d3fff640 1 --2- 172.21.15.55:0/416816435 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f89d40cfb40 0x7f89d40cab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T12:33:12.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.566+0000 7f89d8fc7640 1 --2- 172.21.15.55:0/416816435 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89d415eb00 0x7f89d4161860 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f89cc007e70 tx=0x7f89cc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:12.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.566+0000 7f89d0ff9640 1 -- 172.21.15.55:0/416816435 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89cc014620 con 0x7f89d415eb00 2024-05-27T12:33:12.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.566+0000 7f89d0ff9640 1 -- 172.21.15.55:0/416816435 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89cc019070 con 0x7f89d415eb00 2024-05-27T12:33:12.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.566+0000 7f89d0ff9640 1 -- 172.21.15.55:0/416816435 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89cc014a20 con 0x7f89d415eb00 2024-05-27T12:33:12.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.566+0000 7f89daa2a640 1 -- 172.21.15.55:0/416816435 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89d4160560 con 0x7f89d415eb00 2024-05-27T12:33:12.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.566+0000 7f89daa2a640 1 -- 172.21.15.55:0/416816435 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89d4160b20 con 0x7f89d415eb00 2024-05-27T12:33:12.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.567+0000 7f89daa2a640 1 -- 172.21.15.55:0/416816435 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89d40b6ff0 con 0x7f89d415eb00 2024-05-27T12:33:12.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.568+0000 7f89d0ff9640 1 -- 172.21.15.55:0/416816435 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f89cc014bc0 con 0x7f89d415eb00 2024-05-27T12:33:12.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.568+0000 7f89d0ff9640 1 --2- 172.21.15.55:0/416816435 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f89c006c8f0 0x7f89c006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:12.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.568+0000 7f89d0ff9640 1 -- 172.21.15.55:0/416816435 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f89cc08c470 con 0x7f89d415eb00 2024-05-27T12:33:12.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.569+0000 7f89d3fff640 1 --2- 172.21.15.55:0/416816435 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f89c006c8f0 0x7f89c006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:12.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.569+0000 7f89d3fff640 1 --2- 172.21.15.55:0/416816435 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f89c006c8f0 0x7f89c006edb0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f89c4001700 tx=0x7f89c4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:12.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.573+0000 7f89d0ff9640 1 -- 172.21.15.55:0/416816435 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f89d40b6ff0 con 0x7f89d415eb00 2024-05-27T12:33:12.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.760+0000 7f89daa2a640 1 -- 172.21.15.55:0/416816435 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f89d4068a70 con 0x7f89d415eb00 2024-05-27T12:33:12.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.761+0000 7f89d0ff9640 1 -- 172.21.15.55:0/416816435 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) ==== 100+0+11 (secure 0 0 0) 0x7f89cc05a890 con 0x7f89d415eb00 2024-05-27T12:33:12.763 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2024-05-27T12:33:12.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.763+0000 7f89daa2a640 1 -- 172.21.15.55:0/416816435 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f89c006c8f0 msgr2=0x7f89c006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:12.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.763+0000 7f89daa2a640 1 --2- 172.21.15.55:0/416816435 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f89c006c8f0 0x7f89c006edb0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f89c4001700 tx=0x7f89c4009040 comp rx=0 tx=0).stop 2024-05-27T12:33:12.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.763+0000 7f89daa2a640 1 -- 172.21.15.55:0/416816435 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89d415eb00 msgr2=0x7f89d4161860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:12.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.763+0000 7f89daa2a640 1 --2- 172.21.15.55:0/416816435 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89d415eb00 0x7f89d4161860 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f89cc007e70 tx=0x7f89cc00e4b0 comp rx=0 tx=0).stop 2024-05-27T12:33:12.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.763+0000 7f89daa2a640 1 -- 172.21.15.55:0/416816435 shutdown_connections 2024-05-27T12:33:12.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.763+0000 7f89daa2a640 1 --2- 172.21.15.55:0/416816435 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89d415eb00 0x7f89d4161860 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:12.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.763+0000 7f89daa2a640 1 --2- 172.21.15.55:0/416816435 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f89c006c8f0 0x7f89c006edb0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:12.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.763+0000 7f89daa2a640 1 --2- 172.21.15.55:0/416816435 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f89d40d1d70 0x7f89d4161320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:12.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.763+0000 7f89daa2a640 1 --2- 172.21.15.55:0/416816435 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f89d40cfb40 0x7f89d40cab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:12.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.763+0000 7f89daa2a640 1 -- 172.21.15.55:0/416816435 >> 172.21.15.55:0/416816435 conn(0x7f89d4067a50 msgr2=0x7f89d40b3f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:12.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.763+0000 7f89daa2a640 1 -- 172.21.15.55:0/416816435 shutdown_connections 2024-05-27T12:33:12.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.763+0000 7f89daa2a640 1 -- 172.21.15.55:0/416816435 wait complete. 2024-05-27T12:33:12.852 INFO:tasks.cephfs_test_runner:Starting test: test_progress_bar_for_1_clone (tasks.cephfs.test_volumes.TestCloneProgressReporter) Test that when one clone is in progress, one progress bar is printed 2024-05-27T12:33:12.852 INFO:tasks.cephfs_test_runner:test_progress_bar_for_1_clone (tasks.cephfs.test_volumes.TestCloneProgressReporter) 2024-05-27T12:33:12.853 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-27T12:33:12.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.958+0000 7f6e45da2640 1 Processor -- start 2024-05-27T12:33:12.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.958+0000 7f6e45da2640 1 -- start start 2024-05-27T12:33:12.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.959+0000 7f6e45da2640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6e4009aa30 0x7f6e4009ae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:12.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.959+0000 7f6e45da2640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6e4006cb20 0x7f6e4006cf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:12.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.959+0000 7f6e45da2640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e4009b350 con 0x7f6e40162680 2024-05-27T12:33:12.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.959+0000 7f6e45da2640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f6e400d2290 con 0x7f6e4009aa30 2024-05-27T12:33:12.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.959+0000 7f6e45da2640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f6e400d0df0 con 0x7f6e4006cb20 2024-05-27T12:33:12.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.959+0000 7f6e3f7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6e4009aa30 0x7f6e4009ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:12.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.959+0000 7f6e3ffff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f6e40162680 0x7f6e40162b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:48568/0 (socket says 172.21.15.55:48568) 2024-05-27T12:33:12.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.959+0000 7f6e3ffff640 1 -- 172.21.15.55:0/366721616 learned_addr learned my addr 172.21.15.55:0/366721616 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-27T12:33:12.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.959+0000 7f6e3effd640 1 --2- 172.21.15.55:0/366721616 >> v2:172.21.15.72:3300/0 conn(0x7f6e4006cb20 0x7f6e4006cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:12.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.959+0000 7f6e3f7fe640 1 -- 172.21.15.55:0/366721616 >> v2:172.21.15.72:3300/0 conn(0x7f6e4006cb20 msgr2=0x7f6e4006cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:12.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.959+0000 7f6e3f7fe640 1 --2- 172.21.15.55:0/366721616 >> v2:172.21.15.72:3300/0 conn(0x7f6e4006cb20 0x7f6e4006cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:12.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.959+0000 7f6e3f7fe640 1 -- 172.21.15.55:0/366721616 >> v1:172.21.15.55:6789/0 conn(0x7f6e40162680 legacy=0x7f6e40162b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:12.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.959+0000 7f6e3e7fc640 1 -- 172.21.15.55:0/366721616 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 500017075 0 0) 0x7f6e4009b350 con 0x7f6e40162680 2024-05-27T12:33:12.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.959+0000 7f6e3f7fe640 1 -- 172.21.15.55:0/366721616 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e4006d850 con 0x7f6e4009aa30 2024-05-27T12:33:12.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.960+0000 7f6e3f7fe640 1 --2- 172.21.15.55:0/366721616 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e4009aa30 0x7f6e4009ae10 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f6e40074150 tx=0x7f6e3002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e41fea92c64681fb server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:12.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.960+0000 7f6e3e7fc640 1 -- 172.21.15.55:0/366721616 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e30037070 con 0x7f6e4009aa30 2024-05-27T12:33:12.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.960+0000 7f6e3e7fc640 1 -- 172.21.15.55:0/366721616 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e30032440 con 0x7f6e4009aa30 2024-05-27T12:33:12.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.960+0000 7f6e3e7fc640 1 -- 172.21.15.55:0/366721616 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e30032810 con 0x7f6e4009aa30 2024-05-27T12:33:12.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.961+0000 7f6e45da2640 1 -- 172.21.15.55:0/366721616 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e4009aa30 msgr2=0x7f6e4009ae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:12.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.961+0000 7f6e45da2640 1 --2- 172.21.15.55:0/366721616 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e4009aa30 0x7f6e4009ae10 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f6e40074150 tx=0x7f6e3002a1a0 comp rx=0 tx=0).stop 2024-05-27T12:33:12.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.961+0000 7f6e45da2640 1 -- 172.21.15.55:0/366721616 shutdown_connections 2024-05-27T12:33:12.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.961+0000 7f6e45da2640 1 --2- 172.21.15.55:0/366721616 >> v2:172.21.15.72:3300/0 conn(0x7f6e4006cb20 0x7f6e4006cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:12.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.961+0000 7f6e45da2640 1 --2- 172.21.15.55:0/366721616 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e4009aa30 0x7f6e4009ae10 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:12.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.961+0000 7f6e45da2640 1 -- 172.21.15.55:0/366721616 >> 172.21.15.55:0/366721616 conn(0x7f6e400b4190 msgr2=0x7f6e400b45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:12.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.961+0000 7f6e45da2640 1 -- 172.21.15.55:0/366721616 shutdown_connections 2024-05-27T12:33:12.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.961+0000 7f6e45da2640 1 -- 172.21.15.55:0/366721616 wait complete. 2024-05-27T12:33:12.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.962+0000 7f6e45da2640 1 Processor -- start 2024-05-27T12:33:12.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.962+0000 7f6e45da2640 1 -- start start 2024-05-27T12:33:12.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.963+0000 7f6e45da2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e4006cb20 0x7f6e401579b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:12.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.963+0000 7f6e45da2640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6e4009aa30 0x7f6e400b3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:12.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.963+0000 7f6e45da2640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6e40162680 0x7f6e400cf5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:12.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.963+0000 7f6e45da2640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f6e40160480 con 0x7f6e4006cb20 2024-05-27T12:33:12.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.963+0000 7f6e45da2640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f6e400d0a80 con 0x7f6e4009aa30 2024-05-27T12:33:12.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.963+0000 7f6e45da2640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f6e4006d480 con 0x7f6e40162680 2024-05-27T12:33:12.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.963+0000 7f6e3f7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e4006cb20 0x7f6e401579b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:12.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.963+0000 7f6e3f7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e4006cb20 0x7f6e401579b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44220/0 (socket says 172.21.15.55:44220) 2024-05-27T12:33:12.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.963+0000 7f6e3f7fe640 1 -- 172.21.15.55:0/601147944 learned_addr learned my addr 172.21.15.55:0/601147944 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:33:12.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.963+0000 7f6e3effd640 1 --2- 172.21.15.55:0/601147944 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6e4009aa30 0x7f6e400b3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:12.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.963+0000 7f6e3ffff640 1 --2- 172.21.15.55:0/601147944 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6e40162680 0x7f6e400cf5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:12.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.963+0000 7f6e3f7fe640 1 -- 172.21.15.55:0/601147944 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6e40162680 msgr2=0x7f6e400cf5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:12.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.963+0000 7f6e3f7fe640 1 --2- 172.21.15.55:0/601147944 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6e40162680 0x7f6e400cf5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:12.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.963+0000 7f6e3f7fe640 1 -- 172.21.15.55:0/601147944 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6e4009aa30 msgr2=0x7f6e400b3980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:12.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.963+0000 7f6e3f7fe640 1 --2- 172.21.15.55:0/601147944 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6e4009aa30 0x7f6e400b3980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:12.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.963+0000 7f6e3f7fe640 1 -- 172.21.15.55:0/601147944 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e4015d230 con 0x7f6e4006cb20 2024-05-27T12:33:12.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.964+0000 7f6e3f7fe640 1 --2- 172.21.15.55:0/601147944 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e4006cb20 0x7f6e401579b0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f6e30000c00 tx=0x7f6e300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:12.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.964+0000 7f6e27fff640 1 -- 172.21.15.55:0/601147944 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e30037040 con 0x7f6e4006cb20 2024-05-27T12:33:12.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.964+0000 7f6e27fff640 1 -- 172.21.15.55:0/601147944 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e30042070 con 0x7f6e4006cb20 2024-05-27T12:33:12.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.964+0000 7f6e45da2640 1 -- 172.21.15.55:0/601147944 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e4015d510 con 0x7f6e4006cb20 2024-05-27T12:33:12.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.964+0000 7f6e27fff640 1 -- 172.21.15.55:0/601147944 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e30030960 con 0x7f6e4006cb20 2024-05-27T12:33:12.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.964+0000 7f6e45da2640 1 -- 172.21.15.55:0/601147944 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e4015dad0 con 0x7f6e4006cb20 2024-05-27T12:33:12.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.965+0000 7f6e45da2640 1 -- 172.21.15.55:0/601147944 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e40071f60 con 0x7f6e4006cb20 2024-05-27T12:33:12.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.965+0000 7f6e27fff640 1 -- 172.21.15.55:0/601147944 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6e30030b00 con 0x7f6e4006cb20 2024-05-27T12:33:12.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.966+0000 7f6e27fff640 1 --2- 172.21.15.55:0/601147944 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f6e2c06c8f0 0x7f6e2c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:12.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.966+0000 7f6e27fff640 1 -- 172.21.15.55:0/601147944 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f6e300ac380 con 0x7f6e4006cb20 2024-05-27T12:33:12.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.966+0000 7f6e3effd640 1 --2- 172.21.15.55:0/601147944 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f6e2c06c8f0 0x7f6e2c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:12.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.967+0000 7f6e3effd640 1 --2- 172.21.15.55:0/601147944 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f6e2c06c8f0 0x7f6e2c06edb0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f6e40163500 tx=0x7f6e34009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:12.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:12.970+0000 7f6e27fff640 1 -- 172.21.15.55:0/601147944 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6e40071f60 con 0x7f6e4006cb20 2024-05-27T12:33:13.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.157+0000 7f6e45da2640 1 -- 172.21.15.55:0/601147944 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6e400b50a0 con 0x7f6e4006cb20 2024-05-27T12:33:13.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.158+0000 7f6e27fff640 1 -- 172.21.15.55:0/601147944 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16557 (secure 0 0 0) 0x7f6e3007a160 con 0x7f6e4006cb20 2024-05-27T12:33:13.157 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-27T12:33:13.158 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":23,"fsid":"c3ff4e3b-8dae-4856-9593-e5cc66c59982","created":"2024-05-27T12:32:17.019097+0000","modified":"2024-05-27T12:32:43.361598+0000","last_up_change":"2024-05-27T12:32:28.109744+0000","last_in_change":"2024-05-27T12:32:19.309872+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-27T12:32:29.277895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-27T12:32:39.442745+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-27T12:32:40.672118+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e607b598-061b-4b6f-92ff-95c20b330599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":807572567},{"type":"v1","addr":"172.21.15.55:6801","nonce":807572567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":807572567},{"type":"v1","addr":"172.21.15.55:6803","nonce":807572567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":807572567},{"type":"v1","addr":"172.21.15.55:6807","nonce":807572567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":807572567},{"type":"v1","addr":"172.21.15.55:6805","nonce":807572567}]},"public_addr":"172.21.15.55:6801/807572567","cluster_addr":"172.21.15.55:6803/807572567","heartbeat_back_addr":"172.21.15.55:6807/807572567","heartbeat_front_addr":"172.21.15.55:6805/807572567","state":["exists","up"]},{"osd":1,"uuid":"ba2b5b1d-71a9-4ecc-9a48-55aa7fe54261","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":3426897300},{"type":"v1","addr":"172.21.15.55:6825","nonce":3426897300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":3426897300},{"type":"v1","addr":"172.21.15.55:6827","nonce":3426897300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":3426897300},{"type":"v1","addr":"172.21.15.55:6831","nonce":3426897300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":3426897300},{"type":"v1","addr":"172.21.15.55:6829","nonce":3426897300}]},"public_addr":"172.21.15.55:6825/3426897300","cluster_addr":"172.21.15.55:6827/3426897300","heartbeat_back_addr":"172.21.15.55:6831/3426897300","heartbeat_front_addr":"172.21.15.55:6829/3426897300","state":["exists","up"]},{"osd":2,"uuid":"e6b81cc6-4ff1-45d0-87eb-9f04ccf986a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3510271725},{"type":"v1","addr":"172.21.15.55:6809","nonce":3510271725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3510271725},{"type":"v1","addr":"172.21.15.55:6811","nonce":3510271725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3510271725},{"type":"v1","addr":"172.21.15.55:6815","nonce":3510271725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3510271725},{"type":"v1","addr":"172.21.15.55:6813","nonce":3510271725}]},"public_addr":"172.21.15.55:6809/3510271725","cluster_addr":"172.21.15.55:6811/3510271725","heartbeat_back_addr":"172.21.15.55:6815/3510271725","heartbeat_front_addr":"172.21.15.55:6813/3510271725","state":["exists","up"]},{"osd":3,"uuid":"b6a34b75-807d-4693-b1c3-903cb4c618d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":1066693520},{"type":"v1","addr":"172.21.15.55:6817","nonce":1066693520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":1066693520},{"type":"v1","addr":"172.21.15.55:6819","nonce":1066693520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":1066693520},{"type":"v1","addr":"172.21.15.55:6823","nonce":1066693520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":1066693520},{"type":"v1","addr":"172.21.15.55:6821","nonce":1066693520}]},"public_addr":"172.21.15.55:6817/1066693520","cluster_addr":"172.21.15.55:6819/1066693520","heartbeat_back_addr":"172.21.15.55:6823/1066693520","heartbeat_front_addr":"172.21.15.55:6821/1066693520","state":["exists","up"]},{"osd":4,"uuid":"272ec937-56b4-4f0a-b2e1-b0bc189c9d79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":4190771237},{"type":"v1","addr":"172.21.15.72:6820","nonce":4190771237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":4190771237},{"type":"v1","addr":"172.21.15.72:6824","nonce":4190771237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":4190771237},{"type":"v1","addr":"172.21.15.72:6831","nonce":4190771237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":4190771237},{"type":"v1","addr":"172.21.15.72:6828","nonce":4190771237}]},"public_addr":"172.21.15.72:6820/4190771237","cluster_addr":"172.21.15.72:6824/4190771237","heartbeat_back_addr":"172.21.15.72:6831/4190771237","heartbeat_front_addr":"172.21.15.72:6828/4190771237","state":["exists","up"]},{"osd":5,"uuid":"56439854-72a0-4ef4-81ff-184a3d924a5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":2421889184},{"type":"v1","addr":"172.21.15.72:6801","nonce":2421889184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6803","nonce":2421889184},{"type":"v1","addr":"172.21.15.72:6805","nonce":2421889184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":2421889184},{"type":"v1","addr":"172.21.15.72:6813","nonce":2421889184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6807","nonce":2421889184},{"type":"v1","addr":"172.21.15.72:6809","nonce":2421889184}]},"public_addr":"172.21.15.72:6801/2421889184","cluster_addr":"172.21.15.72:6805/2421889184","heartbeat_back_addr":"172.21.15.72:6813/2421889184","heartbeat_front_addr":"172.21.15.72:6809/2421889184","state":["exists","up"]},{"osd":6,"uuid":"e248e2be-3b6e-49cf-8c8a-1a4152827582","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3796994599},{"type":"v1","addr":"172.21.15.72:6804","nonce":3796994599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":3796994599},{"type":"v1","addr":"172.21.15.72:6808","nonce":3796994599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":3796994599},{"type":"v1","addr":"172.21.15.72:6815","nonce":3796994599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":3796994599},{"type":"v1","addr":"172.21.15.72:6812","nonce":3796994599}]},"public_addr":"172.21.15.72:6804/3796994599","cluster_addr":"172.21.15.72:6808/3796994599","heartbeat_back_addr":"172.21.15.72:6815/3796994599","heartbeat_front_addr":"172.21.15.72:6812/3796994599","state":["exists","up"]},{"osd":7,"uuid":"505a62d3-322b-4629-b4fd-187a55563709","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":3024877895},{"type":"v1","addr":"172.21.15.72:6817","nonce":3024877895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":3024877895},{"type":"v1","addr":"172.21.15.72:6821","nonce":3024877895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6827","nonce":3024877895},{"type":"v1","addr":"172.21.15.72:6829","nonce":3024877895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6823","nonce":3024877895},{"type":"v1","addr":"172.21.15.72:6825","nonce":3024877895}]},"public_addr":"172.21.15.72:6817/3024877895","cluster_addr":"172.21.15.72:6821/3024877895","heartbeat_back_addr":"172.21.15.72:6829/3024877895","heartbeat_front_addr":"172.21.15.72:6825/3024877895","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.241014+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.450799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.465018+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.507647+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.534763+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.495895+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.427110+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.547466+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-27T12:33:13.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.160+0000 7f6e45da2640 1 -- 172.21.15.55:0/601147944 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f6e2c06c8f0 msgr2=0x7f6e2c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:13.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.160+0000 7f6e45da2640 1 --2- 172.21.15.55:0/601147944 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f6e2c06c8f0 0x7f6e2c06edb0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f6e40163500 tx=0x7f6e34009190 comp rx=0 tx=0).stop 2024-05-27T12:33:13.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.160+0000 7f6e45da2640 1 -- 172.21.15.55:0/601147944 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e4006cb20 msgr2=0x7f6e401579b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:13.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.160+0000 7f6e45da2640 1 --2- 172.21.15.55:0/601147944 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e4006cb20 0x7f6e401579b0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f6e30000c00 tx=0x7f6e300046c0 comp rx=0 tx=0).stop 2024-05-27T12:33:13.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.160+0000 7f6e45da2640 1 -- 172.21.15.55:0/601147944 shutdown_connections 2024-05-27T12:33:13.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.160+0000 7f6e45da2640 1 --2- 172.21.15.55:0/601147944 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6e40162680 0x7f6e400cf5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:13.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.160+0000 7f6e45da2640 1 --2- 172.21.15.55:0/601147944 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f6e2c06c8f0 0x7f6e2c06edb0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:13.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.160+0000 7f6e45da2640 1 --2- 172.21.15.55:0/601147944 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6e4009aa30 0x7f6e400b3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:13.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.160+0000 7f6e45da2640 1 --2- 172.21.15.55:0/601147944 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e4006cb20 0x7f6e401579b0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:13.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.160+0000 7f6e45da2640 1 -- 172.21.15.55:0/601147944 >> 172.21.15.55:0/601147944 conn(0x7f6e400b4190 msgr2=0x7f6e40161b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:13.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.160+0000 7f6e45da2640 1 -- 172.21.15.55:0/601147944 shutdown_connections 2024-05-27T12:33:13.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.160+0000 7f6e45da2640 1 -- 172.21.15.55:0/601147944 wait complete. 2024-05-27T12:33:13.171 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-27T12:32:29.277895+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-27T12:32:39.442745+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-27T12:32:40.672118+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-27T12:33:13.171 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-27T12:33:13.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.279+0000 7f771d136640 1 Processor -- start 2024-05-27T12:33:13.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.279+0000 7f771d136640 1 -- start start 2024-05-27T12:33:13.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.280+0000 7f771d136640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f77180cfb40 0x7f77180d1830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:13.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.280+0000 7f771d136640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f77180d1d70 0x7f77180b78f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:13.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.280+0000 7f771d136640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f771815eee0 con 0x7f771815eb00 2024-05-27T12:33:13.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.280+0000 7f771d136640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f77180d5700 con 0x7f77180d1d70 2024-05-27T12:33:13.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.280+0000 7f771d136640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f77180d21a0 con 0x7f77180cfb40 2024-05-27T12:33:13.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.280+0000 7f771759e640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f77180d1d70 0x7f77180b78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:13.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.280+0000 7f771659c640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f77180cfb40 0x7f77180d1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:13.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.280+0000 7f7716d9d640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f771815eb00 0x7f77180d3e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.55:53746/0 (socket says 172.21.15.55:53746) 2024-05-27T12:33:13.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.280+0000 7f7716d9d640 1 -- 172.21.15.55:0/2960071603 learned_addr learned my addr 172.21.15.55:0/2960071603 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-27T12:33:13.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.280+0000 7f771759e640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f77180d1d70 0x7f77180b78f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.55:33166/0 (socket says 172.21.15.55:33166) 2024-05-27T12:33:13.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.280+0000 7f771659c640 1 -- 172.21.15.55:0/2960071603 >> v2:172.21.15.72:3300/0 conn(0x7f77180d1d70 msgr2=0x7f77180b78f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:13.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.280+0000 7f771659c640 1 --2- 172.21.15.55:0/2960071603 >> v2:172.21.15.72:3300/0 conn(0x7f77180d1d70 0x7f77180b78f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:13.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.280+0000 7f771659c640 1 -- 172.21.15.55:0/2960071603 >> v1:172.21.15.72:6789/0 conn(0x7f771815eb00 legacy=0x7f77180d3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:13.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.280+0000 7f771659c640 1 -- 172.21.15.55:0/2960071603 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77180d4660 con 0x7f77180cfb40 2024-05-27T12:33:13.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.281+0000 7f771659c640 1 --2- 172.21.15.55:0/2960071603 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f77180cfb40 0x7f77180d1830 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f770c0097a0 tx=0x7f770c02a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d5f4c6169a2231f5 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:13.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.281+0000 7f7715d9b640 1 -- 172.21.15.55:0/2960071603 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f770c037070 con 0x7f77180cfb40 2024-05-27T12:33:13.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.281+0000 7f7715d9b640 1 -- 172.21.15.55:0/2960071603 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f770c032440 con 0x7f77180cfb40 2024-05-27T12:33:13.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.282+0000 7f7715d9b640 1 -- 172.21.15.55:0/2960071603 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f770c032810 con 0x7f77180cfb40 2024-05-27T12:33:13.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.282+0000 7f771d136640 1 -- 172.21.15.55:0/2960071603 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f77180cfb40 msgr2=0x7f77180d1830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:13.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.282+0000 7f771d136640 1 --2- 172.21.15.55:0/2960071603 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f77180cfb40 0x7f77180d1830 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f770c0097a0 tx=0x7f770c02a210 comp rx=0 tx=0).stop 2024-05-27T12:33:13.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.282+0000 7f771d136640 1 -- 172.21.15.55:0/2960071603 shutdown_connections 2024-05-27T12:33:13.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.282+0000 7f771d136640 1 --2- 172.21.15.55:0/2960071603 >> v2:172.21.15.72:3300/0 conn(0x7f77180d1d70 0x7f77180b78f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:13.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.282+0000 7f771d136640 1 --2- 172.21.15.55:0/2960071603 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f77180cfb40 0x7f77180d1830 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:13.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.282+0000 7f771d136640 1 -- 172.21.15.55:0/2960071603 >> 172.21.15.55:0/2960071603 conn(0x7f7718067a50 msgr2=0x7f7718067e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:13.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.282+0000 7f771d136640 1 -- 172.21.15.55:0/2960071603 shutdown_connections 2024-05-27T12:33:13.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.282+0000 7f771d136640 1 -- 172.21.15.55:0/2960071603 wait complete. 2024-05-27T12:33:13.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.284+0000 7f771d136640 1 Processor -- start 2024-05-27T12:33:13.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.284+0000 7f771d136640 1 -- start start 2024-05-27T12:33:13.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.284+0000 7f771d136640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f77180cfb40 0x7f7718154960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:13.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.284+0000 7f771d136640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f77180d1d70 0x7f7718161920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:13.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.284+0000 7f771d136640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f771815eb00 0x7f7718153b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:13.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.284+0000 7f771d136640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f77180d4f00 con 0x7f77180d1d70 2024-05-27T12:33:13.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.284+0000 7f771d136640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f77180d4c20 con 0x7f771815eb00 2024-05-27T12:33:13.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.284+0000 7f771d136640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f77180d51e0 con 0x7f77180cfb40 2024-05-27T12:33:13.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.284+0000 7f771659c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f77180d1d70 0x7f7718161920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:13.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.284+0000 7f771659c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f77180d1d70 0x7f7718161920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44232/0 (socket says 172.21.15.55:44232) 2024-05-27T12:33:13.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.284+0000 7f771659c640 1 -- 172.21.15.55:0/2754710838 learned_addr learned my addr 172.21.15.55:0/2754710838 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:33:13.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.284+0000 7f771759e640 1 --2- 172.21.15.55:0/2754710838 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f771815eb00 0x7f7718153b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:13.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.285+0000 7f7716d9d640 1 --2- 172.21.15.55:0/2754710838 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f77180cfb40 0x7f7718154960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:13.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.285+0000 7f771659c640 1 -- 172.21.15.55:0/2754710838 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f77180cfb40 msgr2=0x7f7718154960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:13.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.285+0000 7f771659c640 1 --2- 172.21.15.55:0/2754710838 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f77180cfb40 0x7f7718154960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:13.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.285+0000 7f771659c640 1 -- 172.21.15.55:0/2754710838 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f771815eb00 msgr2=0x7f7718153b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:13.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.285+0000 7f771659c640 1 --2- 172.21.15.55:0/2754710838 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f771815eb00 0x7f7718153b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:13.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.285+0000 7f771659c640 1 -- 172.21.15.55:0/2754710838 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7718154ea0 con 0x7f77180d1d70 2024-05-27T12:33:13.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.285+0000 7f771659c640 1 --2- 172.21.15.55:0/2754710838 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f77180d1d70 0x7f7718161920 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f770c0098c0 tx=0x7f770c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:13.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.285+0000 7f76ff7fe640 1 -- 172.21.15.55:0/2754710838 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f770c037040 con 0x7f77180d1d70 2024-05-27T12:33:13.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.285+0000 7f76ff7fe640 1 -- 172.21.15.55:0/2754710838 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f770c042070 con 0x7f77180d1d70 2024-05-27T12:33:13.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.285+0000 7f771d136640 1 -- 172.21.15.55:0/2754710838 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f771815fdf0 con 0x7f77180d1d70 2024-05-27T12:33:13.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.285+0000 7f76ff7fe640 1 -- 172.21.15.55:0/2754710838 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f770c030960 con 0x7f77180d1d70 2024-05-27T12:33:13.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.285+0000 7f771d136640 1 -- 172.21.15.55:0/2754710838 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77180c90c0 con 0x7f77180d1d70 2024-05-27T12:33:13.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.286+0000 7f771d136640 1 -- 172.21.15.55:0/2754710838 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7718068a70 con 0x7f77180d1d70 2024-05-27T12:33:13.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.287+0000 7f76ff7fe640 1 -- 172.21.15.55:0/2754710838 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f770c030b00 con 0x7f77180d1d70 2024-05-27T12:33:13.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.287+0000 7f76ff7fe640 1 --2- 172.21.15.55:0/2754710838 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f770406c8f0 0x7f770406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:13.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.287+0000 7f76ff7fe640 1 -- 172.21.15.55:0/2754710838 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f770c0ac3c0 con 0x7f77180d1d70 2024-05-27T12:33:13.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.288+0000 7f7716d9d640 1 --2- 172.21.15.55:0/2754710838 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f770406c8f0 0x7f770406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:13.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.288+0000 7f7716d9d640 1 --2- 172.21.15.55:0/2754710838 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f770406c8f0 0x7f770406edb0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f7708007fd0 tx=0x7f7708007e80 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:13.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.291+0000 7f76ff7fe640 1 -- 172.21.15.55:0/2754710838 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f771815fdf0 con 0x7f77180d1d70 2024-05-27T12:33:13.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.479+0000 7f771d136640 1 -- 172.21.15.55:0/2754710838 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f77180b49f0 con 0x7f77180d1d70 2024-05-27T12:33:13.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.480+0000 7f76ff7fe640 1 -- 172.21.15.55:0/2754710838 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) ==== 93+0+10 (secure 0 0 0) 0x7f770c07a190 con 0x7f77180d1d70 2024-05-27T12:33:13.479 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-05-27T12:33:13.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.481+0000 7f771d136640 1 -- 172.21.15.55:0/2754710838 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f770406c8f0 msgr2=0x7f770406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:13.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.481+0000 7f771d136640 1 --2- 172.21.15.55:0/2754710838 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f770406c8f0 0x7f770406edb0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f7708007fd0 tx=0x7f7708007e80 comp rx=0 tx=0).stop 2024-05-27T12:33:13.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.481+0000 7f771d136640 1 -- 172.21.15.55:0/2754710838 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f77180d1d70 msgr2=0x7f7718161920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:13.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.481+0000 7f771d136640 1 --2- 172.21.15.55:0/2754710838 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f77180d1d70 0x7f7718161920 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f770c0098c0 tx=0x7f770c0046c0 comp rx=0 tx=0).stop 2024-05-27T12:33:13.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.482+0000 7f771d136640 1 -- 172.21.15.55:0/2754710838 shutdown_connections 2024-05-27T12:33:13.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.482+0000 7f771d136640 1 --2- 172.21.15.55:0/2754710838 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f770406c8f0 0x7f770406edb0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:13.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.482+0000 7f771d136640 1 --2- 172.21.15.55:0/2754710838 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f771815eb00 0x7f7718153b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:13.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.482+0000 7f771d136640 1 --2- 172.21.15.55:0/2754710838 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f77180d1d70 0x7f7718161920 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:13.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.482+0000 7f771d136640 1 --2- 172.21.15.55:0/2754710838 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f77180cfb40 0x7f7718154960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:13.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.482+0000 7f771d136640 1 -- 172.21.15.55:0/2754710838 >> 172.21.15.55:0/2754710838 conn(0x7f7718067a50 msgr2=0x7f77180d2910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:13.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.482+0000 7f771d136640 1 -- 172.21.15.55:0/2754710838 shutdown_connections 2024-05-27T12:33:13.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.482+0000 7f771d136640 1 -- 172.21.15.55:0/2754710838 wait complete. 2024-05-27T12:33:13.492 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-27T12:33:13.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.600+0000 7fbe99119640 1 Processor -- start 2024-05-27T12:33:13.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.600+0000 7fbe99119640 1 -- start start 2024-05-27T12:33:13.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.601+0000 7fbe99119640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbe940cee90 0x7fbe940cf320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:13.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.601+0000 7fbe99119640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbe940c69b0 0x7fbe940c6e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:13.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.601+0000 7fbe99119640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe940cdb50 con 0x7fbe9415c750 2024-05-27T12:33:13.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.601+0000 7fbe99119640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7fbe940cde30 con 0x7fbe940cee90 2024-05-27T12:33:13.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.601+0000 7fbe99119640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fbe940ce110 con 0x7fbe940c69b0 2024-05-27T12:33:13.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.601+0000 7fbe9259c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbe940cee90 0x7fbe940cf320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:13.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.601+0000 7fbe92d9d640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fbe9415c750 0x7fbe940d0c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:48582/0 (socket says 172.21.15.55:48582) 2024-05-27T12:33:13.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.601+0000 7fbe92d9d640 1 -- 172.21.15.55:0/712272297 learned_addr learned my addr 172.21.15.55:0/712272297 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-27T12:33:13.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.602+0000 7fbe9259c640 1 -- 172.21.15.55:0/712272297 >> v2:172.21.15.72:3300/0 conn(0x7fbe940c69b0 msgr2=0x7fbe940c6e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:13.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.602+0000 7fbe9259c640 1 --2- 172.21.15.55:0/712272297 >> v2:172.21.15.72:3300/0 conn(0x7fbe940c69b0 0x7fbe940c6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:13.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.602+0000 7fbe9259c640 1 -- 172.21.15.55:0/712272297 >> v1:172.21.15.55:6789/0 conn(0x7fbe9415c750 legacy=0x7fbe940d0c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:13.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.602+0000 7fbe9259c640 1 -- 172.21.15.55:0/712272297 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe940ce3f0 con 0x7fbe940cee90 2024-05-27T12:33:13.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.602+0000 7fbe9259c640 1 --2- 172.21.15.55:0/712272297 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbe940cee90 0x7fbe940cf320 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fbe940c92d0 tx=0x7fbe7c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=651a1b39957bfb12 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:13.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.602+0000 7fbe91d9b640 1 -- 172.21.15.55:0/712272297 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe7c037070 con 0x7fbe940cee90 2024-05-27T12:33:13.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.603+0000 7fbe91d9b640 1 -- 172.21.15.55:0/712272297 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe7c032440 con 0x7fbe940cee90 2024-05-27T12:33:13.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.603+0000 7fbe91d9b640 1 -- 172.21.15.55:0/712272297 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe7c032810 con 0x7fbe940cee90 2024-05-27T12:33:13.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.603+0000 7fbe99119640 1 -- 172.21.15.55:0/712272297 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbe940cee90 msgr2=0x7fbe940cf320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:13.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.603+0000 7fbe99119640 1 --2- 172.21.15.55:0/712272297 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbe940cee90 0x7fbe940cf320 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fbe940c92d0 tx=0x7fbe7c02a1a0 comp rx=0 tx=0).stop 2024-05-27T12:33:13.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.603+0000 7fbe99119640 1 -- 172.21.15.55:0/712272297 shutdown_connections 2024-05-27T12:33:13.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.603+0000 7fbe99119640 1 --2- 172.21.15.55:0/712272297 >> v2:172.21.15.72:3300/0 conn(0x7fbe940c69b0 0x7fbe940c6e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:13.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.603+0000 7fbe99119640 1 --2- 172.21.15.55:0/712272297 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbe940cee90 0x7fbe940cf320 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:13.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.603+0000 7fbe99119640 1 -- 172.21.15.55:0/712272297 >> 172.21.15.55:0/712272297 conn(0x7fbe940d2660 msgr2=0x7fbe940d2a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:13.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.603+0000 7fbe99119640 1 -- 172.21.15.55:0/712272297 shutdown_connections 2024-05-27T12:33:13.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.603+0000 7fbe99119640 1 -- 172.21.15.55:0/712272297 wait complete. 2024-05-27T12:33:13.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.605+0000 7fbe99119640 1 Processor -- start 2024-05-27T12:33:13.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.605+0000 7fbe99119640 1 -- start start 2024-05-27T12:33:13.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.605+0000 7fbe99119640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbe940c69b0 0x7fbe9415ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:13.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.605+0000 7fbe99119640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbe940cee90 0x7fbe94152990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:13.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.605+0000 7fbe99119640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbe9415c750 0x7fbe94152ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:13.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.605+0000 7fbe99119640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7fbe940d1350 con 0x7fbe9415c750 2024-05-27T12:33:13.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.605+0000 7fbe99119640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fbe940c6490 con 0x7fbe940c69b0 2024-05-27T12:33:13.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.605+0000 7fbe99119640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fbe9415cb30 con 0x7fbe940cee90 2024-05-27T12:33:13.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.606+0000 7fbe9359e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbe9415c750 0x7fbe94152ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:13.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.606+0000 7fbe9359e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbe9415c750 0x7fbe94152ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44250/0 (socket says 172.21.15.55:44250) 2024-05-27T12:33:13.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.606+0000 7fbe9359e640 1 -- 172.21.15.55:0/4100036299 learned_addr learned my addr 172.21.15.55:0/4100036299 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:33:13.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.606+0000 7fbe92d9d640 1 --2- 172.21.15.55:0/4100036299 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbe940c69b0 0x7fbe9415ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:13.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.606+0000 7fbe9259c640 1 --2- 172.21.15.55:0/4100036299 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbe940cee90 0x7fbe94152990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:13.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.606+0000 7fbe9359e640 1 -- 172.21.15.55:0/4100036299 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbe940cee90 msgr2=0x7fbe94152990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:13.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.606+0000 7fbe9359e640 1 --2- 172.21.15.55:0/4100036299 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbe940cee90 0x7fbe94152990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:13.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.606+0000 7fbe9359e640 1 -- 172.21.15.55:0/4100036299 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbe940c69b0 msgr2=0x7fbe9415ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:13.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.606+0000 7fbe9359e640 1 --2- 172.21.15.55:0/4100036299 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbe940c69b0 0x7fbe9415ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:13.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.606+0000 7fbe9359e640 1 -- 172.21.15.55:0/4100036299 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe940b71d0 con 0x7fbe9415c750 2024-05-27T12:33:13.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.606+0000 7fbe9359e640 1 --2- 172.21.15.55:0/4100036299 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbe9415c750 0x7fbe94152ed0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fbe8400b970 tx=0x7fbe8400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:13.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.606+0000 7fbe8b7fe640 1 -- 172.21.15.55:0/4100036299 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe84019070 con 0x7fbe9415c750 2024-05-27T12:33:13.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.606+0000 7fbe8b7fe640 1 -- 172.21.15.55:0/4100036299 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe8400cb60 con 0x7fbe9415c750 2024-05-27T12:33:13.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.606+0000 7fbe99119640 1 -- 172.21.15.55:0/4100036299 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe940b74b0 con 0x7fbe9415c750 2024-05-27T12:33:13.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.606+0000 7fbe8b7fe640 1 -- 172.21.15.55:0/4100036299 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe84014440 con 0x7fbe9415c750 2024-05-27T12:33:13.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.606+0000 7fbe99119640 1 -- 172.21.15.55:0/4100036299 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe940b7a70 con 0x7fbe9415c750 2024-05-27T12:33:13.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.607+0000 7fbe99119640 1 -- 172.21.15.55:0/4100036299 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe940b8550 con 0x7fbe9415c750 2024-05-27T12:33:13.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.608+0000 7fbe8b7fe640 1 -- 172.21.15.55:0/4100036299 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbe8401c070 con 0x7fbe9415c750 2024-05-27T12:33:13.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.608+0000 7fbe8b7fe640 1 --2- 172.21.15.55:0/4100036299 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fbe7406c8f0 0x7fbe7406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:13.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.609+0000 7fbe8b7fe640 1 -- 172.21.15.55:0/4100036299 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fbe8408b810 con 0x7fbe9415c750 2024-05-27T12:33:13.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.609+0000 7fbe92d9d640 1 --2- 172.21.15.55:0/4100036299 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fbe7406c8f0 0x7fbe7406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:13.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.609+0000 7fbe92d9d640 1 --2- 172.21.15.55:0/4100036299 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fbe7406c8f0 0x7fbe7406edb0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c007fd0 tx=0x7fbe8c007e80 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:13.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.613+0000 7fbe8b7fe640 1 -- 172.21.15.55:0/4100036299 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fbe840595f0 con 0x7fbe9415c750 2024-05-27T12:33:13.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.800+0000 7fbe99119640 1 -- 172.21.15.55:0/4100036299 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fbe94075460 con 0x7fbe9415c750 2024-05-27T12:33:13.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.801+0000 7fbe8b7fe640 1 -- 172.21.15.55:0/4100036299 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) ==== 104+0+11 (secure 0 0 0) 0x7fbe8405d8f0 con 0x7fbe9415c750 2024-05-27T12:33:13.800 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2024-05-27T12:33:13.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.803+0000 7fbe99119640 1 -- 172.21.15.55:0/4100036299 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fbe7406c8f0 msgr2=0x7fbe7406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:13.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.803+0000 7fbe99119640 1 --2- 172.21.15.55:0/4100036299 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fbe7406c8f0 0x7fbe7406edb0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c007fd0 tx=0x7fbe8c007e80 comp rx=0 tx=0).stop 2024-05-27T12:33:13.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.803+0000 7fbe99119640 1 -- 172.21.15.55:0/4100036299 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbe9415c750 msgr2=0x7fbe94152ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:13.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.803+0000 7fbe99119640 1 --2- 172.21.15.55:0/4100036299 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbe9415c750 0x7fbe94152ed0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fbe8400b970 tx=0x7fbe8400be30 comp rx=0 tx=0).stop 2024-05-27T12:33:13.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.803+0000 7fbe99119640 1 -- 172.21.15.55:0/4100036299 shutdown_connections 2024-05-27T12:33:13.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.803+0000 7fbe99119640 1 --2- 172.21.15.55:0/4100036299 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbe9415c750 0x7fbe94152ed0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:13.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.803+0000 7fbe99119640 1 --2- 172.21.15.55:0/4100036299 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbe940cee90 0x7fbe94152990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:13.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.803+0000 7fbe99119640 1 --2- 172.21.15.55:0/4100036299 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fbe7406c8f0 0x7fbe7406edb0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:13.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.803+0000 7fbe99119640 1 --2- 172.21.15.55:0/4100036299 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbe940c69b0 0x7fbe9415ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:13.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.803+0000 7fbe99119640 1 -- 172.21.15.55:0/4100036299 >> 172.21.15.55:0/4100036299 conn(0x7fbe940d2660 msgr2=0x7fbe940c6e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:13.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.803+0000 7fbe99119640 1 -- 172.21.15.55:0/4100036299 shutdown_connections 2024-05-27T12:33:13.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.803+0000 7fbe99119640 1 -- 172.21.15.55:0/4100036299 wait complete. 2024-05-27T12:33:13.813 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-27T12:33:13.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.921+0000 7fc2750cb640 1 Processor -- start 2024-05-27T12:33:13.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.921+0000 7fc2750cb640 1 -- start start 2024-05-27T12:33:13.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.922+0000 7fc2750cb640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc270147920 0x7fc2700b2610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:13.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.922+0000 7fc2750cb640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc2700b2b50 0x7fc27006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:13.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.922+0000 7fc2750cb640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc27006bee0 0x7fc2700d1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:13.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.922+0000 7fc2750cb640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7fc2700b2fb0 con 0x7fc27006bee0 2024-05-27T12:33:13.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.922+0000 7fc2750cb640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fc2700cec30 con 0x7fc270147920 2024-05-27T12:33:13.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.922+0000 7fc2750cb640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fc27006c320 con 0x7fc2700b2b50 2024-05-27T12:33:13.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.922+0000 7fc26f59e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc27006bee0 0x7fc2700d1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:13.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.922+0000 7fc26f59e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc27006bee0 0x7fc2700d1520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44256/0 (socket says 172.21.15.55:44256) 2024-05-27T12:33:13.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.922+0000 7fc26f59e640 1 -- 172.21.15.55:0/1646615568 learned_addr learned my addr 172.21.15.55:0/1646615568 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:33:13.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.922+0000 7fc26ed9d640 1 --2- 172.21.15.55:0/1646615568 >> v2:172.21.15.72:3300/0 conn(0x7fc270147920 0x7fc2700b2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:13.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.922+0000 7fc267fff640 1 --2- 172.21.15.55:0/1646615568 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc2700b2b50 0x7fc27006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:13.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.922+0000 7fc26f59e640 1 -- 172.21.15.55:0/1646615568 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc2700b2b50 msgr2=0x7fc27006b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:13.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.922+0000 7fc26f59e640 1 --2- 172.21.15.55:0/1646615568 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc2700b2b50 0x7fc27006b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:13.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.922+0000 7fc26f59e640 1 -- 172.21.15.55:0/1646615568 >> v2:172.21.15.72:3300/0 conn(0x7fc270147920 msgr2=0x7fc2700b2610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:13.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.922+0000 7fc26f59e640 1 --2- 172.21.15.55:0/1646615568 >> v2:172.21.15.72:3300/0 conn(0x7fc270147920 0x7fc2700b2610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:13.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.922+0000 7fc26f59e640 1 -- 172.21.15.55:0/1646615568 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2700ce020 con 0x7fc27006bee0 2024-05-27T12:33:13.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.923+0000 7fc26f59e640 1 --2- 172.21.15.55:0/1646615568 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc27006bee0 0x7fc2700d1520 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fc2700c8680 tx=0x7fc26802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36fba858abe4f06d server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:13.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.923+0000 7fc26e59c640 1 -- 172.21.15.55:0/1646615568 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc268036070 con 0x7fc27006bee0 2024-05-27T12:33:13.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.923+0000 7fc26e59c640 1 -- 172.21.15.55:0/1646615568 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc268031600 con 0x7fc27006bee0 2024-05-27T12:33:13.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.923+0000 7fc26e59c640 1 -- 172.21.15.55:0/1646615568 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2680319d0 con 0x7fc27006bee0 2024-05-27T12:33:13.927 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.923+0000 7fc2750cb640 1 -- 172.21.15.55:0/1646615568 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc27006bee0 msgr2=0x7fc2700d1520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:13.927 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.923+0000 7fc2750cb640 1 --2- 172.21.15.55:0/1646615568 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc27006bee0 0x7fc2700d1520 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fc2700c8680 tx=0x7fc26802a6a0 comp rx=0 tx=0).stop 2024-05-27T12:33:13.927 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.924+0000 7fc2750cb640 1 -- 172.21.15.55:0/1646615568 shutdown_connections 2024-05-27T12:33:13.927 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.924+0000 7fc2750cb640 1 --2- 172.21.15.55:0/1646615568 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc27006bee0 0x7fc2700d1520 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:13.927 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.924+0000 7fc2750cb640 1 --2- 172.21.15.55:0/1646615568 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc2700b2b50 0x7fc27006b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:13.927 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.924+0000 7fc2750cb640 1 --2- 172.21.15.55:0/1646615568 >> v2:172.21.15.72:3300/0 conn(0x7fc270147920 0x7fc2700b2610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:13.927 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.924+0000 7fc2750cb640 1 -- 172.21.15.55:0/1646615568 >> 172.21.15.55:0/1646615568 conn(0x7fc2700734b0 msgr2=0x7fc27009aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:13.927 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.924+0000 7fc2750cb640 1 -- 172.21.15.55:0/1646615568 shutdown_connections 2024-05-27T12:33:13.927 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.924+0000 7fc2750cb640 1 -- 172.21.15.55:0/1646615568 wait complete. 2024-05-27T12:33:13.927 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.925+0000 7fc2750cb640 1 Processor -- start 2024-05-27T12:33:13.927 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.925+0000 7fc2750cb640 1 -- start start 2024-05-27T12:33:13.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.926+0000 7fc2750cb640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc27006bee0 0x7fc27015d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:13.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.926+0000 7fc2750cb640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc2700b2b50 0x7fc27009b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:13.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.926+0000 7fc2750cb640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc270147920 0x7fc27009bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:13.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.926+0000 7fc2750cb640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7fc2700ce8c0 con 0x7fc27006bee0 2024-05-27T12:33:13.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.926+0000 7fc2750cb640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fc2700ce5e0 con 0x7fc2700b2b50 2024-05-27T12:33:13.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.926+0000 7fc2750cb640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fc270147d00 con 0x7fc270147920 2024-05-27T12:33:13.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.926+0000 7fc26ed9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc27006bee0 0x7fc27015d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:13.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.926+0000 7fc26ed9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc27006bee0 0x7fc27015d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44264/0 (socket says 172.21.15.55:44264) 2024-05-27T12:33:13.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.926+0000 7fc26ed9d640 1 -- 172.21.15.55:0/2809390163 learned_addr learned my addr 172.21.15.55:0/2809390163 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:33:13.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.926+0000 7fc267fff640 1 --2- 172.21.15.55:0/2809390163 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc2700b2b50 0x7fc27009b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:13.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.926+0000 7fc26f59e640 1 --2- 172.21.15.55:0/2809390163 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc270147920 0x7fc27009bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:13.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.926+0000 7fc26ed9d640 1 -- 172.21.15.55:0/2809390163 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc270147920 msgr2=0x7fc27009bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:13.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.926+0000 7fc26ed9d640 1 --2- 172.21.15.55:0/2809390163 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc270147920 0x7fc27009bb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:13.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.926+0000 7fc26ed9d640 1 -- 172.21.15.55:0/2809390163 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc2700b2b50 msgr2=0x7fc27009b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:13.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.926+0000 7fc26ed9d640 1 --2- 172.21.15.55:0/2809390163 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc2700b2b50 0x7fc27009b620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:13.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.926+0000 7fc26ed9d640 1 -- 172.21.15.55:0/2809390163 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc27009e610 con 0x7fc27006bee0 2024-05-27T12:33:13.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.926+0000 7fc26ed9d640 1 --2- 172.21.15.55:0/2809390163 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc27006bee0 0x7fc27015d070 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fc26000d620 tx=0x7fc26000dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:13.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.926+0000 7fc2677fe640 1 -- 172.21.15.55:0/2809390163 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc26000b620 con 0x7fc27006bee0 2024-05-27T12:33:13.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.926+0000 7fc2677fe640 1 -- 172.21.15.55:0/2809390163 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc260019070 con 0x7fc27006bee0 2024-05-27T12:33:13.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.927+0000 7fc2750cb640 1 -- 172.21.15.55:0/2809390163 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc27009e8f0 con 0x7fc27006bee0 2024-05-27T12:33:13.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.927+0000 7fc2677fe640 1 -- 172.21.15.55:0/2809390163 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc26000ba00 con 0x7fc27006bee0 2024-05-27T12:33:13.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.927+0000 7fc2750cb640 1 -- 172.21.15.55:0/2809390163 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc27009eeb0 con 0x7fc27006bee0 2024-05-27T12:33:13.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.928+0000 7fc2750cb640 1 -- 172.21.15.55:0/2809390163 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc270068a70 con 0x7fc27006bee0 2024-05-27T12:33:13.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.928+0000 7fc2677fe640 1 -- 172.21.15.55:0/2809390163 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc26000bba0 con 0x7fc27006bee0 2024-05-27T12:33:13.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.928+0000 7fc2677fe640 1 --2- 172.21.15.55:0/2809390163 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fc25006c8f0 0x7fc25006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:13.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.929+0000 7fc2677fe640 1 -- 172.21.15.55:0/2809390163 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fc26008bf80 con 0x7fc27006bee0 2024-05-27T12:33:13.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.929+0000 7fc267fff640 1 --2- 172.21.15.55:0/2809390163 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fc25006c8f0 0x7fc25006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:13.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.929+0000 7fc267fff640 1 --2- 172.21.15.55:0/2809390163 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fc25006c8f0 0x7fc25006edb0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc270147070 tx=0x7fc258008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:13.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:13.933+0000 7fc2677fe640 1 -- 172.21.15.55:0/2809390163 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc26005a3b0 con 0x7fc27006bee0 2024-05-27T12:33:14.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.119+0000 7fc2750cb640 1 -- 172.21.15.55:0/2809390163 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fc27006f9e0 con 0x7fc27006bee0 2024-05-27T12:33:14.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.119+0000 7fc2677fe640 1 -- 172.21.15.55:0/2809390163 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) ==== 100+0+11 (secure 0 0 0) 0x7fc260059cb0 con 0x7fc27006bee0 2024-05-27T12:33:14.119 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2024-05-27T12:33:14.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.121+0000 7fc2750cb640 1 -- 172.21.15.55:0/2809390163 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fc25006c8f0 msgr2=0x7fc25006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:14.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.121+0000 7fc2750cb640 1 --2- 172.21.15.55:0/2809390163 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fc25006c8f0 0x7fc25006edb0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc270147070 tx=0x7fc258008040 comp rx=0 tx=0).stop 2024-05-27T12:33:14.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.121+0000 7fc2750cb640 1 -- 172.21.15.55:0/2809390163 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc27006bee0 msgr2=0x7fc27015d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:14.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.121+0000 7fc2750cb640 1 --2- 172.21.15.55:0/2809390163 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc27006bee0 0x7fc27015d070 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fc26000d620 tx=0x7fc26000dae0 comp rx=0 tx=0).stop 2024-05-27T12:33:14.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.121+0000 7fc2750cb640 1 -- 172.21.15.55:0/2809390163 shutdown_connections 2024-05-27T12:33:14.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.121+0000 7fc2750cb640 1 --2- 172.21.15.55:0/2809390163 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc270147920 0x7fc27009bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:14.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.121+0000 7fc2750cb640 1 --2- 172.21.15.55:0/2809390163 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fc25006c8f0 0x7fc25006edb0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:14.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.121+0000 7fc2750cb640 1 --2- 172.21.15.55:0/2809390163 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc2700b2b50 0x7fc27009b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:14.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.121+0000 7fc2750cb640 1 --2- 172.21.15.55:0/2809390163 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc27006bee0 0x7fc27015d070 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:14.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.121+0000 7fc2750cb640 1 -- 172.21.15.55:0/2809390163 >> 172.21.15.55:0/2809390163 conn(0x7fc2700734b0 msgr2=0x7fc270070930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:14.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.121+0000 7fc2750cb640 1 -- 172.21.15.55:0/2809390163 shutdown_connections 2024-05-27T12:33:14.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.121+0000 7fc2750cb640 1 -- 172.21.15.55:0/2809390163 wait complete. 2024-05-27T12:33:14.131 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_progress_bar_for_1_clone' 2024-05-27T12:33:14.235 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.235+0000 7f1ee015c640 1 Processor -- start 2024-05-27T12:33:14.235 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.236+0000 7f1ee015c640 1 -- start start 2024-05-27T12:33:14.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.236+0000 7f1ee015c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1ed80cfc90 0x7f1ed8067630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:14.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.236+0000 7f1ee015c640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ed815edf0 con 0x7f1ed80ba240 2024-05-27T12:33:14.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.236+0000 7f1ee015c640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ed8067d60 con 0x7f1ed815ea10 2024-05-27T12:33:14.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.236+0000 7f1ee015c640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f1ed8068040 con 0x7f1ed80cfc90 2024-05-27T12:33:14.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.237+0000 7f1ede6f9640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f1ed80ba240 0x7f1ed80d3340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:48588/0 (socket says 172.21.15.55:48588) 2024-05-27T12:33:14.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.236+0000 7f1edd6f7640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1ed80cfc90 0x7f1ed8067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:14.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.237+0000 7f1ede6f9640 1 -- 172.21.15.55:0/2873212180 learned_addr learned my addr 172.21.15.55:0/2873212180 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-27T12:33:14.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.237+0000 7f1edd6f7640 1 -- 172.21.15.55:0/2873212180 >> v1:172.21.15.72:6789/0 conn(0x7f1ed815ea10 legacy=0x7f1ed80cf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:14.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.237+0000 7f1edd6f7640 1 -- 172.21.15.55:0/2873212180 >> v1:172.21.15.55:6789/0 conn(0x7f1ed80ba240 legacy=0x7f1ed80d3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:14.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.237+0000 7f1edcef6640 1 -- 172.21.15.55:0/2873212180 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2681842935 0 0) 0x7f1ed815edf0 con 0x7f1ed80ba240 2024-05-27T12:33:14.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.237+0000 7f1edd6f7640 1 -- 172.21.15.55:0/2873212180 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ed8068320 con 0x7f1ed80cfc90 2024-05-27T12:33:14.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.238+0000 7f1edd6f7640 1 --2- 172.21.15.55:0/2873212180 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1ed80cfc90 0x7f1ed8067630 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f1ecc0097a0 tx=0x7f1ecc02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc7411be5ea571a8 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:14.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.238+0000 7f1edcef6640 1 -- 172.21.15.55:0/2873212180 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ecc037070 con 0x7f1ed80cfc90 2024-05-27T12:33:14.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.238+0000 7f1edcef6640 1 -- 172.21.15.55:0/2873212180 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ecc032440 con 0x7f1ed80cfc90 2024-05-27T12:33:14.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.238+0000 7f1edcef6640 1 -- 172.21.15.55:0/2873212180 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ecc032810 con 0x7f1ed80cfc90 2024-05-27T12:33:14.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.238+0000 7f1ee015c640 1 -- 172.21.15.55:0/2873212180 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1ed80cfc90 msgr2=0x7f1ed8067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:14.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.238+0000 7f1ee015c640 1 --2- 172.21.15.55:0/2873212180 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1ed80cfc90 0x7f1ed8067630 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f1ecc0097a0 tx=0x7f1ecc02a1a0 comp rx=0 tx=0).stop 2024-05-27T12:33:14.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.238+0000 7f1ee015c640 1 -- 172.21.15.55:0/2873212180 shutdown_connections 2024-05-27T12:33:14.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.238+0000 7f1ee015c640 1 --2- 172.21.15.55:0/2873212180 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1ed80cfc90 0x7f1ed8067630 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:14.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.238+0000 7f1ee015c640 1 -- 172.21.15.55:0/2873212180 >> 172.21.15.55:0/2873212180 conn(0x7f1ed80d1330 msgr2=0x7f1ed80d1740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:14.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.238+0000 7f1ee015c640 1 -- 172.21.15.55:0/2873212180 shutdown_connections 2024-05-27T12:33:14.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.239+0000 7f1ee015c640 1 -- 172.21.15.55:0/2873212180 wait complete. 2024-05-27T12:33:14.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.240+0000 7f1ee015c640 1 Processor -- start 2024-05-27T12:33:14.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.240+0000 7f1ee015c640 1 -- start start 2024-05-27T12:33:14.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.240+0000 7f1ee015c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ed80ba240 0x7f1ed80cd100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:14.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.240+0000 7f1ee015c640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1ed80cfc90 0x7f1ed8158f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:14.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.240+0000 7f1ee015c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1ed815ea10 0x7f1ed8159460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:14.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.240+0000 7f1ee015c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f1ed80d3e20 con 0x7f1ed815ea10 2024-05-27T12:33:14.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.240+0000 7f1ee015c640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f1ed80d3ca0 con 0x7f1ed80ba240 2024-05-27T12:33:14.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.240+0000 7f1ee015c640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f1ed80d3fa0 con 0x7f1ed80cfc90 2024-05-27T12:33:14.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.241+0000 7f1ede6f9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1ed815ea10 0x7f1ed8159460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:14.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.241+0000 7f1ede6f9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1ed815ea10 0x7f1ed8159460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44278/0 (socket says 172.21.15.55:44278) 2024-05-27T12:33:14.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.241+0000 7f1ede6f9640 1 -- 172.21.15.55:0/1437770313 learned_addr learned my addr 172.21.15.55:0/1437770313 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:33:14.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.241+0000 7f1eddef8640 1 --2- 172.21.15.55:0/1437770313 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ed80ba240 0x7f1ed80cd100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:14.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.241+0000 7f1ede6f9640 1 -- 172.21.15.55:0/1437770313 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1ed80cfc90 msgr2=0x7f1ed8158f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:14.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.241+0000 7f1edd6f7640 1 --2- 172.21.15.55:0/1437770313 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1ed80cfc90 0x7f1ed8158f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:14.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.241+0000 7f1ede6f9640 1 --2- 172.21.15.55:0/1437770313 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1ed80cfc90 0x7f1ed8158f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:14.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.241+0000 7f1ede6f9640 1 -- 172.21.15.55:0/1437770313 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ed80ba240 msgr2=0x7f1ed80cd100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:14.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.241+0000 7f1ede6f9640 1 --2- 172.21.15.55:0/1437770313 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ed80ba240 0x7f1ed80cd100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:14.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.241+0000 7f1ede6f9640 1 -- 172.21.15.55:0/1437770313 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ed8159b70 con 0x7f1ed815ea10 2024-05-27T12:33:14.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.241+0000 7f1eddef8640 1 --2- 172.21.15.55:0/1437770313 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ed80ba240 0x7f1ed80cd100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T12:33:14.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.241+0000 7f1ede6f9640 1 --2- 172.21.15.55:0/1437770313 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1ed815ea10 0x7f1ed8159460 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f1ec800c7a0 tx=0x7f1ec800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:14.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.241+0000 7f1ed67fc640 1 -- 172.21.15.55:0/1437770313 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ec8018070 con 0x7f1ed815ea10 2024-05-27T12:33:14.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.241+0000 7f1ed67fc640 1 -- 172.21.15.55:0/1437770313 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ec800a640 con 0x7f1ed815ea10 2024-05-27T12:33:14.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.241+0000 7f1ee015c640 1 -- 172.21.15.55:0/1437770313 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ed81f4b80 con 0x7f1ed815ea10 2024-05-27T12:33:14.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.241+0000 7f1ed67fc640 1 -- 172.21.15.55:0/1437770313 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ec800aab0 con 0x7f1ed815ea10 2024-05-27T12:33:14.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.241+0000 7f1ee015c640 1 -- 172.21.15.55:0/1437770313 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ed81f5140 con 0x7f1ed815ea10 2024-05-27T12:33:14.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.242+0000 7f1ee015c640 1 -- 172.21.15.55:0/1437770313 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ed8075460 con 0x7f1ed815ea10 2024-05-27T12:33:14.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.243+0000 7f1ed67fc640 1 -- 172.21.15.55:0/1437770313 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1ec801b070 con 0x7f1ed815ea10 2024-05-27T12:33:14.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.243+0000 7f1ed67fc640 1 --2- 172.21.15.55:0/1437770313 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f1ec406c8f0 0x7f1ec406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:14.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.243+0000 7f1ed67fc640 1 -- 172.21.15.55:0/1437770313 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f1ec808b180 con 0x7f1ed815ea10 2024-05-27T12:33:14.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.243+0000 7f1eddef8640 1 --2- 172.21.15.55:0/1437770313 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f1ec406c8f0 0x7f1ec406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:14.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.244+0000 7f1eddef8640 1 --2- 172.21.15.55:0/1437770313 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f1ec406c8f0 0x7f1ec406edb0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1ed81f7dd0 tx=0x7f1ed0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:14.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.248+0000 7f1ed67fc640 1 -- 172.21.15.55:0/1437770313 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f1ec80595b0 con 0x7f1ed815ea10 2024-05-27T12:33:14.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.509+0000 7f1ee015c640 1 -- 172.21.15.55:0/1437770313 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_progress_bar_for_1_clone"]} v 0) -- 0x7f1ed80cb210 con 0x7f1ed815ea10 2024-05-27T12:33:14.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.535+0000 7f1ed67fc640 1 -- 172.21.15.55:0/1437770313 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_progress_bar_for_1_clone"]}]=0 v51) ==== 163+0+0 (secure 0 0 0) 0x7f1ec8058eb0 con 0x7f1ed815ea10 2024-05-27T12:33:14.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.537+0000 7f1ee015c640 1 -- 172.21.15.55:0/1437770313 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f1ec406c8f0 msgr2=0x7f1ec406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:14.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.537+0000 7f1ee015c640 1 --2- 172.21.15.55:0/1437770313 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f1ec406c8f0 0x7f1ec406edb0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1ed81f7dd0 tx=0x7f1ed0009040 comp rx=0 tx=0).stop 2024-05-27T12:33:14.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.537+0000 7f1ee015c640 1 -- 172.21.15.55:0/1437770313 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1ed815ea10 msgr2=0x7f1ed8159460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:14.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.537+0000 7f1ee015c640 1 --2- 172.21.15.55:0/1437770313 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1ed815ea10 0x7f1ed8159460 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f1ec800c7a0 tx=0x7f1ec800cc60 comp rx=0 tx=0).stop 2024-05-27T12:33:14.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.537+0000 7f1ee015c640 1 -- 172.21.15.55:0/1437770313 shutdown_connections 2024-05-27T12:33:14.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.537+0000 7f1ee015c640 1 --2- 172.21.15.55:0/1437770313 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1ed815ea10 0x7f1ed8159460 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:14.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.537+0000 7f1ee015c640 1 --2- 172.21.15.55:0/1437770313 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1ed80cfc90 0x7f1ed8158f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:14.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.537+0000 7f1ee015c640 1 --2- 172.21.15.55:0/1437770313 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f1ec406c8f0 0x7f1ec406edb0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:14.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.537+0000 7f1ee015c640 1 --2- 172.21.15.55:0/1437770313 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ed80ba240 0x7f1ed80cd100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:14.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.537+0000 7f1ee015c640 1 -- 172.21.15.55:0/1437770313 >> 172.21.15.55:0/1437770313 conn(0x7f1ed80d1330 msgr2=0x7f1ed815dc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:14.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.537+0000 7f1ee015c640 1 -- 172.21.15.55:0/1437770313 shutdown_connections 2024-05-27T12:33:14.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.537+0000 7f1ee015c640 1 -- 172.21.15.55:0/1437770313 wait complete. 2024-05-27T12:33:14.547 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-05-27T12:33:14.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.655+0000 7fc46e667640 1 Processor -- start 2024-05-27T12:33:14.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.655+0000 7fc46e667640 1 -- start start 2024-05-27T12:33:14.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.656+0000 7fc46e667640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc468146060 0x7fc4680b3f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:14.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.656+0000 7fc46e667640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc46806c040 0x7fc468072010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:14.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.656+0000 7fc46e667640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc46815cfd0 con 0x7fc4680cd8a0 2024-05-27T12:33:14.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.656+0000 7fc46e667640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7fc46815dbe0 con 0x7fc46806c040 2024-05-27T12:33:14.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.656+0000 7fc46e667640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fc46815d2b0 con 0x7fc468146060 2024-05-27T12:33:14.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.656+0000 7fc4677fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fc4680cd8a0 0x7fc46806b930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:48600/0 (socket says 172.21.15.55:48600) 2024-05-27T12:33:14.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.656+0000 7fc4677fe640 1 -- 172.21.15.55:0/260744809 learned_addr learned my addr 172.21.15.55:0/260744809 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-27T12:33:14.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.656+0000 7fc46cc04640 1 --2- 172.21.15.55:0/260744809 >> v2:172.21.15.55:3300/0 conn(0x7fc46806c040 0x7fc468072010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:14.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.656+0000 7fc467fff640 1 --2- 172.21.15.55:0/260744809 >> v2:172.21.15.72:3300/0 conn(0x7fc468146060 0x7fc4680b3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:14.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.656+0000 7fc466ffd640 1 -- 172.21.15.55:0/260744809 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 38371380 0 0) 0x7fc46815cfd0 con 0x7fc4680cd8a0 2024-05-27T12:33:14.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.656+0000 7fc466ffd640 1 -- 172.21.15.55:0/260744809 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc450003520 con 0x7fc4680cd8a0 2024-05-27T12:33:14.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.656+0000 7fc46cc04640 1 -- 172.21.15.55:0/260744809 >> v2:172.21.15.72:3300/0 conn(0x7fc468146060 msgr2=0x7fc4680b3f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:14.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.656+0000 7fc46cc04640 1 --2- 172.21.15.55:0/260744809 >> v2:172.21.15.72:3300/0 conn(0x7fc468146060 0x7fc4680b3f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:14.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.656+0000 7fc46cc04640 1 -- 172.21.15.55:0/260744809 >> v1:172.21.15.55:6789/0 conn(0x7fc4680cd8a0 legacy=0x7fc46806b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:14.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.656+0000 7fc46cc04640 1 -- 172.21.15.55:0/260744809 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc46815d590 con 0x7fc46806c040 2024-05-27T12:33:14.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.656+0000 7fc467fff640 1 --2- 172.21.15.55:0/260744809 >> v2:172.21.15.72:3300/0 conn(0x7fc468146060 0x7fc4680b3f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T12:33:14.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.657+0000 7fc46cc04640 1 --2- 172.21.15.55:0/260744809 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc46806c040 0x7fc468072010 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fc4680b5c30 tx=0x7fc46002a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6665f7dfc77cc4c server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:14.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.657+0000 7fc466ffd640 1 -- 172.21.15.55:0/260744809 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc460007740 con 0x7fc46806c040 2024-05-27T12:33:14.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.657+0000 7fc466ffd640 1 -- 172.21.15.55:0/260744809 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4600078e0 con 0x7fc46806c040 2024-05-27T12:33:14.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.657+0000 7fc466ffd640 1 -- 172.21.15.55:0/260744809 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc460007cb0 con 0x7fc46806c040 2024-05-27T12:33:14.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.658+0000 7fc46e667640 1 -- 172.21.15.55:0/260744809 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc46806c040 msgr2=0x7fc468072010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:14.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.658+0000 7fc46e667640 1 --2- 172.21.15.55:0/260744809 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc46806c040 0x7fc468072010 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fc4680b5c30 tx=0x7fc46002a680 comp rx=0 tx=0).stop 2024-05-27T12:33:14.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.658+0000 7fc46e667640 1 -- 172.21.15.55:0/260744809 shutdown_connections 2024-05-27T12:33:14.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.658+0000 7fc46e667640 1 --2- 172.21.15.55:0/260744809 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc46806c040 0x7fc468072010 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:14.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.658+0000 7fc46e667640 1 --2- 172.21.15.55:0/260744809 >> v2:172.21.15.72:3300/0 conn(0x7fc468146060 0x7fc4680b3f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:14.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.658+0000 7fc46e667640 1 -- 172.21.15.55:0/260744809 >> 172.21.15.55:0/260744809 conn(0x7fc4680b2240 msgr2=0x7fc4680b2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:14.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.658+0000 7fc46e667640 1 -- 172.21.15.55:0/260744809 shutdown_connections 2024-05-27T12:33:14.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.658+0000 7fc46e667640 1 -- 172.21.15.55:0/260744809 wait complete. 2024-05-27T12:33:14.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.659+0000 7fc46e667640 1 Processor -- start 2024-05-27T12:33:14.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.659+0000 7fc46e667640 1 -- start start 2024-05-27T12:33:14.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.660+0000 7fc46e667640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc46806c040 0x7fc4681f81d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:14.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.660+0000 7fc46e667640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc4680cd8a0 0x7fc46806de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:14.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.660+0000 7fc46e667640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc468146060 0x7fc4680b15e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:14.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.660+0000 7fc46e667640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7fc4680d0110 con 0x7fc468146060 2024-05-27T12:33:14.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.660+0000 7fc46e667640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fc468146440 con 0x7fc46806c040 2024-05-27T12:33:14.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.660+0000 7fc46e667640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fc4680cdd30 con 0x7fc4680cd8a0 2024-05-27T12:33:14.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.660+0000 7fc46cc04640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc468146060 0x7fc4680b15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:14.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.660+0000 7fc46cc04640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc468146060 0x7fc4680b15e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44284/0 (socket says 172.21.15.55:44284) 2024-05-27T12:33:14.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.660+0000 7fc46cc04640 1 -- 172.21.15.55:0/3944182055 learned_addr learned my addr 172.21.15.55:0/3944182055 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:33:14.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.660+0000 7fc467fff640 1 --2- 172.21.15.55:0/3944182055 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc46806c040 0x7fc4681f81d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:14.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.660+0000 7fc4677fe640 1 --2- 172.21.15.55:0/3944182055 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc4680cd8a0 0x7fc46806de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:14.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.660+0000 7fc46cc04640 1 -- 172.21.15.55:0/3944182055 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc4680cd8a0 msgr2=0x7fc46806de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:14.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.660+0000 7fc46cc04640 1 --2- 172.21.15.55:0/3944182055 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc4680cd8a0 0x7fc46806de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:14.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.660+0000 7fc46cc04640 1 -- 172.21.15.55:0/3944182055 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc46806c040 msgr2=0x7fc4681f81d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:14.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.660+0000 7fc46cc04640 1 --2- 172.21.15.55:0/3944182055 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc46806c040 0x7fc4681f81d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:14.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.660+0000 7fc46cc04640 1 -- 172.21.15.55:0/3944182055 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4680b1b20 con 0x7fc468146060 2024-05-27T12:33:14.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.661+0000 7fc46cc04640 1 --2- 172.21.15.55:0/3944182055 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc468146060 0x7fc4680b15e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fc46002ac70 tx=0x7fc460004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:14.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.661+0000 7fc464ff9640 1 -- 172.21.15.55:0/3944182055 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc460040070 con 0x7fc468146060 2024-05-27T12:33:14.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.661+0000 7fc464ff9640 1 -- 172.21.15.55:0/3944182055 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc460031c60 con 0x7fc468146060 2024-05-27T12:33:14.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.661+0000 7fc46e667640 1 -- 172.21.15.55:0/3944182055 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc46806e4f0 con 0x7fc468146060 2024-05-27T12:33:14.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.661+0000 7fc464ff9640 1 -- 172.21.15.55:0/3944182055 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc460009450 con 0x7fc468146060 2024-05-27T12:33:14.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.661+0000 7fc46e667640 1 -- 172.21.15.55:0/3944182055 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc46806eab0 con 0x7fc468146060 2024-05-27T12:33:14.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.662+0000 7fc46e667640 1 -- 172.21.15.55:0/3944182055 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc468068a70 con 0x7fc468146060 2024-05-27T12:33:14.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.662+0000 7fc464ff9640 1 -- 172.21.15.55:0/3944182055 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc460039040 con 0x7fc468146060 2024-05-27T12:33:14.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.663+0000 7fc464ff9640 1 --2- 172.21.15.55:0/3944182055 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fc45406c8f0 0x7fc45406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:14.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.663+0000 7fc464ff9640 1 -- 172.21.15.55:0/3944182055 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fc4600acef0 con 0x7fc468146060 2024-05-27T12:33:14.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.663+0000 7fc467fff640 1 --2- 172.21.15.55:0/3944182055 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fc45406c8f0 0x7fc45406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:14.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.663+0000 7fc467fff640 1 --2- 172.21.15.55:0/3944182055 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fc45406c8f0 0x7fc45406edb0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc4680ab0f0 tx=0x7fc458008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:14.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.667+0000 7fc464ff9640 1 -- 172.21.15.55:0/3944182055 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc4680b1b20 con 0x7fc468146060 2024-05-27T12:33:14.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.852+0000 7fc46e667640 1 -- 172.21.15.55:0/3944182055 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fc46806c660 con 0x7fc468146060 2024-05-27T12:33:14.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.855+0000 7fc464ff9640 1 -- 172.21.15.55:0/3944182055 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7fc46806c660 con 0x7fc468146060 2024-05-27T12:33:14.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.857+0000 7fc46e667640 1 -- 172.21.15.55:0/3944182055 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fc45406c8f0 msgr2=0x7fc45406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:14.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.857+0000 7fc46e667640 1 --2- 172.21.15.55:0/3944182055 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fc45406c8f0 0x7fc45406edb0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc4680ab0f0 tx=0x7fc458008040 comp rx=0 tx=0).stop 2024-05-27T12:33:14.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.857+0000 7fc46e667640 1 -- 172.21.15.55:0/3944182055 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc468146060 msgr2=0x7fc4680b15e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:14.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.857+0000 7fc46e667640 1 --2- 172.21.15.55:0/3944182055 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc468146060 0x7fc4680b15e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fc46002ac70 tx=0x7fc460004a40 comp rx=0 tx=0).stop 2024-05-27T12:33:14.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.857+0000 7fc46e667640 1 -- 172.21.15.55:0/3944182055 shutdown_connections 2024-05-27T12:33:14.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.857+0000 7fc46e667640 1 --2- 172.21.15.55:0/3944182055 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc468146060 0x7fc4680b15e0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:14.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.857+0000 7fc46e667640 1 --2- 172.21.15.55:0/3944182055 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc4680cd8a0 0x7fc46806de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:14.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.857+0000 7fc46e667640 1 --2- 172.21.15.55:0/3944182055 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fc45406c8f0 0x7fc45406edb0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:14.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.857+0000 7fc46e667640 1 --2- 172.21.15.55:0/3944182055 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc46806c040 0x7fc4681f81d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:14.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.857+0000 7fc46e667640 1 -- 172.21.15.55:0/3944182055 >> 172.21.15.55:0/3944182055 conn(0x7fc4680b2240 msgr2=0x7fc4680d0290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:14.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.858+0000 7fc46e667640 1 -- 172.21.15.55:0/3944182055 shutdown_connections 2024-05-27T12:33:14.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:14.858+0000 7fc46e667640 1 -- 172.21.15.55:0/3944182055 wait complete. 2024-05-27T12:33:14.868 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-05-27T12:33:14.868 DEBUG:teuthology.orchestra.run.smithi055:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-27T12:33:14.905 DEBUG:teuthology.orchestra.run.smithi072:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-27T12:33:14.960 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-05-27T12:33:14.960 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-05-27T12:33:14.961 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-27T12:33:14.977 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-05-27T12:33:14.977 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-27T12:33:15.034 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-05-27T12:33:15.034 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-27T12:33:15.090 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-27T12:33:15.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.234+0000 7ff888a83640 1 Processor -- start 2024-05-27T12:33:15.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.234+0000 7ff888a83640 1 -- start start 2024-05-27T12:33:15.234 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.235+0000 7ff888a83640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff8840d1990 0x7ff884169740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:15.234 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.235+0000 7ff888a83640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8840d3280 con 0x7ff8840ba5e0 2024-05-27T12:33:15.234 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.235+0000 7ff888a83640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8840d3560 con 0x7ff88415eaf0 2024-05-27T12:33:15.234 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.235+0000 7ff888a83640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7ff8840b89d0 con 0x7ff8840d1990 2024-05-27T12:33:15.235 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.235+0000 7ff881d9b640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7ff8840ba5e0 0x7ff8840d1280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:48606/0 (socket says 172.21.15.55:48606) 2024-05-27T12:33:15.235 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.235+0000 7ff881d9b640 1 -- 172.21.15.55:0/2315942442 learned_addr learned my addr 172.21.15.55:0/2315942442 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-27T12:33:15.235 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.235+0000 7ff88159a640 1 -- 172.21.15.55:0/2315942442 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3958503461 0 0) 0x7ff8840d3280 con 0x7ff8840ba5e0 2024-05-27T12:33:15.235 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.235+0000 7ff88159a640 1 -- 172.21.15.55:0/2315942442 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff870003520 con 0x7ff8840ba5e0 2024-05-27T12:33:15.235 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.235+0000 7ff882d9d640 1 --2- 172.21.15.55:0/2315942442 >> v2:172.21.15.72:3300/0 conn(0x7ff8840d1990 0x7ff884169740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:15.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.236+0000 7ff88159a640 1 -- 172.21.15.55:0/2315942442 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 131244412 0 0) 0x7ff870003520 con 0x7ff8840ba5e0 2024-05-27T12:33:15.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.236+0000 7ff88159a640 1 -- 172.21.15.55:0/2315942442 >> v2:172.21.15.72:3300/0 conn(0x7ff8840d1990 msgr2=0x7ff884169740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:15.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.236+0000 7ff88159a640 1 --2- 172.21.15.55:0/2315942442 >> v2:172.21.15.72:3300/0 conn(0x7ff8840d1990 0x7ff884169740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:15.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.236+0000 7ff88159a640 1 -- 172.21.15.55:0/2315942442 >> v1:172.21.15.72:6789/0 conn(0x7ff88415eaf0 legacy=0x7ff8840d2910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:15.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.236+0000 7ff88159a640 1 -- 172.21.15.55:0/2315942442 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8840d3840 con 0x7ff8840ba5e0 2024-05-27T12:33:15.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.236+0000 7ff88159a640 1 -- 172.21.15.55:0/2315942442 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 793017739 0 0) 0x7ff86c001670 con 0x7ff8840ba5e0 2024-05-27T12:33:15.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.236+0000 7ff88159a640 1 -- 172.21.15.55:0/2315942442 >> v1:172.21.15.55:6789/0 conn(0x7ff8840ba5e0 legacy=0x7ff8840d1280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:15.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.236+0000 7ff88159a640 1 --2- 172.21.15.55:0/2315942442 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff870003a90 0x7ff870003eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:15.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.236+0000 7ff88159a640 1 --2- 172.21.15.55:0/2315942442 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff870004800 0x7ff870004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:15.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.236+0000 7ff88159a640 1 --2- 172.21.15.55:0/2315942442 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff870005210 0x7ff87000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:15.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.236+0000 7ff88159a640 1 -- 172.21.15.55:0/2315942442 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7ff8840b89d0 con 0x7ff870003a90 2024-05-27T12:33:15.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.236+0000 7ff88159a640 1 -- 172.21.15.55:0/2315942442 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7ff87000c120 con 0x7ff870004800 2024-05-27T12:33:15.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.236+0000 7ff88159a640 1 -- 172.21.15.55:0/2315942442 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7ff87000c320 con 0x7ff870005210 2024-05-27T12:33:15.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.236+0000 7ff88259c640 1 --2- 172.21.15.55:0/2315942442 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff870003a90 0x7ff870003eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:15.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.236+0000 7ff881d9b640 1 --2- 172.21.15.55:0/2315942442 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff870004800 0x7ff870004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:15.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.236+0000 7ff882d9d640 1 --2- 172.21.15.55:0/2315942442 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff870005210 0x7ff87000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:15.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.236+0000 7ff88259c640 1 -- 172.21.15.55:0/2315942442 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff870005210 msgr2=0x7ff87000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:15.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.236+0000 7ff88259c640 1 --2- 172.21.15.55:0/2315942442 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff870005210 0x7ff87000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:15.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.236+0000 7ff88259c640 1 -- 172.21.15.55:0/2315942442 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff870004800 msgr2=0x7ff870004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:15.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.236+0000 7ff88259c640 1 --2- 172.21.15.55:0/2315942442 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff870004800 0x7ff870004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:15.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.236+0000 7ff88259c640 1 -- 172.21.15.55:0/2315942442 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff870003520 con 0x7ff870003a90 2024-05-27T12:33:15.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.236+0000 7ff882d9d640 1 --2- 172.21.15.55:0/2315942442 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff870005210 0x7ff87000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T12:33:15.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.236+0000 7ff882d9d640 1 -- 172.21.15.55:0/2315942442 reap_dead start 2024-05-27T12:33:15.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.237+0000 7ff88259c640 1 --2- 172.21.15.55:0/2315942442 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff870003a90 0x7ff870003eb0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ff874001e50 tx=0x7ff870005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20d5f2b8f90d37cf server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:15.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.237+0000 7ff88159a640 1 -- 172.21.15.55:0/2315942442 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff874001a70 con 0x7ff870003a90 2024-05-27T12:33:15.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.237+0000 7ff88159a640 1 -- 172.21.15.55:0/2315942442 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff87402ae40 con 0x7ff870003a90 2024-05-27T12:33:15.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.237+0000 7ff88159a640 1 -- 172.21.15.55:0/2315942442 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff874003bb0 con 0x7ff870003a90 2024-05-27T12:33:15.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.237+0000 7ff888a83640 1 -- 172.21.15.55:0/2315942442 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff870003a90 msgr2=0x7ff870003eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:15.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.238+0000 7ff888a83640 1 --2- 172.21.15.55:0/2315942442 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff870003a90 0x7ff870003eb0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ff874001e50 tx=0x7ff870005830 comp rx=0 tx=0).stop 2024-05-27T12:33:15.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.238+0000 7ff888a83640 1 -- 172.21.15.55:0/2315942442 shutdown_connections 2024-05-27T12:33:15.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.238+0000 7ff888a83640 1 --2- 172.21.15.55:0/2315942442 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff870003a90 0x7ff870003eb0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:15.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.238+0000 7ff888a83640 1 -- 172.21.15.55:0/2315942442 >> 172.21.15.55:0/2315942442 conn(0x7ff88406cdb0 msgr2=0x7ff88406d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:15.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.238+0000 7ff888a83640 1 -- 172.21.15.55:0/2315942442 shutdown_connections 2024-05-27T12:33:15.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.238+0000 7ff888a83640 1 -- 172.21.15.55:0/2315942442 wait complete. 2024-05-27T12:33:15.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.239+0000 7ff888a83640 1 Processor -- start 2024-05-27T12:33:15.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.239+0000 7ff888a83640 1 -- start start 2024-05-27T12:33:15.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.240+0000 7ff888a83640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff870003a90 0x7ff8840ca960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:15.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.240+0000 7ff888a83640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff884149270 0x7ff8841496b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:15.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.240+0000 7ff888a83640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff884145d00 0x7ff884146180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:15.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.240+0000 7ff888a83640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7ff88415eed0 con 0x7ff870003a90 2024-05-27T12:33:15.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.240+0000 7ff888a83640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7ff8840d3e90 con 0x7ff884149270 2024-05-27T12:33:15.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.240+0000 7ff888a83640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7ff88415f050 con 0x7ff884145d00 2024-05-27T12:33:15.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.240+0000 7ff88259c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff870003a90 0x7ff8840ca960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:15.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.240+0000 7ff88259c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff870003a90 0x7ff8840ca960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44304/0 (socket says 172.21.15.55:44304) 2024-05-27T12:33:15.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.240+0000 7ff88259c640 1 -- 172.21.15.55:0/1205492975 learned_addr learned my addr 172.21.15.55:0/1205492975 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:33:15.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.240+0000 7ff881d9b640 1 --2- 172.21.15.55:0/1205492975 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff884149270 0x7ff8841496b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:15.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.240+0000 7ff882d9d640 1 --2- 172.21.15.55:0/1205492975 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff884145d00 0x7ff884146180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:15.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.240+0000 7ff88259c640 1 -- 172.21.15.55:0/1205492975 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff884145d00 msgr2=0x7ff884146180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:15.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.240+0000 7ff88259c640 1 --2- 172.21.15.55:0/1205492975 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff884145d00 0x7ff884146180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:15.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.240+0000 7ff88259c640 1 -- 172.21.15.55:0/1205492975 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff884149270 msgr2=0x7ff8841496b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:15.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.240+0000 7ff88259c640 1 --2- 172.21.15.55:0/1205492975 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff884149270 0x7ff8841496b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:15.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.240+0000 7ff88259c640 1 -- 172.21.15.55:0/1205492975 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8841466c0 con 0x7ff870003a90 2024-05-27T12:33:15.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.240+0000 7ff881d9b640 1 --2- 172.21.15.55:0/1205492975 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff884149270 0x7ff8841496b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T12:33:15.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.241+0000 7ff88259c640 1 --2- 172.21.15.55:0/1205492975 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff870003a90 0x7ff8840ca960 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ff874000f80 tx=0x7ff8740014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:15.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.241+0000 7ff87affd640 1 -- 172.21.15.55:0/1205492975 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff87402ac40 con 0x7ff870003a90 2024-05-27T12:33:15.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.241+0000 7ff87affd640 1 -- 172.21.15.55:0/1205492975 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8740050d0 con 0x7ff870003a90 2024-05-27T12:33:15.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.241+0000 7ff87affd640 1 -- 172.21.15.55:0/1205492975 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8740054a0 con 0x7ff870003a90 2024-05-27T12:33:15.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.241+0000 7ff888a83640 1 -- 172.21.15.55:0/1205492975 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff884156a40 con 0x7ff870003a90 2024-05-27T12:33:15.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.241+0000 7ff888a83640 1 -- 172.21.15.55:0/1205492975 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8840ca160 con 0x7ff870003a90 2024-05-27T12:33:15.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.242+0000 7ff888a83640 1 -- 172.21.15.55:0/1205492975 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8840d4440 con 0x7ff870003a90 2024-05-27T12:33:15.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.242+0000 7ff87affd640 1 -- 172.21.15.55:0/1205492975 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff87403a070 con 0x7ff870003a90 2024-05-27T12:33:15.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.243+0000 7ff87affd640 1 --2- 172.21.15.55:0/1205492975 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7ff86406c920 0x7ff86406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:15.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.243+0000 7ff87affd640 1 -- 172.21.15.55:0/1205492975 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7ff8740abed0 con 0x7ff870003a90 2024-05-27T12:33:15.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.243+0000 7ff881d9b640 1 --2- 172.21.15.55:0/1205492975 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7ff86406c920 0x7ff86406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:15.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.243+0000 7ff881d9b640 1 --2- 172.21.15.55:0/1205492975 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7ff86406c920 0x7ff86406ede0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff8840b9800 tx=0x7ff86c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:15.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.247+0000 7ff87affd640 1 -- 172.21.15.55:0/1205492975 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff8840d4440 con 0x7ff870003a90 2024-05-27T12:33:15.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.437+0000 7ff888a83640 1 -- 172.21.15.55:0/1205492975 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff884075460 con 0x7ff870003a90 2024-05-27T12:33:15.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.438+0000 7ff87affd640 1 -- 172.21.15.55:0/1205492975 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16557 (secure 0 0 0) 0x7ff87407a350 con 0x7ff870003a90 2024-05-27T12:33:15.437 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-27T12:33:15.438 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":23,"fsid":"c3ff4e3b-8dae-4856-9593-e5cc66c59982","created":"2024-05-27T12:32:17.019097+0000","modified":"2024-05-27T12:32:43.361598+0000","last_up_change":"2024-05-27T12:32:28.109744+0000","last_in_change":"2024-05-27T12:32:19.309872+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-27T12:32:29.277895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-27T12:32:39.442745+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-27T12:32:40.672118+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e607b598-061b-4b6f-92ff-95c20b330599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":807572567},{"type":"v1","addr":"172.21.15.55:6801","nonce":807572567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":807572567},{"type":"v1","addr":"172.21.15.55:6803","nonce":807572567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":807572567},{"type":"v1","addr":"172.21.15.55:6807","nonce":807572567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":807572567},{"type":"v1","addr":"172.21.15.55:6805","nonce":807572567}]},"public_addr":"172.21.15.55:6801/807572567","cluster_addr":"172.21.15.55:6803/807572567","heartbeat_back_addr":"172.21.15.55:6807/807572567","heartbeat_front_addr":"172.21.15.55:6805/807572567","state":["exists","up"]},{"osd":1,"uuid":"ba2b5b1d-71a9-4ecc-9a48-55aa7fe54261","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":3426897300},{"type":"v1","addr":"172.21.15.55:6825","nonce":3426897300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":3426897300},{"type":"v1","addr":"172.21.15.55:6827","nonce":3426897300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":3426897300},{"type":"v1","addr":"172.21.15.55:6831","nonce":3426897300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":3426897300},{"type":"v1","addr":"172.21.15.55:6829","nonce":3426897300}]},"public_addr":"172.21.15.55:6825/3426897300","cluster_addr":"172.21.15.55:6827/3426897300","heartbeat_back_addr":"172.21.15.55:6831/3426897300","heartbeat_front_addr":"172.21.15.55:6829/3426897300","state":["exists","up"]},{"osd":2,"uuid":"e6b81cc6-4ff1-45d0-87eb-9f04ccf986a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3510271725},{"type":"v1","addr":"172.21.15.55:6809","nonce":3510271725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3510271725},{"type":"v1","addr":"172.21.15.55:6811","nonce":3510271725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3510271725},{"type":"v1","addr":"172.21.15.55:6815","nonce":3510271725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3510271725},{"type":"v1","addr":"172.21.15.55:6813","nonce":3510271725}]},"public_addr":"172.21.15.55:6809/3510271725","cluster_addr":"172.21.15.55:6811/3510271725","heartbeat_back_addr":"172.21.15.55:6815/3510271725","heartbeat_front_addr":"172.21.15.55:6813/3510271725","state":["exists","up"]},{"osd":3,"uuid":"b6a34b75-807d-4693-b1c3-903cb4c618d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":1066693520},{"type":"v1","addr":"172.21.15.55:6817","nonce":1066693520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":1066693520},{"type":"v1","addr":"172.21.15.55:6819","nonce":1066693520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":1066693520},{"type":"v1","addr":"172.21.15.55:6823","nonce":1066693520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":1066693520},{"type":"v1","addr":"172.21.15.55:6821","nonce":1066693520}]},"public_addr":"172.21.15.55:6817/1066693520","cluster_addr":"172.21.15.55:6819/1066693520","heartbeat_back_addr":"172.21.15.55:6823/1066693520","heartbeat_front_addr":"172.21.15.55:6821/1066693520","state":["exists","up"]},{"osd":4,"uuid":"272ec937-56b4-4f0a-b2e1-b0bc189c9d79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":4190771237},{"type":"v1","addr":"172.21.15.72:6820","nonce":4190771237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":4190771237},{"type":"v1","addr":"172.21.15.72:6824","nonce":4190771237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":4190771237},{"type":"v1","addr":"172.21.15.72:6831","nonce":4190771237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":4190771237},{"type":"v1","addr":"172.21.15.72:6828","nonce":4190771237}]},"public_addr":"172.21.15.72:6820/4190771237","cluster_addr":"172.21.15.72:6824/4190771237","heartbeat_back_addr":"172.21.15.72:6831/4190771237","heartbeat_front_addr":"172.21.15.72:6828/4190771237","state":["exists","up"]},{"osd":5,"uuid":"56439854-72a0-4ef4-81ff-184a3d924a5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":2421889184},{"type":"v1","addr":"172.21.15.72:6801","nonce":2421889184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6803","nonce":2421889184},{"type":"v1","addr":"172.21.15.72:6805","nonce":2421889184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":2421889184},{"type":"v1","addr":"172.21.15.72:6813","nonce":2421889184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6807","nonce":2421889184},{"type":"v1","addr":"172.21.15.72:6809","nonce":2421889184}]},"public_addr":"172.21.15.72:6801/2421889184","cluster_addr":"172.21.15.72:6805/2421889184","heartbeat_back_addr":"172.21.15.72:6813/2421889184","heartbeat_front_addr":"172.21.15.72:6809/2421889184","state":["exists","up"]},{"osd":6,"uuid":"e248e2be-3b6e-49cf-8c8a-1a4152827582","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3796994599},{"type":"v1","addr":"172.21.15.72:6804","nonce":3796994599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":3796994599},{"type":"v1","addr":"172.21.15.72:6808","nonce":3796994599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":3796994599},{"type":"v1","addr":"172.21.15.72:6815","nonce":3796994599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":3796994599},{"type":"v1","addr":"172.21.15.72:6812","nonce":3796994599}]},"public_addr":"172.21.15.72:6804/3796994599","cluster_addr":"172.21.15.72:6808/3796994599","heartbeat_back_addr":"172.21.15.72:6815/3796994599","heartbeat_front_addr":"172.21.15.72:6812/3796994599","state":["exists","up"]},{"osd":7,"uuid":"505a62d3-322b-4629-b4fd-187a55563709","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":3024877895},{"type":"v1","addr":"172.21.15.72:6817","nonce":3024877895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":3024877895},{"type":"v1","addr":"172.21.15.72:6821","nonce":3024877895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6827","nonce":3024877895},{"type":"v1","addr":"172.21.15.72:6829","nonce":3024877895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6823","nonce":3024877895},{"type":"v1","addr":"172.21.15.72:6825","nonce":3024877895}]},"public_addr":"172.21.15.72:6817/3024877895","cluster_addr":"172.21.15.72:6821/3024877895","heartbeat_back_addr":"172.21.15.72:6829/3024877895","heartbeat_front_addr":"172.21.15.72:6825/3024877895","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.241014+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.450799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.465018+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.507647+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.534763+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.495895+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.427110+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.547466+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-27T12:33:15.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.440+0000 7ff888a83640 1 -- 172.21.15.55:0/1205492975 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7ff86406c920 msgr2=0x7ff86406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:15.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.440+0000 7ff888a83640 1 --2- 172.21.15.55:0/1205492975 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7ff86406c920 0x7ff86406ede0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff8840b9800 tx=0x7ff86c009040 comp rx=0 tx=0).stop 2024-05-27T12:33:15.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.440+0000 7ff888a83640 1 -- 172.21.15.55:0/1205492975 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff870003a90 msgr2=0x7ff8840ca960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:15.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.440+0000 7ff888a83640 1 --2- 172.21.15.55:0/1205492975 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff870003a90 0x7ff8840ca960 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ff874000f80 tx=0x7ff8740014a0 comp rx=0 tx=0).stop 2024-05-27T12:33:15.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.440+0000 7ff888a83640 1 -- 172.21.15.55:0/1205492975 shutdown_connections 2024-05-27T12:33:15.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.440+0000 7ff888a83640 1 --2- 172.21.15.55:0/1205492975 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff884145d00 0x7ff884146180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:15.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.440+0000 7ff888a83640 1 --2- 172.21.15.55:0/1205492975 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7ff86406c920 0x7ff86406ede0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:15.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.440+0000 7ff888a83640 1 --2- 172.21.15.55:0/1205492975 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff884149270 0x7ff8841496b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:15.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.440+0000 7ff888a83640 1 --2- 172.21.15.55:0/1205492975 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff870003a90 0x7ff8840ca960 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:15.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.440+0000 7ff888a83640 1 -- 172.21.15.55:0/1205492975 >> 172.21.15.55:0/1205492975 conn(0x7ff88406cdb0 msgr2=0x7ff88415d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:15.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.440+0000 7ff888a83640 1 -- 172.21.15.55:0/1205492975 shutdown_connections 2024-05-27T12:33:15.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.440+0000 7ff888a83640 1 -- 172.21.15.55:0/1205492975 wait complete. 2024-05-27T12:33:15.451 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-27T12:32:29.277895+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-27T12:32:39.442745+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-27T12:32:40.672118+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-27T12:33:15.451 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-27T12:33:15.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.560+0000 7f4ae794f640 1 Processor -- start 2024-05-27T12:33:15.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.560+0000 7f4ae794f640 1 -- start start 2024-05-27T12:33:15.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.561+0000 7f4ae794f640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4ae015eb00 0x7f4ae00cfb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:15.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.561+0000 7f4ae794f640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ae015eee0 con 0x7f4ae00d3e50 2024-05-27T12:33:15.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.561+0000 7f4ae794f640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ae00d4660 con 0x7f4ae00d1f40 2024-05-27T12:33:15.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.561+0000 7f4ae794f640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f4ae00d5700 con 0x7f4ae015eb00 2024-05-27T12:33:15.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.561+0000 7f4ae4eea640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f4ae00d3e50 0x7f4ae00d1830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:48608/0 (socket says 172.21.15.55:48608) 2024-05-27T12:33:15.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.561+0000 7f4ae4eea640 1 -- 172.21.15.55:0/920983399 learned_addr learned my addr 172.21.15.55:0/920983399 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-27T12:33:15.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.561+0000 7f4ae56eb640 1 --2- 172.21.15.55:0/920983399 >> v2:172.21.15.72:3300/0 conn(0x7f4ae015eb00 0x7f4ae00cfb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:15.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.562+0000 7f4adffff640 1 -- 172.21.15.55:0/920983399 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3955649760 0 0) 0x7f4ae015eee0 con 0x7f4ae00d3e50 2024-05-27T12:33:15.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.562+0000 7f4adffff640 1 -- 172.21.15.55:0/920983399 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4ac8003520 con 0x7f4ae00d3e50 2024-05-27T12:33:15.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.562+0000 7f4adffff640 1 -- 172.21.15.55:0/920983399 <== mon.1 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4149913236 0 0) 0x7f4ae00d4660 con 0x7f4ae00d1f40 2024-05-27T12:33:15.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.562+0000 7f4adffff640 1 -- 172.21.15.55:0/920983399 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4ae015eee0 con 0x7f4ae00d1f40 2024-05-27T12:33:15.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.562+0000 7f4adffff640 1 -- 172.21.15.55:0/920983399 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2227453825 0 0) 0x7f4ac8003520 con 0x7f4ae00d3e50 2024-05-27T12:33:15.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.562+0000 7f4adffff640 1 -- 172.21.15.55:0/920983399 >> v2:172.21.15.72:3300/0 conn(0x7f4ae015eb00 msgr2=0x7f4ae00cfb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:15.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.562+0000 7f4adffff640 1 --2- 172.21.15.55:0/920983399 >> v2:172.21.15.72:3300/0 conn(0x7f4ae015eb00 0x7f4ae00cfb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:15.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.562+0000 7f4adffff640 1 -- 172.21.15.55:0/920983399 >> v1:172.21.15.72:6789/0 conn(0x7f4ae00d1f40 legacy=0x7f4ae00b78f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:15.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.562+0000 7f4adffff640 1 -- 172.21.15.55:0/920983399 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ae00d4940 con 0x7f4ae00d3e50 2024-05-27T12:33:15.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.562+0000 7f4adffff640 1 -- 172.21.15.55:0/920983399 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 793017739 0 0) 0x7f4ad4001670 con 0x7f4ae00d3e50 2024-05-27T12:33:15.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.562+0000 7f4adffff640 1 -- 172.21.15.55:0/920983399 >> v1:172.21.15.55:6789/0 conn(0x7f4ae00d3e50 legacy=0x7f4ae00d1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:15.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.562+0000 7f4adffff640 1 --2- 172.21.15.55:0/920983399 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4ac8003b40 0x7f4ac8003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:15.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.562+0000 7f4adffff640 1 --2- 172.21.15.55:0/920983399 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ac8004800 0x7f4ac8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:15.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.562+0000 7f4adffff640 1 --2- 172.21.15.55:0/920983399 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4ac80051c0 0x7f4ac800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:15.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.562+0000 7f4adffff640 1 -- 172.21.15.55:0/920983399 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f4ae00d5700 con 0x7f4ac8003b40 2024-05-27T12:33:15.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.562+0000 7f4adffff640 1 -- 172.21.15.55:0/920983399 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f4ac800bfb0 con 0x7f4ac8004800 2024-05-27T12:33:15.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.562+0000 7f4adffff640 1 -- 172.21.15.55:0/920983399 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f4ac800c1b0 con 0x7f4ac80051c0 2024-05-27T12:33:15.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.562+0000 7f4ae56eb640 1 --2- 172.21.15.55:0/920983399 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4ac8003b40 0x7f4ac8003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:15.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.562+0000 7f4ae4eea640 1 --2- 172.21.15.55:0/920983399 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ac8004800 0x7f4ac8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:15.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.562+0000 7f4ae5eec640 1 --2- 172.21.15.55:0/920983399 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4ac80051c0 0x7f4ac800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:15.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.562+0000 7f4ae56eb640 1 -- 172.21.15.55:0/920983399 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4ac80051c0 msgr2=0x7f4ac800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:15.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.562+0000 7f4ae56eb640 1 --2- 172.21.15.55:0/920983399 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4ac80051c0 0x7f4ac800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:15.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.562+0000 7f4ae56eb640 1 -- 172.21.15.55:0/920983399 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ac8004800 msgr2=0x7f4ac8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:15.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.562+0000 7f4ae56eb640 1 --2- 172.21.15.55:0/920983399 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ac8004800 0x7f4ac8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:15.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.562+0000 7f4ae56eb640 1 -- 172.21.15.55:0/920983399 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ac8003520 con 0x7f4ac8003b40 2024-05-27T12:33:15.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.562+0000 7f4ae5eec640 1 --2- 172.21.15.55:0/920983399 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4ac80051c0 0x7f4ac800b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T12:33:15.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.562+0000 7f4ae5eec640 1 -- 172.21.15.55:0/920983399 reap_dead start 2024-05-27T12:33:15.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.563+0000 7f4ae56eb640 1 --2- 172.21.15.55:0/920983399 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4ac8003b40 0x7f4ac8003f40 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f4ad0009f90 tx=0x7f4ac8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6d0643cdb8bade1 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:15.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.563+0000 7f4adffff640 1 -- 172.21.15.55:0/920983399 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ad0009c10 con 0x7f4ac8003b40 2024-05-27T12:33:15.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.563+0000 7f4adffff640 1 -- 172.21.15.55:0/920983399 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ad0036070 con 0x7f4ac8003b40 2024-05-27T12:33:15.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.563+0000 7f4adffff640 1 -- 172.21.15.55:0/920983399 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ad0031830 con 0x7f4ac8003b40 2024-05-27T12:33:15.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.564+0000 7f4ae794f640 1 -- 172.21.15.55:0/920983399 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4ac8003b40 msgr2=0x7f4ac8003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:15.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.564+0000 7f4ae794f640 1 --2- 172.21.15.55:0/920983399 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4ac8003b40 0x7f4ac8003f40 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f4ad0009f90 tx=0x7f4ac8005830 comp rx=0 tx=0).stop 2024-05-27T12:33:15.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.564+0000 7f4ae794f640 1 -- 172.21.15.55:0/920983399 shutdown_connections 2024-05-27T12:33:15.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.564+0000 7f4ae794f640 1 --2- 172.21.15.55:0/920983399 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4ac8003b40 0x7f4ac8003f40 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:15.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.564+0000 7f4ae794f640 1 -- 172.21.15.55:0/920983399 >> 172.21.15.55:0/920983399 conn(0x7f4ae0067a50 msgr2=0x7f4ae0067e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:15.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.564+0000 7f4ae794f640 1 -- 172.21.15.55:0/920983399 shutdown_connections 2024-05-27T12:33:15.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.564+0000 7f4ae794f640 1 -- 172.21.15.55:0/920983399 wait complete. 2024-05-27T12:33:15.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.565+0000 7f4ae794f640 1 Processor -- start 2024-05-27T12:33:15.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.565+0000 7f4ae794f640 1 -- start start 2024-05-27T12:33:15.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.566+0000 7f4ae794f640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ac8003b40 0x7f4ae0158570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:15.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.566+0000 7f4ae794f640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4ae0157e70 0x7f4ae015b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:15.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.566+0000 7f4ae794f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4ae00b4980 0x7f4ae0157320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:15.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.566+0000 7f4ae794f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f4ae00d51e0 con 0x7f4ae00b4980 2024-05-27T12:33:15.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.566+0000 7f4ae794f640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f4ae00d4f00 con 0x7f4ac8003b40 2024-05-27T12:33:15.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.566+0000 7f4ae794f640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f4ae00d42c0 con 0x7f4ae0157e70 2024-05-27T12:33:15.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.566+0000 7f4ae5eec640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4ae00b4980 0x7f4ae0157320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:15.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.566+0000 7f4ae5eec640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4ae00b4980 0x7f4ae0157320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44316/0 (socket says 172.21.15.55:44316) 2024-05-27T12:33:15.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.566+0000 7f4ae5eec640 1 -- 172.21.15.55:0/1296203980 learned_addr learned my addr 172.21.15.55:0/1296203980 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:33:15.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.566+0000 7f4ae56eb640 1 --2- 172.21.15.55:0/1296203980 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ac8003b40 0x7f4ae0158570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:15.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.566+0000 7f4ae4eea640 1 --2- 172.21.15.55:0/1296203980 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4ae0157e70 0x7f4ae015b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:15.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.566+0000 7f4ae5eec640 1 -- 172.21.15.55:0/1296203980 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4ae0157e70 msgr2=0x7f4ae015b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:15.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.566+0000 7f4ae5eec640 1 --2- 172.21.15.55:0/1296203980 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4ae0157e70 0x7f4ae015b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:15.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.566+0000 7f4ae5eec640 1 -- 172.21.15.55:0/1296203980 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ac8003b40 msgr2=0x7f4ae0158570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:15.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.566+0000 7f4ae5eec640 1 --2- 172.21.15.55:0/1296203980 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ac8003b40 0x7f4ae0158570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:15.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.566+0000 7f4ae5eec640 1 -- 172.21.15.55:0/1296203980 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ae0158ab0 con 0x7f4ae00b4980 2024-05-27T12:33:15.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.566+0000 7f4ae4eea640 1 --2- 172.21.15.55:0/1296203980 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4ae0157e70 0x7f4ae015b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T12:33:15.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.567+0000 7f4ae5eec640 1 --2- 172.21.15.55:0/1296203980 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4ae00b4980 0x7f4ae0157320 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f4ae00d1240 tx=0x7f4ad800e960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:15.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.567+0000 7f4addffb640 1 -- 172.21.15.55:0/1296203980 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ad8019070 con 0x7f4ae00b4980 2024-05-27T12:33:15.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.567+0000 7f4addffb640 1 -- 172.21.15.55:0/1296203980 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ad80052e0 con 0x7f4ae00b4980 2024-05-27T12:33:15.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.567+0000 7f4ae794f640 1 -- 172.21.15.55:0/1296203980 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ae0158d50 con 0x7f4ae00b4980 2024-05-27T12:33:15.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.567+0000 7f4addffb640 1 -- 172.21.15.55:0/1296203980 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ad8003810 con 0x7f4ae00b4980 2024-05-27T12:33:15.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.567+0000 7f4ae794f640 1 -- 172.21.15.55:0/1296203980 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ae015a9e0 con 0x7f4ae00b4980 2024-05-27T12:33:15.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.568+0000 7f4ae794f640 1 -- 172.21.15.55:0/1296203980 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ae0068a70 con 0x7f4ae00b4980 2024-05-27T12:33:15.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.568+0000 7f4addffb640 1 -- 172.21.15.55:0/1296203980 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4ad801c070 con 0x7f4ae00b4980 2024-05-27T12:33:15.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.569+0000 7f4addffb640 1 --2- 172.21.15.55:0/1296203980 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f4acc06c8f0 0x7f4acc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:15.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.569+0000 7f4addffb640 1 -- 172.21.15.55:0/1296203980 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f4ad808afa0 con 0x7f4ae00b4980 2024-05-27T12:33:15.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.569+0000 7f4ae56eb640 1 --2- 172.21.15.55:0/1296203980 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f4acc06c8f0 0x7f4acc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:15.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.570+0000 7f4ae56eb640 1 --2- 172.21.15.55:0/1296203980 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f4acc06c8f0 0x7f4acc06edb0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f4ad0009f90 tx=0x7f4ad002f000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:15.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.573+0000 7f4addffb640 1 -- 172.21.15.55:0/1296203980 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4ad8058d80 con 0x7f4ae00b4980 2024-05-27T12:33:15.759 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.759+0000 7f4ae794f640 1 -- 172.21.15.55:0/1296203980 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f4ae00cb930 con 0x7f4ae00b4980 2024-05-27T12:33:15.759 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.759+0000 7f4addffb640 1 -- 172.21.15.55:0/1296203980 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) ==== 93+0+10 (secure 0 0 0) 0x7f4ad805d080 con 0x7f4ae00b4980 2024-05-27T12:33:15.759 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-05-27T12:33:15.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.762+0000 7f4ae794f640 1 -- 172.21.15.55:0/1296203980 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f4acc06c8f0 msgr2=0x7f4acc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:15.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.762+0000 7f4ae794f640 1 --2- 172.21.15.55:0/1296203980 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f4acc06c8f0 0x7f4acc06edb0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f4ad0009f90 tx=0x7f4ad002f000 comp rx=0 tx=0).stop 2024-05-27T12:33:15.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.762+0000 7f4ae794f640 1 -- 172.21.15.55:0/1296203980 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4ae00b4980 msgr2=0x7f4ae0157320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:15.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.762+0000 7f4ae794f640 1 --2- 172.21.15.55:0/1296203980 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4ae00b4980 0x7f4ae0157320 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f4ae00d1240 tx=0x7f4ad800e960 comp rx=0 tx=0).stop 2024-05-27T12:33:15.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.762+0000 7f4ae794f640 1 -- 172.21.15.55:0/1296203980 shutdown_connections 2024-05-27T12:33:15.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.762+0000 7f4ae794f640 1 --2- 172.21.15.55:0/1296203980 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4ae00b4980 0x7f4ae0157320 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:15.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.762+0000 7f4ae794f640 1 --2- 172.21.15.55:0/1296203980 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4ae0157e70 0x7f4ae015b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:15.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.762+0000 7f4ae794f640 1 --2- 172.21.15.55:0/1296203980 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f4acc06c8f0 0x7f4acc06edb0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:15.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.762+0000 7f4ae794f640 1 --2- 172.21.15.55:0/1296203980 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ac8003b40 0x7f4ae0158570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:15.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.762+0000 7f4ae794f640 1 -- 172.21.15.55:0/1296203980 >> 172.21.15.55:0/1296203980 conn(0x7f4ae0067a50 msgr2=0x7f4ae00b9a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:15.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.762+0000 7f4ae794f640 1 -- 172.21.15.55:0/1296203980 shutdown_connections 2024-05-27T12:33:15.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.762+0000 7f4ae794f640 1 -- 172.21.15.55:0/1296203980 wait complete. 2024-05-27T12:33:15.772 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-27T12:33:15.879 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.880+0000 7f6dd8020640 1 Processor -- start 2024-05-27T12:33:15.879 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.880+0000 7f6dd8020640 1 -- start start 2024-05-27T12:33:15.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.881+0000 7f6dd8020640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6dd0162150 0x7f6dd00d14f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:15.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.881+0000 7f6dd8020640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6dd006ca40 0x7f6dd009aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:15.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.881+0000 7f6dd8020640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6dd009af70 0x7f6dd006d100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:15.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.881+0000 7f6dd8020640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f6dd009b3c0 con 0x7f6dd006ca40 2024-05-27T12:33:15.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.881+0000 7f6dd8020640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f6dd00d2020 con 0x7f6dd009af70 2024-05-27T12:33:15.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.881+0000 7f6dd8020640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f6dd00d1d40 con 0x7f6dd0162150 2024-05-27T12:33:15.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.881+0000 7f6dd55bb640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6dd006ca40 0x7f6dd009aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:15.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.881+0000 7f6dd55bb640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6dd006ca40 0x7f6dd009aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44322/0 (socket says 172.21.15.55:44322) 2024-05-27T12:33:15.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.881+0000 7f6dd55bb640 1 -- 172.21.15.55:0/146567292 learned_addr learned my addr 172.21.15.55:0/146567292 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:33:15.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.881+0000 7f6dd65bd640 1 --2- 172.21.15.55:0/146567292 >> v2:172.21.15.72:3300/0 conn(0x7f6dd009af70 0x7f6dd006d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:15.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.881+0000 7f6dd5dbc640 1 --2- 172.21.15.55:0/146567292 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6dd0162150 0x7f6dd00d14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:15.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.881+0000 7f6dd55bb640 1 -- 172.21.15.55:0/146567292 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6dd0162150 msgr2=0x7f6dd00d14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:15.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.881+0000 7f6dd55bb640 1 --2- 172.21.15.55:0/146567292 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6dd0162150 0x7f6dd00d14f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:15.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.881+0000 7f6dd55bb640 1 -- 172.21.15.55:0/146567292 >> v2:172.21.15.72:3300/0 conn(0x7f6dd009af70 msgr2=0x7f6dd006d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:15.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.881+0000 7f6dd55bb640 1 --2- 172.21.15.55:0/146567292 >> v2:172.21.15.72:3300/0 conn(0x7f6dd009af70 0x7f6dd006d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:15.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.881+0000 7f6dd55bb640 1 -- 172.21.15.55:0/146567292 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dd00ccd60 con 0x7f6dd006ca40 2024-05-27T12:33:15.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.882+0000 7f6dd55bb640 1 --2- 172.21.15.55:0/146567292 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6dd006ca40 0x7f6dd009aa30 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f6dd0074100 tx=0x7f6dc402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52414ff732cddd5e server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:15.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.882+0000 7f6dd4dba640 1 -- 172.21.15.55:0/146567292 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dc4037070 con 0x7f6dd006ca40 2024-05-27T12:33:15.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.882+0000 7f6dd4dba640 1 -- 172.21.15.55:0/146567292 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6dc4032440 con 0x7f6dd006ca40 2024-05-27T12:33:15.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.882+0000 7f6dd4dba640 1 -- 172.21.15.55:0/146567292 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dc4032810 con 0x7f6dd006ca40 2024-05-27T12:33:15.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.882+0000 7f6dd8020640 1 -- 172.21.15.55:0/146567292 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6dd006ca40 msgr2=0x7f6dd009aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:15.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.882+0000 7f6dd8020640 1 --2- 172.21.15.55:0/146567292 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6dd006ca40 0x7f6dd009aa30 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f6dd0074100 tx=0x7f6dc402a1e0 comp rx=0 tx=0).stop 2024-05-27T12:33:15.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.882+0000 7f6dd8020640 1 -- 172.21.15.55:0/146567292 shutdown_connections 2024-05-27T12:33:15.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.882+0000 7f6dd8020640 1 --2- 172.21.15.55:0/146567292 >> v2:172.21.15.72:3300/0 conn(0x7f6dd009af70 0x7f6dd006d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:15.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.882+0000 7f6dd8020640 1 --2- 172.21.15.55:0/146567292 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6dd006ca40 0x7f6dd009aa30 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:15.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.882+0000 7f6dd8020640 1 --2- 172.21.15.55:0/146567292 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6dd0162150 0x7f6dd00d14f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:15.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.882+0000 7f6dd8020640 1 -- 172.21.15.55:0/146567292 >> 172.21.15.55:0/146567292 conn(0x7f6dd00b4160 msgr2=0x7f6dd00b4570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:15.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.883+0000 7f6dd8020640 1 -- 172.21.15.55:0/146567292 shutdown_connections 2024-05-27T12:33:15.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.883+0000 7f6dd8020640 1 -- 172.21.15.55:0/146567292 wait complete. 2024-05-27T12:33:15.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.884+0000 7f6dd8020640 1 Processor -- start 2024-05-27T12:33:15.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.884+0000 7f6dd8020640 1 -- start start 2024-05-27T12:33:15.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.884+0000 7f6dd8020640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6dd006ca40 0x7f6dd00c9740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:15.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.884+0000 7f6dd8020640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6dd009af70 0x7f6dd014eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:15.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.884+0000 7f6dd8020640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6dd0162150 0x7f6dd00b0d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:15.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.884+0000 7f6dd8020640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f6dd00d1a30 con 0x7f6dd006ca40 2024-05-27T12:33:15.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.884+0000 7f6dd8020640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f6dd00cd320 con 0x7f6dd009af70 2024-05-27T12:33:15.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.884+0000 7f6dd8020640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f6dd006d640 con 0x7f6dd0162150 2024-05-27T12:33:15.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.885+0000 7f6dd5dbc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6dd006ca40 0x7f6dd00c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:15.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.885+0000 7f6dd5dbc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6dd006ca40 0x7f6dd00c9740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44326/0 (socket says 172.21.15.55:44326) 2024-05-27T12:33:15.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.885+0000 7f6dd5dbc640 1 -- 172.21.15.55:0/985518031 learned_addr learned my addr 172.21.15.55:0/985518031 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:33:15.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.885+0000 7f6dd55bb640 1 --2- 172.21.15.55:0/985518031 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6dd009af70 0x7f6dd014eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:15.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.885+0000 7f6dd65bd640 1 --2- 172.21.15.55:0/985518031 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6dd0162150 0x7f6dd00b0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:15.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.885+0000 7f6dd5dbc640 1 -- 172.21.15.55:0/985518031 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6dd0162150 msgr2=0x7f6dd00b0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:15.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.885+0000 7f6dd5dbc640 1 --2- 172.21.15.55:0/985518031 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6dd0162150 0x7f6dd00b0d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:15.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.885+0000 7f6dd5dbc640 1 -- 172.21.15.55:0/985518031 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6dd009af70 msgr2=0x7f6dd014eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:15.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.885+0000 7f6dd5dbc640 1 --2- 172.21.15.55:0/985518031 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6dd009af70 0x7f6dd014eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:15.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.885+0000 7f6dd5dbc640 1 -- 172.21.15.55:0/985518031 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dd00b38e0 con 0x7f6dd006ca40 2024-05-27T12:33:15.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.885+0000 7f6dd5dbc640 1 --2- 172.21.15.55:0/985518031 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6dd006ca40 0x7f6dd00c9740 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f6dc800d620 tx=0x7f6dc800dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:15.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.885+0000 7f6dce7fc640 1 -- 172.21.15.55:0/985518031 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dc800b620 con 0x7f6dd006ca40 2024-05-27T12:33:15.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.885+0000 7f6dce7fc640 1 -- 172.21.15.55:0/985518031 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6dc8019070 con 0x7f6dd006ca40 2024-05-27T12:33:15.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.885+0000 7f6dd8020640 1 -- 172.21.15.55:0/985518031 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6dd00b3040 con 0x7f6dd006ca40 2024-05-27T12:33:15.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.885+0000 7f6dce7fc640 1 -- 172.21.15.55:0/985518031 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dc800ba00 con 0x7f6dd006ca40 2024-05-27T12:33:15.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.885+0000 7f6dd8020640 1 -- 172.21.15.55:0/985518031 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6dd00b3600 con 0x7f6dd006ca40 2024-05-27T12:33:15.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.886+0000 7f6dd8020640 1 -- 172.21.15.55:0/985518031 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6dd0068a70 con 0x7f6dd006ca40 2024-05-27T12:33:15.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.887+0000 7f6dce7fc640 1 -- 172.21.15.55:0/985518031 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6dc800bba0 con 0x7f6dd006ca40 2024-05-27T12:33:15.895 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.887+0000 7f6dce7fc640 1 --2- 172.21.15.55:0/985518031 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f6dbc06c8f0 0x7f6dbc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:15.895 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.888+0000 7f6dce7fc640 1 -- 172.21.15.55:0/985518031 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f6dc808be10 con 0x7f6dd006ca40 2024-05-27T12:33:15.895 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.888+0000 7f6dd55bb640 1 --2- 172.21.15.55:0/985518031 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f6dbc06c8f0 0x7f6dbc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:15.895 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.888+0000 7f6dd55bb640 1 --2- 172.21.15.55:0/985518031 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f6dbc06c8f0 0x7f6dbc06edb0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f6dc4034000 tx=0x7f6dc402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:15.895 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:15.892+0000 7f6dce7fc640 1 -- 172.21.15.55:0/985518031 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6dc8059bf0 con 0x7f6dd006ca40 2024-05-27T12:33:16.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.076+0000 7f6dd8020640 1 -- 172.21.15.55:0/985518031 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f6dd00717a0 con 0x7f6dd006ca40 2024-05-27T12:33:16.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.076+0000 7f6dce7fc640 1 -- 172.21.15.55:0/985518031 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) ==== 104+0+11 (secure 0 0 0) 0x7f6dc805def0 con 0x7f6dd006ca40 2024-05-27T12:33:16.075 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2024-05-27T12:33:16.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.078+0000 7f6dd8020640 1 -- 172.21.15.55:0/985518031 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f6dbc06c8f0 msgr2=0x7f6dbc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:16.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.078+0000 7f6dd8020640 1 --2- 172.21.15.55:0/985518031 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f6dbc06c8f0 0x7f6dbc06edb0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f6dc4034000 tx=0x7f6dc402e000 comp rx=0 tx=0).stop 2024-05-27T12:33:16.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.078+0000 7f6dd8020640 1 -- 172.21.15.55:0/985518031 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6dd006ca40 msgr2=0x7f6dd00c9740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:16.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.078+0000 7f6dd8020640 1 --2- 172.21.15.55:0/985518031 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6dd006ca40 0x7f6dd00c9740 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f6dc800d620 tx=0x7f6dc800dae0 comp rx=0 tx=0).stop 2024-05-27T12:33:16.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.078+0000 7f6dd8020640 1 -- 172.21.15.55:0/985518031 shutdown_connections 2024-05-27T12:33:16.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.078+0000 7f6dd8020640 1 --2- 172.21.15.55:0/985518031 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6dd0162150 0x7f6dd00b0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:16.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.078+0000 7f6dd8020640 1 --2- 172.21.15.55:0/985518031 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f6dbc06c8f0 0x7f6dbc06edb0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:16.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.078+0000 7f6dd8020640 1 --2- 172.21.15.55:0/985518031 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6dd009af70 0x7f6dd014eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:16.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.078+0000 7f6dd8020640 1 --2- 172.21.15.55:0/985518031 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6dd006ca40 0x7f6dd00c9740 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:16.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.078+0000 7f6dd8020640 1 -- 172.21.15.55:0/985518031 >> 172.21.15.55:0/985518031 conn(0x7f6dd00b4160 msgr2=0x7f6dd00ced90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:16.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.078+0000 7f6dd8020640 1 -- 172.21.15.55:0/985518031 shutdown_connections 2024-05-27T12:33:16.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.078+0000 7f6dd8020640 1 -- 172.21.15.55:0/985518031 wait complete. 2024-05-27T12:33:16.088 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-27T12:33:16.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.195+0000 7f26ab36f640 1 Processor -- start 2024-05-27T12:33:16.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.196+0000 7f26ab36f640 1 -- start start 2024-05-27T12:33:16.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.196+0000 7f26ab36f640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f26a40cfb40 0x7f26a40d1830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:16.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.196+0000 7f26ab36f640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f26a40d1d70 0x7f26a40b78f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:16.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.196+0000 7f26ab36f640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26a40d2180 con 0x7f26a415eb00 2024-05-27T12:33:16.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.196+0000 7f26ab36f640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f26a40d5700 con 0x7f26a40cfb40 2024-05-27T12:33:16.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.196+0000 7f26ab36f640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f26a415eee0 con 0x7f26a40d1d70 2024-05-27T12:33:16.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.196+0000 7f26a910b640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f26a415eb00 0x7f26a40d3e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:48614/0 (socket says 172.21.15.55:48614) 2024-05-27T12:33:16.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.196+0000 7f26a910b640 1 -- 172.21.15.55:0/1649784136 learned_addr learned my addr 172.21.15.55:0/1649784136 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-27T12:33:16.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.197+0000 7f26a890a640 1 --2- 172.21.15.55:0/1649784136 >> v2:172.21.15.55:3300/0 conn(0x7f26a40cfb40 0x7f26a40d1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:16.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.197+0000 7f26a3fff640 1 -- 172.21.15.55:0/1649784136 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3192614297 0 0) 0x7f269c001110 con 0x7f26a415eb00 2024-05-27T12:33:16.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.197+0000 7f26a990c640 1 --2- 172.21.15.55:0/1649784136 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f26a40d1d70 0x7f26a40b78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:16.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.197+0000 7f26a3fff640 1 -- 172.21.15.55:0/1649784136 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f268c003520 con 0x7f26a415eb00 2024-05-27T12:33:16.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.197+0000 7f26a890a640 1 -- 172.21.15.55:0/1649784136 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f26a40d1d70 msgr2=0x7f26a40b78f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:16.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.197+0000 7f26a890a640 1 --2- 172.21.15.55:0/1649784136 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f26a40d1d70 0x7f26a40b78f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:16.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.197+0000 7f26a890a640 1 -- 172.21.15.55:0/1649784136 >> v1:172.21.15.55:6789/0 conn(0x7f26a415eb00 legacy=0x7f26a40d3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:16.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.197+0000 7f26a890a640 1 -- 172.21.15.55:0/1649784136 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26a40d4660 con 0x7f26a40cfb40 2024-05-27T12:33:16.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.197+0000 7f26a990c640 1 --2- 172.21.15.55:0/1649784136 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f26a40d1d70 0x7f26a40b78f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T12:33:16.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.198+0000 7f26a890a640 1 --2- 172.21.15.55:0/1649784136 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f26a40cfb40 0x7f26a40d1830 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f26980097a0 tx=0x7f269802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e1632872e476930 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:16.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.198+0000 7f26a3fff640 1 -- 172.21.15.55:0/1649784136 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2698037070 con 0x7f26a40cfb40 2024-05-27T12:33:16.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.198+0000 7f26a3fff640 1 -- 172.21.15.55:0/1649784136 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2698032440 con 0x7f26a40cfb40 2024-05-27T12:33:16.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.198+0000 7f26a3fff640 1 -- 172.21.15.55:0/1649784136 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2698032810 con 0x7f26a40cfb40 2024-05-27T12:33:16.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.198+0000 7f26ab36f640 1 -- 172.21.15.55:0/1649784136 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f26a40cfb40 msgr2=0x7f26a40d1830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:16.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.198+0000 7f26ab36f640 1 --2- 172.21.15.55:0/1649784136 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f26a40cfb40 0x7f26a40d1830 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f26980097a0 tx=0x7f269802a230 comp rx=0 tx=0).stop 2024-05-27T12:33:16.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.198+0000 7f26ab36f640 1 -- 172.21.15.55:0/1649784136 shutdown_connections 2024-05-27T12:33:16.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.198+0000 7f26ab36f640 1 --2- 172.21.15.55:0/1649784136 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f26a40d1d70 0x7f26a40b78f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:16.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.198+0000 7f26ab36f640 1 --2- 172.21.15.55:0/1649784136 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f26a40cfb40 0x7f26a40d1830 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:16.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.198+0000 7f26ab36f640 1 -- 172.21.15.55:0/1649784136 >> 172.21.15.55:0/1649784136 conn(0x7f26a4067a50 msgr2=0x7f26a4067e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:16.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.198+0000 7f26ab36f640 1 -- 172.21.15.55:0/1649784136 shutdown_connections 2024-05-27T12:33:16.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.198+0000 7f26ab36f640 1 -- 172.21.15.55:0/1649784136 wait complete. 2024-05-27T12:33:16.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.200+0000 7f26ab36f640 1 Processor -- start 2024-05-27T12:33:16.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.200+0000 7f26ab36f640 1 -- start start 2024-05-27T12:33:16.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.200+0000 7f26ab36f640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f26a40cfb40 0x7f26a41f1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:16.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.200+0000 7f26ab36f640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f26a40d1d70 0x7f26a415f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:16.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.200+0000 7f26ab36f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f26a415eb00 0x7f26a415f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:16.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.200+0000 7f26ab36f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f26a40d4f00 con 0x7f26a415eb00 2024-05-27T12:33:16.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.200+0000 7f26ab36f640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f26a40d4c20 con 0x7f26a40cfb40 2024-05-27T12:33:16.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.200+0000 7f26ab36f640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f26a40d51e0 con 0x7f26a40d1d70 2024-05-27T12:33:16.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.200+0000 7f26a990c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f26a415eb00 0x7f26a415f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:16.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.200+0000 7f26a990c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f26a415eb00 0x7f26a415f5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44342/0 (socket says 172.21.15.55:44342) 2024-05-27T12:33:16.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.200+0000 7f26a990c640 1 -- 172.21.15.55:0/3938671027 learned_addr learned my addr 172.21.15.55:0/3938671027 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:33:16.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.201+0000 7f26a910b640 1 --2- 172.21.15.55:0/3938671027 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f26a40cfb40 0x7f26a41f1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:16.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.201+0000 7f26a890a640 1 --2- 172.21.15.55:0/3938671027 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f26a40d1d70 0x7f26a415f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:16.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.201+0000 7f26a990c640 1 -- 172.21.15.55:0/3938671027 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f26a40d1d70 msgr2=0x7f26a415f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:16.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.201+0000 7f26a990c640 1 --2- 172.21.15.55:0/3938671027 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f26a40d1d70 0x7f26a415f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:16.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.201+0000 7f26a990c640 1 -- 172.21.15.55:0/3938671027 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f26a40cfb40 msgr2=0x7f26a41f1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:16.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.201+0000 7f26a990c640 1 --2- 172.21.15.55:0/3938671027 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f26a40cfb40 0x7f26a41f1940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:16.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.201+0000 7f26a990c640 1 -- 172.21.15.55:0/3938671027 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26a41f1e80 con 0x7f26a415eb00 2024-05-27T12:33:16.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.201+0000 7f26a890a640 1 --2- 172.21.15.55:0/3938671027 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f26a40d1d70 0x7f26a415f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T12:33:16.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.201+0000 7f26a910b640 1 --2- 172.21.15.55:0/3938671027 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f26a40cfb40 0x7f26a41f1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T12:33:16.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.201+0000 7f26a990c640 1 --2- 172.21.15.55:0/3938671027 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f26a415eb00 0x7f26a415f5a0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f269400cef0 tx=0x7f269400a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:16.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.201+0000 7f26a1ffb640 1 -- 172.21.15.55:0/3938671027 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f269401a070 con 0x7f26a415eb00 2024-05-27T12:33:16.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.201+0000 7f26a1ffb640 1 -- 172.21.15.55:0/3938671027 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f269400d860 con 0x7f26a415eb00 2024-05-27T12:33:16.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.201+0000 7f26ab36f640 1 -- 172.21.15.55:0/3938671027 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26a4147680 con 0x7f26a415eb00 2024-05-27T12:33:16.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.201+0000 7f26a1ffb640 1 -- 172.21.15.55:0/3938671027 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f269400dc50 con 0x7f26a415eb00 2024-05-27T12:33:16.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.201+0000 7f26ab36f640 1 -- 172.21.15.55:0/3938671027 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26a41618d0 con 0x7f26a415eb00 2024-05-27T12:33:16.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.202+0000 7f26ab36f640 1 -- 172.21.15.55:0/3938671027 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26a4068a70 con 0x7f26a415eb00 2024-05-27T12:33:16.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.203+0000 7f26a1ffb640 1 -- 172.21.15.55:0/3938671027 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f269401d070 con 0x7f26a415eb00 2024-05-27T12:33:16.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.203+0000 7f26a1ffb640 1 --2- 172.21.15.55:0/3938671027 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f269006c8f0 0x7f269006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:16.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.203+0000 7f26a1ffb640 1 -- 172.21.15.55:0/3938671027 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f269408c420 con 0x7f26a415eb00 2024-05-27T12:33:16.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.203+0000 7f26a910b640 1 --2- 172.21.15.55:0/3938671027 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f269006c8f0 0x7f269006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:16.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.204+0000 7f26a910b640 1 --2- 172.21.15.55:0/3938671027 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f269006c8f0 0x7f269006edb0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f269c007fd0 tx=0x7f269c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:16.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.207+0000 7f26a1ffb640 1 -- 172.21.15.55:0/3938671027 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f269405a910 con 0x7f26a415eb00 2024-05-27T12:33:16.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.391+0000 7f26ab36f640 1 -- 172.21.15.55:0/3938671027 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f26a415e0c0 con 0x7f26a415eb00 2024-05-27T12:33:16.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.391+0000 7f26a1ffb640 1 -- 172.21.15.55:0/3938671027 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) ==== 100+0+11 (secure 0 0 0) 0x7f269405a210 con 0x7f26a415eb00 2024-05-27T12:33:16.390 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2024-05-27T12:33:16.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.393+0000 7f26ab36f640 1 -- 172.21.15.55:0/3938671027 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f269006c8f0 msgr2=0x7f269006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:16.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.393+0000 7f26ab36f640 1 --2- 172.21.15.55:0/3938671027 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f269006c8f0 0x7f269006edb0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f269c007fd0 tx=0x7f269c009040 comp rx=0 tx=0).stop 2024-05-27T12:33:16.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.393+0000 7f26ab36f640 1 -- 172.21.15.55:0/3938671027 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f26a415eb00 msgr2=0x7f26a415f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:16.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.393+0000 7f26ab36f640 1 --2- 172.21.15.55:0/3938671027 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f26a415eb00 0x7f26a415f5a0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f269400cef0 tx=0x7f269400a710 comp rx=0 tx=0).stop 2024-05-27T12:33:16.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.393+0000 7f26ab36f640 1 -- 172.21.15.55:0/3938671027 shutdown_connections 2024-05-27T12:33:16.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.393+0000 7f26ab36f640 1 --2- 172.21.15.55:0/3938671027 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f26a415eb00 0x7f26a415f5a0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:16.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.393+0000 7f26ab36f640 1 --2- 172.21.15.55:0/3938671027 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f26a40d1d70 0x7f26a415f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:16.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.393+0000 7f26ab36f640 1 --2- 172.21.15.55:0/3938671027 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f269006c8f0 0x7f269006edb0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:16.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.393+0000 7f26ab36f640 1 --2- 172.21.15.55:0/3938671027 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f26a40cfb40 0x7f26a41f1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:16.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.393+0000 7f26ab36f640 1 -- 172.21.15.55:0/3938671027 >> 172.21.15.55:0/3938671027 conn(0x7f26a4067a50 msgr2=0x7f26a40d2910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:16.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.393+0000 7f26ab36f640 1 -- 172.21.15.55:0/3938671027 shutdown_connections 2024-05-27T12:33:16.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.393+0000 7f26ab36f640 1 -- 172.21.15.55:0/3938671027 wait complete. 2024-05-27T12:33:16.403 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-27T12:33:16.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.509+0000 7ff2dadef640 1 Processor -- start 2024-05-27T12:33:16.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.510+0000 7ff2dadef640 1 -- start start 2024-05-27T12:33:16.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.510+0000 7ff2dadef640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff2d40b54f0 0x7ff2d406e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:16.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.510+0000 7ff2dadef640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff2d415bae0 0x7ff2d415bf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:16.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.510+0000 7ff2dadef640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2d415c690 con 0x7ff2d406b930 2024-05-27T12:33:16.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.510+0000 7ff2dadef640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7ff2d415c970 con 0x7ff2d415bae0 2024-05-27T12:33:16.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.510+0000 7ff2dadef640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7ff2d406dfe0 con 0x7ff2d40b54f0 2024-05-27T12:33:16.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.511+0000 7ff2d3fff640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff2d415bae0 0x7ff2d415bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:16.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.511+0000 7ff2d8b8b640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff2d40b54f0 0x7ff2d406e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:16.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.511+0000 7ff2d938c640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7ff2d406b930 0x7ff2d40ce340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.55:53798/0 (socket says 172.21.15.55:53798) 2024-05-27T12:33:16.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.511+0000 7ff2d938c640 1 -- 172.21.15.55:0/994360650 learned_addr learned my addr 172.21.15.55:0/994360650 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-27T12:33:16.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.511+0000 7ff2d3fff640 1 -- 172.21.15.55:0/994360650 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff2d40b54f0 msgr2=0x7ff2d406e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:16.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.511+0000 7ff2d3fff640 1 --2- 172.21.15.55:0/994360650 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff2d40b54f0 0x7ff2d406e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:16.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.511+0000 7ff2d3fff640 1 -- 172.21.15.55:0/994360650 >> v1:172.21.15.72:6789/0 conn(0x7ff2d406b930 legacy=0x7ff2d40ce340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:16.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.511+0000 7ff2d3fff640 1 -- 172.21.15.55:0/994360650 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2d406e2c0 con 0x7ff2d415bae0 2024-05-27T12:33:16.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.512+0000 7ff2d3fff640 1 --2- 172.21.15.55:0/994360650 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff2d415bae0 0x7ff2d415bf70 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff2bc0097a0 tx=0x7ff2bc02a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4becfd31381297a4 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:16.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.512+0000 7ff2d37fe640 1 -- 172.21.15.55:0/994360650 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2bc037070 con 0x7ff2d415bae0 2024-05-27T12:33:16.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.512+0000 7ff2d37fe640 1 -- 172.21.15.55:0/994360650 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2bc032440 con 0x7ff2d415bae0 2024-05-27T12:33:16.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.512+0000 7ff2d37fe640 1 -- 172.21.15.55:0/994360650 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2bc032810 con 0x7ff2d415bae0 2024-05-27T12:33:16.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.513+0000 7ff2dadef640 1 -- 172.21.15.55:0/994360650 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff2d415bae0 msgr2=0x7ff2d415bf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:16.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.513+0000 7ff2dadef640 1 --2- 172.21.15.55:0/994360650 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff2d415bae0 0x7ff2d415bf70 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff2bc0097a0 tx=0x7ff2bc02a180 comp rx=0 tx=0).stop 2024-05-27T12:33:16.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.513+0000 7ff2dadef640 1 -- 172.21.15.55:0/994360650 shutdown_connections 2024-05-27T12:33:16.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.513+0000 7ff2dadef640 1 --2- 172.21.15.55:0/994360650 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff2d415bae0 0x7ff2d415bf70 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:16.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.513+0000 7ff2dadef640 1 --2- 172.21.15.55:0/994360650 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff2d40b54f0 0x7ff2d406e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:16.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.513+0000 7ff2dadef640 1 -- 172.21.15.55:0/994360650 >> 172.21.15.55:0/994360650 conn(0x7ff2d4067d70 msgr2=0x7ff2d40b2270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:16.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.513+0000 7ff2dadef640 1 -- 172.21.15.55:0/994360650 shutdown_connections 2024-05-27T12:33:16.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.513+0000 7ff2dadef640 1 -- 172.21.15.55:0/994360650 wait complete. 2024-05-27T12:33:16.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.514+0000 7ff2dadef640 1 Processor -- start 2024-05-27T12:33:16.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.514+0000 7ff2dadef640 1 -- start start 2024-05-27T12:33:16.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.515+0000 7ff2dadef640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2d40b54f0 0x7ff2d4156770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:16.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.515+0000 7ff2dadef640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff2d415bae0 0x7ff2d41f41e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:16.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.515+0000 7ff2dadef640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff2d41f4720 0x7ff2d4071e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:16.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.515+0000 7ff2dadef640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7ff2d40b5a50 con 0x7ff2d40b54f0 2024-05-27T12:33:16.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.515+0000 7ff2dadef640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7ff2d40b58d0 con 0x7ff2d415bae0 2024-05-27T12:33:16.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.515+0000 7ff2dadef640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7ff2d406ff90 con 0x7ff2d41f4720 2024-05-27T12:33:16.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.515+0000 7ff2d8b8b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2d40b54f0 0x7ff2d4156770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:16.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.515+0000 7ff2d8b8b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2d40b54f0 0x7ff2d4156770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44344/0 (socket says 172.21.15.55:44344) 2024-05-27T12:33:16.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.515+0000 7ff2d8b8b640 1 -- 172.21.15.55:0/3320991029 learned_addr learned my addr 172.21.15.55:0/3320991029 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:33:16.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.515+0000 7ff2d938c640 1 --2- 172.21.15.55:0/3320991029 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff2d41f4720 0x7ff2d4071e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:16.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.515+0000 7ff2d3fff640 1 --2- 172.21.15.55:0/3320991029 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff2d415bae0 0x7ff2d41f41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:16.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.515+0000 7ff2d8b8b640 1 -- 172.21.15.55:0/3320991029 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff2d41f4720 msgr2=0x7ff2d4071e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:16.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.515+0000 7ff2d8b8b640 1 --2- 172.21.15.55:0/3320991029 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff2d41f4720 0x7ff2d4071e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:16.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.515+0000 7ff2d8b8b640 1 -- 172.21.15.55:0/3320991029 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff2d415bae0 msgr2=0x7ff2d41f41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:16.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.515+0000 7ff2d8b8b640 1 --2- 172.21.15.55:0/3320991029 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff2d415bae0 0x7ff2d41f41e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:16.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.515+0000 7ff2d8b8b640 1 -- 172.21.15.55:0/3320991029 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2d4156cb0 con 0x7ff2d40b54f0 2024-05-27T12:33:16.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.515+0000 7ff2d938c640 1 --2- 172.21.15.55:0/3320991029 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff2d41f4720 0x7ff2d4071e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T12:33:16.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.515+0000 7ff2d8b8b640 1 --2- 172.21.15.55:0/3320991029 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2d40b54f0 0x7ff2d4156770 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7ff2c400e9b0 tx=0x7ff2c400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:16.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.516+0000 7ff2d17fa640 1 -- 172.21.15.55:0/3320991029 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2c4017070 con 0x7ff2d40b54f0 2024-05-27T12:33:16.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.516+0000 7ff2d17fa640 1 -- 172.21.15.55:0/3320991029 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2c400c9a0 con 0x7ff2d40b54f0 2024-05-27T12:33:16.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.516+0000 7ff2dadef640 1 -- 172.21.15.55:0/3320991029 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2d41f4cf0 con 0x7ff2d40b54f0 2024-05-27T12:33:16.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.516+0000 7ff2d17fa640 1 -- 172.21.15.55:0/3320991029 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2c400cd90 con 0x7ff2d40b54f0 2024-05-27T12:33:16.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.516+0000 7ff2dadef640 1 -- 172.21.15.55:0/3320991029 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2d41f52b0 con 0x7ff2d40b54f0 2024-05-27T12:33:16.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.517+0000 7ff2dadef640 1 -- 172.21.15.55:0/3320991029 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2d4075460 con 0x7ff2d40b54f0 2024-05-27T12:33:16.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.517+0000 7ff2d17fa640 1 -- 172.21.15.55:0/3320991029 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff2c401a070 con 0x7ff2d40b54f0 2024-05-27T12:33:16.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.518+0000 7ff2d17fa640 1 --2- 172.21.15.55:0/3320991029 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7ff2b406c8f0 0x7ff2b406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:16.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.518+0000 7ff2d17fa640 1 -- 172.21.15.55:0/3320991029 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7ff2c408bfb0 con 0x7ff2d40b54f0 2024-05-27T12:33:16.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.518+0000 7ff2d3fff640 1 --2- 172.21.15.55:0/3320991029 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7ff2b406c8f0 0x7ff2b406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:16.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.519+0000 7ff2d3fff640 1 --2- 172.21.15.55:0/3320991029 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7ff2b406c8f0 0x7ff2b406edb0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ff2bc034000 tx=0x7ff2bc02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:16.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.522+0000 7ff2d17fa640 1 -- 172.21.15.55:0/3320991029 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff2c405a350 con 0x7ff2d40b54f0 2024-05-27T12:33:16.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.718+0000 7ff2dadef640 1 -- 172.21.15.55:0/3320991029 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7ff2d415c3d0 con 0x7ff2d40b54f0 2024-05-27T12:33:16.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.719+0000 7ff2d17fa640 1 -- 172.21.15.55:0/3320991029 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) ==== 80+0+0 (secure 0 0 0) 0x7ff2c4059c50 con 0x7ff2d40b54f0 2024-05-27T12:33:16.718 INFO:teuthology.orchestra.run.smithi055.stderr:listed 0 entries 2024-05-27T12:33:16.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.721+0000 7ff2dadef640 1 -- 172.21.15.55:0/3320991029 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7ff2b406c8f0 msgr2=0x7ff2b406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:16.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.721+0000 7ff2dadef640 1 --2- 172.21.15.55:0/3320991029 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7ff2b406c8f0 0x7ff2b406edb0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ff2bc034000 tx=0x7ff2bc02e000 comp rx=0 tx=0).stop 2024-05-27T12:33:16.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.721+0000 7ff2dadef640 1 -- 172.21.15.55:0/3320991029 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2d40b54f0 msgr2=0x7ff2d4156770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:16.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.721+0000 7ff2dadef640 1 --2- 172.21.15.55:0/3320991029 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2d40b54f0 0x7ff2d4156770 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7ff2c400e9b0 tx=0x7ff2c400ee70 comp rx=0 tx=0).stop 2024-05-27T12:33:16.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.721+0000 7ff2dadef640 1 -- 172.21.15.55:0/3320991029 shutdown_connections 2024-05-27T12:33:16.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.721+0000 7ff2dadef640 1 --2- 172.21.15.55:0/3320991029 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff2d41f4720 0x7ff2d4071e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:16.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.721+0000 7ff2dadef640 1 --2- 172.21.15.55:0/3320991029 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7ff2b406c8f0 0x7ff2b406edb0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:16.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.721+0000 7ff2dadef640 1 --2- 172.21.15.55:0/3320991029 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff2d415bae0 0x7ff2d41f41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:16.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.721+0000 7ff2dadef640 1 --2- 172.21.15.55:0/3320991029 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2d40b54f0 0x7ff2d4156770 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:16.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.721+0000 7ff2dadef640 1 -- 172.21.15.55:0/3320991029 >> 172.21.15.55:0/3320991029 conn(0x7ff2d406b930 msgr2=0x7ff2d415f950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:16.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.721+0000 7ff2dadef640 1 -- 172.21.15.55:0/3320991029 shutdown_connections 2024-05-27T12:33:16.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:16.721+0000 7ff2dadef640 1 -- 172.21.15.55:0/3320991029 wait complete. 2024-05-27T12:33:16.731 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-05-27T12:33:16.731 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T12:33:16.731 DEBUG:teuthology.orchestra.run.smithi055:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-05-27T12:33:16.759 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi055.front.sepia.ceph.com 2024-05-27T12:33:16.759 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T12:33:16.759 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-27T12:33:16.822 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-05-27T12:33:16.823 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-27T12:33:16.844 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-05-27T12:33:16.844 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-27T12:33:16.902 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-05-27T12:33:16.902 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-27T12:33:16.960 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-27T12:33:17.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.066+0000 7fde71acb640 1 Processor -- start 2024-05-27T12:33:17.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.066+0000 7fde71acb640 1 -- start start 2024-05-27T12:33:17.067 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.067+0000 7fde71acb640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fde6c0cf840 0x7fde6c0c5e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:17.067 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.067+0000 7fde71acb640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde6c06f450 con 0x7fde6c15a250 2024-05-27T12:33:17.067 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.067+0000 7fde71acb640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde6c160360 con 0x7fde6c0cf400 2024-05-27T12:33:17.067 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.067+0000 7fde71acb640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fde6c160f70 con 0x7fde6c0cf840 2024-05-27T12:33:17.067 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.067+0000 7fde6b7fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fde6c15a250 0x7fde6c06ed40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:48630/0 (socket says 172.21.15.55:48630) 2024-05-27T12:33:17.067 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.067+0000 7fde6b7fe640 1 -- 172.21.15.55:0/794155470 learned_addr learned my addr 172.21.15.55:0/794155470 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-27T12:33:17.067 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.067+0000 7fde6bfff640 1 --2- 172.21.15.55:0/794155470 >> v2:172.21.15.72:3300/0 conn(0x7fde6c0cf840 0x7fde6c0c5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:17.067 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.067+0000 7fde6a7fc640 1 -- 172.21.15.55:0/794155470 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3341525089 0 0) 0x7fde6c06f450 con 0x7fde6c15a250 2024-05-27T12:33:17.067 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.067+0000 7fde6a7fc640 1 -- 172.21.15.55:0/794155470 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fde54003520 con 0x7fde6c15a250 2024-05-27T12:33:17.067 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.067+0000 7fde6a7fc640 1 -- 172.21.15.55:0/794155470 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2184299399 0 0) 0x7fde54003520 con 0x7fde6c15a250 2024-05-27T12:33:17.067 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.067+0000 7fde6bfff640 1 -- 172.21.15.55:0/794155470 >> v1:172.21.15.72:6789/0 conn(0x7fde6c0cf400 legacy=0x7fde6c0c5710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:17.068 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.067+0000 7fde6bfff640 1 -- 172.21.15.55:0/794155470 >> v1:172.21.15.55:6789/0 conn(0x7fde6c15a250 legacy=0x7fde6c06ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:17.068 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.067+0000 7fde6bfff640 1 -- 172.21.15.55:0/794155470 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde6c160640 con 0x7fde6c0cf840 2024-05-27T12:33:17.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.068+0000 7fde6bfff640 1 --2- 172.21.15.55:0/794155470 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fde6c0cf840 0x7fde6c0c5e20 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fde640097a0 tx=0x7fde6402a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=29bea58b1fd2a94c server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:17.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.068+0000 7fde6a7fc640 1 -- 172.21.15.55:0/794155470 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde64037070 con 0x7fde6c0cf840 2024-05-27T12:33:17.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.068+0000 7fde6a7fc640 1 -- 172.21.15.55:0/794155470 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde6402ac50 con 0x7fde6c0cf840 2024-05-27T12:33:17.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.068+0000 7fde6a7fc640 1 -- 172.21.15.55:0/794155470 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde5c001670 con 0x7fde6c0cf840 2024-05-27T12:33:17.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.069+0000 7fde71acb640 1 -- 172.21.15.55:0/794155470 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fde6c0cf840 msgr2=0x7fde6c0c5e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:17.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.069+0000 7fde71acb640 1 --2- 172.21.15.55:0/794155470 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fde6c0cf840 0x7fde6c0c5e20 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fde640097a0 tx=0x7fde6402a1c0 comp rx=0 tx=0).stop 2024-05-27T12:33:17.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.069+0000 7fde71acb640 1 -- 172.21.15.55:0/794155470 shutdown_connections 2024-05-27T12:33:17.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.069+0000 7fde71acb640 1 --2- 172.21.15.55:0/794155470 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fde6c0cf840 0x7fde6c0c5e20 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:17.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.069+0000 7fde71acb640 1 -- 172.21.15.55:0/794155470 >> 172.21.15.55:0/794155470 conn(0x7fde6c0b3830 msgr2=0x7fde6c0b3c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:17.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.069+0000 7fde71acb640 1 -- 172.21.15.55:0/794155470 shutdown_connections 2024-05-27T12:33:17.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.069+0000 7fde71acb640 1 -- 172.21.15.55:0/794155470 wait complete. 2024-05-27T12:33:17.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.070+0000 7fde71acb640 1 Processor -- start 2024-05-27T12:33:17.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.070+0000 7fde71acb640 1 -- start start 2024-05-27T12:33:17.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.071+0000 7fde71acb640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fde6c0cf400 0x7fde6c151440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:17.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.071+0000 7fde71acb640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fde6c0cf840 0x7fde6c15bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:17.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.071+0000 7fde71acb640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fde6c15a250 0x7fde6c15c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:17.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.071+0000 7fde71acb640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7fde6c15a630 con 0x7fde6c0cf400 2024-05-27T12:33:17.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.071+0000 7fde71acb640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fde6c160c00 con 0x7fde6c0cf840 2024-05-27T12:33:17.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.071+0000 7fde71acb640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fde6c0cfc40 con 0x7fde6c15a250 2024-05-27T12:33:17.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.071+0000 7fde6b7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fde6c0cf400 0x7fde6c151440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:17.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.071+0000 7fde6b7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fde6c0cf400 0x7fde6c151440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44350/0 (socket says 172.21.15.55:44350) 2024-05-27T12:33:17.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.071+0000 7fde6b7fe640 1 -- 172.21.15.55:0/2681490057 learned_addr learned my addr 172.21.15.55:0/2681490057 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:33:17.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.071+0000 7fde6bfff640 1 --2- 172.21.15.55:0/2681490057 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fde6c15a250 0x7fde6c15c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:17.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.071+0000 7fde6affd640 1 --2- 172.21.15.55:0/2681490057 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fde6c0cf840 0x7fde6c15bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:17.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.072+0000 7fde6b7fe640 1 -- 172.21.15.55:0/2681490057 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fde6c15a250 msgr2=0x7fde6c15c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:17.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.072+0000 7fde6b7fe640 1 --2- 172.21.15.55:0/2681490057 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fde6c15a250 0x7fde6c15c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:17.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.072+0000 7fde6b7fe640 1 -- 172.21.15.55:0/2681490057 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fde6c0cf840 msgr2=0x7fde6c15bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:17.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.072+0000 7fde6b7fe640 1 --2- 172.21.15.55:0/2681490057 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fde6c0cf840 0x7fde6c15bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:17.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.072+0000 7fde6b7fe640 1 -- 172.21.15.55:0/2681490057 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde6c14be80 con 0x7fde6c0cf400 2024-05-27T12:33:17.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.072+0000 7fde6bfff640 1 --2- 172.21.15.55:0/2681490057 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fde6c15a250 0x7fde6c15c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T12:33:17.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.072+0000 7fde6affd640 1 --2- 172.21.15.55:0/2681490057 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fde6c0cf840 0x7fde6c15bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T12:33:17.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.072+0000 7fde6b7fe640 1 --2- 172.21.15.55:0/2681490057 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fde6c0cf400 0x7fde6c151440 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fde5c00c580 tx=0x7fde5c00ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:17.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.072+0000 7fde53fff640 1 -- 172.21.15.55:0/2681490057 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde5c017070 con 0x7fde6c0cf400 2024-05-27T12:33:17.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.072+0000 7fde53fff640 1 -- 172.21.15.55:0/2681490057 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde5c005d00 con 0x7fde6c0cf400 2024-05-27T12:33:17.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.072+0000 7fde53fff640 1 -- 172.21.15.55:0/2681490057 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde5c007330 con 0x7fde6c0cf400 2024-05-27T12:33:17.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.072+0000 7fde71acb640 1 -- 172.21.15.55:0/2681490057 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde6c14c160 con 0x7fde6c0cf400 2024-05-27T12:33:17.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.072+0000 7fde71acb640 1 -- 172.21.15.55:0/2681490057 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde6c14c720 con 0x7fde6c0cf400 2024-05-27T12:33:17.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.073+0000 7fde71acb640 1 -- 172.21.15.55:0/2681490057 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde6c075460 con 0x7fde6c0cf400 2024-05-27T12:33:17.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.073+0000 7fde53fff640 1 -- 172.21.15.55:0/2681490057 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fde5c01a070 con 0x7fde6c0cf400 2024-05-27T12:33:17.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.074+0000 7fde53fff640 1 --2- 172.21.15.55:0/2681490057 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fde5806c8f0 0x7fde5806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:17.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.074+0000 7fde53fff640 1 -- 172.21.15.55:0/2681490057 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fde5c08af90 con 0x7fde6c0cf400 2024-05-27T12:33:17.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.074+0000 7fde6affd640 1 --2- 172.21.15.55:0/2681490057 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fde5806c8f0 0x7fde5806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:17.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.075+0000 7fde6affd640 1 --2- 172.21.15.55:0/2681490057 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fde5806c8f0 0x7fde5806edb0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fde6c153640 tx=0x7fde60009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:17.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.078+0000 7fde53fff640 1 -- 172.21.15.55:0/2681490057 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fde5c0593d0 con 0x7fde6c0cf400 2024-05-27T12:33:17.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.267+0000 7fde71acb640 1 -- 172.21.15.55:0/2681490057 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fde6c155b40 con 0x7fde6c0cf400 2024-05-27T12:33:17.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.268+0000 7fde53fff640 1 -- 172.21.15.55:0/2681490057 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16557 (secure 0 0 0) 0x7fde5c058cd0 con 0x7fde6c0cf400 2024-05-27T12:33:17.267 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-27T12:33:17.268 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":23,"fsid":"c3ff4e3b-8dae-4856-9593-e5cc66c59982","created":"2024-05-27T12:32:17.019097+0000","modified":"2024-05-27T12:32:43.361598+0000","last_up_change":"2024-05-27T12:32:28.109744+0000","last_in_change":"2024-05-27T12:32:19.309872+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-27T12:32:29.277895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-27T12:32:39.442745+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-27T12:32:40.672118+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e607b598-061b-4b6f-92ff-95c20b330599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":807572567},{"type":"v1","addr":"172.21.15.55:6801","nonce":807572567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":807572567},{"type":"v1","addr":"172.21.15.55:6803","nonce":807572567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":807572567},{"type":"v1","addr":"172.21.15.55:6807","nonce":807572567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":807572567},{"type":"v1","addr":"172.21.15.55:6805","nonce":807572567}]},"public_addr":"172.21.15.55:6801/807572567","cluster_addr":"172.21.15.55:6803/807572567","heartbeat_back_addr":"172.21.15.55:6807/807572567","heartbeat_front_addr":"172.21.15.55:6805/807572567","state":["exists","up"]},{"osd":1,"uuid":"ba2b5b1d-71a9-4ecc-9a48-55aa7fe54261","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":3426897300},{"type":"v1","addr":"172.21.15.55:6825","nonce":3426897300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":3426897300},{"type":"v1","addr":"172.21.15.55:6827","nonce":3426897300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":3426897300},{"type":"v1","addr":"172.21.15.55:6831","nonce":3426897300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":3426897300},{"type":"v1","addr":"172.21.15.55:6829","nonce":3426897300}]},"public_addr":"172.21.15.55:6825/3426897300","cluster_addr":"172.21.15.55:6827/3426897300","heartbeat_back_addr":"172.21.15.55:6831/3426897300","heartbeat_front_addr":"172.21.15.55:6829/3426897300","state":["exists","up"]},{"osd":2,"uuid":"e6b81cc6-4ff1-45d0-87eb-9f04ccf986a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3510271725},{"type":"v1","addr":"172.21.15.55:6809","nonce":3510271725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3510271725},{"type":"v1","addr":"172.21.15.55:6811","nonce":3510271725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3510271725},{"type":"v1","addr":"172.21.15.55:6815","nonce":3510271725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3510271725},{"type":"v1","addr":"172.21.15.55:6813","nonce":3510271725}]},"public_addr":"172.21.15.55:6809/3510271725","cluster_addr":"172.21.15.55:6811/3510271725","heartbeat_back_addr":"172.21.15.55:6815/3510271725","heartbeat_front_addr":"172.21.15.55:6813/3510271725","state":["exists","up"]},{"osd":3,"uuid":"b6a34b75-807d-4693-b1c3-903cb4c618d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":1066693520},{"type":"v1","addr":"172.21.15.55:6817","nonce":1066693520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":1066693520},{"type":"v1","addr":"172.21.15.55:6819","nonce":1066693520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":1066693520},{"type":"v1","addr":"172.21.15.55:6823","nonce":1066693520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":1066693520},{"type":"v1","addr":"172.21.15.55:6821","nonce":1066693520}]},"public_addr":"172.21.15.55:6817/1066693520","cluster_addr":"172.21.15.55:6819/1066693520","heartbeat_back_addr":"172.21.15.55:6823/1066693520","heartbeat_front_addr":"172.21.15.55:6821/1066693520","state":["exists","up"]},{"osd":4,"uuid":"272ec937-56b4-4f0a-b2e1-b0bc189c9d79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":4190771237},{"type":"v1","addr":"172.21.15.72:6820","nonce":4190771237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":4190771237},{"type":"v1","addr":"172.21.15.72:6824","nonce":4190771237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":4190771237},{"type":"v1","addr":"172.21.15.72:6831","nonce":4190771237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":4190771237},{"type":"v1","addr":"172.21.15.72:6828","nonce":4190771237}]},"public_addr":"172.21.15.72:6820/4190771237","cluster_addr":"172.21.15.72:6824/4190771237","heartbeat_back_addr":"172.21.15.72:6831/4190771237","heartbeat_front_addr":"172.21.15.72:6828/4190771237","state":["exists","up"]},{"osd":5,"uuid":"56439854-72a0-4ef4-81ff-184a3d924a5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":2421889184},{"type":"v1","addr":"172.21.15.72:6801","nonce":2421889184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6803","nonce":2421889184},{"type":"v1","addr":"172.21.15.72:6805","nonce":2421889184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":2421889184},{"type":"v1","addr":"172.21.15.72:6813","nonce":2421889184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6807","nonce":2421889184},{"type":"v1","addr":"172.21.15.72:6809","nonce":2421889184}]},"public_addr":"172.21.15.72:6801/2421889184","cluster_addr":"172.21.15.72:6805/2421889184","heartbeat_back_addr":"172.21.15.72:6813/2421889184","heartbeat_front_addr":"172.21.15.72:6809/2421889184","state":["exists","up"]},{"osd":6,"uuid":"e248e2be-3b6e-49cf-8c8a-1a4152827582","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3796994599},{"type":"v1","addr":"172.21.15.72:6804","nonce":3796994599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":3796994599},{"type":"v1","addr":"172.21.15.72:6808","nonce":3796994599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":3796994599},{"type":"v1","addr":"172.21.15.72:6815","nonce":3796994599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":3796994599},{"type":"v1","addr":"172.21.15.72:6812","nonce":3796994599}]},"public_addr":"172.21.15.72:6804/3796994599","cluster_addr":"172.21.15.72:6808/3796994599","heartbeat_back_addr":"172.21.15.72:6815/3796994599","heartbeat_front_addr":"172.21.15.72:6812/3796994599","state":["exists","up"]},{"osd":7,"uuid":"505a62d3-322b-4629-b4fd-187a55563709","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":3024877895},{"type":"v1","addr":"172.21.15.72:6817","nonce":3024877895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":3024877895},{"type":"v1","addr":"172.21.15.72:6821","nonce":3024877895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6827","nonce":3024877895},{"type":"v1","addr":"172.21.15.72:6829","nonce":3024877895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6823","nonce":3024877895},{"type":"v1","addr":"172.21.15.72:6825","nonce":3024877895}]},"public_addr":"172.21.15.72:6817/3024877895","cluster_addr":"172.21.15.72:6821/3024877895","heartbeat_back_addr":"172.21.15.72:6829/3024877895","heartbeat_front_addr":"172.21.15.72:6825/3024877895","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.241014+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.450799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.465018+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.507647+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.534763+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.495895+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.427110+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.547466+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-27T12:33:17.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.270+0000 7fde71acb640 1 -- 172.21.15.55:0/2681490057 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fde5806c8f0 msgr2=0x7fde5806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:17.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.270+0000 7fde71acb640 1 --2- 172.21.15.55:0/2681490057 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fde5806c8f0 0x7fde5806edb0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fde6c153640 tx=0x7fde60009040 comp rx=0 tx=0).stop 2024-05-27T12:33:17.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.270+0000 7fde71acb640 1 -- 172.21.15.55:0/2681490057 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fde6c0cf400 msgr2=0x7fde6c151440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:17.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.270+0000 7fde71acb640 1 --2- 172.21.15.55:0/2681490057 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fde6c0cf400 0x7fde6c151440 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fde5c00c580 tx=0x7fde5c00ca40 comp rx=0 tx=0).stop 2024-05-27T12:33:17.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.270+0000 7fde71acb640 1 -- 172.21.15.55:0/2681490057 shutdown_connections 2024-05-27T12:33:17.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.270+0000 7fde71acb640 1 --2- 172.21.15.55:0/2681490057 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fde6c15a250 0x7fde6c15c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:17.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.270+0000 7fde71acb640 1 --2- 172.21.15.55:0/2681490057 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fde5806c8f0 0x7fde5806edb0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:17.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.270+0000 7fde71acb640 1 --2- 172.21.15.55:0/2681490057 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fde6c0cf840 0x7fde6c15bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:17.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.270+0000 7fde71acb640 1 --2- 172.21.15.55:0/2681490057 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fde6c0cf400 0x7fde6c151440 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:17.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.270+0000 7fde71acb640 1 -- 172.21.15.55:0/2681490057 >> 172.21.15.55:0/2681490057 conn(0x7fde6c0b3830 msgr2=0x7fde6c15dfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:17.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.271+0000 7fde71acb640 1 -- 172.21.15.55:0/2681490057 shutdown_connections 2024-05-27T12:33:17.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.271+0000 7fde71acb640 1 -- 172.21.15.55:0/2681490057 wait complete. 2024-05-27T12:33:17.281 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-27T12:32:29.277895+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-27T12:32:39.442745+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-27T12:32:40.672118+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-27T12:33:17.282 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-27T12:33:17.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.389+0000 7f2a526cb640 1 Processor -- start 2024-05-27T12:33:17.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.389+0000 7f2a526cb640 1 -- start start 2024-05-27T12:33:17.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.390+0000 7f2a526cb640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2a4c0cfb40 0x7f2a4c0d1830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:17.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.390+0000 7f2a526cb640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2a4c0d1d70 0x7f2a4c0b78f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:17.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.390+0000 7f2a526cb640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a4c0d2180 con 0x7f2a4c15eb00 2024-05-27T12:33:17.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.390+0000 7f2a526cb640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f2a4c0d5700 con 0x7f2a4c0cfb40 2024-05-27T12:33:17.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.390+0000 7f2a526cb640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f2a4c15eee0 con 0x7f2a4c0d1d70 2024-05-27T12:33:17.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.390+0000 7f2a4b7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2a4c0cfb40 0x7f2a4c0d1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:17.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.390+0000 7f2a4bfff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f2a4c15eb00 0x7f2a4c0d3e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:48640/0 (socket says 172.21.15.55:48640) 2024-05-27T12:33:17.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.390+0000 7f2a4bfff640 1 -- 172.21.15.55:0/4220614065 learned_addr learned my addr 172.21.15.55:0/4220614065 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-27T12:33:17.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.391+0000 7f2a50c68640 1 --2- 172.21.15.55:0/4220614065 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2a4c0d1d70 0x7f2a4c0b78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:17.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.391+0000 7f2a4b7fe640 1 -- 172.21.15.55:0/4220614065 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2a4c0d1d70 msgr2=0x7f2a4c0b78f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:17.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.391+0000 7f2a4b7fe640 1 --2- 172.21.15.55:0/4220614065 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2a4c0d1d70 0x7f2a4c0b78f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:17.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.391+0000 7f2a4b7fe640 1 -- 172.21.15.55:0/4220614065 >> v1:172.21.15.55:6789/0 conn(0x7f2a4c15eb00 legacy=0x7f2a4c0d3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:17.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.391+0000 7f2a4b7fe640 1 -- 172.21.15.55:0/4220614065 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a4c0d4660 con 0x7f2a4c0cfb40 2024-05-27T12:33:17.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.391+0000 7f2a4affd640 1 -- 172.21.15.55:0/4220614065 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4112746020 0 0) 0x7f2a3c001110 con 0x7f2a4c15eb00 2024-05-27T12:33:17.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.392+0000 7f2a4b7fe640 1 --2- 172.21.15.55:0/4220614065 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2a4c0cfb40 0x7f2a4c0d1830 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f2a400097a0 tx=0x7f2a4002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68958e1fc2f6e720 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:17.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.392+0000 7f2a4affd640 1 -- 172.21.15.55:0/4220614065 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a40037070 con 0x7f2a4c0cfb40 2024-05-27T12:33:17.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.392+0000 7f2a4affd640 1 -- 172.21.15.55:0/4220614065 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a40032440 con 0x7f2a4c0cfb40 2024-05-27T12:33:17.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.392+0000 7f2a4affd640 1 -- 172.21.15.55:0/4220614065 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a40032810 con 0x7f2a4c0cfb40 2024-05-27T12:33:17.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.392+0000 7f2a526cb640 1 -- 172.21.15.55:0/4220614065 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2a4c0cfb40 msgr2=0x7f2a4c0d1830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:17.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.392+0000 7f2a526cb640 1 --2- 172.21.15.55:0/4220614065 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2a4c0cfb40 0x7f2a4c0d1830 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f2a400097a0 tx=0x7f2a4002a210 comp rx=0 tx=0).stop 2024-05-27T12:33:17.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.392+0000 7f2a526cb640 1 -- 172.21.15.55:0/4220614065 shutdown_connections 2024-05-27T12:33:17.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.392+0000 7f2a526cb640 1 --2- 172.21.15.55:0/4220614065 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2a4c0d1d70 0x7f2a4c0b78f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:17.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.392+0000 7f2a526cb640 1 --2- 172.21.15.55:0/4220614065 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2a4c0cfb40 0x7f2a4c0d1830 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:17.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.392+0000 7f2a526cb640 1 -- 172.21.15.55:0/4220614065 >> 172.21.15.55:0/4220614065 conn(0x7f2a4c067a50 msgr2=0x7f2a4c067e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:17.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.392+0000 7f2a526cb640 1 -- 172.21.15.55:0/4220614065 shutdown_connections 2024-05-27T12:33:17.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.392+0000 7f2a526cb640 1 -- 172.21.15.55:0/4220614065 wait complete. 2024-05-27T12:33:17.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.393+0000 7f2a526cb640 1 Processor -- start 2024-05-27T12:33:17.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.394+0000 7f2a526cb640 1 -- start start 2024-05-27T12:33:17.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.394+0000 7f2a526cb640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2a4c0cfb40 0x7f2a4c0caca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:17.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.394+0000 7f2a526cb640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a4c0d1d70 0x7f2a4c1f4250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:17.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.394+0000 7f2a526cb640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2a4c15eb00 0x7f2a4c15fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:17.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.394+0000 7f2a526cb640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f2a4c0d4f00 con 0x7f2a4c0cfb40 2024-05-27T12:33:17.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.394+0000 7f2a526cb640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f2a4c0d4c20 con 0x7f2a4c0d1d70 2024-05-27T12:33:17.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.394+0000 7f2a526cb640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f2a4c0d51e0 con 0x7f2a4c15eb00 2024-05-27T12:33:17.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.394+0000 7f2a4bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2a4c0cfb40 0x7f2a4c0caca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:17.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.395+0000 7f2a4bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2a4c0cfb40 0x7f2a4c0caca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44364/0 (socket says 172.21.15.55:44364) 2024-05-27T12:33:17.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.395+0000 7f2a4bfff640 1 -- 172.21.15.55:0/286807982 learned_addr learned my addr 172.21.15.55:0/286807982 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:33:17.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.395+0000 7f2a4b7fe640 1 --2- 172.21.15.55:0/286807982 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a4c0d1d70 0x7f2a4c1f4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:17.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.395+0000 7f2a50c68640 1 --2- 172.21.15.55:0/286807982 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2a4c15eb00 0x7f2a4c15fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:17.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.395+0000 7f2a4bfff640 1 -- 172.21.15.55:0/286807982 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2a4c15eb00 msgr2=0x7f2a4c15fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:17.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.395+0000 7f2a4bfff640 1 --2- 172.21.15.55:0/286807982 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2a4c15eb00 0x7f2a4c15fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:17.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.395+0000 7f2a4bfff640 1 -- 172.21.15.55:0/286807982 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a4c0d1d70 msgr2=0x7f2a4c1f4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:17.397 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.395+0000 7f2a4bfff640 1 --2- 172.21.15.55:0/286807982 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a4c0d1d70 0x7f2a4c1f4250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:17.397 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.395+0000 7f2a4bfff640 1 -- 172.21.15.55:0/286807982 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a4c160290 con 0x7f2a4c0cfb40 2024-05-27T12:33:17.397 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.395+0000 7f2a4bfff640 1 --2- 172.21.15.55:0/286807982 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2a4c0cfb40 0x7f2a4c0caca0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f2a3c00c7b0 tx=0x7f2a3c00cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:17.397 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.395+0000 7f2a48ff9640 1 -- 172.21.15.55:0/286807982 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a3c018070 con 0x7f2a4c0cfb40 2024-05-27T12:33:17.397 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.395+0000 7f2a48ff9640 1 -- 172.21.15.55:0/286807982 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a3c0072d0 con 0x7f2a4c0cfb40 2024-05-27T12:33:17.397 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.395+0000 7f2a526cb640 1 -- 172.21.15.55:0/286807982 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a4c1f49c0 con 0x7f2a4c0cfb40 2024-05-27T12:33:17.397 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.395+0000 7f2a48ff9640 1 -- 172.21.15.55:0/286807982 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a3c0047e0 con 0x7f2a4c0cfb40 2024-05-27T12:33:17.397 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.395+0000 7f2a526cb640 1 -- 172.21.15.55:0/286807982 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a4c1f4f80 con 0x7f2a4c0cfb40 2024-05-27T12:33:17.397 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.396+0000 7f2a526cb640 1 -- 172.21.15.55:0/286807982 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a4c068a70 con 0x7f2a4c0cfb40 2024-05-27T12:33:17.397 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.397+0000 7f2a48ff9640 1 -- 172.21.15.55:0/286807982 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2a3c01b070 con 0x7f2a4c0cfb40 2024-05-27T12:33:17.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.397+0000 7f2a48ff9640 1 --2- 172.21.15.55:0/286807982 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f2a3806c8f0 0x7f2a3806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:17.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.397+0000 7f2a48ff9640 1 -- 172.21.15.55:0/286807982 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f2a3c08ae80 con 0x7f2a4c0cfb40 2024-05-27T12:33:17.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.397+0000 7f2a4b7fe640 1 --2- 172.21.15.55:0/286807982 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f2a3806c8f0 0x7f2a3806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:17.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.398+0000 7f2a4b7fe640 1 --2- 172.21.15.55:0/286807982 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f2a3806c8f0 0x7f2a3806edb0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f2a40034000 tx=0x7f2a4002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:17.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.401+0000 7f2a48ff9640 1 -- 172.21.15.55:0/286807982 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2a4c0d2180 con 0x7f2a4c0cfb40 2024-05-27T12:33:17.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.586+0000 7f2a526cb640 1 -- 172.21.15.55:0/286807982 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f2a4c06bcc0 con 0x7f2a4c0cfb40 2024-05-27T12:33:17.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.586+0000 7f2a48ff9640 1 -- 172.21.15.55:0/286807982 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) ==== 93+0+10 (secure 0 0 0) 0x7f2a3c0592b0 con 0x7f2a4c0cfb40 2024-05-27T12:33:17.586 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-05-27T12:33:17.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.588+0000 7f2a526cb640 1 -- 172.21.15.55:0/286807982 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f2a3806c8f0 msgr2=0x7f2a3806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:17.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.588+0000 7f2a526cb640 1 --2- 172.21.15.55:0/286807982 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f2a3806c8f0 0x7f2a3806edb0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f2a40034000 tx=0x7f2a4002e000 comp rx=0 tx=0).stop 2024-05-27T12:33:17.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.588+0000 7f2a526cb640 1 -- 172.21.15.55:0/286807982 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2a4c0cfb40 msgr2=0x7f2a4c0caca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:17.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.588+0000 7f2a526cb640 1 --2- 172.21.15.55:0/286807982 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2a4c0cfb40 0x7f2a4c0caca0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f2a3c00c7b0 tx=0x7f2a3c00cc70 comp rx=0 tx=0).stop 2024-05-27T12:33:17.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.588+0000 7f2a526cb640 1 -- 172.21.15.55:0/286807982 shutdown_connections 2024-05-27T12:33:17.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.588+0000 7f2a526cb640 1 --2- 172.21.15.55:0/286807982 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2a4c15eb00 0x7f2a4c15fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:17.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.588+0000 7f2a526cb640 1 --2- 172.21.15.55:0/286807982 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f2a3806c8f0 0x7f2a3806edb0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:17.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.588+0000 7f2a526cb640 1 --2- 172.21.15.55:0/286807982 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a4c0d1d70 0x7f2a4c1f4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:17.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.588+0000 7f2a526cb640 1 --2- 172.21.15.55:0/286807982 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2a4c0cfb40 0x7f2a4c0caca0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:17.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.588+0000 7f2a526cb640 1 -- 172.21.15.55:0/286807982 >> 172.21.15.55:0/286807982 conn(0x7f2a4c067a50 msgr2=0x7f2a4c0b7890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:17.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.588+0000 7f2a526cb640 1 -- 172.21.15.55:0/286807982 shutdown_connections 2024-05-27T12:33:17.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.588+0000 7f2a526cb640 1 -- 172.21.15.55:0/286807982 wait complete. 2024-05-27T12:33:17.599 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-27T12:33:17.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.706+0000 7f0f61891640 1 Processor -- start 2024-05-27T12:33:17.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.706+0000 7f0f61891640 1 -- start start 2024-05-27T12:33:17.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.707+0000 7f0f61891640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0f5c15eaf0 0x7f0f5c0b1b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:17.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.707+0000 7f0f61891640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f5c0b0d40 con 0x7f0f5c0b24e0 2024-05-27T12:33:17.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.707+0000 7f0f61891640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f5c0b1020 con 0x7f0f5c06c040 2024-05-27T12:33:17.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.707+0000 7f0f61891640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f0f5c1635f0 con 0x7f0f5c15eaf0 2024-05-27T12:33:17.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.707+0000 7f0f5a7fc640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f0f5c0b24e0 0x7f0f5c06b930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:48652/0 (socket says 172.21.15.55:48652) 2024-05-27T12:33:17.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.707+0000 7f0f5a7fc640 1 -- 172.21.15.55:0/597490125 learned_addr learned my addr 172.21.15.55:0/597490125 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-27T12:33:17.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.707+0000 7f0f5affd640 1 --2- 172.21.15.55:0/597490125 >> v2:172.21.15.72:3300/0 conn(0x7f0f5c15eaf0 0x7f0f5c0b1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:17.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.708+0000 7f0f59ffb640 1 -- 172.21.15.55:0/597490125 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2881697025 0 0) 0x7f0f5c0b0d40 con 0x7f0f5c0b24e0 2024-05-27T12:33:17.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.708+0000 7f0f59ffb640 1 -- 172.21.15.55:0/597490125 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0f48003520 con 0x7f0f5c0b24e0 2024-05-27T12:33:17.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.708+0000 7f0f5affd640 1 -- 172.21.15.55:0/597490125 >> v1:172.21.15.72:6789/0 conn(0x7f0f5c06c040 legacy=0x7f0f5c0d07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:17.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.708+0000 7f0f5affd640 1 -- 172.21.15.55:0/597490125 >> v1:172.21.15.55:6789/0 conn(0x7f0f5c0b24e0 legacy=0x7f0f5c06b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:17.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.708+0000 7f0f5affd640 1 -- 172.21.15.55:0/597490125 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f5c0b1300 con 0x7f0f5c15eaf0 2024-05-27T12:33:17.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.708+0000 7f0f5affd640 1 --2- 172.21.15.55:0/597490125 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0f5c15eaf0 0x7f0f5c0b1b00 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f0f540097a0 tx=0x7f0f5402a2c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ad48945a3ae7aef3 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:17.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.709+0000 7f0f59ffb640 1 -- 172.21.15.55:0/597490125 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f54037070 con 0x7f0f5c15eaf0 2024-05-27T12:33:17.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.709+0000 7f0f59ffb640 1 -- 172.21.15.55:0/597490125 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f54032640 con 0x7f0f5c15eaf0 2024-05-27T12:33:17.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.709+0000 7f0f59ffb640 1 -- 172.21.15.55:0/597490125 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f54032a10 con 0x7f0f5c15eaf0 2024-05-27T12:33:17.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.709+0000 7f0f61891640 1 -- 172.21.15.55:0/597490125 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0f5c15eaf0 msgr2=0x7f0f5c0b1b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:17.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.709+0000 7f0f61891640 1 --2- 172.21.15.55:0/597490125 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0f5c15eaf0 0x7f0f5c0b1b00 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f0f540097a0 tx=0x7f0f5402a2c0 comp rx=0 tx=0).stop 2024-05-27T12:33:17.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.709+0000 7f0f61891640 1 -- 172.21.15.55:0/597490125 shutdown_connections 2024-05-27T12:33:17.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.709+0000 7f0f61891640 1 --2- 172.21.15.55:0/597490125 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0f5c15eaf0 0x7f0f5c0b1b00 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:17.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.709+0000 7f0f61891640 1 -- 172.21.15.55:0/597490125 >> 172.21.15.55:0/597490125 conn(0x7f0f5c0733d0 msgr2=0x7f0f5c09aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:17.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.709+0000 7f0f61891640 1 -- 172.21.15.55:0/597490125 shutdown_connections 2024-05-27T12:33:17.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.709+0000 7f0f61891640 1 -- 172.21.15.55:0/597490125 wait complete. 2024-05-27T12:33:17.710 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.711+0000 7f0f61891640 1 Processor -- start 2024-05-27T12:33:17.710 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.711+0000 7f0f61891640 1 -- start start 2024-05-27T12:33:17.712 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.711+0000 7f0f61891640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0f5c06c040 0x7f0f5c0b5080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:17.712 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.711+0000 7f0f61891640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0f5c0b24e0 0x7f0f5c0c5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:17.712 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.712+0000 7f0f61891640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0f5c15eaf0 0x7f0f5c1f1be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:17.712 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.712+0000 7f0f61891640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f0f5c15eed0 con 0x7f0f5c0b24e0 2024-05-27T12:33:17.712 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.712+0000 7f0f61891640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f0f5c0b0af0 con 0x7f0f5c15eaf0 2024-05-27T12:33:17.712 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.712+0000 7f0f61891640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f0f5c0b2930 con 0x7f0f5c06c040 2024-05-27T12:33:17.712 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.712+0000 7f0f5a7fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0f5c0b24e0 0x7f0f5c0c5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:17.712 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.712+0000 7f0f5a7fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0f5c0b24e0 0x7f0f5c0c5120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44368/0 (socket says 172.21.15.55:44368) 2024-05-27T12:33:17.712 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.712+0000 7f0f5a7fc640 1 -- 172.21.15.55:0/1403102163 learned_addr learned my addr 172.21.15.55:0/1403102163 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:33:17.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.712+0000 7f0f5affd640 1 --2- 172.21.15.55:0/1403102163 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0f5c06c040 0x7f0f5c0b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:17.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.712+0000 7f0f5b7fe640 1 --2- 172.21.15.55:0/1403102163 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0f5c15eaf0 0x7f0f5c1f1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:17.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.712+0000 7f0f5a7fc640 1 -- 172.21.15.55:0/1403102163 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0f5c06c040 msgr2=0x7f0f5c0b5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:17.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.712+0000 7f0f5a7fc640 1 --2- 172.21.15.55:0/1403102163 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0f5c06c040 0x7f0f5c0b5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:17.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.712+0000 7f0f5a7fc640 1 -- 172.21.15.55:0/1403102163 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0f5c15eaf0 msgr2=0x7f0f5c1f1be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:17.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.712+0000 7f0f5a7fc640 1 --2- 172.21.15.55:0/1403102163 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0f5c15eaf0 0x7f0f5c1f1be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:17.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.712+0000 7f0f5a7fc640 1 -- 172.21.15.55:0/1403102163 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f5c0c63a0 con 0x7f0f5c0b24e0 2024-05-27T12:33:17.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.712+0000 7f0f5a7fc640 1 --2- 172.21.15.55:0/1403102163 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0f5c0b24e0 0x7f0f5c0c5120 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f0f4400c500 tx=0x7f0f4400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:17.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.712+0000 7f0f53fff640 1 -- 172.21.15.55:0/1403102163 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f44017070 con 0x7f0f5c0b24e0 2024-05-27T12:33:17.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.712+0000 7f0f53fff640 1 -- 172.21.15.55:0/1403102163 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f44005ce0 con 0x7f0f5c0b24e0 2024-05-27T12:33:17.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.712+0000 7f0f61891640 1 -- 172.21.15.55:0/1403102163 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f5c0c5820 con 0x7f0f5c0b24e0 2024-05-27T12:33:17.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.712+0000 7f0f53fff640 1 -- 172.21.15.55:0/1403102163 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f44007330 con 0x7f0f5c0b24e0 2024-05-27T12:33:17.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.712+0000 7f0f61891640 1 -- 172.21.15.55:0/1403102163 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f5c0c5de0 con 0x7f0f5c0b24e0 2024-05-27T12:33:17.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.714+0000 7f0f61891640 1 -- 172.21.15.55:0/1403102163 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f5c0c6ac0 con 0x7f0f5c0b24e0 2024-05-27T12:33:17.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.714+0000 7f0f53fff640 1 -- 172.21.15.55:0/1403102163 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0f4401a070 con 0x7f0f5c0b24e0 2024-05-27T12:33:17.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.714+0000 7f0f53fff640 1 --2- 172.21.15.55:0/1403102163 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f0f3c06c8f0 0x7f0f3c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:17.715 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.714+0000 7f0f53fff640 1 -- 172.21.15.55:0/1403102163 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f0f4408ae70 con 0x7f0f5c0b24e0 2024-05-27T12:33:17.715 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.715+0000 7f0f5affd640 1 --2- 172.21.15.55:0/1403102163 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f0f3c06c8f0 0x7f0f3c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:17.715 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.715+0000 7f0f5affd640 1 --2- 172.21.15.55:0/1403102163 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f0f3c06c8f0 0x7f0f3c06edb0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f0f54034000 tx=0x7f0f5402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:17.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.719+0000 7f0f53fff640 1 -- 172.21.15.55:0/1403102163 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f0f44058da0 con 0x7f0f5c0b24e0 2024-05-27T12:33:17.900 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.901+0000 7f0f61891640 1 -- 172.21.15.55:0/1403102163 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f0f5c0b7570 con 0x7f0f5c0b24e0 2024-05-27T12:33:17.901 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.901+0000 7f0f53fff640 1 -- 172.21.15.55:0/1403102163 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) ==== 104+0+11 (secure 0 0 0) 0x7f0f4405d0a0 con 0x7f0f5c0b24e0 2024-05-27T12:33:17.901 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2024-05-27T12:33:17.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.903+0000 7f0f61891640 1 -- 172.21.15.55:0/1403102163 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f0f3c06c8f0 msgr2=0x7f0f3c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:17.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.903+0000 7f0f61891640 1 --2- 172.21.15.55:0/1403102163 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f0f3c06c8f0 0x7f0f3c06edb0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f0f54034000 tx=0x7f0f5402e000 comp rx=0 tx=0).stop 2024-05-27T12:33:17.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.903+0000 7f0f61891640 1 -- 172.21.15.55:0/1403102163 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0f5c0b24e0 msgr2=0x7f0f5c0c5120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:17.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.903+0000 7f0f61891640 1 --2- 172.21.15.55:0/1403102163 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0f5c0b24e0 0x7f0f5c0c5120 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f0f4400c500 tx=0x7f0f4400c9c0 comp rx=0 tx=0).stop 2024-05-27T12:33:17.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.903+0000 7f0f61891640 1 -- 172.21.15.55:0/1403102163 shutdown_connections 2024-05-27T12:33:17.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.903+0000 7f0f61891640 1 --2- 172.21.15.55:0/1403102163 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f0f3c06c8f0 0x7f0f3c06edb0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:17.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.903+0000 7f0f61891640 1 --2- 172.21.15.55:0/1403102163 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0f5c15eaf0 0x7f0f5c1f1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:17.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.903+0000 7f0f61891640 1 --2- 172.21.15.55:0/1403102163 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0f5c0b24e0 0x7f0f5c0c5120 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:17.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.903+0000 7f0f61891640 1 --2- 172.21.15.55:0/1403102163 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0f5c06c040 0x7f0f5c0b5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:17.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.903+0000 7f0f61891640 1 -- 172.21.15.55:0/1403102163 >> 172.21.15.55:0/1403102163 conn(0x7f0f5c0733d0 msgr2=0x7f0f5c0d06b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:17.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.903+0000 7f0f61891640 1 -- 172.21.15.55:0/1403102163 shutdown_connections 2024-05-27T12:33:17.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:17.904+0000 7f0f61891640 1 -- 172.21.15.55:0/1403102163 wait complete. 2024-05-27T12:33:17.914 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-27T12:33:18.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.021+0000 7f4c0c043640 1 Processor -- start 2024-05-27T12:33:18.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.021+0000 7f4c0c043640 1 -- start start 2024-05-27T12:33:18.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.022+0000 7f4c0c043640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4c0415cb20 0x7f4c040d12e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:18.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.022+0000 7f4c0c043640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4c040b1f90 0x7f4c040cdb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:18.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.022+0000 7f4c0c043640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4c040b23d0 0x7f4c040ce060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:18.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.022+0000 7f4c0c043640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f4c040ce5a0 con 0x7f4c040b1f90 2024-05-27T12:33:18.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.022+0000 7f4c0c043640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f4c0409b790 con 0x7f4c040b23d0 2024-05-27T12:33:18.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.022+0000 7f4c0c043640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f4c0409ba70 con 0x7f4c0415cb20 2024-05-27T12:33:18.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.022+0000 7f4c095de640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4c040b1f90 0x7f4c040cdb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:18.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.022+0000 7f4c095de640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4c040b1f90 0x7f4c040cdb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44378/0 (socket says 172.21.15.55:44378) 2024-05-27T12:33:18.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.022+0000 7f4c095de640 1 -- 172.21.15.55:0/3746172531 learned_addr learned my addr 172.21.15.55:0/3746172531 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:33:18.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.022+0000 7f4c0a5e0640 1 --2- 172.21.15.55:0/3746172531 >> v2:172.21.15.72:3300/0 conn(0x7f4c040b23d0 0x7f4c040ce060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:18.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.022+0000 7f4c09ddf640 1 --2- 172.21.15.55:0/3746172531 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4c0415cb20 0x7f4c040d12e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:18.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.022+0000 7f4c095de640 1 -- 172.21.15.55:0/3746172531 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4c0415cb20 msgr2=0x7f4c040d12e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:18.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.022+0000 7f4c095de640 1 --2- 172.21.15.55:0/3746172531 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4c0415cb20 0x7f4c040d12e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:18.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.022+0000 7f4c095de640 1 -- 172.21.15.55:0/3746172531 >> v2:172.21.15.72:3300/0 conn(0x7f4c040b23d0 msgr2=0x7f4c040ce060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:18.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.022+0000 7f4c095de640 1 --2- 172.21.15.55:0/3746172531 >> v2:172.21.15.72:3300/0 conn(0x7f4c040b23d0 0x7f4c040ce060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:18.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.022+0000 7f4c095de640 1 -- 172.21.15.55:0/3746172531 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c0409bd50 con 0x7f4c040b1f90 2024-05-27T12:33:18.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.023+0000 7f4c095de640 1 --2- 172.21.15.55:0/3746172531 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4c040b1f90 0x7f4c040cdb20 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f4c04073f70 tx=0x7f4bf402a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1ecd421bf05cd97 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:18.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.023+0000 7f4c08ddd640 1 -- 172.21.15.55:0/3746172531 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bf4037070 con 0x7f4c040b1f90 2024-05-27T12:33:18.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.023+0000 7f4c08ddd640 1 -- 172.21.15.55:0/3746172531 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bf402ae00 con 0x7f4c040b1f90 2024-05-27T12:33:18.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.023+0000 7f4c08ddd640 1 -- 172.21.15.55:0/3746172531 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bf4032660 con 0x7f4c040b1f90 2024-05-27T12:33:18.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.024+0000 7f4c0c043640 1 -- 172.21.15.55:0/3746172531 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4c040b1f90 msgr2=0x7f4c040cdb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:18.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.024+0000 7f4c0c043640 1 --2- 172.21.15.55:0/3746172531 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4c040b1f90 0x7f4c040cdb20 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f4c04073f70 tx=0x7f4bf402a0b0 comp rx=0 tx=0).stop 2024-05-27T12:33:18.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.024+0000 7f4c0c043640 1 -- 172.21.15.55:0/3746172531 shutdown_connections 2024-05-27T12:33:18.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.024+0000 7f4c0c043640 1 --2- 172.21.15.55:0/3746172531 >> v2:172.21.15.72:3300/0 conn(0x7f4c040b23d0 0x7f4c040ce060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:18.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.024+0000 7f4c0c043640 1 --2- 172.21.15.55:0/3746172531 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4c040b1f90 0x7f4c040cdb20 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:18.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.024+0000 7f4c0c043640 1 --2- 172.21.15.55:0/3746172531 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4c0415cb20 0x7f4c040d12e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:18.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.024+0000 7f4c0c043640 1 -- 172.21.15.55:0/3746172531 >> 172.21.15.55:0/3746172531 conn(0x7f4c040b4160 msgr2=0x7f4c040b4570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:18.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.024+0000 7f4c0c043640 1 -- 172.21.15.55:0/3746172531 shutdown_connections 2024-05-27T12:33:18.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.024+0000 7f4c0c043640 1 -- 172.21.15.55:0/3746172531 wait complete. 2024-05-27T12:33:18.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.025+0000 7f4c0c043640 1 Processor -- start 2024-05-27T12:33:18.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.025+0000 7f4c0c043640 1 -- start start 2024-05-27T12:33:18.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.026+0000 7f4c0c043640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4c040b1f90 0x7f4c041f6880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:18.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.026+0000 7f4c0c043640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4c040b23d0 0x7f4c040c9740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:18.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.026+0000 7f4c0c043640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4c0415cb20 0x7f4c040c9c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:18.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.026+0000 7f4c0c043640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f4c040d0240 con 0x7f4c0415cb20 2024-05-27T12:33:18.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.026+0000 7f4c0c043640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f4c0409b410 con 0x7f4c040b23d0 2024-05-27T12:33:18.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.026+0000 7f4c0c043640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f4c040d03c0 con 0x7f4c040b1f90 2024-05-27T12:33:18.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.026+0000 7f4c0a5e0640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4c0415cb20 0x7f4c040c9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:18.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.026+0000 7f4c0a5e0640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4c0415cb20 0x7f4c040c9c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44384/0 (socket says 172.21.15.55:44384) 2024-05-27T12:33:18.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.026+0000 7f4c0a5e0640 1 -- 172.21.15.55:0/2662011121 learned_addr learned my addr 172.21.15.55:0/2662011121 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:33:18.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.026+0000 7f4c09ddf640 1 --2- 172.21.15.55:0/2662011121 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4c040b1f90 0x7f4c041f6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:18.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.026+0000 7f4c095de640 1 --2- 172.21.15.55:0/2662011121 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4c040b23d0 0x7f4c040c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:18.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.026+0000 7f4c0a5e0640 1 -- 172.21.15.55:0/2662011121 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4c040b1f90 msgr2=0x7f4c041f6880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:18.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.026+0000 7f4c0a5e0640 1 --2- 172.21.15.55:0/2662011121 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4c040b1f90 0x7f4c041f6880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:18.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.026+0000 7f4c0a5e0640 1 -- 172.21.15.55:0/2662011121 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4c040b23d0 msgr2=0x7f4c040c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:18.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.026+0000 7f4c0a5e0640 1 --2- 172.21.15.55:0/2662011121 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4c040b23d0 0x7f4c040c9740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:18.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.026+0000 7f4c0a5e0640 1 -- 172.21.15.55:0/2662011121 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c040cc480 con 0x7f4c0415cb20 2024-05-27T12:33:18.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.026+0000 7f4c095de640 1 --2- 172.21.15.55:0/2662011121 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4c040b23d0 0x7f4c040c9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T12:33:18.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.026+0000 7f4c09ddf640 1 --2- 172.21.15.55:0/2662011121 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4c040b1f90 0x7f4c041f6880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T12:33:18.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.027+0000 7f4c0a5e0640 1 --2- 172.21.15.55:0/2662011121 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4c0415cb20 0x7f4c040c9c80 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f4bfc00ef00 tx=0x7f4bfc00b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:18.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.027+0000 7f4bfa7fc640 1 -- 172.21.15.55:0/2662011121 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bfc018020 con 0x7f4c0415cb20 2024-05-27T12:33:18.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.027+0000 7f4bfa7fc640 1 -- 172.21.15.55:0/2662011121 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bfc014400 con 0x7f4c0415cb20 2024-05-27T12:33:18.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.027+0000 7f4bfa7fc640 1 -- 172.21.15.55:0/2662011121 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bfc0147f0 con 0x7f4c0415cb20 2024-05-27T12:33:18.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.027+0000 7f4c0c043640 1 -- 172.21.15.55:0/2662011121 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c040cc760 con 0x7f4c0415cb20 2024-05-27T12:33:18.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.027+0000 7f4c0c043640 1 -- 172.21.15.55:0/2662011121 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c041f6dc0 con 0x7f4c0415cb20 2024-05-27T12:33:18.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.028+0000 7f4c0c043640 1 -- 172.21.15.55:0/2662011121 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c04068a70 con 0x7f4c0415cb20 2024-05-27T12:33:18.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.028+0000 7f4bfa7fc640 1 -- 172.21.15.55:0/2662011121 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4bfc005d10 con 0x7f4c0415cb20 2024-05-27T12:33:18.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.029+0000 7f4bfa7fc640 1 --2- 172.21.15.55:0/2662011121 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f4be806c8f0 0x7f4be806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:18.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.029+0000 7f4bfa7fc640 1 -- 172.21.15.55:0/2662011121 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f4bfc08c610 con 0x7f4c0415cb20 2024-05-27T12:33:18.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.029+0000 7f4c09ddf640 1 --2- 172.21.15.55:0/2662011121 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f4be806c8f0 0x7f4be806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:18.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.029+0000 7f4c09ddf640 1 --2- 172.21.15.55:0/2662011121 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f4be806c8f0 0x7f4be806edb0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4c00009a20 tx=0x7f4c00008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:18.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.033+0000 7f4bfa7fc640 1 -- 172.21.15.55:0/2662011121 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4bfc022030 con 0x7f4c0415cb20 2024-05-27T12:33:18.221 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.222+0000 7f4c0c043640 1 -- 172.21.15.55:0/2662011121 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f4c040b4e80 con 0x7f4c0415cb20 2024-05-27T12:33:18.221 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.222+0000 7f4bfa7fc640 1 -- 172.21.15.55:0/2662011121 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) ==== 100+0+11 (secure 0 0 0) 0x7f4bfc05aa40 con 0x7f4c0415cb20 2024-05-27T12:33:18.221 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2024-05-27T12:33:18.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.224+0000 7f4c0c043640 1 -- 172.21.15.55:0/2662011121 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f4be806c8f0 msgr2=0x7f4be806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:18.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.224+0000 7f4c0c043640 1 --2- 172.21.15.55:0/2662011121 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f4be806c8f0 0x7f4be806edb0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4c00009a20 tx=0x7f4c00008040 comp rx=0 tx=0).stop 2024-05-27T12:33:18.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.224+0000 7f4c0c043640 1 -- 172.21.15.55:0/2662011121 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4c0415cb20 msgr2=0x7f4c040c9c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:18.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.224+0000 7f4c0c043640 1 --2- 172.21.15.55:0/2662011121 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4c0415cb20 0x7f4c040c9c80 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f4bfc00ef00 tx=0x7f4bfc00b480 comp rx=0 tx=0).stop 2024-05-27T12:33:18.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.224+0000 7f4c0c043640 1 -- 172.21.15.55:0/2662011121 shutdown_connections 2024-05-27T12:33:18.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.224+0000 7f4c0c043640 1 --2- 172.21.15.55:0/2662011121 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4c0415cb20 0x7f4c040c9c80 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:18.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.224+0000 7f4c0c043640 1 --2- 172.21.15.55:0/2662011121 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f4be806c8f0 0x7f4be806edb0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:18.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.224+0000 7f4c0c043640 1 --2- 172.21.15.55:0/2662011121 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4c040b23d0 0x7f4c040c9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:18.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.224+0000 7f4c0c043640 1 --2- 172.21.15.55:0/2662011121 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4c040b1f90 0x7f4c041f6880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:18.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.224+0000 7f4c0c043640 1 -- 172.21.15.55:0/2662011121 >> 172.21.15.55:0/2662011121 conn(0x7f4c040b4160 msgr2=0x7f4c04070ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:18.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.224+0000 7f4c0c043640 1 -- 172.21.15.55:0/2662011121 shutdown_connections 2024-05-27T12:33:18.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.224+0000 7f4c0c043640 1 -- 172.21.15.55:0/2662011121 wait complete. 2024-05-27T12:33:18.234 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-27T12:33:18.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.340+0000 7f2b26ecf640 1 Processor -- start 2024-05-27T12:33:18.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.340+0000 7f2b26ecf640 1 -- start start 2024-05-27T12:33:18.340 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.341+0000 7f2b26ecf640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2b200b54f0 0x7f2b2006e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:18.341 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.341+0000 7f2b26ecf640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2b2015bae0 0x7f2b2015bf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:18.341 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.341+0000 7f2b26ecf640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2b2006b930 0x7f2b2006bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:18.341 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.341+0000 7f2b26ecf640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f2b2015c690 con 0x7f2b200b54f0 2024-05-27T12:33:18.341 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.341+0000 7f2b26ecf640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f2b2015c970 con 0x7f2b2006b930 2024-05-27T12:33:18.341 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.341+0000 7f2b26ecf640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f2b2006dfe0 con 0x7f2b2015bae0 2024-05-27T12:33:18.341 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.341+0000 7f2b24c6b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2b200b54f0 0x7f2b2006e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:18.341 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.341+0000 7f2b24c6b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2b200b54f0 0x7f2b2006e7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44392/0 (socket says 172.21.15.55:44392) 2024-05-27T12:33:18.341 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.341+0000 7f2b24c6b640 1 -- 172.21.15.55:0/1875448279 learned_addr learned my addr 172.21.15.55:0/1875448279 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:33:18.341 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.341+0000 7f2b17fff640 1 --2- 172.21.15.55:0/1875448279 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2b2015bae0 0x7f2b2015bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:18.341 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.341+0000 7f2b2546c640 1 --2- 172.21.15.55:0/1875448279 >> v2:172.21.15.72:3300/0 conn(0x7f2b2006b930 0x7f2b2006bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:18.341 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.341+0000 7f2b24c6b640 1 -- 172.21.15.55:0/1875448279 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2b2015bae0 msgr2=0x7f2b2015bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:18.341 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.341+0000 7f2b24c6b640 1 --2- 172.21.15.55:0/1875448279 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2b2015bae0 0x7f2b2015bf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:18.341 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.341+0000 7f2b24c6b640 1 -- 172.21.15.55:0/1875448279 >> v2:172.21.15.72:3300/0 conn(0x7f2b2006b930 msgr2=0x7f2b2006bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:18.342 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.341+0000 7f2b24c6b640 1 --2- 172.21.15.55:0/1875448279 >> v2:172.21.15.72:3300/0 conn(0x7f2b2006b930 0x7f2b2006bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:18.342 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.341+0000 7f2b24c6b640 1 -- 172.21.15.55:0/1875448279 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b2006e2c0 con 0x7f2b200b54f0 2024-05-27T12:33:18.342 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.341+0000 7f2b17fff640 1 --2- 172.21.15.55:0/1875448279 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2b2015bae0 0x7f2b2015bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T12:33:18.342 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.341+0000 7f2b2546c640 1 --2- 172.21.15.55:0/1875448279 >> v2:172.21.15.72:3300/0 conn(0x7f2b2006b930 0x7f2b2006bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T12:33:18.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.342+0000 7f2b24c6b640 1 --2- 172.21.15.55:0/1875448279 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b200b54f0 0x7f2b2006e7c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f2b2015cb80 tx=0x7f2b1c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5fe7993b3c8d9f server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:18.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.342+0000 7f2b177fe640 1 -- 172.21.15.55:0/1875448279 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b1c037070 con 0x7f2b200b54f0 2024-05-27T12:33:18.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.342+0000 7f2b177fe640 1 -- 172.21.15.55:0/1875448279 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b1c032440 con 0x7f2b200b54f0 2024-05-27T12:33:18.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.342+0000 7f2b177fe640 1 -- 172.21.15.55:0/1875448279 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b1c032810 con 0x7f2b200b54f0 2024-05-27T12:33:18.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.343+0000 7f2b26ecf640 1 -- 172.21.15.55:0/1875448279 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b200b54f0 msgr2=0x7f2b2006e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:18.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.343+0000 7f2b26ecf640 1 --2- 172.21.15.55:0/1875448279 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b200b54f0 0x7f2b2006e7c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f2b2015cb80 tx=0x7f2b1c02a1e0 comp rx=0 tx=0).stop 2024-05-27T12:33:18.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.343+0000 7f2b26ecf640 1 -- 172.21.15.55:0/1875448279 shutdown_connections 2024-05-27T12:33:18.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.343+0000 7f2b26ecf640 1 --2- 172.21.15.55:0/1875448279 >> v2:172.21.15.72:3300/0 conn(0x7f2b2006b930 0x7f2b2006bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:18.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.343+0000 7f2b26ecf640 1 --2- 172.21.15.55:0/1875448279 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2b2015bae0 0x7f2b2015bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:18.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.343+0000 7f2b26ecf640 1 --2- 172.21.15.55:0/1875448279 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b200b54f0 0x7f2b2006e7c0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:18.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.343+0000 7f2b26ecf640 1 -- 172.21.15.55:0/1875448279 >> 172.21.15.55:0/1875448279 conn(0x7f2b20067d70 msgr2=0x7f2b200b2270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:18.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.343+0000 7f2b26ecf640 1 -- 172.21.15.55:0/1875448279 shutdown_connections 2024-05-27T12:33:18.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.343+0000 7f2b26ecf640 1 -- 172.21.15.55:0/1875448279 wait complete. 2024-05-27T12:33:18.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.344+0000 7f2b26ecf640 1 Processor -- start 2024-05-27T12:33:18.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.344+0000 7f2b26ecf640 1 -- start start 2024-05-27T12:33:18.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.345+0000 7f2b26ecf640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2b200b54f0 0x7f2b2014fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:18.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.345+0000 7f2b26ecf640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2b2015bae0 0x7f2b200ad8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:18.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.345+0000 7f2b26ecf640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b20148f90 0x7f2b2015cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:18.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.345+0000 7f2b26ecf640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f2b200b5a50 con 0x7f2b20148f90 2024-05-27T12:33:18.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.345+0000 7f2b26ecf640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f2b200b58d0 con 0x7f2b2015bae0 2024-05-27T12:33:18.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.345+0000 7f2b26ecf640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f2b2006ff90 con 0x7f2b200b54f0 2024-05-27T12:33:18.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.345+0000 7f2b2546c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b20148f90 0x7f2b2015cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:18.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.345+0000 7f2b2546c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b20148f90 0x7f2b2015cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44402/0 (socket says 172.21.15.55:44402) 2024-05-27T12:33:18.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.345+0000 7f2b2546c640 1 -- 172.21.15.55:0/1722833854 learned_addr learned my addr 172.21.15.55:0/1722833854 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:33:18.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.345+0000 7f2b17fff640 1 --2- 172.21.15.55:0/1722833854 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2b2015bae0 0x7f2b200ad8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:18.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.345+0000 7f2b24c6b640 1 --2- 172.21.15.55:0/1722833854 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2b200b54f0 0x7f2b2014fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:18.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.345+0000 7f2b2546c640 1 -- 172.21.15.55:0/1722833854 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2b200b54f0 msgr2=0x7f2b2014fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:18.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.345+0000 7f2b2546c640 1 --2- 172.21.15.55:0/1722833854 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2b200b54f0 0x7f2b2014fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:18.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.345+0000 7f2b2546c640 1 -- 172.21.15.55:0/1722833854 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2b2015bae0 msgr2=0x7f2b200ad8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:18.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.345+0000 7f2b2546c640 1 --2- 172.21.15.55:0/1722833854 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2b2015bae0 0x7f2b200ad8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:18.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.346+0000 7f2b2546c640 1 -- 172.21.15.55:0/1722833854 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b2015d120 con 0x7f2b20148f90 2024-05-27T12:33:18.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.346+0000 7f2b2546c640 1 --2- 172.21.15.55:0/1722833854 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b20148f90 0x7f2b2015cbe0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f2b18007db0 tx=0x7f2b1800d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:18.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.346+0000 7f2b157fa640 1 -- 172.21.15.55:0/1722833854 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b1801a070 con 0x7f2b20148f90 2024-05-27T12:33:18.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.346+0000 7f2b157fa640 1 -- 172.21.15.55:0/1722833854 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b18003990 con 0x7f2b20148f90 2024-05-27T12:33:18.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.346+0000 7f2b26ecf640 1 -- 172.21.15.55:0/1722833854 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b2015d3c0 con 0x7f2b20148f90 2024-05-27T12:33:18.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.346+0000 7f2b157fa640 1 -- 172.21.15.55:0/1722833854 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b18003d60 con 0x7f2b20148f90 2024-05-27T12:33:18.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.346+0000 7f2b26ecf640 1 -- 172.21.15.55:0/1722833854 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b2015d980 con 0x7f2b20148f90 2024-05-27T12:33:18.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.347+0000 7f2b26ecf640 1 -- 172.21.15.55:0/1722833854 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b20075460 con 0x7f2b20148f90 2024-05-27T12:33:18.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.348+0000 7f2b157fa640 1 -- 172.21.15.55:0/1722833854 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2b1801d070 con 0x7f2b20148f90 2024-05-27T12:33:18.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.348+0000 7f2b157fa640 1 --2- 172.21.15.55:0/1722833854 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f2b0c06c920 0x7f2b0c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:18.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.348+0000 7f2b157fa640 1 -- 172.21.15.55:0/1722833854 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f2b1808bc80 con 0x7f2b20148f90 2024-05-27T12:33:18.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.348+0000 7f2b24c6b640 1 --2- 172.21.15.55:0/1722833854 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f2b0c06c920 0x7f2b0c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:18.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.349+0000 7f2b24c6b640 1 --2- 172.21.15.55:0/1722833854 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f2b0c06c920 0x7f2b0c06ede0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f2b1c034000 tx=0x7f2b1c02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:18.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.352+0000 7f2b157fa640 1 -- 172.21.15.55:0/1722833854 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2b18010070 con 0x7f2b20148f90 2024-05-27T12:33:18.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.548+0000 7f2b26ecf640 1 -- 172.21.15.55:0/1722833854 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f2b2006f430 con 0x7f2b20148f90 2024-05-27T12:33:18.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.548+0000 7f2b157fa640 1 -- 172.21.15.55:0/1722833854 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) ==== 80+0+0 (secure 0 0 0) 0x7f2b18059a60 con 0x7f2b20148f90 2024-05-27T12:33:18.548 INFO:teuthology.orchestra.run.smithi055.stderr:listed 0 entries 2024-05-27T12:33:18.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.550+0000 7f2b26ecf640 1 -- 172.21.15.55:0/1722833854 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f2b0c06c920 msgr2=0x7f2b0c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:18.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.550+0000 7f2b26ecf640 1 --2- 172.21.15.55:0/1722833854 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f2b0c06c920 0x7f2b0c06ede0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f2b1c034000 tx=0x7f2b1c02e000 comp rx=0 tx=0).stop 2024-05-27T12:33:18.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.550+0000 7f2b26ecf640 1 -- 172.21.15.55:0/1722833854 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b20148f90 msgr2=0x7f2b2015cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:18.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.550+0000 7f2b26ecf640 1 --2- 172.21.15.55:0/1722833854 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b20148f90 0x7f2b2015cbe0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f2b18007db0 tx=0x7f2b1800d4a0 comp rx=0 tx=0).stop 2024-05-27T12:33:18.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.550+0000 7f2b26ecf640 1 -- 172.21.15.55:0/1722833854 shutdown_connections 2024-05-27T12:33:18.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.550+0000 7f2b26ecf640 1 --2- 172.21.15.55:0/1722833854 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b20148f90 0x7f2b2015cbe0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:18.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.550+0000 7f2b26ecf640 1 --2- 172.21.15.55:0/1722833854 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f2b0c06c920 0x7f2b0c06ede0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:18.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.550+0000 7f2b26ecf640 1 --2- 172.21.15.55:0/1722833854 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2b2015bae0 0x7f2b200ad8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:18.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.550+0000 7f2b26ecf640 1 --2- 172.21.15.55:0/1722833854 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2b200b54f0 0x7f2b2014fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:18.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.550+0000 7f2b26ecf640 1 -- 172.21.15.55:0/1722833854 >> 172.21.15.55:0/1722833854 conn(0x7f2b2006b930 msgr2=0x7f2b200d0600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:18.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.550+0000 7f2b26ecf640 1 -- 172.21.15.55:0/1722833854 shutdown_connections 2024-05-27T12:33:18.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.550+0000 7f2b26ecf640 1 -- 172.21.15.55:0/1722833854 wait complete. 2024-05-27T12:33:18.561 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-05-27T12:33:18.561 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T12:33:18.561 DEBUG:teuthology.orchestra.run.smithi072:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-05-27T12:33:18.593 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi072.front.sepia.ceph.com 2024-05-27T12:33:18.593 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T12:33:18.593 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-05-27T12:33:18.661 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-05-27T12:33:18.661 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-27T12:33:18.678 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-05-27T12:33:18.678 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-27T12:33:18.735 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-05-27T12:33:18.736 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-27T12:33:18.792 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-27T12:33:18.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.937+0000 7f3a331e5640 1 Processor -- start 2024-05-27T12:33:18.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.937+0000 7f3a331e5640 1 -- start start 2024-05-27T12:33:18.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.937+0000 7f3a331e5640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3a2c15ec00 0x7f3a2c0b3db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:18.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.938+0000 7f3a331e5640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3a2c0b3860 0x7f3a2c0cfd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:18.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.938+0000 7f3a331e5640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a2c1632f0 con 0x7f3a2c0b6370 2024-05-27T12:33:18.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.938+0000 7f3a331e5640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f3a2c0cf2e0 con 0x7f3a2c0b3860 2024-05-27T12:33:18.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.938+0000 7f3a331e5640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f3a2c1635d0 con 0x7f3a2c15ec00 2024-05-27T12:33:18.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.938+0000 7f3a31782640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f3a2c0b6370 0x7f3a2c0d2980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:48658/0 (socket says 172.21.15.55:48658) 2024-05-27T12:33:18.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.938+0000 7f3a31782640 1 -- 172.21.15.55:0/1456756975 learned_addr learned my addr 172.21.15.55:0/1456756975 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-27T12:33:18.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.938+0000 7f3a30f81640 1 --2- 172.21.15.55:0/1456756975 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3a2c15ec00 0x7f3a2c0b3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:18.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.938+0000 7f3a2bfff640 1 --2- 172.21.15.55:0/1456756975 >> v2:172.21.15.72:3300/0 conn(0x7f3a2c0b3860 0x7f3a2c0cfd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:18.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.938+0000 7f3a2b7fe640 1 -- 172.21.15.55:0/1456756975 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2024033446 0 0) 0x7f3a2c1632f0 con 0x7f3a2c0b6370 2024-05-27T12:33:18.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.938+0000 7f3a2b7fe640 1 -- 172.21.15.55:0/1456756975 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3a18003520 con 0x7f3a2c0b6370 2024-05-27T12:33:18.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.938+0000 7f3a2b7fe640 1 -- 172.21.15.55:0/1456756975 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 382818901 0 0) 0x7f3a18003520 con 0x7f3a2c0b6370 2024-05-27T12:33:18.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.938+0000 7f3a2b7fe640 1 -- 172.21.15.55:0/1456756975 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3a2c15ec00 msgr2=0x7f3a2c0b3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:18.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.938+0000 7f3a2b7fe640 1 --2- 172.21.15.55:0/1456756975 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3a2c15ec00 0x7f3a2c0b3db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:18.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.938+0000 7f3a2b7fe640 1 -- 172.21.15.55:0/1456756975 >> v2:172.21.15.72:3300/0 conn(0x7f3a2c0b3860 msgr2=0x7f3a2c0cfd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:18.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.938+0000 7f3a2b7fe640 1 --2- 172.21.15.55:0/1456756975 >> v2:172.21.15.72:3300/0 conn(0x7f3a2c0b3860 0x7f3a2c0cfd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:18.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.938+0000 7f3a2b7fe640 1 -- 172.21.15.55:0/1456756975 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a2c0cf530 con 0x7f3a2c0b6370 2024-05-27T12:33:18.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.938+0000 7f3a2b7fe640 1 -- 172.21.15.55:0/1456756975 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 793017739 0 0) 0x7f3a14001670 con 0x7f3a2c0b6370 2024-05-27T12:33:18.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.938+0000 7f3a2b7fe640 1 -- 172.21.15.55:0/1456756975 >> v1:172.21.15.55:6789/0 conn(0x7f3a2c0b6370 legacy=0x7f3a2c0d2980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:18.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.938+0000 7f3a2b7fe640 1 --2- 172.21.15.55:0/1456756975 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3a18003a90 0x7f3a18003eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:18.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.938+0000 7f3a2b7fe640 1 --2- 172.21.15.55:0/1456756975 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a18004800 0x7f3a18004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:18.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.938+0000 7f3a2b7fe640 1 --2- 172.21.15.55:0/1456756975 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3a2c15ec00 0x7f3a180051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:18.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.938+0000 7f3a2b7fe640 1 -- 172.21.15.55:0/1456756975 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f3a2c0cf2e0 con 0x7f3a18004800 2024-05-27T12:33:18.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.938+0000 7f3a2b7fe640 1 -- 172.21.15.55:0/1456756975 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f3a2c1635d0 con 0x7f3a18003a90 2024-05-27T12:33:18.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.938+0000 7f3a2b7fe640 1 -- 172.21.15.55:0/1456756975 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f3a1800b9f0 con 0x7f3a2c15ec00 2024-05-27T12:33:18.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.939+0000 7f3a2bfff640 1 --2- 172.21.15.55:0/1456756975 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a18004800 0x7f3a18004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:18.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.939+0000 7f3a30f81640 1 --2- 172.21.15.55:0/1456756975 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3a18003a90 0x7f3a18003eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:18.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.939+0000 7f3a31782640 1 --2- 172.21.15.55:0/1456756975 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3a2c15ec00 0x7f3a180051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:18.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.939+0000 7f3a2bfff640 1 -- 172.21.15.55:0/1456756975 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3a2c15ec00 msgr2=0x7f3a180051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:18.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.939+0000 7f3a2bfff640 1 --2- 172.21.15.55:0/1456756975 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3a2c15ec00 0x7f3a180051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:18.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.939+0000 7f3a2bfff640 1 -- 172.21.15.55:0/1456756975 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3a18003a90 msgr2=0x7f3a18003eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:18.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.939+0000 7f3a2bfff640 1 --2- 172.21.15.55:0/1456756975 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3a18003a90 0x7f3a18003eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:18.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.939+0000 7f3a2bfff640 1 -- 172.21.15.55:0/1456756975 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a18003520 con 0x7f3a18004800 2024-05-27T12:33:18.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.939+0000 7f3a2bfff640 1 --2- 172.21.15.55:0/1456756975 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a18004800 0x7f3a18004c80 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c009fc0 tx=0x7f3a18005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89b12b8cf682168a server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:18.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.940+0000 7f3a2b7fe640 1 -- 172.21.15.55:0/1456756975 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a1c009c10 con 0x7f3a18004800 2024-05-27T12:33:18.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.940+0000 7f3a2b7fe640 1 -- 172.21.15.55:0/1456756975 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a1c036070 con 0x7f3a18004800 2024-05-27T12:33:18.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.940+0000 7f3a2b7fe640 1 -- 172.21.15.55:0/1456756975 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a1c02d070 con 0x7f3a18004800 2024-05-27T12:33:18.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.940+0000 7f3a331e5640 1 -- 172.21.15.55:0/1456756975 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a18004800 msgr2=0x7f3a18004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:18.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.940+0000 7f3a331e5640 1 --2- 172.21.15.55:0/1456756975 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a18004800 0x7f3a18004c80 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c009fc0 tx=0x7f3a18005830 comp rx=0 tx=0).stop 2024-05-27T12:33:18.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.940+0000 7f3a31782640 1 -- 172.21.15.55:0/1456756975 reap_dead start 2024-05-27T12:33:18.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.940+0000 7f3a331e5640 1 -- 172.21.15.55:0/1456756975 shutdown_connections 2024-05-27T12:33:18.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.940+0000 7f3a331e5640 1 -- 172.21.15.55:0/1456756975 >> 172.21.15.55:0/1456756975 conn(0x7f3a2c0d1370 msgr2=0x7f3a2c0d1780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:18.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.940+0000 7f3a331e5640 1 -- 172.21.15.55:0/1456756975 shutdown_connections 2024-05-27T12:33:18.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.940+0000 7f3a331e5640 1 -- 172.21.15.55:0/1456756975 wait complete. 2024-05-27T12:33:18.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.941+0000 7f3a331e5640 1 Processor -- start 2024-05-27T12:33:18.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.941+0000 7f3a331e5640 1 -- start start 2024-05-27T12:33:18.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.942+0000 7f3a331e5640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3a18004800 0x7f3a2c15ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:18.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.942+0000 7f3a331e5640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3a2c1f8ae0 0x7f3a2c152c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:18.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.942+0000 7f3a331e5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a2c1f8f40 0x7f3a2c1531d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:18.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.942+0000 7f3a331e5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f3a2c0b3530 con 0x7f3a2c1f8f40 2024-05-27T12:33:18.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.942+0000 7f3a331e5640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f3a2c0d0270 con 0x7f3a2c1f8ae0 2024-05-27T12:33:18.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.942+0000 7f3a331e5640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f3a2c15efe0 con 0x7f3a18004800 2024-05-27T12:33:18.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.942+0000 7f3a31782640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a2c1f8f40 0x7f3a2c1531d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:18.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.942+0000 7f3a31782640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a2c1f8f40 0x7f3a2c1531d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44420/0 (socket says 172.21.15.55:44420) 2024-05-27T12:33:18.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.942+0000 7f3a31782640 1 -- 172.21.15.55:0/2869477526 learned_addr learned my addr 172.21.15.55:0/2869477526 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:33:18.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.943+0000 7f3a2bfff640 1 --2- 172.21.15.55:0/2869477526 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3a2c1f8ae0 0x7f3a2c152c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:18.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.943+0000 7f3a30f81640 1 --2- 172.21.15.55:0/2869477526 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3a18004800 0x7f3a2c15ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:18.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.943+0000 7f3a31782640 1 -- 172.21.15.55:0/2869477526 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3a18004800 msgr2=0x7f3a2c15ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:18.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.943+0000 7f3a31782640 1 --2- 172.21.15.55:0/2869477526 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3a18004800 0x7f3a2c15ab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:18.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.943+0000 7f3a31782640 1 -- 172.21.15.55:0/2869477526 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3a2c1f8ae0 msgr2=0x7f3a2c152c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:18.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.943+0000 7f3a31782640 1 --2- 172.21.15.55:0/2869477526 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3a2c1f8ae0 0x7f3a2c152c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:18.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.943+0000 7f3a31782640 1 -- 172.21.15.55:0/2869477526 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a2c15f4c0 con 0x7f3a2c1f8f40 2024-05-27T12:33:18.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.943+0000 7f3a2bfff640 1 --2- 172.21.15.55:0/2869477526 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3a2c1f8ae0 0x7f3a2c152c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T12:33:18.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.943+0000 7f3a31782640 1 --2- 172.21.15.55:0/2869477526 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a2c1f8f40 0x7f3a2c1531d0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f3a2c0d43e0 tx=0x7f3a14007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:18.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.943+0000 7f3a297fa640 1 -- 172.21.15.55:0/2869477526 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a1400f680 con 0x7f3a2c1f8f40 2024-05-27T12:33:18.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.943+0000 7f3a297fa640 1 -- 172.21.15.55:0/2869477526 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a14018070 con 0x7f3a2c1f8f40 2024-05-27T12:33:18.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.943+0000 7f3a297fa640 1 -- 172.21.15.55:0/2869477526 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a1400faa0 con 0x7f3a2c1f8f40 2024-05-27T12:33:18.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.943+0000 7f3a331e5640 1 -- 172.21.15.55:0/2869477526 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a2c1560f0 con 0x7f3a2c1f8f40 2024-05-27T12:33:18.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.943+0000 7f3a331e5640 1 -- 172.21.15.55:0/2869477526 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a2c15fa40 con 0x7f3a2c1f8f40 2024-05-27T12:33:18.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.944+0000 7f3a331e5640 1 -- 172.21.15.55:0/2869477526 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a2c0b70d0 con 0x7f3a2c1f8f40 2024-05-27T12:33:18.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.945+0000 7f3a297fa640 1 -- 172.21.15.55:0/2869477526 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3a1400fc40 con 0x7f3a2c1f8f40 2024-05-27T12:33:18.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.945+0000 7f3a297fa640 1 --2- 172.21.15.55:0/2869477526 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f3a0c06c8f0 0x7f3a0c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:18.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.945+0000 7f3a297fa640 1 -- 172.21.15.55:0/2869477526 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f3a1408ba00 con 0x7f3a2c1f8f40 2024-05-27T12:33:18.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.946+0000 7f3a30f81640 1 --2- 172.21.15.55:0/2869477526 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f3a0c06c8f0 0x7f3a0c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:18.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.946+0000 7f3a30f81640 1 --2- 172.21.15.55:0/2869477526 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f3a0c06c8f0 0x7f3a0c06edb0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f3a240098a0 tx=0x7f3a24008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:18.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:18.949+0000 7f3a297fa640 1 -- 172.21.15.55:0/2869477526 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3a2c0b70d0 con 0x7f3a2c1f8f40 2024-05-27T12:33:19.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.139+0000 7f3a331e5640 1 -- 172.21.15.55:0/2869477526 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3a2c06db20 con 0x7f3a2c1f8f40 2024-05-27T12:33:19.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.140+0000 7f3a297fa640 1 -- 172.21.15.55:0/2869477526 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16557 (secure 0 0 0) 0x7f3a2c06db20 con 0x7f3a2c1f8f40 2024-05-27T12:33:19.140 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-27T12:33:19.140 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":23,"fsid":"c3ff4e3b-8dae-4856-9593-e5cc66c59982","created":"2024-05-27T12:32:17.019097+0000","modified":"2024-05-27T12:32:43.361598+0000","last_up_change":"2024-05-27T12:32:28.109744+0000","last_in_change":"2024-05-27T12:32:19.309872+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-27T12:32:29.277895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-27T12:32:39.442745+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-27T12:32:40.672118+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e607b598-061b-4b6f-92ff-95c20b330599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":807572567},{"type":"v1","addr":"172.21.15.55:6801","nonce":807572567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":807572567},{"type":"v1","addr":"172.21.15.55:6803","nonce":807572567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":807572567},{"type":"v1","addr":"172.21.15.55:6807","nonce":807572567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":807572567},{"type":"v1","addr":"172.21.15.55:6805","nonce":807572567}]},"public_addr":"172.21.15.55:6801/807572567","cluster_addr":"172.21.15.55:6803/807572567","heartbeat_back_addr":"172.21.15.55:6807/807572567","heartbeat_front_addr":"172.21.15.55:6805/807572567","state":["exists","up"]},{"osd":1,"uuid":"ba2b5b1d-71a9-4ecc-9a48-55aa7fe54261","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":3426897300},{"type":"v1","addr":"172.21.15.55:6825","nonce":3426897300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":3426897300},{"type":"v1","addr":"172.21.15.55:6827","nonce":3426897300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":3426897300},{"type":"v1","addr":"172.21.15.55:6831","nonce":3426897300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":3426897300},{"type":"v1","addr":"172.21.15.55:6829","nonce":3426897300}]},"public_addr":"172.21.15.55:6825/3426897300","cluster_addr":"172.21.15.55:6827/3426897300","heartbeat_back_addr":"172.21.15.55:6831/3426897300","heartbeat_front_addr":"172.21.15.55:6829/3426897300","state":["exists","up"]},{"osd":2,"uuid":"e6b81cc6-4ff1-45d0-87eb-9f04ccf986a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3510271725},{"type":"v1","addr":"172.21.15.55:6809","nonce":3510271725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3510271725},{"type":"v1","addr":"172.21.15.55:6811","nonce":3510271725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3510271725},{"type":"v1","addr":"172.21.15.55:6815","nonce":3510271725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3510271725},{"type":"v1","addr":"172.21.15.55:6813","nonce":3510271725}]},"public_addr":"172.21.15.55:6809/3510271725","cluster_addr":"172.21.15.55:6811/3510271725","heartbeat_back_addr":"172.21.15.55:6815/3510271725","heartbeat_front_addr":"172.21.15.55:6813/3510271725","state":["exists","up"]},{"osd":3,"uuid":"b6a34b75-807d-4693-b1c3-903cb4c618d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":1066693520},{"type":"v1","addr":"172.21.15.55:6817","nonce":1066693520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":1066693520},{"type":"v1","addr":"172.21.15.55:6819","nonce":1066693520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":1066693520},{"type":"v1","addr":"172.21.15.55:6823","nonce":1066693520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":1066693520},{"type":"v1","addr":"172.21.15.55:6821","nonce":1066693520}]},"public_addr":"172.21.15.55:6817/1066693520","cluster_addr":"172.21.15.55:6819/1066693520","heartbeat_back_addr":"172.21.15.55:6823/1066693520","heartbeat_front_addr":"172.21.15.55:6821/1066693520","state":["exists","up"]},{"osd":4,"uuid":"272ec937-56b4-4f0a-b2e1-b0bc189c9d79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":4190771237},{"type":"v1","addr":"172.21.15.72:6820","nonce":4190771237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":4190771237},{"type":"v1","addr":"172.21.15.72:6824","nonce":4190771237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":4190771237},{"type":"v1","addr":"172.21.15.72:6831","nonce":4190771237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":4190771237},{"type":"v1","addr":"172.21.15.72:6828","nonce":4190771237}]},"public_addr":"172.21.15.72:6820/4190771237","cluster_addr":"172.21.15.72:6824/4190771237","heartbeat_back_addr":"172.21.15.72:6831/4190771237","heartbeat_front_addr":"172.21.15.72:6828/4190771237","state":["exists","up"]},{"osd":5,"uuid":"56439854-72a0-4ef4-81ff-184a3d924a5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":2421889184},{"type":"v1","addr":"172.21.15.72:6801","nonce":2421889184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6803","nonce":2421889184},{"type":"v1","addr":"172.21.15.72:6805","nonce":2421889184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":2421889184},{"type":"v1","addr":"172.21.15.72:6813","nonce":2421889184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6807","nonce":2421889184},{"type":"v1","addr":"172.21.15.72:6809","nonce":2421889184}]},"public_addr":"172.21.15.72:6801/2421889184","cluster_addr":"172.21.15.72:6805/2421889184","heartbeat_back_addr":"172.21.15.72:6813/2421889184","heartbeat_front_addr":"172.21.15.72:6809/2421889184","state":["exists","up"]},{"osd":6,"uuid":"e248e2be-3b6e-49cf-8c8a-1a4152827582","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3796994599},{"type":"v1","addr":"172.21.15.72:6804","nonce":3796994599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":3796994599},{"type":"v1","addr":"172.21.15.72:6808","nonce":3796994599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":3796994599},{"type":"v1","addr":"172.21.15.72:6815","nonce":3796994599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":3796994599},{"type":"v1","addr":"172.21.15.72:6812","nonce":3796994599}]},"public_addr":"172.21.15.72:6804/3796994599","cluster_addr":"172.21.15.72:6808/3796994599","heartbeat_back_addr":"172.21.15.72:6815/3796994599","heartbeat_front_addr":"172.21.15.72:6812/3796994599","state":["exists","up"]},{"osd":7,"uuid":"505a62d3-322b-4629-b4fd-187a55563709","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":3024877895},{"type":"v1","addr":"172.21.15.72:6817","nonce":3024877895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":3024877895},{"type":"v1","addr":"172.21.15.72:6821","nonce":3024877895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6827","nonce":3024877895},{"type":"v1","addr":"172.21.15.72:6829","nonce":3024877895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6823","nonce":3024877895},{"type":"v1","addr":"172.21.15.72:6825","nonce":3024877895}]},"public_addr":"172.21.15.72:6817/3024877895","cluster_addr":"172.21.15.72:6821/3024877895","heartbeat_back_addr":"172.21.15.72:6829/3024877895","heartbeat_front_addr":"172.21.15.72:6825/3024877895","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.241014+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.450799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.465018+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.507647+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.534763+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.495895+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.427110+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.547466+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-27T12:33:19.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.142+0000 7f3a331e5640 1 -- 172.21.15.55:0/2869477526 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f3a0c06c8f0 msgr2=0x7f3a0c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:19.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.142+0000 7f3a331e5640 1 --2- 172.21.15.55:0/2869477526 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f3a0c06c8f0 0x7f3a0c06edb0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f3a240098a0 tx=0x7f3a24008040 comp rx=0 tx=0).stop 2024-05-27T12:33:19.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.142+0000 7f3a331e5640 1 -- 172.21.15.55:0/2869477526 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a2c1f8f40 msgr2=0x7f3a2c1531d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:19.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.142+0000 7f3a331e5640 1 --2- 172.21.15.55:0/2869477526 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a2c1f8f40 0x7f3a2c1531d0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f3a2c0d43e0 tx=0x7f3a14007430 comp rx=0 tx=0).stop 2024-05-27T12:33:19.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.142+0000 7f3a331e5640 1 -- 172.21.15.55:0/2869477526 shutdown_connections 2024-05-27T12:33:19.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.142+0000 7f3a331e5640 1 --2- 172.21.15.55:0/2869477526 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a2c1f8f40 0x7f3a2c1531d0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:19.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.142+0000 7f3a331e5640 1 --2- 172.21.15.55:0/2869477526 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f3a0c06c8f0 0x7f3a0c06edb0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:19.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.142+0000 7f3a331e5640 1 --2- 172.21.15.55:0/2869477526 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3a2c1f8ae0 0x7f3a2c152c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:19.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.142+0000 7f3a331e5640 1 --2- 172.21.15.55:0/2869477526 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3a18004800 0x7f3a2c15ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:19.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.142+0000 7f3a331e5640 1 -- 172.21.15.55:0/2869477526 >> 172.21.15.55:0/2869477526 conn(0x7f3a2c0d1370 msgr2=0x7f3a2c0b3d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:19.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.142+0000 7f3a331e5640 1 -- 172.21.15.55:0/2869477526 shutdown_connections 2024-05-27T12:33:19.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.142+0000 7f3a331e5640 1 -- 172.21.15.55:0/2869477526 wait complete. 2024-05-27T12:33:19.153 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-27T12:32:29.277895+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-27T12:32:39.442745+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-27T12:32:40.672118+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-27T12:33:19.154 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-27T12:33:19.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.261+0000 7f7980acf640 1 Processor -- start 2024-05-27T12:33:19.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.261+0000 7f7980acf640 1 -- start start 2024-05-27T12:33:19.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.262+0000 7f7980acf640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f797c06ca40 0x7f797c09aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:19.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.262+0000 7f7980acf640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f797c09af70 0x7f797c0cd840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:19.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.262+0000 7f7980acf640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f797c0d2020 con 0x7f797c162150 2024-05-27T12:33:19.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.262+0000 7f7980acf640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f797c09b3c0 con 0x7f797c09af70 2024-05-27T12:33:19.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.262+0000 7f7980acf640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f797c0d1d40 con 0x7f797c06ca40 2024-05-27T12:33:19.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.262+0000 7f797ad9d640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f797c09af70 0x7f797c0cd840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:19.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.262+0000 7f7979d9b640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f797c06ca40 0x7f797c09aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:19.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.262+0000 7f797a59c640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f797c162150 0x7f797c0d14f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.55:53834/0 (socket says 172.21.15.55:53834) 2024-05-27T12:33:19.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.262+0000 7f797a59c640 1 -- 172.21.15.55:0/58587011 learned_addr learned my addr 172.21.15.55:0/58587011 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-27T12:33:19.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.263+0000 7f797ad9d640 1 -- 172.21.15.55:0/58587011 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f797c06ca40 msgr2=0x7f797c09aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:19.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.263+0000 7f797ad9d640 1 --2- 172.21.15.55:0/58587011 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f797c06ca40 0x7f797c09aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:19.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.263+0000 7f797ad9d640 1 -- 172.21.15.55:0/58587011 >> v1:172.21.15.72:6789/0 conn(0x7f797c162150 legacy=0x7f797c0d14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:19.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.263+0000 7f797959a640 1 -- 172.21.15.55:0/58587011 <== mon.1 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 445947839 0 0) 0x7f797c0d2020 con 0x7f797c162150 2024-05-27T12:33:19.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.263+0000 7f797ad9d640 1 -- 172.21.15.55:0/58587011 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f797c0ccd60 con 0x7f797c09af70 2024-05-27T12:33:19.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.263+0000 7f797ad9d640 1 --2- 172.21.15.55:0/58587011 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f797c09af70 0x7f797c0cd840 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f7974009d90 tx=0x7f797402a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b2726f7ca423b3b8 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:19.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.264+0000 7f797959a640 1 -- 172.21.15.55:0/58587011 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7974007740 con 0x7f797c09af70 2024-05-27T12:33:19.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.264+0000 7f797959a640 1 -- 172.21.15.55:0/58587011 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79740078e0 con 0x7f797c09af70 2024-05-27T12:33:19.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.264+0000 7f797959a640 1 -- 172.21.15.55:0/58587011 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7974007cb0 con 0x7f797c09af70 2024-05-27T12:33:19.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.264+0000 7f7980acf640 1 -- 172.21.15.55:0/58587011 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f797c09af70 msgr2=0x7f797c0cd840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:19.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.264+0000 7f7980acf640 1 --2- 172.21.15.55:0/58587011 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f797c09af70 0x7f797c0cd840 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f7974009d90 tx=0x7f797402a660 comp rx=0 tx=0).stop 2024-05-27T12:33:19.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.264+0000 7f7980acf640 1 -- 172.21.15.55:0/58587011 shutdown_connections 2024-05-27T12:33:19.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.264+0000 7f7980acf640 1 --2- 172.21.15.55:0/58587011 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f797c09af70 0x7f797c0cd840 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:19.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.264+0000 7f7980acf640 1 --2- 172.21.15.55:0/58587011 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f797c06ca40 0x7f797c09aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:19.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.264+0000 7f7980acf640 1 -- 172.21.15.55:0/58587011 >> 172.21.15.55:0/58587011 conn(0x7f797c0b4160 msgr2=0x7f797c0b4570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:19.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.264+0000 7f7980acf640 1 -- 172.21.15.55:0/58587011 shutdown_connections 2024-05-27T12:33:19.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.264+0000 7f7980acf640 1 -- 172.21.15.55:0/58587011 wait complete. 2024-05-27T12:33:19.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.265+0000 7f7980acf640 1 Processor -- start 2024-05-27T12:33:19.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.266+0000 7f7980acf640 1 -- start start 2024-05-27T12:33:19.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.266+0000 7f7980acf640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f797c06ca40 0x7f797c14cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:19.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.266+0000 7f7980acf640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f797c09af70 0x7f797c0b5270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:19.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.266+0000 7f7980acf640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f797c162150 0x7f797c159510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:19.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.266+0000 7f7980acf640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f797c0cdd80 con 0x7f797c06ca40 2024-05-27T12:33:19.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.266+0000 7f7980acf640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f797c0cd320 con 0x7f797c162150 2024-05-27T12:33:19.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.266+0000 7f7980acf640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f797c0cdf00 con 0x7f797c09af70 2024-05-27T12:33:19.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.266+0000 7f797a59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f797c06ca40 0x7f797c14cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:19.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.266+0000 7f797a59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f797c06ca40 0x7f797c14cdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44434/0 (socket says 172.21.15.55:44434) 2024-05-27T12:33:19.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.266+0000 7f797a59c640 1 -- 172.21.15.55:0/2502637033 learned_addr learned my addr 172.21.15.55:0/2502637033 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:33:19.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.266+0000 7f7979d9b640 1 --2- 172.21.15.55:0/2502637033 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f797c09af70 0x7f797c0b5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:19.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.266+0000 7f797ad9d640 1 --2- 172.21.15.55:0/2502637033 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f797c162150 0x7f797c159510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:19.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.267+0000 7f797a59c640 1 -- 172.21.15.55:0/2502637033 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f797c09af70 msgr2=0x7f797c0b5270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:19.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.267+0000 7f797a59c640 1 --2- 172.21.15.55:0/2502637033 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f797c09af70 0x7f797c0b5270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:19.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.267+0000 7f797a59c640 1 -- 172.21.15.55:0/2502637033 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f797c162150 msgr2=0x7f797c159510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:19.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.267+0000 7f797a59c640 1 --2- 172.21.15.55:0/2502637033 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f797c162150 0x7f797c159510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:19.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.267+0000 7f797a59c640 1 -- 172.21.15.55:0/2502637033 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f797c0b26b0 con 0x7f797c06ca40 2024-05-27T12:33:19.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.267+0000 7f797a59c640 1 --2- 172.21.15.55:0/2502637033 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f797c06ca40 0x7f797c14cdb0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f796c00c430 tx=0x7f796c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:19.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.267+0000 7f796affd640 1 -- 172.21.15.55:0/2502637033 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f796c0074e0 con 0x7f797c06ca40 2024-05-27T12:33:19.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.267+0000 7f796affd640 1 -- 172.21.15.55:0/2502637033 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f796c0047e0 con 0x7f797c06ca40 2024-05-27T12:33:19.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.267+0000 7f7980acf640 1 -- 172.21.15.55:0/2502637033 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f797c0b2990 con 0x7f797c06ca40 2024-05-27T12:33:19.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.267+0000 7f796affd640 1 -- 172.21.15.55:0/2502637033 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f796c004bd0 con 0x7f797c06ca40 2024-05-27T12:33:19.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.267+0000 7f7980acf640 1 -- 172.21.15.55:0/2502637033 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f797c0b2f50 con 0x7f797c06ca40 2024-05-27T12:33:19.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.268+0000 7f7980acf640 1 -- 172.21.15.55:0/2502637033 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f797c068a70 con 0x7f797c06ca40 2024-05-27T12:33:19.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.269+0000 7f796affd640 1 -- 172.21.15.55:0/2502637033 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f796c011070 con 0x7f797c06ca40 2024-05-27T12:33:19.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.269+0000 7f796affd640 1 --2- 172.21.15.55:0/2502637033 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f795c06c8f0 0x7f795c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:19.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.269+0000 7f796affd640 1 -- 172.21.15.55:0/2502637033 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f796c08b780 con 0x7f797c06ca40 2024-05-27T12:33:19.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.269+0000 7f7979d9b640 1 --2- 172.21.15.55:0/2502637033 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f795c06c8f0 0x7f795c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:19.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.270+0000 7f7979d9b640 1 --2- 172.21.15.55:0/2502637033 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f795c06c8f0 0x7f795c06edb0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f797c0cf790 tx=0x7f7970009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:19.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.274+0000 7f796affd640 1 -- 172.21.15.55:0/2502637033 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f796c059450 con 0x7f797c06ca40 2024-05-27T12:33:19.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.463+0000 7f7980acf640 1 -- 172.21.15.55:0/2502637033 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f797c06e330 con 0x7f797c06ca40 2024-05-27T12:33:19.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.464+0000 7f796affd640 1 -- 172.21.15.55:0/2502637033 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) ==== 93+0+10 (secure 0 0 0) 0x7f796c05d750 con 0x7f797c06ca40 2024-05-27T12:33:19.464 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-05-27T12:33:19.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.466+0000 7f7980acf640 1 -- 172.21.15.55:0/2502637033 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f795c06c8f0 msgr2=0x7f795c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:19.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.466+0000 7f7980acf640 1 --2- 172.21.15.55:0/2502637033 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f795c06c8f0 0x7f795c06edb0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f797c0cf790 tx=0x7f7970009190 comp rx=0 tx=0).stop 2024-05-27T12:33:19.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.466+0000 7f7980acf640 1 -- 172.21.15.55:0/2502637033 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f797c06ca40 msgr2=0x7f797c14cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:19.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.466+0000 7f7980acf640 1 --2- 172.21.15.55:0/2502637033 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f797c06ca40 0x7f797c14cdb0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f796c00c430 tx=0x7f796c00c8f0 comp rx=0 tx=0).stop 2024-05-27T12:33:19.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.466+0000 7f7980acf640 1 -- 172.21.15.55:0/2502637033 shutdown_connections 2024-05-27T12:33:19.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.466+0000 7f7980acf640 1 --2- 172.21.15.55:0/2502637033 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f795c06c8f0 0x7f795c06edb0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:19.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.466+0000 7f7980acf640 1 --2- 172.21.15.55:0/2502637033 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f797c162150 0x7f797c159510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:19.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.466+0000 7f7980acf640 1 --2- 172.21.15.55:0/2502637033 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f797c09af70 0x7f797c0b5270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:19.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.466+0000 7f7980acf640 1 --2- 172.21.15.55:0/2502637033 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f797c06ca40 0x7f797c14cdb0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:19.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.466+0000 7f7980acf640 1 -- 172.21.15.55:0/2502637033 >> 172.21.15.55:0/2502637033 conn(0x7f797c0b4160 msgr2=0x7f797c070290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:19.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.466+0000 7f7980acf640 1 -- 172.21.15.55:0/2502637033 shutdown_connections 2024-05-27T12:33:19.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.466+0000 7f7980acf640 1 -- 172.21.15.55:0/2502637033 wait complete. 2024-05-27T12:33:19.476 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-27T12:33:19.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.584+0000 7f97cc529640 1 Processor -- start 2024-05-27T12:33:19.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.584+0000 7f97cc529640 1 -- start start 2024-05-27T12:33:19.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.585+0000 7f97cc529640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f97c415bb50 0x7f97c40cf460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:19.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.585+0000 7f97cc529640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97c40cc760 con 0x7f97c415b770 2024-05-27T12:33:19.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.585+0000 7f97cc529640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97c40cca40 con 0x7f97c40d1580 2024-05-27T12:33:19.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.585+0000 7f97cc529640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f97c40ccd20 con 0x7f97c415bb50 2024-05-27T12:33:19.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.585+0000 7f97ca2c5640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f97c415b770 0x7f97c40cbf60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:48668/0 (socket says 172.21.15.55:48668) 2024-05-27T12:33:19.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.585+0000 7f97ca2c5640 1 -- 172.21.15.55:0/2233971001 learned_addr learned my addr 172.21.15.55:0/2233971001 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-27T12:33:19.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.586+0000 7f97c92c3640 1 -- 172.21.15.55:0/2233971001 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3085348026 0 0) 0x7f97c40cc760 con 0x7f97c415b770 2024-05-27T12:33:19.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.586+0000 7f97c92c3640 1 -- 172.21.15.55:0/2233971001 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f97ac003520 con 0x7f97c415b770 2024-05-27T12:33:19.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.586+0000 7f97c9ac4640 1 --2- 172.21.15.55:0/2233971001 >> v2:172.21.15.72:3300/0 conn(0x7f97c415bb50 0x7f97c40cf460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:19.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.586+0000 7f97c92c3640 1 -- 172.21.15.55:0/2233971001 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 865255153 0 0) 0x7f97ac003520 con 0x7f97c415b770 2024-05-27T12:33:19.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.586+0000 7f97c92c3640 1 -- 172.21.15.55:0/2233971001 >> v2:172.21.15.72:3300/0 conn(0x7f97c415bb50 msgr2=0x7f97c40cf460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:19.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.586+0000 7f97c92c3640 1 --2- 172.21.15.55:0/2233971001 >> v2:172.21.15.72:3300/0 conn(0x7f97c415bb50 0x7f97c40cf460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:19.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.586+0000 7f97c92c3640 1 -- 172.21.15.55:0/2233971001 >> v1:172.21.15.72:6789/0 conn(0x7f97c40d1580 legacy=0x7f97c40d1990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:19.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.586+0000 7f97c92c3640 1 -- 172.21.15.55:0/2233971001 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97c40cd000 con 0x7f97c415b770 2024-05-27T12:33:19.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.586+0000 7f97c92c3640 1 -- 172.21.15.55:0/2233971001 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 793017739 0 0) 0x7f97bc001670 con 0x7f97c415b770 2024-05-27T12:33:19.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.586+0000 7f97c92c3640 1 -- 172.21.15.55:0/2233971001 >> v1:172.21.15.55:6789/0 conn(0x7f97c415b770 legacy=0x7f97c40cbf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:19.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.586+0000 7f97c92c3640 1 --2- 172.21.15.55:0/2233971001 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97ac0039b0 0x7f97ac003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:19.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.586+0000 7f97c92c3640 1 --2- 172.21.15.55:0/2233971001 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f97ac004800 0x7f97ac004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:19.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.586+0000 7f97c92c3640 1 --2- 172.21.15.55:0/2233971001 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f97ac0051c0 0x7f97ac00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:19.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.586+0000 7f97c92c3640 1 -- 172.21.15.55:0/2233971001 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f97c40ccd20 con 0x7f97ac0051c0 2024-05-27T12:33:19.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.586+0000 7f97c92c3640 1 -- 172.21.15.55:0/2233971001 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f97ac00c160 con 0x7f97ac0039b0 2024-05-27T12:33:19.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.586+0000 7f97c92c3640 1 -- 172.21.15.55:0/2233971001 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f97ac00c360 con 0x7f97ac004800 2024-05-27T12:33:19.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.586+0000 7f97caac6640 1 --2- 172.21.15.55:0/2233971001 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f97ac0051c0 0x7f97ac00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:19.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.586+0000 7f97ca2c5640 1 --2- 172.21.15.55:0/2233971001 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97ac0039b0 0x7f97ac003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:19.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.586+0000 7f97c9ac4640 1 --2- 172.21.15.55:0/2233971001 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f97ac004800 0x7f97ac004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:19.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.587+0000 7f97caac6640 1 -- 172.21.15.55:0/2233971001 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f97ac004800 msgr2=0x7f97ac004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:19.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.587+0000 7f97caac6640 1 --2- 172.21.15.55:0/2233971001 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f97ac004800 0x7f97ac004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:19.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.587+0000 7f97caac6640 1 -- 172.21.15.55:0/2233971001 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97ac0039b0 msgr2=0x7f97ac003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:19.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.587+0000 7f97caac6640 1 --2- 172.21.15.55:0/2233971001 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97ac0039b0 0x7f97ac003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:19.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.587+0000 7f97caac6640 1 -- 172.21.15.55:0/2233971001 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97ac003520 con 0x7f97ac0051c0 2024-05-27T12:33:19.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.587+0000 7f97caac6640 1 -- 172.21.15.55:0/2233971001 reap_dead start 2024-05-27T12:33:19.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.587+0000 7f97caac6640 1 --2- 172.21.15.55:0/2233971001 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f97ac0051c0 0x7f97ac00b9c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f97b4001e50 tx=0x7f97ac005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b855c2532b537e server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:19.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.587+0000 7f97c92c3640 1 -- 172.21.15.55:0/2233971001 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97b4001a70 con 0x7f97ac0051c0 2024-05-27T12:33:19.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.587+0000 7f97c92c3640 1 -- 172.21.15.55:0/2233971001 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97b4003970 con 0x7f97ac0051c0 2024-05-27T12:33:19.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.587+0000 7f97c92c3640 1 -- 172.21.15.55:0/2233971001 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97b4003d60 con 0x7f97ac0051c0 2024-05-27T12:33:19.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.588+0000 7f97cc529640 1 -- 172.21.15.55:0/2233971001 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f97ac0051c0 msgr2=0x7f97ac00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:19.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.588+0000 7f97cc529640 1 --2- 172.21.15.55:0/2233971001 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f97ac0051c0 0x7f97ac00b9c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f97b4001e50 tx=0x7f97ac005830 comp rx=0 tx=0).stop 2024-05-27T12:33:19.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.588+0000 7f97cc529640 1 -- 172.21.15.55:0/2233971001 shutdown_connections 2024-05-27T12:33:19.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.588+0000 7f97cc529640 1 --2- 172.21.15.55:0/2233971001 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f97ac0051c0 0x7f97ac00b9c0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:19.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.588+0000 7f97cc529640 1 -- 172.21.15.55:0/2233971001 >> 172.21.15.55:0/2233971001 conn(0x7f97c40733d0 msgr2=0x7f97c409aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:19.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.588+0000 7f97cc529640 1 -- 172.21.15.55:0/2233971001 shutdown_connections 2024-05-27T12:33:19.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.588+0000 7f97cc529640 1 -- 172.21.15.55:0/2233971001 wait complete. 2024-05-27T12:33:19.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.589+0000 7f97cc529640 1 Processor -- start 2024-05-27T12:33:19.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.589+0000 7f97cc529640 1 -- start start 2024-05-27T12:33:19.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.590+0000 7f97cc529640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f97ac0051c0 0x7f97c41f7000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:19.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.590+0000 7f97cc529640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f97c41f5220 0x7f97c40b0550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:19.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.590+0000 7f97cc529640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97c40b0a90 0x7f97c41f4300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:19.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.590+0000 7f97cc529640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f97c40cf5e0 con 0x7f97c41f5220 2024-05-27T12:33:19.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.590+0000 7f97cc529640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f97c40cf460 con 0x7f97c40b0a90 2024-05-27T12:33:19.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.590+0000 7f97cc529640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f97c40cf760 con 0x7f97ac0051c0 2024-05-27T12:33:19.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.590+0000 7f97c9ac4640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f97c41f5220 0x7f97c40b0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:19.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.590+0000 7f97c9ac4640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f97c41f5220 0x7f97c40b0550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44456/0 (socket says 172.21.15.55:44456) 2024-05-27T12:33:19.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.590+0000 7f97c9ac4640 1 -- 172.21.15.55:0/921082959 learned_addr learned my addr 172.21.15.55:0/921082959 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:33:19.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.590+0000 7f97ca2c5640 1 --2- 172.21.15.55:0/921082959 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f97ac0051c0 0x7f97c41f7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:19.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.590+0000 7f97caac6640 1 --2- 172.21.15.55:0/921082959 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97c40b0a90 0x7f97c41f4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:19.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.590+0000 7f97c9ac4640 1 -- 172.21.15.55:0/921082959 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f97ac0051c0 msgr2=0x7f97c41f7000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:19.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.590+0000 7f97c9ac4640 1 --2- 172.21.15.55:0/921082959 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f97ac0051c0 0x7f97c41f7000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:19.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.590+0000 7f97c9ac4640 1 -- 172.21.15.55:0/921082959 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97c40b0a90 msgr2=0x7f97c41f4300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:19.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.590+0000 7f97c9ac4640 1 --2- 172.21.15.55:0/921082959 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97c40b0a90 0x7f97c41f4300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:19.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.591+0000 7f97c9ac4640 1 -- 172.21.15.55:0/921082959 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97c41f5030 con 0x7f97c41f5220 2024-05-27T12:33:19.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.591+0000 7f97caac6640 1 --2- 172.21.15.55:0/921082959 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97c40b0a90 0x7f97c41f4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T12:33:19.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.591+0000 7f97c9ac4640 1 --2- 172.21.15.55:0/921082959 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f97c41f5220 0x7f97c40b0550 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f97b80118e0 tx=0x7f97b8011da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:19.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.591+0000 7f97c2ffd640 1 -- 172.21.15.55:0/921082959 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97b800faf0 con 0x7f97c41f5220 2024-05-27T12:33:19.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.591+0000 7f97c2ffd640 1 -- 172.21.15.55:0/921082959 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97b800fc90 con 0x7f97c41f5220 2024-05-27T12:33:19.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.591+0000 7f97cc529640 1 -- 172.21.15.55:0/921082959 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97c40ae510 con 0x7f97c41f5220 2024-05-27T12:33:19.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.591+0000 7f97c2ffd640 1 -- 172.21.15.55:0/921082959 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97b8014440 con 0x7f97c41f5220 2024-05-27T12:33:19.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.591+0000 7f97cc529640 1 -- 172.21.15.55:0/921082959 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97c40aead0 con 0x7f97c41f5220 2024-05-27T12:33:19.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.592+0000 7f97cc529640 1 -- 172.21.15.55:0/921082959 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97c40b0ea0 con 0x7f97c41f5220 2024-05-27T12:33:19.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.592+0000 7f97c2ffd640 1 -- 172.21.15.55:0/921082959 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f97b8012040 con 0x7f97c41f5220 2024-05-27T12:33:19.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.593+0000 7f97c2ffd640 1 --2- 172.21.15.55:0/921082959 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f97b006c920 0x7f97b006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:19.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.593+0000 7f97c2ffd640 1 -- 172.21.15.55:0/921082959 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f97b808c200 con 0x7f97c41f5220 2024-05-27T12:33:19.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.593+0000 7f97ca2c5640 1 --2- 172.21.15.55:0/921082959 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f97b006c920 0x7f97b006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:19.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.594+0000 7f97ca2c5640 1 --2- 172.21.15.55:0/921082959 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f97b006c920 0x7f97b006ede0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f97c40b2e30 tx=0x7f97bc0078f0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:19.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.597+0000 7f97c2ffd640 1 -- 172.21.15.55:0/921082959 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f97c40b0ea0 con 0x7f97c41f5220 2024-05-27T12:33:19.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.784+0000 7f97cc529640 1 -- 172.21.15.55:0/921082959 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f97c4075460 con 0x7f97c41f5220 2024-05-27T12:33:19.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.785+0000 7f97c2ffd640 1 -- 172.21.15.55:0/921082959 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) ==== 104+0+11 (secure 0 0 0) 0x7f97b8019030 con 0x7f97c41f5220 2024-05-27T12:33:19.784 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2024-05-27T12:33:19.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.787+0000 7f97cc529640 1 -- 172.21.15.55:0/921082959 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f97b006c920 msgr2=0x7f97b006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:19.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.787+0000 7f97cc529640 1 --2- 172.21.15.55:0/921082959 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f97b006c920 0x7f97b006ede0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f97c40b2e30 tx=0x7f97bc0078f0 comp rx=0 tx=0).stop 2024-05-27T12:33:19.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.787+0000 7f97cc529640 1 -- 172.21.15.55:0/921082959 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f97c41f5220 msgr2=0x7f97c40b0550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:19.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.787+0000 7f97cc529640 1 --2- 172.21.15.55:0/921082959 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f97c41f5220 0x7f97c40b0550 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f97b80118e0 tx=0x7f97b8011da0 comp rx=0 tx=0).stop 2024-05-27T12:33:19.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.787+0000 7f97cc529640 1 -- 172.21.15.55:0/921082959 shutdown_connections 2024-05-27T12:33:19.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.787+0000 7f97cc529640 1 --2- 172.21.15.55:0/921082959 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f97b006c920 0x7f97b006ede0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:19.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.787+0000 7f97cc529640 1 --2- 172.21.15.55:0/921082959 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97c40b0a90 0x7f97c41f4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:19.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.787+0000 7f97cc529640 1 --2- 172.21.15.55:0/921082959 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f97c41f5220 0x7f97c40b0550 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:19.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.787+0000 7f97cc529640 1 --2- 172.21.15.55:0/921082959 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f97ac0051c0 0x7f97c41f7000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:19.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.787+0000 7f97cc529640 1 -- 172.21.15.55:0/921082959 >> 172.21.15.55:0/921082959 conn(0x7f97c40733d0 msgr2=0x7f97c415df40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:19.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.787+0000 7f97cc529640 1 -- 172.21.15.55:0/921082959 shutdown_connections 2024-05-27T12:33:19.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.787+0000 7f97cc529640 1 -- 172.21.15.55:0/921082959 wait complete. 2024-05-27T12:33:19.797 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-27T12:33:19.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.904+0000 7f1bc098e640 1 Processor -- start 2024-05-27T12:33:19.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.904+0000 7f1bc098e640 1 -- start start 2024-05-27T12:33:19.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.905+0000 7f1bc098e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1bbc15eb00 0x7f1bbc0cfb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:19.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.905+0000 7f1bc098e640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1bbc15eee0 con 0x7f1bbc0d3e50 2024-05-27T12:33:19.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.905+0000 7f1bc098e640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1bbc0d4660 con 0x7f1bbc0d1f40 2024-05-27T12:33:19.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.905+0000 7f1bc098e640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f1bbc0d5700 con 0x7f1bbc15eb00 2024-05-27T12:33:19.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.905+0000 7f1bba59c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1bbc15eb00 0x7f1bbc0cfb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:19.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.905+0000 7f1bb3fff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f1bbc0d3e50 0x7f1bbc0d1830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:48680/0 (socket says 172.21.15.55:48680) 2024-05-27T12:33:19.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.905+0000 7f1bb3fff640 1 -- 172.21.15.55:0/511862669 learned_addr learned my addr 172.21.15.55:0/511862669 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-27T12:33:19.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.906+0000 7f1bba59c640 1 -- 172.21.15.55:0/511862669 >> v1:172.21.15.72:6789/0 conn(0x7f1bbc0d1f40 legacy=0x7f1bbc0b78f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:19.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.906+0000 7f1bba59c640 1 -- 172.21.15.55:0/511862669 >> v1:172.21.15.55:6789/0 conn(0x7f1bbc0d3e50 legacy=0x7f1bbc0d1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:19.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.906+0000 7f1bba59c640 1 -- 172.21.15.55:0/511862669 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bbc0d4940 con 0x7f1bbc15eb00 2024-05-27T12:33:19.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.906+0000 7f1bb9d9b640 1 -- 172.21.15.55:0/511862669 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1470785188 0 0) 0x7f1bbc15eee0 con 0x7f1bbc0d3e50 2024-05-27T12:33:19.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.906+0000 7f1bba59c640 1 --2- 172.21.15.55:0/511862669 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1bbc15eb00 0x7f1bbc0cfb40 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f1bac0097a0 tx=0x7f1bac02a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d18bcf341d74e876 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:19.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.906+0000 7f1bb9d9b640 1 -- 172.21.15.55:0/511862669 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bac037070 con 0x7f1bbc15eb00 2024-05-27T12:33:19.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.906+0000 7f1bb9d9b640 1 -- 172.21.15.55:0/511862669 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bac032640 con 0x7f1bbc15eb00 2024-05-27T12:33:19.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.907+0000 7f1bb9d9b640 1 -- 172.21.15.55:0/511862669 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bac032a10 con 0x7f1bbc15eb00 2024-05-27T12:33:19.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.907+0000 7f1bc098e640 1 -- 172.21.15.55:0/511862669 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1bbc15eb00 msgr2=0x7f1bbc0cfb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:19.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.907+0000 7f1bc098e640 1 --2- 172.21.15.55:0/511862669 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1bbc15eb00 0x7f1bbc0cfb40 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f1bac0097a0 tx=0x7f1bac02a2c0 comp rx=0 tx=0).stop 2024-05-27T12:33:19.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.907+0000 7f1bc098e640 1 -- 172.21.15.55:0/511862669 shutdown_connections 2024-05-27T12:33:19.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.907+0000 7f1bc098e640 1 --2- 172.21.15.55:0/511862669 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1bbc15eb00 0x7f1bbc0cfb40 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:19.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.907+0000 7f1bc098e640 1 -- 172.21.15.55:0/511862669 >> 172.21.15.55:0/511862669 conn(0x7f1bbc067a50 msgr2=0x7f1bbc067e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:19.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.907+0000 7f1bc098e640 1 -- 172.21.15.55:0/511862669 shutdown_connections 2024-05-27T12:33:19.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.907+0000 7f1bc098e640 1 -- 172.21.15.55:0/511862669 wait complete. 2024-05-27T12:33:19.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.908+0000 7f1bc098e640 1 Processor -- start 2024-05-27T12:33:19.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.908+0000 7f1bc098e640 1 -- start start 2024-05-27T12:33:19.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.909+0000 7f1bc098e640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1bbc0d1f40 0x7f1bbc153cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:19.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.909+0000 7f1bc098e640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1bbc0d3e50 0x7f1bbc15f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:19.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.909+0000 7f1bc098e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1bbc15eb00 0x7f1bbc15f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:19.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.909+0000 7f1bc098e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f1bbc0d51e0 con 0x7f1bbc15eb00 2024-05-27T12:33:19.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.909+0000 7f1bc098e640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f1bbc0d4f00 con 0x7f1bbc0d1f40 2024-05-27T12:33:19.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.909+0000 7f1bc098e640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f1bbc0d42c0 con 0x7f1bbc0d3e50 2024-05-27T12:33:19.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.909+0000 7f1bbad9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1bbc15eb00 0x7f1bbc15f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:19.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.909+0000 7f1bbad9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1bbc15eb00 0x7f1bbc15f610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44472/0 (socket says 172.21.15.55:44472) 2024-05-27T12:33:19.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.909+0000 7f1bbad9d640 1 -- 172.21.15.55:0/897957415 learned_addr learned my addr 172.21.15.55:0/897957415 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:33:19.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.909+0000 7f1bb3fff640 1 --2- 172.21.15.55:0/897957415 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1bbc0d3e50 0x7f1bbc15f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:19.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.909+0000 7f1bba59c640 1 --2- 172.21.15.55:0/897957415 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1bbc0d1f40 0x7f1bbc153cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:19.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.910+0000 7f1bbad9d640 1 -- 172.21.15.55:0/897957415 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1bbc0d3e50 msgr2=0x7f1bbc15f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:19.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.910+0000 7f1bbad9d640 1 --2- 172.21.15.55:0/897957415 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1bbc0d3e50 0x7f1bbc15f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:19.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.910+0000 7f1bbad9d640 1 -- 172.21.15.55:0/897957415 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1bbc0d1f40 msgr2=0x7f1bbc153cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:19.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.910+0000 7f1bbad9d640 1 --2- 172.21.15.55:0/897957415 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1bbc0d1f40 0x7f1bbc153cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:19.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.910+0000 7f1bbad9d640 1 -- 172.21.15.55:0/897957415 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bbc0ccf70 con 0x7f1bbc15eb00 2024-05-27T12:33:19.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.910+0000 7f1bbad9d640 1 --2- 172.21.15.55:0/897957415 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1bbc15eb00 0x7f1bbc15f610 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f1bb400c7d0 tx=0x7f1bb400cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:19.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.910+0000 7f1bb2ffd640 1 -- 172.21.15.55:0/897957415 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bb4003b70 con 0x7f1bbc15eb00 2024-05-27T12:33:19.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.910+0000 7f1bb2ffd640 1 -- 172.21.15.55:0/897957415 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bb4003d30 con 0x7f1bbc15eb00 2024-05-27T12:33:19.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.910+0000 7f1bc098e640 1 -- 172.21.15.55:0/897957415 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bbc0cd250 con 0x7f1bbc15eb00 2024-05-27T12:33:19.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.910+0000 7f1bb2ffd640 1 -- 172.21.15.55:0/897957415 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bb400aa90 con 0x7f1bbc15eb00 2024-05-27T12:33:19.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.910+0000 7f1bc098e640 1 -- 172.21.15.55:0/897957415 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bbc0cd810 con 0x7f1bbc15eb00 2024-05-27T12:33:19.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.911+0000 7f1bc098e640 1 -- 172.21.15.55:0/897957415 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1bbc068a70 con 0x7f1bbc15eb00 2024-05-27T12:33:19.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.912+0000 7f1bb2ffd640 1 -- 172.21.15.55:0/897957415 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1bb400ac30 con 0x7f1bbc15eb00 2024-05-27T12:33:19.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.912+0000 7f1bb2ffd640 1 --2- 172.21.15.55:0/897957415 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f1b9c06c8f0 0x7f1b9c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:19.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.912+0000 7f1bb2ffd640 1 -- 172.21.15.55:0/897957415 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f1bb408b950 con 0x7f1bbc15eb00 2024-05-27T12:33:19.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.912+0000 7f1bba59c640 1 --2- 172.21.15.55:0/897957415 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f1b9c06c8f0 0x7f1b9c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:19.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.913+0000 7f1bba59c640 1 --2- 172.21.15.55:0/897957415 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f1b9c06c8f0 0x7f1b9c06edb0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f1bac034000 tx=0x7f1bac02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:19.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:19.916+0000 7f1bb2ffd640 1 -- 172.21.15.55:0/897957415 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f1bb4059730 con 0x7f1bbc15eb00 2024-05-27T12:33:20.101 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.102+0000 7f1bc098e640 1 -- 172.21.15.55:0/897957415 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f1bbc0b9f70 con 0x7f1bbc15eb00 2024-05-27T12:33:20.101 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.102+0000 7f1bb2ffd640 1 -- 172.21.15.55:0/897957415 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) ==== 100+0+11 (secure 0 0 0) 0x7f1bb405da30 con 0x7f1bbc15eb00 2024-05-27T12:33:20.101 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2024-05-27T12:33:20.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.104+0000 7f1bc098e640 1 -- 172.21.15.55:0/897957415 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f1b9c06c8f0 msgr2=0x7f1b9c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:20.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.104+0000 7f1bc098e640 1 --2- 172.21.15.55:0/897957415 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f1b9c06c8f0 0x7f1b9c06edb0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f1bac034000 tx=0x7f1bac02e000 comp rx=0 tx=0).stop 2024-05-27T12:33:20.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.104+0000 7f1bc098e640 1 -- 172.21.15.55:0/897957415 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1bbc15eb00 msgr2=0x7f1bbc15f610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:20.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.104+0000 7f1bc098e640 1 --2- 172.21.15.55:0/897957415 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1bbc15eb00 0x7f1bbc15f610 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f1bb400c7d0 tx=0x7f1bb400cc90 comp rx=0 tx=0).stop 2024-05-27T12:33:20.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.104+0000 7f1bc098e640 1 -- 172.21.15.55:0/897957415 shutdown_connections 2024-05-27T12:33:20.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.104+0000 7f1bc098e640 1 --2- 172.21.15.55:0/897957415 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1bbc15eb00 0x7f1bbc15f610 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:20.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.104+0000 7f1bc098e640 1 --2- 172.21.15.55:0/897957415 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1bbc0d3e50 0x7f1bbc15f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:20.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.104+0000 7f1bc098e640 1 --2- 172.21.15.55:0/897957415 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f1b9c06c8f0 0x7f1b9c06edb0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:20.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.104+0000 7f1bc098e640 1 --2- 172.21.15.55:0/897957415 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1bbc0d1f40 0x7f1bbc153cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:20.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.104+0000 7f1bc098e640 1 -- 172.21.15.55:0/897957415 >> 172.21.15.55:0/897957415 conn(0x7f1bbc067a50 msgr2=0x7f1bbc0b7d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:20.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.104+0000 7f1bc098e640 1 -- 172.21.15.55:0/897957415 shutdown_connections 2024-05-27T12:33:20.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.104+0000 7f1bc098e640 1 -- 172.21.15.55:0/897957415 wait complete. 2024-05-27T12:33:20.115 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-27T12:33:20.220 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.220+0000 7fdbcbf7d640 1 Processor -- start 2024-05-27T12:33:20.220 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.221+0000 7fdbcbf7d640 1 -- start start 2024-05-27T12:33:20.221 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.221+0000 7fdbcbf7d640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fdbc415e9a0 0x7fdbc4162510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:20.221 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.221+0000 7fdbcbf7d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fdbc40b6a60 0x7fdbc40d3790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:20.221 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.221+0000 7fdbcbf7d640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdbc4162f40 con 0x7fdbc4162a50 2024-05-27T12:33:20.221 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.221+0000 7fdbcbf7d640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7fdbc4163220 con 0x7fdbc40b6a60 2024-05-27T12:33:20.221 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.221+0000 7fdbcbf7d640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fdbc40d2f90 con 0x7fdbc415e9a0 2024-05-27T12:33:20.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.222+0000 7fdbca51a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fdbc40b6a60 0x7fdbc40d3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:20.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.222+0000 7fdbc9518640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fdbc4162a50 0x7fdbc40b6350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:48694/0 (socket says 172.21.15.55:48694) 2024-05-27T12:33:20.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.222+0000 7fdbc9518640 1 -- 172.21.15.55:0/2092780546 learned_addr learned my addr 172.21.15.55:0/2092780546 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-27T12:33:20.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.222+0000 7fdbc9d19640 1 --2- 172.21.15.55:0/2092780546 >> v2:172.21.15.72:3300/0 conn(0x7fdbc415e9a0 0x7fdbc4162510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:20.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.222+0000 7fdbca51a640 1 -- 172.21.15.55:0/2092780546 >> v2:172.21.15.72:3300/0 conn(0x7fdbc415e9a0 msgr2=0x7fdbc4162510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:20.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.222+0000 7fdbca51a640 1 --2- 172.21.15.55:0/2092780546 >> v2:172.21.15.72:3300/0 conn(0x7fdbc415e9a0 0x7fdbc4162510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:20.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.222+0000 7fdbca51a640 1 -- 172.21.15.55:0/2092780546 >> v1:172.21.15.55:6789/0 conn(0x7fdbc4162a50 legacy=0x7fdbc40b6350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:20.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.222+0000 7fdbca51a640 1 -- 172.21.15.55:0/2092780546 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbc40d3270 con 0x7fdbc40b6a60 2024-05-27T12:33:20.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.222+0000 7fdbc8d17640 1 -- 172.21.15.55:0/2092780546 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 125807807 0 0) 0x7fdbc4162f40 con 0x7fdbc4162a50 2024-05-27T12:33:20.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.223+0000 7fdbca51a640 1 --2- 172.21.15.55:0/2092780546 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdbc40b6a60 0x7fdbc40d3790 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fdbc40d2450 tx=0x7fdbb402a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95998f16529e4500 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:20.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.223+0000 7fdbc8d17640 1 -- 172.21.15.55:0/2092780546 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbb4007740 con 0x7fdbc40b6a60 2024-05-27T12:33:20.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.223+0000 7fdbc8d17640 1 -- 172.21.15.55:0/2092780546 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbb40078e0 con 0x7fdbc40b6a60 2024-05-27T12:33:20.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.223+0000 7fdbc8d17640 1 -- 172.21.15.55:0/2092780546 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbb4007cb0 con 0x7fdbc40b6a60 2024-05-27T12:33:20.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.223+0000 7fdbcbf7d640 1 -- 172.21.15.55:0/2092780546 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdbc40b6a60 msgr2=0x7fdbc40d3790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:20.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.223+0000 7fdbcbf7d640 1 --2- 172.21.15.55:0/2092780546 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdbc40b6a60 0x7fdbc40d3790 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fdbc40d2450 tx=0x7fdbb402a5f0 comp rx=0 tx=0).stop 2024-05-27T12:33:20.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.223+0000 7fdbcbf7d640 1 -- 172.21.15.55:0/2092780546 shutdown_connections 2024-05-27T12:33:20.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.223+0000 7fdbcbf7d640 1 --2- 172.21.15.55:0/2092780546 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdbc40b6a60 0x7fdbc40d3790 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:20.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.223+0000 7fdbcbf7d640 1 --2- 172.21.15.55:0/2092780546 >> v2:172.21.15.72:3300/0 conn(0x7fdbc415e9a0 0x7fdbc4162510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:20.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.223+0000 7fdbcbf7d640 1 -- 172.21.15.55:0/2092780546 >> 172.21.15.55:0/2092780546 conn(0x7fdbc40d1350 msgr2=0x7fdbc40d1760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:20.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.223+0000 7fdbcbf7d640 1 -- 172.21.15.55:0/2092780546 shutdown_connections 2024-05-27T12:33:20.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.223+0000 7fdbcbf7d640 1 -- 172.21.15.55:0/2092780546 wait complete. 2024-05-27T12:33:20.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.225+0000 7fdbcbf7d640 1 Processor -- start 2024-05-27T12:33:20.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.225+0000 7fdbcbf7d640 1 -- start start 2024-05-27T12:33:20.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.225+0000 7fdbcbf7d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdbc40b6a60 0x7fdbc40ce2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:20.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.225+0000 7fdbcbf7d640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdbc415e9a0 0x7fdbc41f5930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:20.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.225+0000 7fdbcbf7d640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdbc4162a50 0x7fdbc40cb9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:20.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.225+0000 7fdbcbf7d640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7fdbc40cf440 con 0x7fdbc40b6a60 2024-05-27T12:33:20.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.225+0000 7fdbcbf7d640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fdbc40cf2c0 con 0x7fdbc415e9a0 2024-05-27T12:33:20.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.225+0000 7fdbcbf7d640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fdbc40b7bb0 con 0x7fdbc4162a50 2024-05-27T12:33:20.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.225+0000 7fdbc9d19640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdbc40b6a60 0x7fdbc40ce2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:20.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.225+0000 7fdbc9d19640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdbc40b6a60 0x7fdbc40ce2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44486/0 (socket says 172.21.15.55:44486) 2024-05-27T12:33:20.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.226+0000 7fdbc9d19640 1 -- 172.21.15.55:0/3075559535 learned_addr learned my addr 172.21.15.55:0/3075559535 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:33:20.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.226+0000 7fdbca51a640 1 --2- 172.21.15.55:0/3075559535 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdbc4162a50 0x7fdbc40cb9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:20.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.226+0000 7fdbc9518640 1 --2- 172.21.15.55:0/3075559535 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdbc415e9a0 0x7fdbc41f5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:20.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.226+0000 7fdbc9d19640 1 -- 172.21.15.55:0/3075559535 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdbc4162a50 msgr2=0x7fdbc40cb9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:20.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.226+0000 7fdbc9d19640 1 --2- 172.21.15.55:0/3075559535 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdbc4162a50 0x7fdbc40cb9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:20.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.226+0000 7fdbc9d19640 1 -- 172.21.15.55:0/3075559535 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdbc415e9a0 msgr2=0x7fdbc41f5930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:20.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.226+0000 7fdbc9d19640 1 --2- 172.21.15.55:0/3075559535 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdbc415e9a0 0x7fdbc41f5930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:20.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.226+0000 7fdbc9d19640 1 -- 172.21.15.55:0/3075559535 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbc40cc040 con 0x7fdbc40b6a60 2024-05-27T12:33:20.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.226+0000 7fdbca51a640 1 --2- 172.21.15.55:0/3075559535 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdbc4162a50 0x7fdbc40cb9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T12:33:20.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.226+0000 7fdbc9518640 1 --2- 172.21.15.55:0/3075559535 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdbc415e9a0 0x7fdbc41f5930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T12:33:20.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.226+0000 7fdbc9d19640 1 --2- 172.21.15.55:0/3075559535 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdbc40b6a60 0x7fdbc40ce2c0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fdbbc00d800 tx=0x7fdbbc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:20.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.226+0000 7fdbc27fc640 1 -- 172.21.15.55:0/3075559535 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbbc00b6c0 con 0x7fdbc40b6a60 2024-05-27T12:33:20.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.226+0000 7fdbc27fc640 1 -- 172.21.15.55:0/3075559535 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbbc019070 con 0x7fdbc40b6a60 2024-05-27T12:33:20.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.226+0000 7fdbcbf7d640 1 -- 172.21.15.55:0/3075559535 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbc41f4e50 con 0x7fdbc40b6a60 2024-05-27T12:33:20.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.226+0000 7fdbc27fc640 1 -- 172.21.15.55:0/3075559535 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbbc00ba80 con 0x7fdbc40b6a60 2024-05-27T12:33:20.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.226+0000 7fdbcbf7d640 1 -- 172.21.15.55:0/3075559535 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbc41f5410 con 0x7fdbc40b6a60 2024-05-27T12:33:20.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.227+0000 7fdbcbf7d640 1 -- 172.21.15.55:0/3075559535 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdbc4075460 con 0x7fdbc40b6a60 2024-05-27T12:33:20.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.228+0000 7fdbc27fc640 1 -- 172.21.15.55:0/3075559535 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fdbbc00bc20 con 0x7fdbc40b6a60 2024-05-27T12:33:20.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.228+0000 7fdbc27fc640 1 --2- 172.21.15.55:0/3075559535 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fdbb006c8f0 0x7fdbb006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:20.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.228+0000 7fdbc27fc640 1 -- 172.21.15.55:0/3075559535 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fdbbc08c040 con 0x7fdbc40b6a60 2024-05-27T12:33:20.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.229+0000 7fdbc9518640 1 --2- 172.21.15.55:0/3075559535 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fdbb006c8f0 0x7fdbb006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:20.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.229+0000 7fdbc9518640 1 --2- 172.21.15.55:0/3075559535 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fdbb006c8f0 0x7fdbb006edb0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fdbc40c7e20 tx=0x7fdbb8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:20.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.233+0000 7fdbc27fc640 1 -- 172.21.15.55:0/3075559535 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fdbbc01c360 con 0x7fdbc40b6a60 2024-05-27T12:33:20.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.435+0000 7fdbcbf7d640 1 -- 172.21.15.55:0/3075559535 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fdbc40d26c0 con 0x7fdbc40b6a60 2024-05-27T12:33:20.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.436+0000 7fdbc27fc640 1 -- 172.21.15.55:0/3075559535 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) ==== 80+0+0 (secure 0 0 0) 0x7fdbbc05a470 con 0x7fdbc40b6a60 2024-05-27T12:33:20.435 INFO:teuthology.orchestra.run.smithi055.stderr:listed 0 entries 2024-05-27T12:33:20.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.438+0000 7fdbcbf7d640 1 -- 172.21.15.55:0/3075559535 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fdbb006c8f0 msgr2=0x7fdbb006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:20.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.438+0000 7fdbcbf7d640 1 --2- 172.21.15.55:0/3075559535 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fdbb006c8f0 0x7fdbb006edb0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fdbc40c7e20 tx=0x7fdbb8009040 comp rx=0 tx=0).stop 2024-05-27T12:33:20.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.438+0000 7fdbcbf7d640 1 -- 172.21.15.55:0/3075559535 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdbc40b6a60 msgr2=0x7fdbc40ce2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:20.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.438+0000 7fdbcbf7d640 1 --2- 172.21.15.55:0/3075559535 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdbc40b6a60 0x7fdbc40ce2c0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fdbbc00d800 tx=0x7fdbbc00dcc0 comp rx=0 tx=0).stop 2024-05-27T12:33:20.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.438+0000 7fdbcbf7d640 1 -- 172.21.15.55:0/3075559535 shutdown_connections 2024-05-27T12:33:20.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.438+0000 7fdbcbf7d640 1 --2- 172.21.15.55:0/3075559535 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdbc4162a50 0x7fdbc40cb9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:20.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.438+0000 7fdbcbf7d640 1 --2- 172.21.15.55:0/3075559535 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fdbb006c8f0 0x7fdbb006edb0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:20.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.438+0000 7fdbcbf7d640 1 --2- 172.21.15.55:0/3075559535 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdbc415e9a0 0x7fdbc41f5930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:20.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.438+0000 7fdbcbf7d640 1 --2- 172.21.15.55:0/3075559535 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdbc40b6a60 0x7fdbc40ce2c0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:20.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.438+0000 7fdbcbf7d640 1 -- 172.21.15.55:0/3075559535 >> 172.21.15.55:0/3075559535 conn(0x7fdbc40d1350 msgr2=0x7fdbc40d1730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:20.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.438+0000 7fdbcbf7d640 1 -- 172.21.15.55:0/3075559535 shutdown_connections 2024-05-27T12:33:20.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.438+0000 7fdbcbf7d640 1 -- 172.21.15.55:0/3075559535 wait complete. 2024-05-27T12:33:20.448 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-05-27T12:33:20.448 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T12:33:20.449 DEBUG:teuthology.orchestra.run.smithi055:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2024-05-27T12:33:20.476 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi055.front.sepia.ceph.com 2024-05-27T12:33:20.476 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T12:33:20.476 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-05-27T12:33:20.532 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-05-27T12:33:20.532 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-27T12:33:20.552 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-05-27T12:33:20.552 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-27T12:33:20.611 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-05-27T12:33:20.611 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-27T12:33:20.669 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-27T12:33:20.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.774+0000 7f1f23a05640 1 Processor -- start 2024-05-27T12:33:20.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.774+0000 7f1f23a05640 1 -- start start 2024-05-27T12:33:20.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.775+0000 7f1f23a05640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1f1c15f9b0 0x7f1f1c0d1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:20.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.775+0000 7f1f23a05640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1f1c09b140 0x7f1f1c1684f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:20.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.775+0000 7f1f23a05640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f1c15fdd0 con 0x7f1f1c15eb00 2024-05-27T12:33:20.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.775+0000 7f1f23a05640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f1f1c0d08b0 con 0x7f1f1c15f9b0 2024-05-27T12:33:20.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.775+0000 7f1f23a05640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f1f1c0d0b50 con 0x7f1f1c09b140 2024-05-27T12:33:20.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.775+0000 7f1f217a1640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f1f1c15eb00 0x7f1f1c09aa30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:48712/0 (socket says 172.21.15.55:48712) 2024-05-27T12:33:20.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.775+0000 7f1f217a1640 1 -- 172.21.15.55:0/947956655 learned_addr learned my addr 172.21.15.55:0/947956655 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-27T12:33:20.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.775+0000 7f1f20fa0640 1 --2- 172.21.15.55:0/947956655 >> v2:172.21.15.72:3300/0 conn(0x7f1f1c15f9b0 0x7f1f1c0d1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:20.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.775+0000 7f1f21fa2640 1 --2- 172.21.15.55:0/947956655 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1f1c09b140 0x7f1f1c1684f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:20.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.775+0000 7f1f13fff640 1 -- 172.21.15.55:0/947956655 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3452236298 0 0) 0x7f1f1c15fdd0 con 0x7f1f1c15eb00 2024-05-27T12:33:20.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.775+0000 7f1f13fff640 1 -- 172.21.15.55:0/947956655 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1f08003520 con 0x7f1f1c15eb00 2024-05-27T12:33:20.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.776+0000 7f1f13fff640 1 -- 172.21.15.55:0/947956655 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2716870099 0 0) 0x7f1f08003520 con 0x7f1f1c15eb00 2024-05-27T12:33:20.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.776+0000 7f1f13fff640 1 -- 172.21.15.55:0/947956655 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1f1c09b140 msgr2=0x7f1f1c1684f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:20.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.776+0000 7f1f13fff640 1 --2- 172.21.15.55:0/947956655 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1f1c09b140 0x7f1f1c1684f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:20.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.776+0000 7f1f13fff640 1 -- 172.21.15.55:0/947956655 >> v2:172.21.15.72:3300/0 conn(0x7f1f1c15f9b0 msgr2=0x7f1f1c0d1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:20.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.776+0000 7f1f13fff640 1 --2- 172.21.15.55:0/947956655 >> v2:172.21.15.72:3300/0 conn(0x7f1f1c15f9b0 0x7f1f1c0d1630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:20.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.776+0000 7f1f13fff640 1 -- 172.21.15.55:0/947956655 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f1c0d0e30 con 0x7f1f1c15eb00 2024-05-27T12:33:20.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.776+0000 7f1f13fff640 1 -- 172.21.15.55:0/947956655 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 793017739 0 0) 0x7f1f18001670 con 0x7f1f1c15eb00 2024-05-27T12:33:20.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.776+0000 7f1f13fff640 1 -- 172.21.15.55:0/947956655 >> v1:172.21.15.55:6789/0 conn(0x7f1f1c15eb00 legacy=0x7f1f1c09aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:20.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.776+0000 7f1f13fff640 1 --2- 172.21.15.55:0/947956655 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1f1c09b140 0x7f1f08003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:20.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.776+0000 7f1f13fff640 1 --2- 172.21.15.55:0/947956655 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f08004010 0x7f1f08004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:20.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.776+0000 7f1f13fff640 1 --2- 172.21.15.55:0/947956655 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1f08004d40 0x7f1f080051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:20.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.776+0000 7f1f13fff640 1 -- 172.21.15.55:0/947956655 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f1f1c0d08b0 con 0x7f1f08004d40 2024-05-27T12:33:20.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.776+0000 7f1f13fff640 1 -- 172.21.15.55:0/947956655 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f1f1c0d0b50 con 0x7f1f08004010 2024-05-27T12:33:20.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.776+0000 7f1f13fff640 1 -- 172.21.15.55:0/947956655 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f1f0800bad0 con 0x7f1f1c09b140 2024-05-27T12:33:20.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.776+0000 7f1f20fa0640 1 --2- 172.21.15.55:0/947956655 >> v2:172.21.15.72:3300/0 conn(0x7f1f1c15f9b0 0x7f1f1c0d1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T12:33:20.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.776+0000 7f1f21fa2640 1 --2- 172.21.15.55:0/947956655 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1f08004d40 0x7f1f080051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:20.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.776+0000 7f1f217a1640 1 --2- 172.21.15.55:0/947956655 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1f1c09b140 0x7f1f08003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:20.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.776+0000 7f1f20fa0640 1 --2- 172.21.15.55:0/947956655 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f08004010 0x7f1f08004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:20.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.776+0000 7f1f21fa2640 1 -- 172.21.15.55:0/947956655 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1f1c09b140 msgr2=0x7f1f08003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:20.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.776+0000 7f1f21fa2640 1 --2- 172.21.15.55:0/947956655 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1f1c09b140 0x7f1f08003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:20.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.776+0000 7f1f21fa2640 1 -- 172.21.15.55:0/947956655 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f08004010 msgr2=0x7f1f08004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:20.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.776+0000 7f1f21fa2640 1 --2- 172.21.15.55:0/947956655 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f08004010 0x7f1f08004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:20.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.776+0000 7f1f21fa2640 1 -- 172.21.15.55:0/947956655 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f08003520 con 0x7f1f08004d40 2024-05-27T12:33:20.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.777+0000 7f1f21fa2640 1 --2- 172.21.15.55:0/947956655 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1f08004d40 0x7f1f080051c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f1f14009fc0 tx=0x7f1f08005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40d9f12045645c5e server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:20.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.777+0000 7f1f13fff640 1 -- 172.21.15.55:0/947956655 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f14009c10 con 0x7f1f08004d40 2024-05-27T12:33:20.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.777+0000 7f1f13fff640 1 -- 172.21.15.55:0/947956655 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f14036070 con 0x7f1f08004d40 2024-05-27T12:33:20.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.777+0000 7f1f13fff640 1 -- 172.21.15.55:0/947956655 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f14031880 con 0x7f1f08004d40 2024-05-27T12:33:20.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.778+0000 7f1f23a05640 1 -- 172.21.15.55:0/947956655 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1f08004d40 msgr2=0x7f1f080051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:20.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.778+0000 7f1f23a05640 1 --2- 172.21.15.55:0/947956655 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1f08004d40 0x7f1f080051c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f1f14009fc0 tx=0x7f1f08005830 comp rx=0 tx=0).stop 2024-05-27T12:33:20.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.778+0000 7f1f21fa2640 1 -- 172.21.15.55:0/947956655 reap_dead start 2024-05-27T12:33:20.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.778+0000 7f1f23a05640 1 -- 172.21.15.55:0/947956655 shutdown_connections 2024-05-27T12:33:20.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.778+0000 7f1f23a05640 1 -- 172.21.15.55:0/947956655 >> 172.21.15.55:0/947956655 conn(0x7f1f1c0b4100 msgr2=0x7f1f1c0b4510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:20.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.778+0000 7f1f23a05640 1 -- 172.21.15.55:0/947956655 shutdown_connections 2024-05-27T12:33:20.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.778+0000 7f1f23a05640 1 -- 172.21.15.55:0/947956655 wait complete. 2024-05-27T12:33:20.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.779+0000 7f1f23a05640 1 Processor -- start 2024-05-27T12:33:20.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.779+0000 7f1f23a05640 1 -- start start 2024-05-27T12:33:20.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.780+0000 7f1f23a05640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f08004d40 0x7f1f1c155be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:20.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.780+0000 7f1f23a05640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1f1c0cee10 0x7f1f1c0cf270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:20.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.780+0000 7f1f23a05640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1f1c0b6780 0x7f1f1c0b6c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:20.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.780+0000 7f1f23a05640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f1f1c09b5d0 con 0x7f1f1c0b6780 2024-05-27T12:33:20.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.780+0000 7f1f23a05640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f1f1c160040 con 0x7f1f08004d40 2024-05-27T12:33:20.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.780+0000 7f1f23a05640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f1f1c0cf7b0 con 0x7f1f1c0cee10 2024-05-27T12:33:20.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.780+0000 7f1f21fa2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1f1c0b6780 0x7f1f1c0b6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:20.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.780+0000 7f1f21fa2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1f1c0b6780 0x7f1f1c0b6c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44504/0 (socket says 172.21.15.55:44504) 2024-05-27T12:33:20.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.780+0000 7f1f21fa2640 1 -- 172.21.15.55:0/417833797 learned_addr learned my addr 172.21.15.55:0/417833797 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:33:20.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.780+0000 7f1f20fa0640 1 --2- 172.21.15.55:0/417833797 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1f1c0cee10 0x7f1f1c0cf270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:20.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.780+0000 7f1f217a1640 1 --2- 172.21.15.55:0/417833797 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f08004d40 0x7f1f1c155be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:20.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.780+0000 7f1f21fa2640 1 -- 172.21.15.55:0/417833797 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1f1c0cee10 msgr2=0x7f1f1c0cf270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:20.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.780+0000 7f1f21fa2640 1 --2- 172.21.15.55:0/417833797 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1f1c0cee10 0x7f1f1c0cf270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:20.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.780+0000 7f1f21fa2640 1 -- 172.21.15.55:0/417833797 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f08004d40 msgr2=0x7f1f1c155be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:20.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.780+0000 7f1f21fa2640 1 --2- 172.21.15.55:0/417833797 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f08004d40 0x7f1f1c155be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:20.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.780+0000 7f1f21fa2640 1 -- 172.21.15.55:0/417833797 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f1c0b74b0 con 0x7f1f1c0b6780 2024-05-27T12:33:20.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.781+0000 7f1f21fa2640 1 --2- 172.21.15.55:0/417833797 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1f1c0b6780 0x7f1f1c0b6c00 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f1f14033040 tx=0x7f1f14009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:20.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.781+0000 7f1f11ffb640 1 -- 172.21.15.55:0/417833797 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f14009c10 con 0x7f1f1c0b6780 2024-05-27T12:33:20.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.781+0000 7f1f11ffb640 1 -- 172.21.15.55:0/417833797 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f14031dd0 con 0x7f1f1c0b6780 2024-05-27T12:33:20.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.781+0000 7f1f11ffb640 1 -- 172.21.15.55:0/417833797 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f14003bd0 con 0x7f1f1c0b6780 2024-05-27T12:33:20.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.781+0000 7f1f23a05640 1 -- 172.21.15.55:0/417833797 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f1c0b7790 con 0x7f1f1c0b6780 2024-05-27T12:33:20.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.781+0000 7f1f23a05640 1 -- 172.21.15.55:0/417833797 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f1c0b7d50 con 0x7f1f1c0b6780 2024-05-27T12:33:20.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.782+0000 7f1f23a05640 1 -- 172.21.15.55:0/417833797 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f1c075460 con 0x7f1f1c0b6780 2024-05-27T12:33:20.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.782+0000 7f1f11ffb640 1 -- 172.21.15.55:0/417833797 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1f14005d10 con 0x7f1f1c0b6780 2024-05-27T12:33:20.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.783+0000 7f1f11ffb640 1 --2- 172.21.15.55:0/417833797 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f1f0006c920 0x7f1f0006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:20.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.783+0000 7f1f11ffb640 1 -- 172.21.15.55:0/417833797 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f1f140ad120 con 0x7f1f1c0b6780 2024-05-27T12:33:20.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.783+0000 7f1f217a1640 1 --2- 172.21.15.55:0/417833797 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f1f0006c920 0x7f1f0006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:20.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.784+0000 7f1f217a1640 1 --2- 172.21.15.55:0/417833797 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f1f0006c920 0x7f1f0006ede0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1f18007d90 tx=0x7f1f180078f0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:20.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.787+0000 7f1f11ffb640 1 -- 172.21.15.55:0/417833797 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f1f1404a060 con 0x7f1f1c0b6780 2024-05-27T12:33:20.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.972+0000 7f1f23a05640 1 -- 172.21.15.55:0/417833797 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1f1c0b1890 con 0x7f1f1c0b6780 2024-05-27T12:33:20.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.973+0000 7f1f11ffb640 1 -- 172.21.15.55:0/417833797 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16557 (secure 0 0 0) 0x7f1f1407af00 con 0x7f1f1c0b6780 2024-05-27T12:33:20.972 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-27T12:33:20.973 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":23,"fsid":"c3ff4e3b-8dae-4856-9593-e5cc66c59982","created":"2024-05-27T12:32:17.019097+0000","modified":"2024-05-27T12:32:43.361598+0000","last_up_change":"2024-05-27T12:32:28.109744+0000","last_in_change":"2024-05-27T12:32:19.309872+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-27T12:32:29.277895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-27T12:32:39.442745+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-27T12:32:40.672118+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e607b598-061b-4b6f-92ff-95c20b330599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":807572567},{"type":"v1","addr":"172.21.15.55:6801","nonce":807572567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":807572567},{"type":"v1","addr":"172.21.15.55:6803","nonce":807572567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":807572567},{"type":"v1","addr":"172.21.15.55:6807","nonce":807572567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":807572567},{"type":"v1","addr":"172.21.15.55:6805","nonce":807572567}]},"public_addr":"172.21.15.55:6801/807572567","cluster_addr":"172.21.15.55:6803/807572567","heartbeat_back_addr":"172.21.15.55:6807/807572567","heartbeat_front_addr":"172.21.15.55:6805/807572567","state":["exists","up"]},{"osd":1,"uuid":"ba2b5b1d-71a9-4ecc-9a48-55aa7fe54261","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":3426897300},{"type":"v1","addr":"172.21.15.55:6825","nonce":3426897300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":3426897300},{"type":"v1","addr":"172.21.15.55:6827","nonce":3426897300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":3426897300},{"type":"v1","addr":"172.21.15.55:6831","nonce":3426897300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":3426897300},{"type":"v1","addr":"172.21.15.55:6829","nonce":3426897300}]},"public_addr":"172.21.15.55:6825/3426897300","cluster_addr":"172.21.15.55:6827/3426897300","heartbeat_back_addr":"172.21.15.55:6831/3426897300","heartbeat_front_addr":"172.21.15.55:6829/3426897300","state":["exists","up"]},{"osd":2,"uuid":"e6b81cc6-4ff1-45d0-87eb-9f04ccf986a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3510271725},{"type":"v1","addr":"172.21.15.55:6809","nonce":3510271725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3510271725},{"type":"v1","addr":"172.21.15.55:6811","nonce":3510271725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3510271725},{"type":"v1","addr":"172.21.15.55:6815","nonce":3510271725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3510271725},{"type":"v1","addr":"172.21.15.55:6813","nonce":3510271725}]},"public_addr":"172.21.15.55:6809/3510271725","cluster_addr":"172.21.15.55:6811/3510271725","heartbeat_back_addr":"172.21.15.55:6815/3510271725","heartbeat_front_addr":"172.21.15.55:6813/3510271725","state":["exists","up"]},{"osd":3,"uuid":"b6a34b75-807d-4693-b1c3-903cb4c618d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":1066693520},{"type":"v1","addr":"172.21.15.55:6817","nonce":1066693520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":1066693520},{"type":"v1","addr":"172.21.15.55:6819","nonce":1066693520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":1066693520},{"type":"v1","addr":"172.21.15.55:6823","nonce":1066693520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":1066693520},{"type":"v1","addr":"172.21.15.55:6821","nonce":1066693520}]},"public_addr":"172.21.15.55:6817/1066693520","cluster_addr":"172.21.15.55:6819/1066693520","heartbeat_back_addr":"172.21.15.55:6823/1066693520","heartbeat_front_addr":"172.21.15.55:6821/1066693520","state":["exists","up"]},{"osd":4,"uuid":"272ec937-56b4-4f0a-b2e1-b0bc189c9d79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":4190771237},{"type":"v1","addr":"172.21.15.72:6820","nonce":4190771237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":4190771237},{"type":"v1","addr":"172.21.15.72:6824","nonce":4190771237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":4190771237},{"type":"v1","addr":"172.21.15.72:6831","nonce":4190771237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":4190771237},{"type":"v1","addr":"172.21.15.72:6828","nonce":4190771237}]},"public_addr":"172.21.15.72:6820/4190771237","cluster_addr":"172.21.15.72:6824/4190771237","heartbeat_back_addr":"172.21.15.72:6831/4190771237","heartbeat_front_addr":"172.21.15.72:6828/4190771237","state":["exists","up"]},{"osd":5,"uuid":"56439854-72a0-4ef4-81ff-184a3d924a5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":2421889184},{"type":"v1","addr":"172.21.15.72:6801","nonce":2421889184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6803","nonce":2421889184},{"type":"v1","addr":"172.21.15.72:6805","nonce":2421889184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":2421889184},{"type":"v1","addr":"172.21.15.72:6813","nonce":2421889184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6807","nonce":2421889184},{"type":"v1","addr":"172.21.15.72:6809","nonce":2421889184}]},"public_addr":"172.21.15.72:6801/2421889184","cluster_addr":"172.21.15.72:6805/2421889184","heartbeat_back_addr":"172.21.15.72:6813/2421889184","heartbeat_front_addr":"172.21.15.72:6809/2421889184","state":["exists","up"]},{"osd":6,"uuid":"e248e2be-3b6e-49cf-8c8a-1a4152827582","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3796994599},{"type":"v1","addr":"172.21.15.72:6804","nonce":3796994599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":3796994599},{"type":"v1","addr":"172.21.15.72:6808","nonce":3796994599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":3796994599},{"type":"v1","addr":"172.21.15.72:6815","nonce":3796994599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":3796994599},{"type":"v1","addr":"172.21.15.72:6812","nonce":3796994599}]},"public_addr":"172.21.15.72:6804/3796994599","cluster_addr":"172.21.15.72:6808/3796994599","heartbeat_back_addr":"172.21.15.72:6815/3796994599","heartbeat_front_addr":"172.21.15.72:6812/3796994599","state":["exists","up"]},{"osd":7,"uuid":"505a62d3-322b-4629-b4fd-187a55563709","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":3024877895},{"type":"v1","addr":"172.21.15.72:6817","nonce":3024877895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":3024877895},{"type":"v1","addr":"172.21.15.72:6821","nonce":3024877895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6827","nonce":3024877895},{"type":"v1","addr":"172.21.15.72:6829","nonce":3024877895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6823","nonce":3024877895},{"type":"v1","addr":"172.21.15.72:6825","nonce":3024877895}]},"public_addr":"172.21.15.72:6817/3024877895","cluster_addr":"172.21.15.72:6821/3024877895","heartbeat_back_addr":"172.21.15.72:6829/3024877895","heartbeat_front_addr":"172.21.15.72:6825/3024877895","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.241014+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.450799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.465018+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.507647+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.534763+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.495895+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.427110+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.547466+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-27T12:33:20.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.975+0000 7f1f23a05640 1 -- 172.21.15.55:0/417833797 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f1f0006c920 msgr2=0x7f1f0006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:20.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.975+0000 7f1f23a05640 1 --2- 172.21.15.55:0/417833797 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f1f0006c920 0x7f1f0006ede0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1f18007d90 tx=0x7f1f180078f0 comp rx=0 tx=0).stop 2024-05-27T12:33:20.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.975+0000 7f1f23a05640 1 -- 172.21.15.55:0/417833797 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1f1c0b6780 msgr2=0x7f1f1c0b6c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:20.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.975+0000 7f1f23a05640 1 --2- 172.21.15.55:0/417833797 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1f1c0b6780 0x7f1f1c0b6c00 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f1f14033040 tx=0x7f1f14009750 comp rx=0 tx=0).stop 2024-05-27T12:33:20.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.975+0000 7f1f23a05640 1 -- 172.21.15.55:0/417833797 shutdown_connections 2024-05-27T12:33:20.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.975+0000 7f1f23a05640 1 --2- 172.21.15.55:0/417833797 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1f1c0b6780 0x7f1f1c0b6c00 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:20.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.975+0000 7f1f23a05640 1 --2- 172.21.15.55:0/417833797 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1f1c0cee10 0x7f1f1c0cf270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:20.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.975+0000 7f1f23a05640 1 --2- 172.21.15.55:0/417833797 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f1f0006c920 0x7f1f0006ede0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:20.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.975+0000 7f1f23a05640 1 --2- 172.21.15.55:0/417833797 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f08004d40 0x7f1f1c155be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:20.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.975+0000 7f1f23a05640 1 -- 172.21.15.55:0/417833797 >> 172.21.15.55:0/417833797 conn(0x7f1f1c0b4100 msgr2=0x7f1f1c0b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:20.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.975+0000 7f1f23a05640 1 -- 172.21.15.55:0/417833797 shutdown_connections 2024-05-27T12:33:20.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:20.975+0000 7f1f23a05640 1 -- 172.21.15.55:0/417833797 wait complete. 2024-05-27T12:33:20.986 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-27T12:32:29.277895+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-27T12:32:39.442745+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-27T12:32:40.672118+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-27T12:33:20.986 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-27T12:33:21.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.095+0000 7ff09a68a640 1 Processor -- start 2024-05-27T12:33:21.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.095+0000 7ff09a68a640 1 -- start start 2024-05-27T12:33:21.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.095+0000 7ff09a68a640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff09415eb00 0x7ff0940cfb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:21.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.095+0000 7ff09a68a640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff0940d1f40 0x7ff0940b78f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:21.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.096+0000 7ff09a68a640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff09415eee0 con 0x7ff0940d3e50 2024-05-27T12:33:21.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.096+0000 7ff09a68a640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7ff0940d5700 con 0x7ff0940d1f40 2024-05-27T12:33:21.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.096+0000 7ff09a68a640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7ff0940d4660 con 0x7ff09415eb00 2024-05-27T12:33:21.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.096+0000 7ff098c27640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff0940d1f40 0x7ff0940b78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:21.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.096+0000 7ff093fff640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff09415eb00 0x7ff0940cfb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:21.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.096+0000 7ff08bfff640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7ff0940d3e50 0x7ff0940d1830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.55:53860/0 (socket says 172.21.15.55:53860) 2024-05-27T12:33:21.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.096+0000 7ff08bfff640 1 -- 172.21.15.55:0/221799143 learned_addr learned my addr 172.21.15.55:0/221799143 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-27T12:33:21.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.096+0000 7ff093fff640 1 -- 172.21.15.55:0/221799143 >> v2:172.21.15.72:3300/0 conn(0x7ff0940d1f40 msgr2=0x7ff0940b78f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:21.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.096+0000 7ff093fff640 1 --2- 172.21.15.55:0/221799143 >> v2:172.21.15.72:3300/0 conn(0x7ff0940d1f40 0x7ff0940b78f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:21.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.096+0000 7ff093fff640 1 -- 172.21.15.55:0/221799143 >> v1:172.21.15.72:6789/0 conn(0x7ff0940d3e50 legacy=0x7ff0940d1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:21.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.096+0000 7ff093fff640 1 -- 172.21.15.55:0/221799143 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0940d4940 con 0x7ff09415eb00 2024-05-27T12:33:21.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.096+0000 7ff098c27640 1 --2- 172.21.15.55:0/221799143 >> v2:172.21.15.72:3300/0 conn(0x7ff0940d1f40 0x7ff0940b78f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T12:33:21.097 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.097+0000 7ff093fff640 1 --2- 172.21.15.55:0/221799143 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff09415eb00 0x7ff0940cfb40 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff0840097a0 tx=0x7ff08402a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dd8fea00305b5967 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:21.097 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.097+0000 7ff0937fe640 1 -- 172.21.15.55:0/221799143 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff084037070 con 0x7ff09415eb00 2024-05-27T12:33:21.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.097+0000 7ff0937fe640 1 -- 172.21.15.55:0/221799143 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff084032440 con 0x7ff09415eb00 2024-05-27T12:33:21.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.097+0000 7ff0937fe640 1 -- 172.21.15.55:0/221799143 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff084032810 con 0x7ff09415eb00 2024-05-27T12:33:21.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.098+0000 7ff09a68a640 1 -- 172.21.15.55:0/221799143 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff09415eb00 msgr2=0x7ff0940cfb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:21.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.098+0000 7ff09a68a640 1 --2- 172.21.15.55:0/221799143 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff09415eb00 0x7ff0940cfb40 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff0840097a0 tx=0x7ff08402a210 comp rx=0 tx=0).stop 2024-05-27T12:33:21.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.098+0000 7ff09a68a640 1 -- 172.21.15.55:0/221799143 shutdown_connections 2024-05-27T12:33:21.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.098+0000 7ff09a68a640 1 --2- 172.21.15.55:0/221799143 >> v2:172.21.15.72:3300/0 conn(0x7ff0940d1f40 0x7ff0940b78f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:21.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.098+0000 7ff09a68a640 1 --2- 172.21.15.55:0/221799143 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff09415eb00 0x7ff0940cfb40 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:21.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.098+0000 7ff09a68a640 1 -- 172.21.15.55:0/221799143 >> 172.21.15.55:0/221799143 conn(0x7ff094067a50 msgr2=0x7ff094067e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:21.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.098+0000 7ff09a68a640 1 -- 172.21.15.55:0/221799143 shutdown_connections 2024-05-27T12:33:21.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.098+0000 7ff09a68a640 1 -- 172.21.15.55:0/221799143 wait complete. 2024-05-27T12:33:21.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.099+0000 7ff09a68a640 1 Processor -- start 2024-05-27T12:33:21.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.099+0000 7ff09a68a640 1 -- start start 2024-05-27T12:33:21.101 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.100+0000 7ff09a68a640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff0940d1f40 0x7ff094154a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:21.101 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.100+0000 7ff09a68a640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff0940d3e50 0x7ff0941f43f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:21.101 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.100+0000 7ff09a68a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff09415eb00 0x7ff09415bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:21.101 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.100+0000 7ff09a68a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7ff0940d51e0 con 0x7ff09415eb00 2024-05-27T12:33:21.101 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.100+0000 7ff09a68a640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7ff0940d4f00 con 0x7ff0940d3e50 2024-05-27T12:33:21.101 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.100+0000 7ff09a68a640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7ff0940d4290 con 0x7ff0940d1f40 2024-05-27T12:33:21.101 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.100+0000 7ff098c27640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff09415eb00 0x7ff09415bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:21.101 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.100+0000 7ff098c27640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff09415eb00 0x7ff09415bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44518/0 (socket says 172.21.15.55:44518) 2024-05-27T12:33:21.101 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.100+0000 7ff098c27640 1 -- 172.21.15.55:0/233322714 learned_addr learned my addr 172.21.15.55:0/233322714 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:33:21.101 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.100+0000 7ff08bfff640 1 --2- 172.21.15.55:0/233322714 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff0940d3e50 0x7ff0941f43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:21.101 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.100+0000 7ff093fff640 1 --2- 172.21.15.55:0/233322714 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff0940d1f40 0x7ff094154a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:21.101 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.101+0000 7ff098c27640 1 -- 172.21.15.55:0/233322714 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff0940d1f40 msgr2=0x7ff094154a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:21.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.101+0000 7ff098c27640 1 --2- 172.21.15.55:0/233322714 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff0940d1f40 0x7ff094154a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:21.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.101+0000 7ff098c27640 1 -- 172.21.15.55:0/233322714 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff0940d3e50 msgr2=0x7ff0941f43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:21.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.101+0000 7ff098c27640 1 --2- 172.21.15.55:0/233322714 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff0940d3e50 0x7ff0941f43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:21.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.101+0000 7ff098c27640 1 -- 172.21.15.55:0/233322714 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0940c9170 con 0x7ff09415eb00 2024-05-27T12:33:21.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.101+0000 7ff098c27640 1 --2- 172.21.15.55:0/233322714 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff09415eb00 0x7ff09415bc60 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7ff08c00efc0 tx=0x7ff08c009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:21.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.101+0000 7ff0917fa640 1 -- 172.21.15.55:0/233322714 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff08c018020 con 0x7ff09415eb00 2024-05-27T12:33:21.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.101+0000 7ff0917fa640 1 -- 172.21.15.55:0/233322714 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff08c014480 con 0x7ff09415eb00 2024-05-27T12:33:21.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.101+0000 7ff0917fa640 1 -- 172.21.15.55:0/233322714 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff08c014870 con 0x7ff09415eb00 2024-05-27T12:33:21.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.101+0000 7ff09a68a640 1 -- 172.21.15.55:0/233322714 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0940c9be0 con 0x7ff09415eb00 2024-05-27T12:33:21.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.101+0000 7ff09a68a640 1 -- 172.21.15.55:0/233322714 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0940ca1a0 con 0x7ff09415eb00 2024-05-27T12:33:21.103 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.102+0000 7ff09a68a640 1 -- 172.21.15.55:0/233322714 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0940b7570 con 0x7ff09415eb00 2024-05-27T12:33:21.103 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.102+0000 7ff0917fa640 1 -- 172.21.15.55:0/233322714 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff08c005d10 con 0x7ff09415eb00 2024-05-27T12:33:21.103 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.103+0000 7ff0917fa640 1 --2- 172.21.15.55:0/233322714 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7ff07406c920 0x7ff07406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:21.103 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.103+0000 7ff0917fa640 1 -- 172.21.15.55:0/233322714 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7ff08c08c7e0 con 0x7ff09415eb00 2024-05-27T12:33:21.103 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.103+0000 7ff093fff640 1 --2- 172.21.15.55:0/233322714 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7ff07406c920 0x7ff07406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:21.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.104+0000 7ff093fff640 1 --2- 172.21.15.55:0/233322714 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7ff07406c920 0x7ff07406ede0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ff084034000 tx=0x7ff08402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:21.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.107+0000 7ff0917fa640 1 -- 172.21.15.55:0/233322714 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff0940b7570 con 0x7ff09415eb00 2024-05-27T12:33:21.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.293+0000 7ff09a68a640 1 -- 172.21.15.55:0/233322714 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7ff094068a70 con 0x7ff09415eb00 2024-05-27T12:33:21.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.293+0000 7ff0917fa640 1 -- 172.21.15.55:0/233322714 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) ==== 93+0+10 (secure 0 0 0) 0x7ff08c022030 con 0x7ff09415eb00 2024-05-27T12:33:21.293 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-05-27T12:33:21.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.295+0000 7ff09a68a640 1 -- 172.21.15.55:0/233322714 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7ff07406c920 msgr2=0x7ff07406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:21.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.295+0000 7ff09a68a640 1 --2- 172.21.15.55:0/233322714 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7ff07406c920 0x7ff07406ede0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ff084034000 tx=0x7ff08402e000 comp rx=0 tx=0).stop 2024-05-27T12:33:21.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.295+0000 7ff09a68a640 1 -- 172.21.15.55:0/233322714 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff09415eb00 msgr2=0x7ff09415bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:21.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.295+0000 7ff09a68a640 1 --2- 172.21.15.55:0/233322714 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff09415eb00 0x7ff09415bc60 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7ff08c00efc0 tx=0x7ff08c009f90 comp rx=0 tx=0).stop 2024-05-27T12:33:21.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.295+0000 7ff09a68a640 1 -- 172.21.15.55:0/233322714 shutdown_connections 2024-05-27T12:33:21.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.295+0000 7ff09a68a640 1 --2- 172.21.15.55:0/233322714 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff09415eb00 0x7ff09415bc60 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:21.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.295+0000 7ff09a68a640 1 --2- 172.21.15.55:0/233322714 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7ff07406c920 0x7ff07406ede0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:21.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.295+0000 7ff09a68a640 1 --2- 172.21.15.55:0/233322714 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff0940d3e50 0x7ff0941f43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:21.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.295+0000 7ff09a68a640 1 --2- 172.21.15.55:0/233322714 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff0940d1f40 0x7ff094154a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:21.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.295+0000 7ff09a68a640 1 -- 172.21.15.55:0/233322714 >> 172.21.15.55:0/233322714 conn(0x7ff094067a50 msgr2=0x7ff0940d1830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:21.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.296+0000 7ff09a68a640 1 -- 172.21.15.55:0/233322714 shutdown_connections 2024-05-27T12:33:21.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.296+0000 7ff09a68a640 1 -- 172.21.15.55:0/233322714 wait complete. 2024-05-27T12:33:21.306 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-27T12:33:21.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.415+0000 7f4380d6f640 1 Processor -- start 2024-05-27T12:33:21.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.415+0000 7f4380d6f640 1 -- start start 2024-05-27T12:33:21.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.416+0000 7f4380d6f640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f437c0cfb40 0x7f437c0d1830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:21.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.416+0000 7f4380d6f640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f437c0d1d70 0x7f437c0b78f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:21.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.416+0000 7f4380d6f640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f437c0d2180 con 0x7f437c15eb00 2024-05-27T12:33:21.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.416+0000 7f4380d6f640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f437c0d5700 con 0x7f437c0cfb40 2024-05-27T12:33:21.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.416+0000 7f4380d6f640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f437c15eee0 con 0x7f437c0d1d70 2024-05-27T12:33:21.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.417+0000 7f437ad9d640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f437c0d1d70 0x7f437c0b78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:21.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.417+0000 7f4379d9b640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f437c0cfb40 0x7f437c0d1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:21.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.417+0000 7f437ad9d640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f437c0d1d70 0x7f437c0b78f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.55:55076/0 (socket says 172.21.15.55:55076) 2024-05-27T12:33:21.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.417+0000 7f437ad9d640 1 -- 172.21.15.55:0/418733909 learned_addr learned my addr 172.21.15.55:0/418733909 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:33:21.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.417+0000 7f437a59c640 1 --1- 172.21.15.55:0/418733909 >> v1:172.21.15.72:6789/0 conn(0x7f437c15eb00 0x7f437c0d3e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.55:53868/0 (socket says 172.21.15.55:53868) 2024-05-27T12:33:21.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.417+0000 7f4379d9b640 1 -- 172.21.15.55:0/418733909 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f437c0d1d70 msgr2=0x7f437c0b78f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:21.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.417+0000 7f4379d9b640 1 --2- 172.21.15.55:0/418733909 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f437c0d1d70 0x7f437c0b78f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:21.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.417+0000 7f4379d9b640 1 -- 172.21.15.55:0/418733909 >> v1:172.21.15.72:6789/0 conn(0x7f437c15eb00 legacy=0x7f437c0d3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:21.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.417+0000 7f4379d9b640 1 -- 172.21.15.55:0/418733909 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f437c0d4660 con 0x7f437c0cfb40 2024-05-27T12:33:21.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.417+0000 7f437959a640 1 -- 172.21.15.55:0/418733909 <== mon.1 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2735880742 0 0) 0x7f4374001490 con 0x7f437c15eb00 2024-05-27T12:33:21.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.417+0000 7f437ad9d640 1 --2- 172.21.15.55:0/418733909 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f437c0d1d70 0x7f437c0b78f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T12:33:21.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.418+0000 7f4379d9b640 1 --2- 172.21.15.55:0/418733909 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f437c0cfb40 0x7f437c0d1830 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f43640097a0 tx=0x7f436402a210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=51f88e4c62aba24b server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:21.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.418+0000 7f437959a640 1 -- 172.21.15.55:0/418733909 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4364037070 con 0x7f437c0cfb40 2024-05-27T12:33:21.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.418+0000 7f437959a640 1 -- 172.21.15.55:0/418733909 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4364032440 con 0x7f437c0cfb40 2024-05-27T12:33:21.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.418+0000 7f437959a640 1 -- 172.21.15.55:0/418733909 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4364032810 con 0x7f437c0cfb40 2024-05-27T12:33:21.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.418+0000 7f4380d6f640 1 -- 172.21.15.55:0/418733909 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f437c0cfb40 msgr2=0x7f437c0d1830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:21.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.418+0000 7f4380d6f640 1 --2- 172.21.15.55:0/418733909 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f437c0cfb40 0x7f437c0d1830 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f43640097a0 tx=0x7f436402a210 comp rx=0 tx=0).stop 2024-05-27T12:33:21.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.419+0000 7f4380d6f640 1 -- 172.21.15.55:0/418733909 shutdown_connections 2024-05-27T12:33:21.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.419+0000 7f4380d6f640 1 --2- 172.21.15.55:0/418733909 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f437c0d1d70 0x7f437c0b78f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:21.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.419+0000 7f4380d6f640 1 --2- 172.21.15.55:0/418733909 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f437c0cfb40 0x7f437c0d1830 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:21.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.419+0000 7f4380d6f640 1 -- 172.21.15.55:0/418733909 >> 172.21.15.55:0/418733909 conn(0x7f437c067a50 msgr2=0x7f437c067e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:21.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.419+0000 7f4380d6f640 1 -- 172.21.15.55:0/418733909 shutdown_connections 2024-05-27T12:33:21.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.419+0000 7f4380d6f640 1 -- 172.21.15.55:0/418733909 wait complete. 2024-05-27T12:33:21.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.420+0000 7f4380d6f640 1 Processor -- start 2024-05-27T12:33:21.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.420+0000 7f4380d6f640 1 -- start start 2024-05-27T12:33:21.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.421+0000 7f4380d6f640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f437c0cfb40 0x7f437c1541d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:21.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.421+0000 7f4380d6f640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f437c0d1d70 0x7f437c0cd130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:21.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.421+0000 7f4380d6f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f437c15eb00 0x7f437c0cd670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:21.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.421+0000 7f4380d6f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f437c0d4f00 con 0x7f437c15eb00 2024-05-27T12:33:21.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.421+0000 7f4380d6f640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f437c0d4c20 con 0x7f437c0d1d70 2024-05-27T12:33:21.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.421+0000 7f4380d6f640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f437c0d51e0 con 0x7f437c0cfb40 2024-05-27T12:33:21.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.421+0000 7f437ad9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f437c15eb00 0x7f437c0cd670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:21.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.421+0000 7f437ad9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f437c15eb00 0x7f437c0cd670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44526/0 (socket says 172.21.15.55:44526) 2024-05-27T12:33:21.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.421+0000 7f437ad9d640 1 -- 172.21.15.55:0/957571800 learned_addr learned my addr 172.21.15.55:0/957571800 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:33:21.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.421+0000 7f4379d9b640 1 --2- 172.21.15.55:0/957571800 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f437c0d1d70 0x7f437c0cd130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:21.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.421+0000 7f437a59c640 1 --2- 172.21.15.55:0/957571800 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f437c0cfb40 0x7f437c1541d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:21.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.421+0000 7f437ad9d640 1 -- 172.21.15.55:0/957571800 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f437c0cfb40 msgr2=0x7f437c1541d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:21.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.421+0000 7f437ad9d640 1 --2- 172.21.15.55:0/957571800 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f437c0cfb40 0x7f437c1541d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:21.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.421+0000 7f437ad9d640 1 -- 172.21.15.55:0/957571800 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f437c0d1d70 msgr2=0x7f437c0cd130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:21.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.421+0000 7f437ad9d640 1 --2- 172.21.15.55:0/957571800 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f437c0d1d70 0x7f437c0cd130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:21.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.421+0000 7f437ad9d640 1 -- 172.21.15.55:0/957571800 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f437c160a60 con 0x7f437c15eb00 2024-05-27T12:33:21.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.421+0000 7f437a59c640 1 --2- 172.21.15.55:0/957571800 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f437c0cfb40 0x7f437c1541d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T12:33:21.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.421+0000 7f437ad9d640 1 --2- 172.21.15.55:0/957571800 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f437c15eb00 0x7f437c0cd670 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f436c00e960 tx=0x7f436c00ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:21.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.421+0000 7f4372ffd640 1 -- 172.21.15.55:0/957571800 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f436c017070 con 0x7f437c15eb00 2024-05-27T12:33:21.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.421+0000 7f4372ffd640 1 -- 172.21.15.55:0/957571800 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f436c004020 con 0x7f437c15eb00 2024-05-27T12:33:21.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.421+0000 7f4380d6f640 1 -- 172.21.15.55:0/957571800 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f437c154710 con 0x7f437c15eb00 2024-05-27T12:33:21.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.422+0000 7f4372ffd640 1 -- 172.21.15.55:0/957571800 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f436c0043f0 con 0x7f437c15eb00 2024-05-27T12:33:21.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.422+0000 7f4380d6f640 1 -- 172.21.15.55:0/957571800 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f437c1604a0 con 0x7f437c15eb00 2024-05-27T12:33:21.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.423+0000 7f4380d6f640 1 -- 172.21.15.55:0/957571800 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f437c068a70 con 0x7f437c15eb00 2024-05-27T12:33:21.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.423+0000 7f4372ffd640 1 -- 172.21.15.55:0/957571800 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f436c00ca00 con 0x7f437c15eb00 2024-05-27T12:33:21.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.423+0000 7f4372ffd640 1 --2- 172.21.15.55:0/957571800 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f435c06c8f0 0x7f435c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:21.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.423+0000 7f4372ffd640 1 -- 172.21.15.55:0/957571800 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f436c08b960 con 0x7f437c15eb00 2024-05-27T12:33:21.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.424+0000 7f437a59c640 1 --2- 172.21.15.55:0/957571800 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f435c06c8f0 0x7f435c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:21.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.424+0000 7f437a59c640 1 --2- 172.21.15.55:0/957571800 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f435c06c8f0 0x7f435c06edb0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f43740012e0 tx=0x7f4374007d90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:21.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.428+0000 7f4372ffd640 1 -- 172.21.15.55:0/957571800 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f436c059750 con 0x7f437c15eb00 2024-05-27T12:33:21.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.616+0000 7f4380d6f640 1 -- 172.21.15.55:0/957571800 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f437c0cf500 con 0x7f437c15eb00 2024-05-27T12:33:21.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.616+0000 7f4372ffd640 1 -- 172.21.15.55:0/957571800 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) ==== 104+0+11 (secure 0 0 0) 0x7f436c05da50 con 0x7f437c15eb00 2024-05-27T12:33:21.616 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2024-05-27T12:33:21.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.618+0000 7f4380d6f640 1 -- 172.21.15.55:0/957571800 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f435c06c8f0 msgr2=0x7f435c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:21.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.618+0000 7f4380d6f640 1 --2- 172.21.15.55:0/957571800 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f435c06c8f0 0x7f435c06edb0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f43740012e0 tx=0x7f4374007d90 comp rx=0 tx=0).stop 2024-05-27T12:33:21.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.618+0000 7f4380d6f640 1 -- 172.21.15.55:0/957571800 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f437c15eb00 msgr2=0x7f437c0cd670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:21.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.618+0000 7f4380d6f640 1 --2- 172.21.15.55:0/957571800 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f437c15eb00 0x7f437c0cd670 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f436c00e960 tx=0x7f436c00ee20 comp rx=0 tx=0).stop 2024-05-27T12:33:21.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.618+0000 7f4380d6f640 1 -- 172.21.15.55:0/957571800 shutdown_connections 2024-05-27T12:33:21.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.618+0000 7f4380d6f640 1 --2- 172.21.15.55:0/957571800 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f437c15eb00 0x7f437c0cd670 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:21.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.618+0000 7f4380d6f640 1 --2- 172.21.15.55:0/957571800 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f435c06c8f0 0x7f435c06edb0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:21.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.618+0000 7f4380d6f640 1 --2- 172.21.15.55:0/957571800 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f437c0d1d70 0x7f437c0cd130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:21.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.618+0000 7f4380d6f640 1 --2- 172.21.15.55:0/957571800 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f437c0cfb40 0x7f437c1541d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:21.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.618+0000 7f4380d6f640 1 -- 172.21.15.55:0/957571800 >> 172.21.15.55:0/957571800 conn(0x7f437c067a50 msgr2=0x7f437c0b3f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:21.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.618+0000 7f4380d6f640 1 -- 172.21.15.55:0/957571800 shutdown_connections 2024-05-27T12:33:21.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.618+0000 7f4380d6f640 1 -- 172.21.15.55:0/957571800 wait complete. 2024-05-27T12:33:21.628 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-27T12:33:21.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.736+0000 7f942ca43640 1 Processor -- start 2024-05-27T12:33:21.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.736+0000 7f942ca43640 1 -- start start 2024-05-27T12:33:21.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.737+0000 7f942ca43640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f942815eb00 0x7f94280cfb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:21.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.737+0000 7f942ca43640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f94280d3e50 0x7f94280d1830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:21.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.737+0000 7f942ca43640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f942815eee0 con 0x7f94280d1d70 2024-05-27T12:33:21.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.737+0000 7f942ca43640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f94280d5700 con 0x7f94280d3e50 2024-05-27T12:33:21.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.737+0000 7f942ca43640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f94280d21a0 con 0x7f942815eb00 2024-05-27T12:33:21.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.738+0000 7f9426d9d640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f94280d1d70 0x7f94280d2910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:48720/0 (socket says 172.21.15.55:48720) 2024-05-27T12:33:21.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.738+0000 7f9426d9d640 1 -- 172.21.15.55:0/861645523 learned_addr learned my addr 172.21.15.55:0/861645523 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-27T12:33:21.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.738+0000 7f9425d9b640 1 --2- 172.21.15.55:0/861645523 >> v2:172.21.15.72:3300/0 conn(0x7f94280d3e50 0x7f94280d1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:21.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.738+0000 7f942659c640 1 --2- 172.21.15.55:0/861645523 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f942815eb00 0x7f94280cfb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:21.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.738+0000 7f942559a640 1 -- 172.21.15.55:0/861645523 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3347552259 0 0) 0x7f942815eee0 con 0x7f94280d1d70 2024-05-27T12:33:21.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.738+0000 7f942559a640 1 -- 172.21.15.55:0/861645523 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9414003520 con 0x7f94280d1d70 2024-05-27T12:33:21.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.738+0000 7f942559a640 1 -- 172.21.15.55:0/861645523 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1031598581 0 0) 0x7f9414003520 con 0x7f94280d1d70 2024-05-27T12:33:21.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.738+0000 7f942559a640 1 -- 172.21.15.55:0/861645523 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f942815eb00 msgr2=0x7f94280cfb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:21.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.738+0000 7f942559a640 1 --2- 172.21.15.55:0/861645523 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f942815eb00 0x7f94280cfb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:21.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.738+0000 7f942559a640 1 -- 172.21.15.55:0/861645523 >> v2:172.21.15.72:3300/0 conn(0x7f94280d3e50 msgr2=0x7f94280d1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:21.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.738+0000 7f942559a640 1 --2- 172.21.15.55:0/861645523 >> v2:172.21.15.72:3300/0 conn(0x7f94280d3e50 0x7f94280d1830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:21.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.738+0000 7f942559a640 1 -- 172.21.15.55:0/861645523 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94280d4660 con 0x7f94280d1d70 2024-05-27T12:33:21.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.738+0000 7f942559a640 1 -- 172.21.15.55:0/861645523 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 793017739 0 0) 0x7f9418001670 con 0x7f94280d1d70 2024-05-27T12:33:21.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.738+0000 7f942559a640 1 -- 172.21.15.55:0/861645523 >> v1:172.21.15.55:6789/0 conn(0x7f94280d1d70 legacy=0x7f94280d2910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:21.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.738+0000 7f942559a640 1 --2- 172.21.15.55:0/861645523 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f94140039e0 0x7f9414003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:21.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.738+0000 7f942559a640 1 --2- 172.21.15.55:0/861645523 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9414004800 0x7f9414004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:21.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.738+0000 7f942559a640 1 --2- 172.21.15.55:0/861645523 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f942815eb00 0x7f94140051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:21.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.738+0000 7f942559a640 1 -- 172.21.15.55:0/861645523 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f94280d5700 con 0x7f94140039e0 2024-05-27T12:33:21.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.738+0000 7f942559a640 1 -- 172.21.15.55:0/861645523 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f94280d21a0 con 0x7f9414004800 2024-05-27T12:33:21.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.738+0000 7f942559a640 1 -- 172.21.15.55:0/861645523 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f941400b9f0 con 0x7f942815eb00 2024-05-27T12:33:21.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.738+0000 7f942659c640 1 --2- 172.21.15.55:0/861645523 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f94140039e0 0x7f9414003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:21.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.739+0000 7f9425d9b640 1 --2- 172.21.15.55:0/861645523 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9414004800 0x7f9414004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:21.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.739+0000 7f9426d9d640 1 --2- 172.21.15.55:0/861645523 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f942815eb00 0x7f94140051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:21.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.739+0000 7f942659c640 1 -- 172.21.15.55:0/861645523 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f942815eb00 msgr2=0x7f94140051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:21.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.739+0000 7f942659c640 1 --2- 172.21.15.55:0/861645523 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f942815eb00 0x7f94140051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:21.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.739+0000 7f942659c640 1 -- 172.21.15.55:0/861645523 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9414004800 msgr2=0x7f9414004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:21.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.739+0000 7f942659c640 1 --2- 172.21.15.55:0/861645523 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9414004800 0x7f9414004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:21.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.739+0000 7f942659c640 1 -- 172.21.15.55:0/861645523 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9414003520 con 0x7f94140039e0 2024-05-27T12:33:21.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.739+0000 7f942659c640 1 --2- 172.21.15.55:0/861645523 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f94140039e0 0x7f9414003e00 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f9420009fc0 tx=0x7f9414005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7cbc6132746a9fb server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:21.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.740+0000 7f942559a640 1 -- 172.21.15.55:0/861645523 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9420009c10 con 0x7f94140039e0 2024-05-27T12:33:21.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.740+0000 7f942559a640 1 -- 172.21.15.55:0/861645523 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9420036070 con 0x7f94140039e0 2024-05-27T12:33:21.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.740+0000 7f942559a640 1 -- 172.21.15.55:0/861645523 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9420031880 con 0x7f94140039e0 2024-05-27T12:33:21.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.740+0000 7f942ca43640 1 -- 172.21.15.55:0/861645523 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f94140039e0 msgr2=0x7f9414003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:21.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.740+0000 7f942ca43640 1 --2- 172.21.15.55:0/861645523 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f94140039e0 0x7f9414003e00 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f9420009fc0 tx=0x7f9414005830 comp rx=0 tx=0).stop 2024-05-27T12:33:21.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.740+0000 7f9426d9d640 1 -- 172.21.15.55:0/861645523 reap_dead start 2024-05-27T12:33:21.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.740+0000 7f942ca43640 1 -- 172.21.15.55:0/861645523 shutdown_connections 2024-05-27T12:33:21.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.740+0000 7f942ca43640 1 -- 172.21.15.55:0/861645523 >> 172.21.15.55:0/861645523 conn(0x7f9428067a50 msgr2=0x7f9428067e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:21.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.740+0000 7f942ca43640 1 -- 172.21.15.55:0/861645523 shutdown_connections 2024-05-27T12:33:21.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.740+0000 7f942ca43640 1 -- 172.21.15.55:0/861645523 wait complete. 2024-05-27T12:33:21.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.742+0000 7f942ca43640 1 Processor -- start 2024-05-27T12:33:21.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.742+0000 7f942ca43640 1 -- start start 2024-05-27T12:33:21.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.742+0000 7f942ca43640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f94140039e0 0x7f9428158fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:21.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.742+0000 7f942ca43640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f942815a670 0x7f94280ccc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:21.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.742+0000 7f942ca43640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f942814eca0 0x7f94280b4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:21.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.742+0000 7f942ca43640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f94280d4f00 con 0x7f942814eca0 2024-05-27T12:33:21.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.742+0000 7f942ca43640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f94280d4c20 con 0x7f942815a670 2024-05-27T12:33:21.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.742+0000 7f942ca43640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f94280d51e0 con 0x7f94140039e0 2024-05-27T12:33:21.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.743+0000 7f9426d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f942814eca0 0x7f94280b4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:21.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.743+0000 7f9426d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f942814eca0 0x7f94280b4ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44550/0 (socket says 172.21.15.55:44550) 2024-05-27T12:33:21.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.743+0000 7f9426d9d640 1 -- 172.21.15.55:0/3153085163 learned_addr learned my addr 172.21.15.55:0/3153085163 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:33:21.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.743+0000 7f9425d9b640 1 --2- 172.21.15.55:0/3153085163 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f942815a670 0x7f94280ccc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:21.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.743+0000 7f942659c640 1 --2- 172.21.15.55:0/3153085163 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f94140039e0 0x7f9428158fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:21.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.743+0000 7f9426d9d640 1 -- 172.21.15.55:0/3153085163 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f94140039e0 msgr2=0x7f9428158fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:21.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.743+0000 7f9426d9d640 1 --2- 172.21.15.55:0/3153085163 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f94140039e0 0x7f9428158fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:21.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.743+0000 7f9426d9d640 1 -- 172.21.15.55:0/3153085163 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f942815a670 msgr2=0x7f94280ccc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:21.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.743+0000 7f9426d9d640 1 --2- 172.21.15.55:0/3153085163 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f942815a670 0x7f94280ccc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:21.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.743+0000 7f9426d9d640 1 -- 172.21.15.55:0/3153085163 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94280cd1d0 con 0x7f942814eca0 2024-05-27T12:33:21.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.743+0000 7f9425d9b640 1 --2- 172.21.15.55:0/3153085163 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f942815a670 0x7f94280ccc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T12:33:21.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.743+0000 7f9426d9d640 1 --2- 172.21.15.55:0/3153085163 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f942814eca0 0x7f94280b4ac0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f94280b63a0 tx=0x7f9418007720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:21.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.743+0000 7f941effd640 1 -- 172.21.15.55:0/3153085163 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f941801a070 con 0x7f942814eca0 2024-05-27T12:33:21.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.743+0000 7f941effd640 1 -- 172.21.15.55:0/3153085163 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9418001610 con 0x7f942814eca0 2024-05-27T12:33:21.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.743+0000 7f942ca43640 1 -- 172.21.15.55:0/3153085163 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94281595d0 con 0x7f942814eca0 2024-05-27T12:33:21.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.743+0000 7f941effd640 1 -- 172.21.15.55:0/3153085163 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f941800fad0 con 0x7f942814eca0 2024-05-27T12:33:21.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.743+0000 7f942ca43640 1 -- 172.21.15.55:0/3153085163 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9428159b90 con 0x7f942814eca0 2024-05-27T12:33:21.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.744+0000 7f942ca43640 1 -- 172.21.15.55:0/3153085163 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94280d2520 con 0x7f942814eca0 2024-05-27T12:33:21.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.745+0000 7f941effd640 1 -- 172.21.15.55:0/3153085163 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f941801d070 con 0x7f942814eca0 2024-05-27T12:33:21.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.745+0000 7f941effd640 1 --2- 172.21.15.55:0/3153085163 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f940806c920 0x7f940806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:21.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.745+0000 7f941effd640 1 -- 172.21.15.55:0/3153085163 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5825+0+0 (secure 0 0 0) 0x7f941808b0d0 con 0x7f942814eca0 2024-05-27T12:33:21.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.746+0000 7f942659c640 1 --2- 172.21.15.55:0/3153085163 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f940806c920 0x7f940806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:21.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.746+0000 7f942659c640 1 --2- 172.21.15.55:0/3153085163 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f940806c920 0x7f940806ede0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f9420035000 tx=0x7f942002f000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:21.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.750+0000 7f941effd640 1 -- 172.21.15.55:0/3153085163 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f94280d2520 con 0x7f942814eca0 2024-05-27T12:33:21.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.934+0000 7f942ca43640 1 -- 172.21.15.55:0/3153085163 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f9428068a70 con 0x7f942814eca0 2024-05-27T12:33:21.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.935+0000 7f941effd640 1 -- 172.21.15.55:0/3153085163 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) ==== 100+0+11 (secure 0 0 0) 0x7f9418059510 con 0x7f942814eca0 2024-05-27T12:33:21.934 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2024-05-27T12:33:21.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.936+0000 7f942ca43640 1 -- 172.21.15.55:0/3153085163 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f940806c920 msgr2=0x7f940806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:21.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.937+0000 7f942ca43640 1 --2- 172.21.15.55:0/3153085163 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f940806c920 0x7f940806ede0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f9420035000 tx=0x7f942002f000 comp rx=0 tx=0).stop 2024-05-27T12:33:21.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.937+0000 7f942ca43640 1 -- 172.21.15.55:0/3153085163 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f942814eca0 msgr2=0x7f94280b4ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:21.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.937+0000 7f942ca43640 1 --2- 172.21.15.55:0/3153085163 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f942814eca0 0x7f94280b4ac0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f94280b63a0 tx=0x7f9418007720 comp rx=0 tx=0).stop 2024-05-27T12:33:21.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.937+0000 7f942ca43640 1 -- 172.21.15.55:0/3153085163 shutdown_connections 2024-05-27T12:33:21.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.937+0000 7f942ca43640 1 --2- 172.21.15.55:0/3153085163 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f942814eca0 0x7f94280b4ac0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:21.937 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.937+0000 7f942ca43640 1 --2- 172.21.15.55:0/3153085163 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f940806c920 0x7f940806ede0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:21.937 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.937+0000 7f942ca43640 1 --2- 172.21.15.55:0/3153085163 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f942815a670 0x7f94280ccc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:21.937 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.937+0000 7f942ca43640 1 --2- 172.21.15.55:0/3153085163 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f94140039e0 0x7f9428158fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:21.937 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.937+0000 7f942ca43640 1 -- 172.21.15.55:0/3153085163 >> 172.21.15.55:0/3153085163 conn(0x7f9428067a50 msgr2=0x7f94280ceb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:21.937 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.937+0000 7f942ca43640 1 -- 172.21.15.55:0/3153085163 shutdown_connections 2024-05-27T12:33:21.937 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:21.937+0000 7f942ca43640 1 -- 172.21.15.55:0/3153085163 wait complete. 2024-05-27T12:33:21.947 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-27T12:33:22.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.052+0000 7faeeb2e1640 1 Processor -- start 2024-05-27T12:33:22.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.053+0000 7faeeb2e1640 1 -- start start 2024-05-27T12:33:22.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.053+0000 7faeeb2e1640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7faee40b7bb0 0x7faee40b6350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:22.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.053+0000 7faeeb2e1640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7faee40b6890 0x7faee40d3790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:22.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.053+0000 7faeeb2e1640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faee4162f40 con 0x7faee415e9a0 2024-05-27T12:33:22.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.053+0000 7faeeb2e1640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7faee4163220 con 0x7faee40b7bb0 2024-05-27T12:33:22.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.053+0000 7faeeb2e1640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7faee40d2f90 con 0x7faee40b6890 2024-05-27T12:33:22.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.053+0000 7faee887c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7faee40b7bb0 0x7faee40b6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:22.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.054+0000 7faee907d640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7faee415e9a0 0x7faee4162510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:48732/0 (socket says 172.21.15.55:48732) 2024-05-27T12:33:22.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.054+0000 7faee887c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7faee40b7bb0 0x7faee40b6350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44556/0 (socket says 172.21.15.55:44556) 2024-05-27T12:33:22.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.054+0000 7faee907d640 1 -- 172.21.15.55:0/1572551621 learned_addr learned my addr 172.21.15.55:0/1572551621 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-27T12:33:22.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.054+0000 7faee987e640 1 --2- 172.21.15.55:0/1572551621 >> v2:172.21.15.72:3300/0 conn(0x7faee40b6890 0x7faee40d3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:22.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.054+0000 7faee887c640 1 -- 172.21.15.55:0/1572551621 >> v2:172.21.15.72:3300/0 conn(0x7faee40b6890 msgr2=0x7faee40d3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:22.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.054+0000 7faee887c640 1 --2- 172.21.15.55:0/1572551621 >> v2:172.21.15.72:3300/0 conn(0x7faee40b6890 0x7faee40d3790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:22.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.054+0000 7faee887c640 1 -- 172.21.15.55:0/1572551621 >> v1:172.21.15.55:6789/0 conn(0x7faee415e9a0 legacy=0x7faee4162510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:22.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.054+0000 7faedbfff640 1 -- 172.21.15.55:0/1572551621 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2047643589 0 0) 0x7faee4162f40 con 0x7faee415e9a0 2024-05-27T12:33:22.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.054+0000 7faee887c640 1 -- 172.21.15.55:0/1572551621 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faee40d3270 con 0x7faee40b7bb0 2024-05-27T12:33:22.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.054+0000 7faee987e640 1 --2- 172.21.15.55:0/1572551621 >> v2:172.21.15.72:3300/0 conn(0x7faee40b6890 0x7faee40d3790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T12:33:22.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.055+0000 7faee887c640 1 --2- 172.21.15.55:0/1572551621 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faee40b7bb0 0x7faee40b6350 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7faee40d0bc0 tx=0x7faed402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ec4d3023cdfb7d9 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:22.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.055+0000 7faedbfff640 1 -- 172.21.15.55:0/1572551621 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faed4037070 con 0x7faee40b7bb0 2024-05-27T12:33:22.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.055+0000 7faedbfff640 1 -- 172.21.15.55:0/1572551621 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faed4032440 con 0x7faee40b7bb0 2024-05-27T12:33:22.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.055+0000 7faedbfff640 1 -- 172.21.15.55:0/1572551621 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faed402ae60 con 0x7faee40b7bb0 2024-05-27T12:33:22.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.055+0000 7faeeb2e1640 1 -- 172.21.15.55:0/1572551621 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faee40b7bb0 msgr2=0x7faee40b6350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:22.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.055+0000 7faeeb2e1640 1 --2- 172.21.15.55:0/1572551621 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faee40b7bb0 0x7faee40b6350 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7faee40d0bc0 tx=0x7faed402a110 comp rx=0 tx=0).stop 2024-05-27T12:33:22.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.055+0000 7faeeb2e1640 1 -- 172.21.15.55:0/1572551621 shutdown_connections 2024-05-27T12:33:22.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.055+0000 7faeeb2e1640 1 --2- 172.21.15.55:0/1572551621 >> v2:172.21.15.72:3300/0 conn(0x7faee40b6890 0x7faee40d3790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:22.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.055+0000 7faeeb2e1640 1 --2- 172.21.15.55:0/1572551621 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faee40b7bb0 0x7faee40b6350 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:22.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.055+0000 7faeeb2e1640 1 -- 172.21.15.55:0/1572551621 >> 172.21.15.55:0/1572551621 conn(0x7faee40d1350 msgr2=0x7faee40d1760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:22.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.055+0000 7faeeb2e1640 1 -- 172.21.15.55:0/1572551621 shutdown_connections 2024-05-27T12:33:22.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.055+0000 7faeeb2e1640 1 -- 172.21.15.55:0/1572551621 wait complete. 2024-05-27T12:33:22.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.057+0000 7faeeb2e1640 1 Processor -- start 2024-05-27T12:33:22.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.057+0000 7faeeb2e1640 1 -- start start 2024-05-27T12:33:22.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.057+0000 7faeeb2e1640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faee40b6890 0x7faee4151f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:22.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.057+0000 7faeeb2e1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faee40b7bb0 0x7faee41f7950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:22.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.057+0000 7faeeb2e1640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faee415e9a0 0x7faee41f4b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:22.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.057+0000 7faeeb2e1640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7faee40cf2c0 con 0x7faee40b7bb0 2024-05-27T12:33:22.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.057+0000 7faeeb2e1640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7faee415ed80 con 0x7faee40b6890 2024-05-27T12:33:22.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.057+0000 7faeeb2e1640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7faee40cf440 con 0x7faee415e9a0 2024-05-27T12:33:22.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.057+0000 7faee887c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faee40b7bb0 0x7faee41f7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:22.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.057+0000 7faee887c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faee40b7bb0 0x7faee41f7950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44572/0 (socket says 172.21.15.55:44572) 2024-05-27T12:33:22.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.057+0000 7faee887c640 1 -- 172.21.15.55:0/2992140104 learned_addr learned my addr 172.21.15.55:0/2992140104 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:33:22.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.058+0000 7faee887c640 1 -- 172.21.15.55:0/2992140104 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faee415e9a0 msgr2=0x7faee41f4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:22.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.058+0000 7faee887c640 1 --2- 172.21.15.55:0/2992140104 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faee415e9a0 0x7faee41f4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:22.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.058+0000 7faee887c640 1 -- 172.21.15.55:0/2992140104 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faee40b6890 msgr2=0x7faee4151f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:22.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.058+0000 7faee887c640 1 --2- 172.21.15.55:0/2992140104 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faee40b6890 0x7faee4151f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:22.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.058+0000 7faee887c640 1 -- 172.21.15.55:0/2992140104 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faee41f81a0 con 0x7faee40b7bb0 2024-05-27T12:33:22.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.058+0000 7faee887c640 1 --2- 172.21.15.55:0/2992140104 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faee40b7bb0 0x7faee41f7950 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7faed4000c00 tx=0x7faed40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:22.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.058+0000 7faed9ffb640 1 -- 172.21.15.55:0/2992140104 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faed4037050 con 0x7faee40b7bb0 2024-05-27T12:33:22.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.058+0000 7faed9ffb640 1 -- 172.21.15.55:0/2992140104 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faed4038040 con 0x7faee40b7bb0 2024-05-27T12:33:22.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.058+0000 7faeeb2e1640 1 -- 172.21.15.55:0/2992140104 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faee41f8480 con 0x7faee40b7bb0 2024-05-27T12:33:22.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.058+0000 7faed9ffb640 1 -- 172.21.15.55:0/2992140104 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faed4004470 con 0x7faee40b7bb0 2024-05-27T12:33:22.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.058+0000 7faeeb2e1640 1 -- 172.21.15.55:0/2992140104 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faee41f4670 con 0x7faee40b7bb0 2024-05-27T12:33:22.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.059+0000 7faeeb2e1640 1 -- 172.21.15.55:0/2992140104 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faee4075460 con 0x7faee40b7bb0 2024-05-27T12:33:22.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.060+0000 7faed9ffb640 1 -- 172.21.15.55:0/2992140104 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7faed4030900 con 0x7faee40b7bb0 2024-05-27T12:33:22.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.060+0000 7faed9ffb640 1 --2- 172.21.15.55:0/2992140104 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7faec806c920 0x7faec806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:22.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.060+0000 7faed9ffb640 1 -- 172.21.15.55:0/2992140104 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5825+0+0 (secure 0 0 0) 0x7faed40ac650 con 0x7faee40b7bb0 2024-05-27T12:33:22.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.060+0000 7faee907d640 1 --2- 172.21.15.55:0/2992140104 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7faec806c920 0x7faec806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:22.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.061+0000 7faee907d640 1 --2- 172.21.15.55:0/2992140104 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7faec806c920 0x7faec806ede0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7faee0007fd0 tx=0x7faee0007ce0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:22.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.065+0000 7faed9ffb640 1 -- 172.21.15.55:0/2992140104 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7faed407aa90 con 0x7faee40b7bb0 2024-05-27T12:33:22.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.259+0000 7faeeb2e1640 1 -- 172.21.15.55:0/2992140104 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7faee41f4840 con 0x7faee40b7bb0 2024-05-27T12:33:22.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.259+0000 7faed9ffb640 1 -- 172.21.15.55:0/2992140104 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) ==== 80+0+0 (secure 0 0 0) 0x7faed407a390 con 0x7faee40b7bb0 2024-05-27T12:33:22.258 INFO:teuthology.orchestra.run.smithi055.stderr:listed 0 entries 2024-05-27T12:33:22.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.261+0000 7faeeb2e1640 1 -- 172.21.15.55:0/2992140104 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7faec806c920 msgr2=0x7faec806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:22.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.261+0000 7faeeb2e1640 1 --2- 172.21.15.55:0/2992140104 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7faec806c920 0x7faec806ede0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7faee0007fd0 tx=0x7faee0007ce0 comp rx=0 tx=0).stop 2024-05-27T12:33:22.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.261+0000 7faeeb2e1640 1 -- 172.21.15.55:0/2992140104 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faee40b7bb0 msgr2=0x7faee41f7950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:22.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.261+0000 7faeeb2e1640 1 --2- 172.21.15.55:0/2992140104 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faee40b7bb0 0x7faee41f7950 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7faed4000c00 tx=0x7faed40046c0 comp rx=0 tx=0).stop 2024-05-27T12:33:22.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.261+0000 7faeeb2e1640 1 -- 172.21.15.55:0/2992140104 shutdown_connections 2024-05-27T12:33:22.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.261+0000 7faeeb2e1640 1 --2- 172.21.15.55:0/2992140104 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faee415e9a0 0x7faee41f4b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:22.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.261+0000 7faeeb2e1640 1 --2- 172.21.15.55:0/2992140104 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faee40b7bb0 0x7faee41f7950 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:22.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.261+0000 7faeeb2e1640 1 --2- 172.21.15.55:0/2992140104 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7faec806c920 0x7faec806ede0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:22.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.261+0000 7faeeb2e1640 1 --2- 172.21.15.55:0/2992140104 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faee40b6890 0x7faee4151f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:22.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.261+0000 7faeeb2e1640 1 -- 172.21.15.55:0/2992140104 >> 172.21.15.55:0/2992140104 conn(0x7faee40d1350 msgr2=0x7faee40d50b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:22.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.261+0000 7faeeb2e1640 1 -- 172.21.15.55:0/2992140104 shutdown_connections 2024-05-27T12:33:22.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.261+0000 7faeeb2e1640 1 -- 172.21.15.55:0/2992140104 wait complete. 2024-05-27T12:33:22.272 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-05-27T12:33:22.272 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T12:33:22.272 DEBUG:teuthology.orchestra.run.smithi072:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2024-05-27T12:33:22.304 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi072.front.sepia.ceph.com 2024-05-27T12:33:22.304 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T12:33:22.304 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-05-27T12:33:22.363 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-05-27T12:33:22.363 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-27T12:33:22.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.468+0000 7f50390fa640 1 Processor -- start 2024-05-27T12:33:22.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.468+0000 7f50390fa640 1 -- start start 2024-05-27T12:33:22.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.469+0000 7f50390fa640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f503415e960 0x7f50340b0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:22.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.469+0000 7f50390fa640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f50340707b0 0x7f503415ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:22.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.469+0000 7f50390fa640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f503415f780 con 0x7f5034070c10 2024-05-27T12:33:22.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.469+0000 7f50390fa640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f50340b1100 con 0x7f503415e960 2024-05-27T12:33:22.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.469+0000 7f50390fa640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f503415fa60 con 0x7f50340707b0 2024-05-27T12:33:22.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.469+0000 7f503359e640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f5034070c10 0x7f503406b930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:48744/0 (socket says 172.21.15.55:48744) 2024-05-27T12:33:22.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.469+0000 7f503359e640 1 -- 172.21.15.55:0/2055757097 learned_addr learned my addr 172.21.15.55:0/2055757097 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-27T12:33:22.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.470+0000 7f503259c640 1 --2- 172.21.15.55:0/2055757097 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f50340707b0 0x7f503415ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:22.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.470+0000 7f5032d9d640 1 --2- 172.21.15.55:0/2055757097 >> v2:172.21.15.72:3300/0 conn(0x7f503415e960 0x7f50340b0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:22.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.470+0000 7f5031d9b640 1 -- 172.21.15.55:0/2055757097 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2033410062 0 0) 0x7f503415f780 con 0x7f5034070c10 2024-05-27T12:33:22.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.470+0000 7f5031d9b640 1 -- 172.21.15.55:0/2055757097 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5020003520 con 0x7f5034070c10 2024-05-27T12:33:22.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.470+0000 7f5031d9b640 1 -- 172.21.15.55:0/2055757097 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1332839145 0 0) 0x7f5020003520 con 0x7f5034070c10 2024-05-27T12:33:22.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.470+0000 7f5031d9b640 1 -- 172.21.15.55:0/2055757097 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f50340707b0 msgr2=0x7f503415ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:22.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.470+0000 7f5031d9b640 1 --2- 172.21.15.55:0/2055757097 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f50340707b0 0x7f503415ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:22.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.470+0000 7f5031d9b640 1 -- 172.21.15.55:0/2055757097 >> v2:172.21.15.72:3300/0 conn(0x7f503415e960 msgr2=0x7f50340b0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:22.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.470+0000 7f5031d9b640 1 --2- 172.21.15.55:0/2055757097 >> v2:172.21.15.72:3300/0 conn(0x7f503415e960 0x7f50340b0bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:22.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.470+0000 7f5031d9b640 1 -- 172.21.15.55:0/2055757097 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f503415fd40 con 0x7f5034070c10 2024-05-27T12:33:22.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.470+0000 7f5031d9b640 1 -- 172.21.15.55:0/2055757097 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 793017739 0 0) 0x7f502c001670 con 0x7f5034070c10 2024-05-27T12:33:22.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.470+0000 7f5031d9b640 1 -- 172.21.15.55:0/2055757097 >> v1:172.21.15.55:6789/0 conn(0x7f5034070c10 legacy=0x7f503406b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:22.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.470+0000 7f5031d9b640 1 --2- 172.21.15.55:0/2055757097 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5020003a90 0x7f5020003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:22.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.470+0000 7f5031d9b640 1 --2- 172.21.15.55:0/2055757097 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5020004800 0x7f5020004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:22.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.470+0000 7f5031d9b640 1 --2- 172.21.15.55:0/2055757097 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f50340707b0 0x7f50200051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:22.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.470+0000 7f5031d9b640 1 -- 172.21.15.55:0/2055757097 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f50340b1100 con 0x7f5020004800 2024-05-27T12:33:22.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.470+0000 7f5031d9b640 1 -- 172.21.15.55:0/2055757097 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f503415fa60 con 0x7f5020003a90 2024-05-27T12:33:22.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.470+0000 7f5031d9b640 1 -- 172.21.15.55:0/2055757097 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f502000ba10 con 0x7f50340707b0 2024-05-27T12:33:22.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.470+0000 7f503259c640 1 --2- 172.21.15.55:0/2055757097 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5020004800 0x7f5020004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:22.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.470+0000 7f5032d9d640 1 --2- 172.21.15.55:0/2055757097 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5020003a90 0x7f5020003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:22.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.470+0000 7f503359e640 1 --2- 172.21.15.55:0/2055757097 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f50340707b0 0x7f50200051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:22.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.471+0000 7f503259c640 1 -- 172.21.15.55:0/2055757097 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f50340707b0 msgr2=0x7f50200051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:22.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.471+0000 7f503259c640 1 --2- 172.21.15.55:0/2055757097 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f50340707b0 0x7f50200051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:22.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.471+0000 7f503259c640 1 -- 172.21.15.55:0/2055757097 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5020003a90 msgr2=0x7f5020003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:22.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.471+0000 7f503259c640 1 --2- 172.21.15.55:0/2055757097 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5020003a90 0x7f5020003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:22.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.471+0000 7f503259c640 1 -- 172.21.15.55:0/2055757097 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5020003520 con 0x7f5020004800 2024-05-27T12:33:22.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.471+0000 7f503259c640 1 --2- 172.21.15.55:0/2055757097 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5020004800 0x7f5020004c80 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f501c009af0 tx=0x7f5020005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5645602a7044eae0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:22.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.471+0000 7f5031d9b640 1 -- 172.21.15.55:0/2055757097 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f501c036070 con 0x7f5020004800 2024-05-27T12:33:22.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.471+0000 7f5031d9b640 1 -- 172.21.15.55:0/2055757097 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f501c031400 con 0x7f5020004800 2024-05-27T12:33:22.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.471+0000 7f5031d9b640 1 -- 172.21.15.55:0/2055757097 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f501c009690 con 0x7f5020004800 2024-05-27T12:33:22.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.472+0000 7f50390fa640 1 -- 172.21.15.55:0/2055757097 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5020004800 msgr2=0x7f5020004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:22.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.472+0000 7f50390fa640 1 --2- 172.21.15.55:0/2055757097 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5020004800 0x7f5020004c80 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f501c009af0 tx=0x7f5020005830 comp rx=0 tx=0).stop 2024-05-27T12:33:22.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.472+0000 7f503359e640 1 -- 172.21.15.55:0/2055757097 reap_dead start 2024-05-27T12:33:22.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.472+0000 7f50390fa640 1 -- 172.21.15.55:0/2055757097 shutdown_connections 2024-05-27T12:33:22.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.472+0000 7f50390fa640 1 -- 172.21.15.55:0/2055757097 >> 172.21.15.55:0/2055757097 conn(0x7f50340b3360 msgr2=0x7f50340b3770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:22.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.472+0000 7f50390fa640 1 -- 172.21.15.55:0/2055757097 shutdown_connections 2024-05-27T12:33:22.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.472+0000 7f50390fa640 1 -- 172.21.15.55:0/2055757097 wait complete. 2024-05-27T12:33:22.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.474+0000 7f50390fa640 1 Processor -- start 2024-05-27T12:33:22.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.474+0000 7f50390fa640 1 -- start start 2024-05-27T12:33:22.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.474+0000 7f50390fa640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5020004800 0x7f5034148d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:22.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.474+0000 7f50390fa640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5034153c90 0x7f503415ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:22.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.474+0000 7f50390fa640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f50341604c0 0x7f5034160940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:22.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.474+0000 7f50390fa640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f503406c1c0 con 0x7f50341604c0 2024-05-27T12:33:22.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.474+0000 7f50390fa640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f503406c040 con 0x7f5020004800 2024-05-27T12:33:22.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.474+0000 7f50390fa640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f503415ed40 con 0x7f5034153c90 2024-05-27T12:33:22.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.475+0000 7f503359e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f50341604c0 0x7f5034160940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:22.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.475+0000 7f503359e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f50341604c0 0x7f5034160940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44592/0 (socket says 172.21.15.55:44592) 2024-05-27T12:33:22.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.475+0000 7f503359e640 1 -- 172.21.15.55:0/690958519 learned_addr learned my addr 172.21.15.55:0/690958519 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:33:22.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.475+0000 7f5032d9d640 1 --2- 172.21.15.55:0/690958519 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5020004800 0x7f5034148d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:22.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.475+0000 7f503259c640 1 --2- 172.21.15.55:0/690958519 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5034153c90 0x7f503415ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:22.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.475+0000 7f503359e640 1 -- 172.21.15.55:0/690958519 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5034153c90 msgr2=0x7f503415ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:22.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.475+0000 7f503359e640 1 --2- 172.21.15.55:0/690958519 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5034153c90 0x7f503415ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:22.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.475+0000 7f503359e640 1 -- 172.21.15.55:0/690958519 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5020004800 msgr2=0x7f5034148d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:22.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.475+0000 7f503359e640 1 --2- 172.21.15.55:0/690958519 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5020004800 0x7f5034148d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:22.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.475+0000 7f503359e640 1 -- 172.21.15.55:0/690958519 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5034156c40 con 0x7f50341604c0 2024-05-27T12:33:22.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.475+0000 7f503359e640 1 --2- 172.21.15.55:0/690958519 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f50341604c0 0x7f5034160940 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f502c004a10 tx=0x7f502c0018b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:22.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.475+0000 7f502b7fe640 1 -- 172.21.15.55:0/690958519 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f502c00fa80 con 0x7f50341604c0 2024-05-27T12:33:22.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.475+0000 7f502b7fe640 1 -- 172.21.15.55:0/690958519 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f502c00fc20 con 0x7f50341604c0 2024-05-27T12:33:22.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.475+0000 7f50390fa640 1 -- 172.21.15.55:0/690958519 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50340cac30 con 0x7f50341604c0 2024-05-27T12:33:22.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.475+0000 7f502b7fe640 1 -- 172.21.15.55:0/690958519 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f502c016440 con 0x7f50341604c0 2024-05-27T12:33:22.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.475+0000 7f50390fa640 1 -- 172.21.15.55:0/690958519 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5034156960 con 0x7f50341604c0 2024-05-27T12:33:22.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.476+0000 7f50390fa640 1 -- 172.21.15.55:0/690958519 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f503406be60 con 0x7f50341604c0 2024-05-27T12:33:22.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.477+0000 7f502b7fe640 1 -- 172.21.15.55:0/690958519 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f502c0153e0 con 0x7f50341604c0 2024-05-27T12:33:22.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.477+0000 7f502b7fe640 1 --2- 172.21.15.55:0/690958519 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f501406c8f0 0x7f501406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:22.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.477+0000 7f502b7fe640 1 -- 172.21.15.55:0/690958519 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5825+0+0 (secure 0 0 0) 0x7f502c08bbd0 con 0x7f50341604c0 2024-05-27T12:33:22.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.478+0000 7f5032d9d640 1 --2- 172.21.15.55:0/690958519 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f501406c8f0 0x7f501406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:22.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.478+0000 7f5032d9d640 1 --2- 172.21.15.55:0/690958519 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f501406c8f0 0x7f501406edb0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f5024014450 tx=0x7f502400b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:22.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.482+0000 7f502b7fe640 1 -- 172.21.15.55:0/690958519 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f503406be60 con 0x7f50341604c0 2024-05-27T12:33:22.711 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.712+0000 7f50390fa640 1 -- 172.21.15.55:0/690958519 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f50341629f0 con 0x7f50341604c0 2024-05-27T12:33:22.711 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.712+0000 7f502b7fe640 1 -- 172.21.15.55:0/690958519 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5166 (secure 0 0 0) 0x7f502c01c060 con 0x7f50341604c0 2024-05-27T12:33:22.711 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-27T12:33:22.712 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/1501264038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":1501264038},{"type":"v1","addr":"172.21.15.55:6834","nonce":1501264038}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/3311546358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":3311546358},{"type":"v1","addr":"172.21.15.55:6835","nonce":3311546358}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4282,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/138819105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6835","nonce":138819105},{"type":"v1","addr":"172.21.15.72:6837","nonce":138819105}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-27T12:32:41.727353+0000","modified":"2024-05-27T12:32:43.723059+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.72:6836/70510151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":70510151},{"type":"v1","addr":"172.21.15.72:6836","nonce":70510151}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4290,"qdb_cluster":[4290]},"id":1}]} 2024-05-27T12:33:22.712 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 6 2024-05-27T12:33:22.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.714+0000 7f50390fa640 1 -- 172.21.15.55:0/690958519 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f501406c8f0 msgr2=0x7f501406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:22.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.714+0000 7f50390fa640 1 --2- 172.21.15.55:0/690958519 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f501406c8f0 0x7f501406edb0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f5024014450 tx=0x7f502400b040 comp rx=0 tx=0).stop 2024-05-27T12:33:22.715 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.715+0000 7f50390fa640 1 -- 172.21.15.55:0/690958519 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f50341604c0 msgr2=0x7f5034160940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:22.715 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.715+0000 7f50390fa640 1 --2- 172.21.15.55:0/690958519 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f50341604c0 0x7f5034160940 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f502c004a10 tx=0x7f502c0018b0 comp rx=0 tx=0).stop 2024-05-27T12:33:22.715 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.715+0000 7f50390fa640 1 -- 172.21.15.55:0/690958519 shutdown_connections 2024-05-27T12:33:22.715 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.715+0000 7f50390fa640 1 --2- 172.21.15.55:0/690958519 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f50341604c0 0x7f5034160940 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:22.715 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.715+0000 7f50390fa640 1 --2- 172.21.15.55:0/690958519 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5034153c90 0x7f503415ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:22.715 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.715+0000 7f50390fa640 1 --2- 172.21.15.55:0/690958519 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f501406c8f0 0x7f501406edb0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:22.715 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.715+0000 7f50390fa640 1 --2- 172.21.15.55:0/690958519 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5020004800 0x7f5034148d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:22.715 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.715+0000 7f50390fa640 1 -- 172.21.15.55:0/690958519 >> 172.21.15.55:0/690958519 conn(0x7f50340b3360 msgr2=0x7f50340d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:22.715 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.715+0000 7f50390fa640 1 -- 172.21.15.55:0/690958519 shutdown_connections 2024-05-27T12:33:22.715 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.715+0000 7f50390fa640 1 -- 172.21.15.55:0/690958519 wait complete. 2024-05-27T12:33:22.725 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-27T12:33:22.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.830+0000 7f8799413640 1 Processor -- start 2024-05-27T12:33:22.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.830+0000 7f8799413640 1 -- start start 2024-05-27T12:33:22.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.831+0000 7f8799413640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8794163510 0x7f879415f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:22.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.831+0000 7f8799413640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87941601b0 con 0x7f879415c960 2024-05-27T12:33:22.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.831+0000 7f8799413640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f879415f910 con 0x7f879415c580 2024-05-27T12:33:22.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.831+0000 7f8799413640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f879415fbf0 con 0x7f8794163510 2024-05-27T12:33:22.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.831+0000 7f87937fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8794163510 0x7f879415f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:22.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.831+0000 7f87927fc640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f879415c960 0x7f8794162e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:50238/0 (socket says 172.21.15.55:50238) 2024-05-27T12:33:22.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.831+0000 7f87927fc640 1 -- 172.21.15.55:0/2848645948 learned_addr learned my addr 172.21.15.55:0/2848645948 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-27T12:33:22.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.832+0000 7f87937fe640 1 -- 172.21.15.55:0/2848645948 >> v1:172.21.15.72:6789/0 conn(0x7f879415c580 legacy=0x7f87940d2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:22.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.832+0000 7f8791ffb640 1 -- 172.21.15.55:0/2848645948 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3267303040 0 0) 0x7f87941601b0 con 0x7f879415c960 2024-05-27T12:33:22.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.832+0000 7f87937fe640 1 -- 172.21.15.55:0/2848645948 >> v1:172.21.15.55:6789/0 conn(0x7f879415c960 legacy=0x7f8794162e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:22.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.832+0000 7f87937fe640 1 -- 172.21.15.55:0/2848645948 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f879415fed0 con 0x7f8794163510 2024-05-27T12:33:22.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.832+0000 7f87937fe640 1 --2- 172.21.15.55:0/2848645948 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8794163510 0x7f879415f1e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f87840097d0 tx=0x7f878402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a121251a8994c0a server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:22.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.833+0000 7f8791ffb640 1 -- 172.21.15.55:0/2848645948 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8784037070 con 0x7f8794163510 2024-05-27T12:33:22.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.833+0000 7f8791ffb640 1 -- 172.21.15.55:0/2848645948 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8784032440 con 0x7f8794163510 2024-05-27T12:33:22.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.833+0000 7f8791ffb640 1 -- 172.21.15.55:0/2848645948 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8784032810 con 0x7f8794163510 2024-05-27T12:33:22.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.833+0000 7f8799413640 1 -- 172.21.15.55:0/2848645948 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8794163510 msgr2=0x7f879415f1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:22.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.833+0000 7f8799413640 1 --2- 172.21.15.55:0/2848645948 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8794163510 0x7f879415f1e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f87840097d0 tx=0x7f878402a270 comp rx=0 tx=0).stop 2024-05-27T12:33:22.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.833+0000 7f8799413640 1 -- 172.21.15.55:0/2848645948 shutdown_connections 2024-05-27T12:33:22.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.833+0000 7f8799413640 1 --2- 172.21.15.55:0/2848645948 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8794163510 0x7f879415f1e0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:22.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.833+0000 7f8799413640 1 -- 172.21.15.55:0/2848645948 >> 172.21.15.55:0/2848645948 conn(0x7f8794067a50 msgr2=0x7f8794067e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:22.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.833+0000 7f8799413640 1 -- 172.21.15.55:0/2848645948 shutdown_connections 2024-05-27T12:33:22.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.833+0000 7f8799413640 1 -- 172.21.15.55:0/2848645948 wait complete. 2024-05-27T12:33:22.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.834+0000 7f8799413640 1 Processor -- start 2024-05-27T12:33:22.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.835+0000 7f8799413640 1 -- start start 2024-05-27T12:33:22.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.835+0000 7f8799413640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f879415c580 0x7f87941f5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:22.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.835+0000 7f8799413640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f879415c960 0x7f87941f2290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:22.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.835+0000 7f8799413640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8794163510 0x7f87941f7100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:22.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.835+0000 7f8799413640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f87940ba310 con 0x7f8794163510 2024-05-27T12:33:22.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.835+0000 7f8799413640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f87940d3310 con 0x7f879415c580 2024-05-27T12:33:22.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.835+0000 7f8799413640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f87940ba490 con 0x7f879415c960 2024-05-27T12:33:22.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.835+0000 7f87937fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8794163510 0x7f87941f7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:22.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.835+0000 7f87937fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8794163510 0x7f87941f7100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33142/0 (socket says 172.21.15.55:33142) 2024-05-27T12:33:22.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.835+0000 7f87937fe640 1 -- 172.21.15.55:0/1674267076 learned_addr learned my addr 172.21.15.55:0/1674267076 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:33:22.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.836+0000 7f8792ffd640 1 --2- 172.21.15.55:0/1674267076 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f879415c580 0x7f87941f5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:22.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.836+0000 7f87927fc640 1 --2- 172.21.15.55:0/1674267076 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f879415c960 0x7f87941f2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:22.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.836+0000 7f87937fe640 1 -- 172.21.15.55:0/1674267076 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f879415c960 msgr2=0x7f87941f2290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:22.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.836+0000 7f87937fe640 1 --2- 172.21.15.55:0/1674267076 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f879415c960 0x7f87941f2290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:22.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.836+0000 7f87937fe640 1 -- 172.21.15.55:0/1674267076 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f879415c580 msgr2=0x7f87941f5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:22.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.836+0000 7f87937fe640 1 --2- 172.21.15.55:0/1674267076 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f879415c580 0x7f87941f5810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:22.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.836+0000 7f87937fe640 1 -- 172.21.15.55:0/1674267076 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87941f6060 con 0x7f8794163510 2024-05-27T12:33:22.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.836+0000 7f87927fc640 1 --2- 172.21.15.55:0/1674267076 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f879415c960 0x7f87941f2290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T12:33:22.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.836+0000 7f8792ffd640 1 --2- 172.21.15.55:0/1674267076 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f879415c580 0x7f87941f5810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T12:33:22.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.836+0000 7f87937fe640 1 --2- 172.21.15.55:0/1674267076 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8794163510 0x7f87941f7100 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f87840097d0 tx=0x7f87840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:22.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.836+0000 7f878b7fe640 1 -- 172.21.15.55:0/1674267076 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8784037040 con 0x7f8794163510 2024-05-27T12:33:22.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.836+0000 7f878b7fe640 1 -- 172.21.15.55:0/1674267076 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8784042070 con 0x7f8794163510 2024-05-27T12:33:22.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.836+0000 7f8799413640 1 -- 172.21.15.55:0/1674267076 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87941f6340 con 0x7f8794163510 2024-05-27T12:33:22.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.836+0000 7f878b7fe640 1 -- 172.21.15.55:0/1674267076 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8784030b30 con 0x7f8794163510 2024-05-27T12:33:22.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.836+0000 7f8799413640 1 -- 172.21.15.55:0/1674267076 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87941f6be0 con 0x7f8794163510 2024-05-27T12:33:22.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.837+0000 7f8799413640 1 -- 172.21.15.55:0/1674267076 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8794075460 con 0x7f8794163510 2024-05-27T12:33:22.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.837+0000 7f878b7fe640 1 -- 172.21.15.55:0/1674267076 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8784030cd0 con 0x7f8794163510 2024-05-27T12:33:22.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.838+0000 7f878b7fe640 1 --2- 172.21.15.55:0/1674267076 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f877406c8f0 0x7f877406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:22.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.838+0000 7f878b7fe640 1 -- 172.21.15.55:0/1674267076 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7f87840ac760 con 0x7f8794163510 2024-05-27T12:33:22.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.838+0000 7f8792ffd640 1 --2- 172.21.15.55:0/1674267076 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f877406c8f0 0x7f877406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:22.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.839+0000 7f8792ffd640 1 --2- 172.21.15.55:0/1674267076 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f877406c8f0 0x7f877406edb0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f87940cc2b0 tx=0x7f878c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:22.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:22.842+0000 7f878b7fe640 1 -- 172.21.15.55:0/1674267076 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f878407aba0 con 0x7f8794163510 2024-05-27T12:33:23.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.032+0000 7f8799413640 1 -- 172.21.15.55:0/1674267076 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8794159850 con 0x7f8794163510 2024-05-27T12:33:23.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.033+0000 7f878b7fe640 1 -- 172.21.15.55:0/1674267076 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+16805 (secure 0 0 0) 0x7f878407a4a0 con 0x7f8794163510 2024-05-27T12:33:23.032 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-27T12:33:23.032 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":25,"fsid":"c3ff4e3b-8dae-4856-9593-e5cc66c59982","created":"2024-05-27T12:32:17.019097+0000","modified":"2024-05-27T12:33:22.578415+0000","last_up_change":"2024-05-27T12:32:28.109744+0000","last_in_change":"2024-05-27T12:32:19.309872+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-27T12:32:29.277895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-27T12:32:39.442745+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-27T12:32:40.672118+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e607b598-061b-4b6f-92ff-95c20b330599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":807572567},{"type":"v1","addr":"172.21.15.55:6801","nonce":807572567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":807572567},{"type":"v1","addr":"172.21.15.55:6803","nonce":807572567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":807572567},{"type":"v1","addr":"172.21.15.55:6807","nonce":807572567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":807572567},{"type":"v1","addr":"172.21.15.55:6805","nonce":807572567}]},"public_addr":"172.21.15.55:6801/807572567","cluster_addr":"172.21.15.55:6803/807572567","heartbeat_back_addr":"172.21.15.55:6807/807572567","heartbeat_front_addr":"172.21.15.55:6805/807572567","state":["exists","up"]},{"osd":1,"uuid":"ba2b5b1d-71a9-4ecc-9a48-55aa7fe54261","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":3426897300},{"type":"v1","addr":"172.21.15.55:6825","nonce":3426897300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":3426897300},{"type":"v1","addr":"172.21.15.55:6827","nonce":3426897300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":3426897300},{"type":"v1","addr":"172.21.15.55:6831","nonce":3426897300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":3426897300},{"type":"v1","addr":"172.21.15.55:6829","nonce":3426897300}]},"public_addr":"172.21.15.55:6825/3426897300","cluster_addr":"172.21.15.55:6827/3426897300","heartbeat_back_addr":"172.21.15.55:6831/3426897300","heartbeat_front_addr":"172.21.15.55:6829/3426897300","state":["exists","up"]},{"osd":2,"uuid":"e6b81cc6-4ff1-45d0-87eb-9f04ccf986a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3510271725},{"type":"v1","addr":"172.21.15.55:6809","nonce":3510271725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3510271725},{"type":"v1","addr":"172.21.15.55:6811","nonce":3510271725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3510271725},{"type":"v1","addr":"172.21.15.55:6815","nonce":3510271725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3510271725},{"type":"v1","addr":"172.21.15.55:6813","nonce":3510271725}]},"public_addr":"172.21.15.55:6809/3510271725","cluster_addr":"172.21.15.55:6811/3510271725","heartbeat_back_addr":"172.21.15.55:6815/3510271725","heartbeat_front_addr":"172.21.15.55:6813/3510271725","state":["exists","up"]},{"osd":3,"uuid":"b6a34b75-807d-4693-b1c3-903cb4c618d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":1066693520},{"type":"v1","addr":"172.21.15.55:6817","nonce":1066693520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":1066693520},{"type":"v1","addr":"172.21.15.55:6819","nonce":1066693520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":1066693520},{"type":"v1","addr":"172.21.15.55:6823","nonce":1066693520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":1066693520},{"type":"v1","addr":"172.21.15.55:6821","nonce":1066693520}]},"public_addr":"172.21.15.55:6817/1066693520","cluster_addr":"172.21.15.55:6819/1066693520","heartbeat_back_addr":"172.21.15.55:6823/1066693520","heartbeat_front_addr":"172.21.15.55:6821/1066693520","state":["exists","up"]},{"osd":4,"uuid":"272ec937-56b4-4f0a-b2e1-b0bc189c9d79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":4190771237},{"type":"v1","addr":"172.21.15.72:6820","nonce":4190771237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":4190771237},{"type":"v1","addr":"172.21.15.72:6824","nonce":4190771237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":4190771237},{"type":"v1","addr":"172.21.15.72:6831","nonce":4190771237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":4190771237},{"type":"v1","addr":"172.21.15.72:6828","nonce":4190771237}]},"public_addr":"172.21.15.72:6820/4190771237","cluster_addr":"172.21.15.72:6824/4190771237","heartbeat_back_addr":"172.21.15.72:6831/4190771237","heartbeat_front_addr":"172.21.15.72:6828/4190771237","state":["exists","up"]},{"osd":5,"uuid":"56439854-72a0-4ef4-81ff-184a3d924a5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":2421889184},{"type":"v1","addr":"172.21.15.72:6801","nonce":2421889184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6803","nonce":2421889184},{"type":"v1","addr":"172.21.15.72:6805","nonce":2421889184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":2421889184},{"type":"v1","addr":"172.21.15.72:6813","nonce":2421889184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6807","nonce":2421889184},{"type":"v1","addr":"172.21.15.72:6809","nonce":2421889184}]},"public_addr":"172.21.15.72:6801/2421889184","cluster_addr":"172.21.15.72:6805/2421889184","heartbeat_back_addr":"172.21.15.72:6813/2421889184","heartbeat_front_addr":"172.21.15.72:6809/2421889184","state":["exists","up"]},{"osd":6,"uuid":"e248e2be-3b6e-49cf-8c8a-1a4152827582","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3796994599},{"type":"v1","addr":"172.21.15.72:6804","nonce":3796994599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":3796994599},{"type":"v1","addr":"172.21.15.72:6808","nonce":3796994599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":3796994599},{"type":"v1","addr":"172.21.15.72:6815","nonce":3796994599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":3796994599},{"type":"v1","addr":"172.21.15.72:6812","nonce":3796994599}]},"public_addr":"172.21.15.72:6804/3796994599","cluster_addr":"172.21.15.72:6808/3796994599","heartbeat_back_addr":"172.21.15.72:6815/3796994599","heartbeat_front_addr":"172.21.15.72:6812/3796994599","state":["exists","up"]},{"osd":7,"uuid":"505a62d3-322b-4629-b4fd-187a55563709","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":3024877895},{"type":"v1","addr":"172.21.15.72:6817","nonce":3024877895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":3024877895},{"type":"v1","addr":"172.21.15.72:6821","nonce":3024877895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6827","nonce":3024877895},{"type":"v1","addr":"172.21.15.72:6829","nonce":3024877895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6823","nonce":3024877895},{"type":"v1","addr":"172.21.15.72:6825","nonce":3024877895}]},"public_addr":"172.21.15.72:6817/3024877895","cluster_addr":"172.21.15.72:6821/3024877895","heartbeat_back_addr":"172.21.15.72:6829/3024877895","heartbeat_front_addr":"172.21.15.72:6825/3024877895","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.241014+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.450799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.465018+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.507647+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.534763+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.495895+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.427110+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.547466+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.b","mappings":[{"from":3,"to":1}]},{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.12","mappings":[{"from":0,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-27T12:33:23.034 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.035+0000 7f8799413640 1 -- 172.21.15.55:0/1674267076 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f877406c8f0 msgr2=0x7f877406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:23.034 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.035+0000 7f8799413640 1 --2- 172.21.15.55:0/1674267076 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f877406c8f0 0x7f877406edb0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f87940cc2b0 tx=0x7f878c009040 comp rx=0 tx=0).stop 2024-05-27T12:33:23.034 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.035+0000 7f8799413640 1 -- 172.21.15.55:0/1674267076 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8794163510 msgr2=0x7f87941f7100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:23.034 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.035+0000 7f8799413640 1 --2- 172.21.15.55:0/1674267076 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8794163510 0x7f87941f7100 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f87840097d0 tx=0x7f87840046c0 comp rx=0 tx=0).stop 2024-05-27T12:33:23.034 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.035+0000 7f8799413640 1 -- 172.21.15.55:0/1674267076 shutdown_connections 2024-05-27T12:33:23.034 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.035+0000 7f8799413640 1 --2- 172.21.15.55:0/1674267076 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8794163510 0x7f87941f7100 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:23.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.035+0000 7f8799413640 1 --2- 172.21.15.55:0/1674267076 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f879415c960 0x7f87941f2290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:23.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.035+0000 7f8799413640 1 --2- 172.21.15.55:0/1674267076 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f877406c8f0 0x7f877406edb0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:23.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.035+0000 7f8799413640 1 --2- 172.21.15.55:0/1674267076 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f879415c580 0x7f87941f5810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:23.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.035+0000 7f8799413640 1 -- 172.21.15.55:0/1674267076 >> 172.21.15.55:0/1674267076 conn(0x7f8794067a50 msgr2=0x7f87940ceb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:23.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.035+0000 7f8799413640 1 -- 172.21.15.55:0/1674267076 shutdown_connections 2024-05-27T12:33:23.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.035+0000 7f8799413640 1 -- 172.21.15.55:0/1674267076 wait complete. 2024-05-27T12:33:23.045 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-27T12:32:29.277895+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-27T12:32:39.442745+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-27T12:32:40.672118+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-27T12:33:23.046 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-27T12:33:23.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.153+0000 7f02bff95640 1 Processor -- start 2024-05-27T12:33:23.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.153+0000 7f02bff95640 1 -- start start 2024-05-27T12:33:23.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.154+0000 7f02bff95640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f02b809b140 0x7f02b8169750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:23.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.154+0000 7f02bff95640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02b80d2020 con 0x7f02b8162150 2024-05-27T12:33:23.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.154+0000 7f02bff95640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02b80d1d40 con 0x7f02b806ca40 2024-05-27T12:33:23.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.154+0000 7f02bff95640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f02b80ccd60 con 0x7f02b809b140 2024-05-27T12:33:23.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.154+0000 7f02be532640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f02b809b140 0x7f02b8169750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:23.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.154+0000 7f02bdd31640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f02b8162150 0x7f02b80d14f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:50254/0 (socket says 172.21.15.55:50254) 2024-05-27T12:33:23.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.154+0000 7f02be532640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f02b809b140 0x7f02b8169750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33146/0 (socket says 172.21.15.55:33146) 2024-05-27T12:33:23.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.154+0000 7f02bdd31640 1 -- 172.21.15.55:0/4032400696 learned_addr learned my addr 172.21.15.55:0/4032400696 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-27T12:33:23.155 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.155+0000 7f02be532640 1 -- 172.21.15.55:0/4032400696 >> v1:172.21.15.72:6789/0 conn(0x7f02b806ca40 legacy=0x7f02b809aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:23.155 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.155+0000 7f02bcd2f640 1 -- 172.21.15.55:0/4032400696 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 225651262 0 0) 0x7f02b80d2020 con 0x7f02b8162150 2024-05-27T12:33:23.155 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.155+0000 7f02be532640 1 -- 172.21.15.55:0/4032400696 >> v1:172.21.15.55:6789/0 conn(0x7f02b8162150 legacy=0x7f02b80d14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:23.155 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.155+0000 7f02be532640 1 -- 172.21.15.55:0/4032400696 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02b80cd040 con 0x7f02b809b140 2024-05-27T12:33:23.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.155+0000 7f02be532640 1 --2- 172.21.15.55:0/4032400696 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f02b809b140 0x7f02b8169750 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f02b0009d90 tx=0x7f02b002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d16bc22e2d871299 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:23.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.155+0000 7f02bcd2f640 1 -- 172.21.15.55:0/4032400696 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02b0007740 con 0x7f02b809b140 2024-05-27T12:33:23.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.156+0000 7f02bcd2f640 1 -- 172.21.15.55:0/4032400696 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02b00078e0 con 0x7f02b809b140 2024-05-27T12:33:23.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.156+0000 7f02bcd2f640 1 -- 172.21.15.55:0/4032400696 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02b0007cb0 con 0x7f02b809b140 2024-05-27T12:33:23.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.156+0000 7f02bff95640 1 -- 172.21.15.55:0/4032400696 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f02b809b140 msgr2=0x7f02b8169750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:23.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.156+0000 7f02bff95640 1 --2- 172.21.15.55:0/4032400696 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f02b809b140 0x7f02b8169750 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f02b0009d90 tx=0x7f02b002a6f0 comp rx=0 tx=0).stop 2024-05-27T12:33:23.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.156+0000 7f02bff95640 1 -- 172.21.15.55:0/4032400696 shutdown_connections 2024-05-27T12:33:23.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.156+0000 7f02bff95640 1 --2- 172.21.15.55:0/4032400696 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f02b809b140 0x7f02b8169750 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:23.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.156+0000 7f02bff95640 1 -- 172.21.15.55:0/4032400696 >> 172.21.15.55:0/4032400696 conn(0x7f02b80b4160 msgr2=0x7f02b80b4570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:23.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.156+0000 7f02bff95640 1 -- 172.21.15.55:0/4032400696 shutdown_connections 2024-05-27T12:33:23.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.156+0000 7f02bff95640 1 -- 172.21.15.55:0/4032400696 wait complete. 2024-05-27T12:33:23.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.157+0000 7f02bff95640 1 Processor -- start 2024-05-27T12:33:23.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.157+0000 7f02bff95640 1 -- start start 2024-05-27T12:33:23.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.158+0000 7f02bff95640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f02b806ca40 0x7f02b815c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:23.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.158+0000 7f02bff95640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f02b809b140 0x7f02b8158970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:23.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.158+0000 7f02bff95640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f02b8162150 0x7f02b8158eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:23.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.158+0000 7f02bff95640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f02b80ce9d0 con 0x7f02b806ca40 2024-05-27T12:33:23.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.158+0000 7f02bff95640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f02b80ce850 con 0x7f02b809b140 2024-05-27T12:33:23.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.158+0000 7f02bff95640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f02b8169c90 con 0x7f02b8162150 2024-05-27T12:33:23.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.158+0000 7f02bdd31640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f02b806ca40 0x7f02b815c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:23.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.158+0000 7f02bdd31640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f02b806ca40 0x7f02b815c3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33158/0 (socket says 172.21.15.55:33158) 2024-05-27T12:33:23.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.158+0000 7f02bdd31640 1 -- 172.21.15.55:0/3980876911 learned_addr learned my addr 172.21.15.55:0/3980876911 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:33:23.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.158+0000 7f02bd530640 1 --2- 172.21.15.55:0/3980876911 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f02b809b140 0x7f02b8158970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:23.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.158+0000 7f02be532640 1 --2- 172.21.15.55:0/3980876911 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f02b8162150 0x7f02b8158eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:23.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.158+0000 7f02bdd31640 1 -- 172.21.15.55:0/3980876911 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f02b8162150 msgr2=0x7f02b8158eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:23.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.158+0000 7f02bdd31640 1 --2- 172.21.15.55:0/3980876911 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f02b8162150 0x7f02b8158eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:23.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.158+0000 7f02bdd31640 1 -- 172.21.15.55:0/3980876911 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f02b809b140 msgr2=0x7f02b8158970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:23.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.158+0000 7f02bdd31640 1 --2- 172.21.15.55:0/3980876911 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f02b809b140 0x7f02b8158970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:23.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.158+0000 7f02bdd31640 1 -- 172.21.15.55:0/3980876911 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02b815f570 con 0x7f02b806ca40 2024-05-27T12:33:23.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.159+0000 7f02bdd31640 1 --2- 172.21.15.55:0/3980876911 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f02b806ca40 0x7f02b815c3c0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f02b400c4a0 tx=0x7f02b400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:23.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.159+0000 7f02ae7fc640 1 -- 172.21.15.55:0/3980876911 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02b4018070 con 0x7f02b806ca40 2024-05-27T12:33:23.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.159+0000 7f02ae7fc640 1 -- 172.21.15.55:0/3980876911 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02b40074e0 con 0x7f02b806ca40 2024-05-27T12:33:23.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.159+0000 7f02bff95640 1 -- 172.21.15.55:0/3980876911 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02b815f850 con 0x7f02b806ca40 2024-05-27T12:33:23.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.159+0000 7f02ae7fc640 1 -- 172.21.15.55:0/3980876911 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02b4004a20 con 0x7f02b806ca40 2024-05-27T12:33:23.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.159+0000 7f02bff95640 1 -- 172.21.15.55:0/3980876911 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02b815fe10 con 0x7f02b806ca40 2024-05-27T12:33:23.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.160+0000 7f02bff95640 1 -- 172.21.15.55:0/3980876911 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02b80b8580 con 0x7f02b806ca40 2024-05-27T12:33:23.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.160+0000 7f02ae7fc640 1 -- 172.21.15.55:0/3980876911 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f02b401b070 con 0x7f02b806ca40 2024-05-27T12:33:23.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.161+0000 7f02ae7fc640 1 --2- 172.21.15.55:0/3980876911 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f029c06c8f0 0x7f029c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:23.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.161+0000 7f02ae7fc640 1 -- 172.21.15.55:0/3980876911 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7f02b408aea0 con 0x7f02b806ca40 2024-05-27T12:33:23.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.161+0000 7f02bd530640 1 --2- 172.21.15.55:0/3980876911 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f029c06c8f0 0x7f029c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:23.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.162+0000 7f02bd530640 1 --2- 172.21.15.55:0/3980876911 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f029c06c8f0 0x7f029c06edb0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f02b80b3ad0 tx=0x7f02a8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:23.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.165+0000 7f02ae7fc640 1 -- 172.21.15.55:0/3980876911 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f02b40592e0 con 0x7f02b806ca40 2024-05-27T12:33:23.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.348+0000 7f02bff95640 1 -- 172.21.15.55:0/3980876911 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f02b815c9c0 con 0x7f02b806ca40 2024-05-27T12:33:23.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.348+0000 7f02ae7fc640 1 -- 172.21.15.55:0/3980876911 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) ==== 93+0+10 (secure 0 0 0) 0x7f02b4058be0 con 0x7f02b806ca40 2024-05-27T12:33:23.348 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-05-27T12:33:23.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.350+0000 7f02bff95640 1 -- 172.21.15.55:0/3980876911 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f029c06c8f0 msgr2=0x7f029c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:23.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.350+0000 7f02bff95640 1 --2- 172.21.15.55:0/3980876911 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f029c06c8f0 0x7f029c06edb0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f02b80b3ad0 tx=0x7f02a8009040 comp rx=0 tx=0).stop 2024-05-27T12:33:23.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.350+0000 7f02bff95640 1 -- 172.21.15.55:0/3980876911 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f02b806ca40 msgr2=0x7f02b815c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:23.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.350+0000 7f02bff95640 1 --2- 172.21.15.55:0/3980876911 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f02b806ca40 0x7f02b815c3c0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f02b400c4a0 tx=0x7f02b400c960 comp rx=0 tx=0).stop 2024-05-27T12:33:23.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.350+0000 7f02bff95640 1 -- 172.21.15.55:0/3980876911 shutdown_connections 2024-05-27T12:33:23.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.350+0000 7f02bff95640 1 --2- 172.21.15.55:0/3980876911 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f02b8162150 0x7f02b8158eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:23.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.350+0000 7f02bff95640 1 --2- 172.21.15.55:0/3980876911 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f029c06c8f0 0x7f029c06edb0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:23.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.350+0000 7f02bff95640 1 --2- 172.21.15.55:0/3980876911 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f02b809b140 0x7f02b8158970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:23.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.350+0000 7f02bff95640 1 --2- 172.21.15.55:0/3980876911 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f02b806ca40 0x7f02b815c3c0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:23.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.350+0000 7f02bff95640 1 -- 172.21.15.55:0/3980876911 >> 172.21.15.55:0/3980876911 conn(0x7f02b80b4160 msgr2=0x7f02b809b840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:23.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.350+0000 7f02bff95640 1 -- 172.21.15.55:0/3980876911 shutdown_connections 2024-05-27T12:33:23.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.350+0000 7f02bff95640 1 -- 172.21.15.55:0/3980876911 wait complete. 2024-05-27T12:33:23.361 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-27T12:33:23.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.468+0000 7f7f0c64e640 1 Processor -- start 2024-05-27T12:33:23.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.468+0000 7f7f0c64e640 1 -- start start 2024-05-27T12:33:23.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.469+0000 7f7f0c64e640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7f0409aa30 0x7f7f0409aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:23.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.469+0000 7f7f0c64e640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f0406cb70 con 0x7f7f0409b980 2024-05-27T12:33:23.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.469+0000 7f7f0c64e640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f0406ce50 con 0x7f7f0415eb60 2024-05-27T12:33:23.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.469+0000 7f7f0c64e640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f7f040d1aa0 con 0x7f7f0409aa30 2024-05-27T12:33:23.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.469+0000 7f7f09be9640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f7f0409b980 0x7f7f040d1390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:50258/0 (socket says 172.21.15.55:50258) 2024-05-27T12:33:23.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.469+0000 7f7f09be9640 1 -- 172.21.15.55:0/1796678710 learned_addr learned my addr 172.21.15.55:0/1796678710 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-27T12:33:23.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.469+0000 7f7f0abeb640 1 --2- 172.21.15.55:0/1796678710 >> v2:172.21.15.72:3300/0 conn(0x7f7f0409aa30 0x7f7f0409aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:23.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.470+0000 7f7f093e8640 1 -- 172.21.15.55:0/1796678710 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1193018230 0 0) 0x7f7f0406cb70 con 0x7f7f0409b980 2024-05-27T12:33:23.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.470+0000 7f7f093e8640 1 -- 172.21.15.55:0/1796678710 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7ef0003520 con 0x7f7f0409b980 2024-05-27T12:33:23.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.470+0000 7f7f093e8640 1 -- 172.21.15.55:0/1796678710 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 938198506 0 0) 0x7f7ef0003520 con 0x7f7f0409b980 2024-05-27T12:33:23.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.470+0000 7f7f0abeb640 1 -- 172.21.15.55:0/1796678710 >> v1:172.21.15.72:6789/0 conn(0x7f7f0415eb60 legacy=0x7f7f0406d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:23.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.470+0000 7f7f0abeb640 1 -- 172.21.15.55:0/1796678710 >> v1:172.21.15.55:6789/0 conn(0x7f7f0409b980 legacy=0x7f7f040d1390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:23.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.470+0000 7f7f0abeb640 1 -- 172.21.15.55:0/1796678710 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f0406d130 con 0x7f7f0409aa30 2024-05-27T12:33:23.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.471+0000 7f7f0abeb640 1 --2- 172.21.15.55:0/1796678710 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f0409aa30 0x7f7f0409aea0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f7efc009d90 tx=0x7f7efc02a560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ead5e9d558819b3c server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:23.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.471+0000 7f7f093e8640 1 -- 172.21.15.55:0/1796678710 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ef4001670 con 0x7f7f0409aa30 2024-05-27T12:33:23.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.471+0000 7f7f093e8640 1 -- 172.21.15.55:0/1796678710 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7efc007540 con 0x7f7f0409aa30 2024-05-27T12:33:23.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.471+0000 7f7f093e8640 1 -- 172.21.15.55:0/1796678710 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7efc0078f0 con 0x7f7f0409aa30 2024-05-27T12:33:23.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.471+0000 7f7f0c64e640 1 -- 172.21.15.55:0/1796678710 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f0409aa30 msgr2=0x7f7f0409aea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:23.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.471+0000 7f7f0c64e640 1 --2- 172.21.15.55:0/1796678710 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f0409aa30 0x7f7f0409aea0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f7efc009d90 tx=0x7f7efc02a560 comp rx=0 tx=0).stop 2024-05-27T12:33:23.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.471+0000 7f7f0c64e640 1 -- 172.21.15.55:0/1796678710 shutdown_connections 2024-05-27T12:33:23.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.471+0000 7f7f0c64e640 1 --2- 172.21.15.55:0/1796678710 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f0409aa30 0x7f7f0409aea0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:23.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.471+0000 7f7f0c64e640 1 -- 172.21.15.55:0/1796678710 >> 172.21.15.55:0/1796678710 conn(0x7f7f040b4160 msgr2=0x7f7f040b4570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:23.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.471+0000 7f7f0c64e640 1 -- 172.21.15.55:0/1796678710 shutdown_connections 2024-05-27T12:33:23.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.471+0000 7f7f0c64e640 1 -- 172.21.15.55:0/1796678710 wait complete. 2024-05-27T12:33:23.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.473+0000 7f7f0c64e640 1 Processor -- start 2024-05-27T12:33:23.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.473+0000 7f7f0c64e640 1 -- start start 2024-05-27T12:33:23.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.473+0000 7f7f0c64e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7f0409aa30 0x7f7f040cb9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:23.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.473+0000 7f7f0c64e640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7f0409b980 0x7f7f040b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:23.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.473+0000 7f7f0c64e640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f0415eb60 0x7f7f040b6d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:23.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.473+0000 7f7f0c64e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f7f040d1cc0 con 0x7f7f0409aa30 2024-05-27T12:33:23.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.473+0000 7f7f0c64e640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f7f0409b3e0 con 0x7f7f0415eb60 2024-05-27T12:33:23.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.473+0000 7f7f0c64e640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f7f040cccc0 con 0x7f7f0409b980 2024-05-27T12:33:23.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.474+0000 7f7f0a3ea640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7f0409aa30 0x7f7f040cb9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:23.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.474+0000 7f7f0a3ea640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7f0409aa30 0x7f7f040cb9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33166/0 (socket says 172.21.15.55:33166) 2024-05-27T12:33:23.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.474+0000 7f7f0a3ea640 1 -- 172.21.15.55:0/2135572526 learned_addr learned my addr 172.21.15.55:0/2135572526 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:33:23.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.474+0000 7f7f0abeb640 1 --2- 172.21.15.55:0/2135572526 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f0415eb60 0x7f7f040b6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:23.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.474+0000 7f7f09be9640 1 --2- 172.21.15.55:0/2135572526 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7f0409b980 0x7f7f040b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:23.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.474+0000 7f7f0a3ea640 1 -- 172.21.15.55:0/2135572526 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7f0409b980 msgr2=0x7f7f040b60e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:23.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.474+0000 7f7f0a3ea640 1 --2- 172.21.15.55:0/2135572526 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7f0409b980 0x7f7f040b60e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:23.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.474+0000 7f7f0a3ea640 1 -- 172.21.15.55:0/2135572526 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f0415eb60 msgr2=0x7f7f040b6d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:23.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.474+0000 7f7f0a3ea640 1 --2- 172.21.15.55:0/2135572526 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f0415eb60 0x7f7f040b6d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:23.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.474+0000 7f7f0a3ea640 1 -- 172.21.15.55:0/2135572526 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f040b6620 con 0x7f7f0409aa30 2024-05-27T12:33:23.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.474+0000 7f7f0abeb640 1 --2- 172.21.15.55:0/2135572526 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f0415eb60 0x7f7f040b6d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T12:33:23.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.474+0000 7f7f0a3ea640 1 --2- 172.21.15.55:0/2135572526 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7f0409aa30 0x7f7f040cb9c0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f7f0000c430 tx=0x7f7f0000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:23.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.474+0000 7f7efaffd640 1 -- 172.21.15.55:0/2135572526 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f00017070 con 0x7f7f0409aa30 2024-05-27T12:33:23.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.474+0000 7f7efaffd640 1 -- 172.21.15.55:0/2135572526 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f000052d0 con 0x7f7f0409aa30 2024-05-27T12:33:23.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.474+0000 7f7f0c64e640 1 -- 172.21.15.55:0/2135572526 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f040cbfa0 con 0x7f7f0409aa30 2024-05-27T12:33:23.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.474+0000 7f7efaffd640 1 -- 172.21.15.55:0/2135572526 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f00003830 con 0x7f7f0409aa30 2024-05-27T12:33:23.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.474+0000 7f7f0c64e640 1 -- 172.21.15.55:0/2135572526 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f040ca4d0 con 0x7f7f0409aa30 2024-05-27T12:33:23.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.475+0000 7f7f0c64e640 1 -- 172.21.15.55:0/2135572526 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f04068a70 con 0x7f7f0409aa30 2024-05-27T12:33:23.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.476+0000 7f7efaffd640 1 -- 172.21.15.55:0/2135572526 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7f0001a070 con 0x7f7f0409aa30 2024-05-27T12:33:23.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.476+0000 7f7efaffd640 1 --2- 172.21.15.55:0/2135572526 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f7ee806c920 0x7f7ee806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:23.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.476+0000 7f7efaffd640 1 -- 172.21.15.55:0/2135572526 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7f7f0008aeb0 con 0x7f7f0409aa30 2024-05-27T12:33:23.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.477+0000 7f7f09be9640 1 --2- 172.21.15.55:0/2135572526 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f7ee806c920 0x7f7ee806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:23.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.477+0000 7f7f09be9640 1 --2- 172.21.15.55:0/2135572526 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f7ee806c920 0x7f7ee806ede0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f7f040cb770 tx=0x7f7ef4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:23.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.481+0000 7f7efaffd640 1 -- 172.21.15.55:0/2135572526 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7f00059260 con 0x7f7f0409aa30 2024-05-27T12:33:23.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.665+0000 7f7f0c64e640 1 -- 172.21.15.55:0/2135572526 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f7f040c92a0 con 0x7f7f0409aa30 2024-05-27T12:33:23.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.665+0000 7f7efaffd640 1 -- 172.21.15.55:0/2135572526 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) ==== 104+0+11 (secure 0 0 0) 0x7f7f00058b60 con 0x7f7f0409aa30 2024-05-27T12:33:23.665 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2024-05-27T12:33:23.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.667+0000 7f7f0c64e640 1 -- 172.21.15.55:0/2135572526 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f7ee806c920 msgr2=0x7f7ee806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:23.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.667+0000 7f7f0c64e640 1 --2- 172.21.15.55:0/2135572526 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f7ee806c920 0x7f7ee806ede0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f7f040cb770 tx=0x7f7ef4009040 comp rx=0 tx=0).stop 2024-05-27T12:33:23.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.667+0000 7f7f0c64e640 1 -- 172.21.15.55:0/2135572526 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7f0409aa30 msgr2=0x7f7f040cb9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:23.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.667+0000 7f7f0c64e640 1 --2- 172.21.15.55:0/2135572526 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7f0409aa30 0x7f7f040cb9c0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f7f0000c430 tx=0x7f7f0000c8f0 comp rx=0 tx=0).stop 2024-05-27T12:33:23.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.667+0000 7f7f0c64e640 1 -- 172.21.15.55:0/2135572526 shutdown_connections 2024-05-27T12:33:23.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.667+0000 7f7f0c64e640 1 --2- 172.21.15.55:0/2135572526 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f7ee806c920 0x7f7ee806ede0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:23.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.667+0000 7f7f0c64e640 1 --2- 172.21.15.55:0/2135572526 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f0415eb60 0x7f7f040b6d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:23.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.667+0000 7f7f0c64e640 1 --2- 172.21.15.55:0/2135572526 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7f0409b980 0x7f7f040b60e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:23.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.667+0000 7f7f0c64e640 1 --2- 172.21.15.55:0/2135572526 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7f0409aa30 0x7f7f040cb9c0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:23.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.667+0000 7f7f0c64e640 1 -- 172.21.15.55:0/2135572526 >> 172.21.15.55:0/2135572526 conn(0x7f7f040b4160 msgr2=0x7f7f040d1220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:23.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.668+0000 7f7f0c64e640 1 -- 172.21.15.55:0/2135572526 shutdown_connections 2024-05-27T12:33:23.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.668+0000 7f7f0c64e640 1 -- 172.21.15.55:0/2135572526 wait complete. 2024-05-27T12:33:23.678 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-27T12:33:23.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.785+0000 7febcfbe8640 1 Processor -- start 2024-05-27T12:33:23.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.785+0000 7febcfbe8640 1 -- start start 2024-05-27T12:33:23.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.786+0000 7febcfbe8640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7febc815eb00 0x7febc80cfb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:23.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.786+0000 7febcfbe8640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7febc80d1f40 0x7febc80b78f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:23.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.786+0000 7febcfbe8640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7febc815eee0 con 0x7febc80d3e50 2024-05-27T12:33:23.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.786+0000 7febcfbe8640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7febc80d5700 con 0x7febc815eb00 2024-05-27T12:33:23.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.786+0000 7febcfbe8640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7febc80d4660 con 0x7febc80d1f40 2024-05-27T12:33:23.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.786+0000 7febcd984640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7febc815eb00 0x7febc80cfb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:23.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.786+0000 7febcd183640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7febc80d3e50 0x7febc80d1830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:50264/0 (socket says 172.21.15.55:50264) 2024-05-27T12:33:23.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.786+0000 7febcd183640 1 -- 172.21.15.55:0/3332117376 learned_addr learned my addr 172.21.15.55:0/3332117376 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-27T12:33:23.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.787+0000 7febcd984640 1 -- 172.21.15.55:0/3332117376 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7febc80d1f40 msgr2=0x7febc80b78f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:23.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.787+0000 7febce185640 1 --2- 172.21.15.55:0/3332117376 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7febc80d1f40 0x7febc80b78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:23.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.787+0000 7febcd984640 1 --2- 172.21.15.55:0/3332117376 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7febc80d1f40 0x7febc80b78f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:23.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.787+0000 7febcc982640 1 -- 172.21.15.55:0/3332117376 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2884760355 0 0) 0x7febc815eee0 con 0x7febc80d3e50 2024-05-27T12:33:23.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.787+0000 7febcd984640 1 -- 172.21.15.55:0/3332117376 >> v1:172.21.15.55:6789/0 conn(0x7febc80d3e50 legacy=0x7febc80d1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:23.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.787+0000 7febcd984640 1 -- 172.21.15.55:0/3332117376 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febc80d4940 con 0x7febc815eb00 2024-05-27T12:33:23.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.787+0000 7febcd984640 1 --2- 172.21.15.55:0/3332117376 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7febc815eb00 0x7febc80cfb40 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7febb8009d90 tx=0x7febb802a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a7972b0accccb82 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:23.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.788+0000 7febcc982640 1 -- 172.21.15.55:0/3332117376 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febb8007740 con 0x7febc815eb00 2024-05-27T12:33:23.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.788+0000 7febcc982640 1 -- 172.21.15.55:0/3332117376 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febb80078e0 con 0x7febc815eb00 2024-05-27T12:33:23.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.788+0000 7febcc982640 1 -- 172.21.15.55:0/3332117376 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febb8007cb0 con 0x7febc815eb00 2024-05-27T12:33:23.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.788+0000 7febcfbe8640 1 -- 172.21.15.55:0/3332117376 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7febc815eb00 msgr2=0x7febc80cfb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:23.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.788+0000 7febcfbe8640 1 --2- 172.21.15.55:0/3332117376 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7febc815eb00 0x7febc80cfb40 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7febb8009d90 tx=0x7febb802a6f0 comp rx=0 tx=0).stop 2024-05-27T12:33:23.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.788+0000 7febcfbe8640 1 -- 172.21.15.55:0/3332117376 shutdown_connections 2024-05-27T12:33:23.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.788+0000 7febcfbe8640 1 --2- 172.21.15.55:0/3332117376 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7febc80d1f40 0x7febc80b78f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:23.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.788+0000 7febcfbe8640 1 --2- 172.21.15.55:0/3332117376 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7febc815eb00 0x7febc80cfb40 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:23.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.788+0000 7febcfbe8640 1 -- 172.21.15.55:0/3332117376 >> 172.21.15.55:0/3332117376 conn(0x7febc8067a50 msgr2=0x7febc8067e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:23.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.788+0000 7febcfbe8640 1 -- 172.21.15.55:0/3332117376 shutdown_connections 2024-05-27T12:33:23.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.788+0000 7febcfbe8640 1 -- 172.21.15.55:0/3332117376 wait complete. 2024-05-27T12:33:23.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.789+0000 7febcfbe8640 1 Processor -- start 2024-05-27T12:33:23.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.790+0000 7febcfbe8640 1 -- start start 2024-05-27T12:33:23.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.790+0000 7febcfbe8640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7febc80d1f40 0x7febc814a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:23.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.790+0000 7febcfbe8640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7febc80d3e50 0x7febc8147200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:23.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.790+0000 7febcfbe8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7febc815eb00 0x7febc815f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:23.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.790+0000 7febcfbe8640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7febc80d51e0 con 0x7febc815eb00 2024-05-27T12:33:23.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.790+0000 7febcfbe8640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7febc80d4f00 con 0x7febc80d3e50 2024-05-27T12:33:23.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.790+0000 7febcfbe8640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7febc80d42c0 con 0x7febc80d1f40 2024-05-27T12:33:23.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.790+0000 7febce185640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7febc815eb00 0x7febc815f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:23.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.790+0000 7febce185640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7febc815eb00 0x7febc815f0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33190/0 (socket says 172.21.15.55:33190) 2024-05-27T12:33:23.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.790+0000 7febce185640 1 -- 172.21.15.55:0/328774970 learned_addr learned my addr 172.21.15.55:0/328774970 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:33:23.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.791+0000 7febcd984640 1 --2- 172.21.15.55:0/328774970 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7febc80d1f40 0x7febc814a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:23.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.791+0000 7febcd183640 1 --2- 172.21.15.55:0/328774970 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7febc80d3e50 0x7febc8147200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:23.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.791+0000 7febce185640 1 -- 172.21.15.55:0/328774970 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7febc80d1f40 msgr2=0x7febc814a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:23.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.791+0000 7febce185640 1 --2- 172.21.15.55:0/328774970 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7febc80d1f40 0x7febc814a210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:23.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.791+0000 7febce185640 1 -- 172.21.15.55:0/328774970 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7febc80d3e50 msgr2=0x7febc8147200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:23.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.791+0000 7febce185640 1 --2- 172.21.15.55:0/328774970 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7febc80d3e50 0x7febc8147200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:23.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.791+0000 7febce185640 1 -- 172.21.15.55:0/328774970 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febc8147740 con 0x7febc815eb00 2024-05-27T12:33:23.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.791+0000 7febce185640 1 --2- 172.21.15.55:0/328774970 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7febc815eb00 0x7febc815f0d0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7febc000c580 tx=0x7febc000ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:23.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.791+0000 7febc67fc640 1 -- 172.21.15.55:0/328774970 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febc0015070 con 0x7febc815eb00 2024-05-27T12:33:23.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.791+0000 7febc67fc640 1 -- 172.21.15.55:0/328774970 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febc0004220 con 0x7febc815eb00 2024-05-27T12:33:23.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.791+0000 7febcfbe8640 1 -- 172.21.15.55:0/328774970 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febc81613b0 con 0x7febc815eb00 2024-05-27T12:33:23.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.791+0000 7febc67fc640 1 -- 172.21.15.55:0/328774970 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febc0003610 con 0x7febc815eb00 2024-05-27T12:33:23.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.791+0000 7febcfbe8640 1 -- 172.21.15.55:0/328774970 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febc8161970 con 0x7febc815eb00 2024-05-27T12:33:23.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.792+0000 7febcfbe8640 1 -- 172.21.15.55:0/328774970 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7febc8068a70 con 0x7febc815eb00 2024-05-27T12:33:23.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.793+0000 7febc67fc640 1 -- 172.21.15.55:0/328774970 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7febc00037b0 con 0x7febc815eb00 2024-05-27T12:33:23.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.793+0000 7febc67fc640 1 --2- 172.21.15.55:0/328774970 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7febb406c8f0 0x7febb406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:23.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.793+0000 7febc67fc640 1 -- 172.21.15.55:0/328774970 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7febc008b930 con 0x7febc815eb00 2024-05-27T12:33:23.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.793+0000 7febcd984640 1 --2- 172.21.15.55:0/328774970 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7febb406c8f0 0x7febb406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:23.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.794+0000 7febcd984640 1 --2- 172.21.15.55:0/328774970 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7febb406c8f0 0x7febb406edb0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7febb8034000 tx=0x7febb802f000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:23.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.797+0000 7febc67fc640 1 -- 172.21.15.55:0/328774970 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7febc8147740 con 0x7febc815eb00 2024-05-27T12:33:23.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.982+0000 7febcfbe8640 1 -- 172.21.15.55:0/328774970 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7febc815e1a0 con 0x7febc815eb00 2024-05-27T12:33:23.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.982+0000 7febc67fc640 1 -- 172.21.15.55:0/328774970 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) ==== 100+0+11 (secure 0 0 0) 0x7febc0059cf0 con 0x7febc815eb00 2024-05-27T12:33:23.981 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2024-05-27T12:33:23.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.984+0000 7febcfbe8640 1 -- 172.21.15.55:0/328774970 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7febb406c8f0 msgr2=0x7febb406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:23.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.984+0000 7febcfbe8640 1 --2- 172.21.15.55:0/328774970 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7febb406c8f0 0x7febb406edb0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7febb8034000 tx=0x7febb802f000 comp rx=0 tx=0).stop 2024-05-27T12:33:23.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.984+0000 7febcfbe8640 1 -- 172.21.15.55:0/328774970 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7febc815eb00 msgr2=0x7febc815f0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:23.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.984+0000 7febcfbe8640 1 --2- 172.21.15.55:0/328774970 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7febc815eb00 0x7febc815f0d0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7febc000c580 tx=0x7febc000ca40 comp rx=0 tx=0).stop 2024-05-27T12:33:23.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.984+0000 7febcfbe8640 1 -- 172.21.15.55:0/328774970 shutdown_connections 2024-05-27T12:33:23.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.984+0000 7febcfbe8640 1 --2- 172.21.15.55:0/328774970 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7febc815eb00 0x7febc815f0d0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:23.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.984+0000 7febcfbe8640 1 --2- 172.21.15.55:0/328774970 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7febb406c8f0 0x7febb406edb0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:23.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.984+0000 7febcfbe8640 1 --2- 172.21.15.55:0/328774970 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7febc80d3e50 0x7febc8147200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:23.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.984+0000 7febcfbe8640 1 --2- 172.21.15.55:0/328774970 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7febc80d1f40 0x7febc814a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:23.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.984+0000 7febcfbe8640 1 -- 172.21.15.55:0/328774970 >> 172.21.15.55:0/328774970 conn(0x7febc8067a50 msgr2=0x7febc80b7a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:23.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.984+0000 7febcfbe8640 1 -- 172.21.15.55:0/328774970 shutdown_connections 2024-05-27T12:33:23.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:23.984+0000 7febcfbe8640 1 -- 172.21.15.55:0/328774970 wait complete. 2024-05-27T12:33:23.994 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-27T12:33:24.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.098+0000 7f73b1810640 1 Processor -- start 2024-05-27T12:33:24.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.098+0000 7f73b1810640 1 -- start start 2024-05-27T12:33:24.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.099+0000 7f73b1810640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f73ac1680e0 0x7f73ac16a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:24.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.099+0000 7f73b1810640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73ac0cdae0 con 0x7f73ac0cd670 2024-05-27T12:33:24.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.099+0000 7f73b1810640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73ac0b3e60 con 0x7f73ac0d0890 2024-05-27T12:33:24.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.099+0000 7f73b1810640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f73ac0b3b80 con 0x7f73ac1680e0 2024-05-27T12:33:24.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.099+0000 7f73ab7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f73ac1680e0 0x7f73ac16a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:24.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.099+0000 7f73aa7fc640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f73ac0cd670 0x7f73ac1669c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:50274/0 (socket says 172.21.15.55:50274) 2024-05-27T12:33:24.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.099+0000 7f73ab7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f73ac1680e0 0x7f73ac16a4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33192/0 (socket says 172.21.15.55:33192) 2024-05-27T12:33:24.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.099+0000 7f73aa7fc640 1 -- 172.21.15.55:0/2362445213 learned_addr learned my addr 172.21.15.55:0/2362445213 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-27T12:33:24.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.100+0000 7f73ab7fe640 1 -- 172.21.15.55:0/2362445213 >> v1:172.21.15.72:6789/0 conn(0x7f73ac0d0890 legacy=0x7f73ac0d0c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:24.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.100+0000 7f73ab7fe640 1 -- 172.21.15.55:0/2362445213 >> v1:172.21.15.55:6789/0 conn(0x7f73ac0cd670 legacy=0x7f73ac1669c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:24.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.100+0000 7f73ab7fe640 1 -- 172.21.15.55:0/2362445213 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73ac06ba60 con 0x7f73ac1680e0 2024-05-27T12:33:24.101 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.100+0000 7f73ab7fe640 1 --2- 172.21.15.55:0/2362445213 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73ac1680e0 0x7f73ac16a4d0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f739c0097a0 tx=0x7f739c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ee67d4d20bfa4b9 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:24.101 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.101+0000 7f73a9ffb640 1 -- 172.21.15.55:0/2362445213 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f739c037070 con 0x7f73ac1680e0 2024-05-27T12:33:24.101 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.101+0000 7f73a9ffb640 1 -- 172.21.15.55:0/2362445213 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f739c032440 con 0x7f73ac1680e0 2024-05-27T12:33:24.101 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.101+0000 7f73a9ffb640 1 -- 172.21.15.55:0/2362445213 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f739c032810 con 0x7f73ac1680e0 2024-05-27T12:33:24.101 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.101+0000 7f73b1810640 1 -- 172.21.15.55:0/2362445213 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73ac1680e0 msgr2=0x7f73ac16a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:24.101 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.101+0000 7f73b1810640 1 --2- 172.21.15.55:0/2362445213 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73ac1680e0 0x7f73ac16a4d0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f739c0097a0 tx=0x7f739c02a1e0 comp rx=0 tx=0).stop 2024-05-27T12:33:24.101 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.101+0000 7f73b1810640 1 -- 172.21.15.55:0/2362445213 shutdown_connections 2024-05-27T12:33:24.101 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.101+0000 7f73b1810640 1 --2- 172.21.15.55:0/2362445213 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73ac1680e0 0x7f73ac16a4d0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:24.101 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.101+0000 7f73b1810640 1 -- 172.21.15.55:0/2362445213 >> 172.21.15.55:0/2362445213 conn(0x7f73ac09aa30 msgr2=0x7f73ac0b3050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:24.101 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.101+0000 7f73b1810640 1 -- 172.21.15.55:0/2362445213 shutdown_connections 2024-05-27T12:33:24.101 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.101+0000 7f73b1810640 1 -- 172.21.15.55:0/2362445213 wait complete. 2024-05-27T12:33:24.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.102+0000 7f73b1810640 1 Processor -- start 2024-05-27T12:33:24.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.103+0000 7f73b1810640 1 -- start start 2024-05-27T12:33:24.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.103+0000 7f73b1810640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f73ac0cd670 0x7f73ac167b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:24.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.103+0000 7f73b1810640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73ac0d0890 0x7f73ac06f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:24.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.103+0000 7f73b1810640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f73ac1680e0 0x7f73ac159bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:24.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.103+0000 7f73b1810640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f73ac0b0830 con 0x7f73ac0d0890 2024-05-27T12:33:24.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.103+0000 7f73b1810640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f73ac06c020 con 0x7f73ac1680e0 2024-05-27T12:33:24.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.103+0000 7f73b1810640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f73ac0b09b0 con 0x7f73ac0cd670 2024-05-27T12:33:24.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.103+0000 7f73aa7fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73ac0d0890 0x7f73ac06f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:24.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.103+0000 7f73aa7fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73ac0d0890 0x7f73ac06f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33196/0 (socket says 172.21.15.55:33196) 2024-05-27T12:33:24.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.103+0000 7f73aa7fc640 1 -- 172.21.15.55:0/54375059 learned_addr learned my addr 172.21.15.55:0/54375059 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:33:24.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.104+0000 7f73ab7fe640 1 --2- 172.21.15.55:0/54375059 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f73ac1680e0 0x7f73ac159bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:24.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.104+0000 7f73aaffd640 1 --2- 172.21.15.55:0/54375059 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f73ac0cd670 0x7f73ac167b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:24.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.104+0000 7f73aa7fc640 1 -- 172.21.15.55:0/54375059 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f73ac0cd670 msgr2=0x7f73ac167b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:24.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.104+0000 7f73aa7fc640 1 --2- 172.21.15.55:0/54375059 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f73ac0cd670 0x7f73ac167b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:24.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.104+0000 7f73aa7fc640 1 -- 172.21.15.55:0/54375059 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f73ac1680e0 msgr2=0x7f73ac159bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:24.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.104+0000 7f73aa7fc640 1 --2- 172.21.15.55:0/54375059 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f73ac1680e0 0x7f73ac159bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:24.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.104+0000 7f73aa7fc640 1 -- 172.21.15.55:0/54375059 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73ac0c8770 con 0x7f73ac0d0890 2024-05-27T12:33:24.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.104+0000 7f73ab7fe640 1 --2- 172.21.15.55:0/54375059 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f73ac1680e0 0x7f73ac159bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T12:33:24.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.104+0000 7f73aa7fc640 1 --2- 172.21.15.55:0/54375059 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73ac0d0890 0x7f73ac06f5d0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f739400c400 tx=0x7f739400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:24.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.104+0000 7f73a3fff640 1 -- 172.21.15.55:0/54375059 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7394017070 con 0x7f73ac0d0890 2024-05-27T12:33:24.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.104+0000 7f73a3fff640 1 -- 172.21.15.55:0/54375059 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7394005ce0 con 0x7f73ac0d0890 2024-05-27T12:33:24.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.104+0000 7f73b1810640 1 -- 172.21.15.55:0/54375059 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73ac0c8a50 con 0x7f73ac0d0890 2024-05-27T12:33:24.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.104+0000 7f73a3fff640 1 -- 172.21.15.55:0/54375059 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73940072f0 con 0x7f73ac0d0890 2024-05-27T12:33:24.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.104+0000 7f73b1810640 1 -- 172.21.15.55:0/54375059 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73ac0b1b50 con 0x7f73ac0d0890 2024-05-27T12:33:24.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.105+0000 7f73b1810640 1 -- 172.21.15.55:0/54375059 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73ac0c8c20 con 0x7f73ac0d0890 2024-05-27T12:33:24.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.106+0000 7f73a3fff640 1 -- 172.21.15.55:0/54375059 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f739401a070 con 0x7f73ac0d0890 2024-05-27T12:33:24.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.106+0000 7f73a3fff640 1 --2- 172.21.15.55:0/54375059 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f738c06c8f0 0x7f738c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:24.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.107+0000 7f73a3fff640 1 -- 172.21.15.55:0/54375059 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7f739408afe0 con 0x7f73ac0d0890 2024-05-27T12:33:24.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.107+0000 7f73aaffd640 1 --2- 172.21.15.55:0/54375059 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f738c06c8f0 0x7f738c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:24.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.107+0000 7f73aaffd640 1 --2- 172.21.15.55:0/54375059 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f738c06c8f0 0x7f738c06edb0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f73a4005520 tx=0x7f73a4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:24.110 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.111+0000 7f73a3fff640 1 -- 172.21.15.55:0/54375059 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f73ac0c8c20 con 0x7f73ac0d0890 2024-05-27T12:33:24.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.334+0000 7f73b1810640 1 -- 172.21.15.55:0/54375059 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f73ac0b1660 con 0x7f73ac0d0890 2024-05-27T12:33:24.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.334+0000 7f73a3fff640 1 -- 172.21.15.55:0/54375059 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5166 (secure 0 0 0) 0x7f73ac0cdae0 con 0x7f73ac0d0890 2024-05-27T12:33:24.334 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-27T12:33:24.334 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/1501264038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":1501264038},{"type":"v1","addr":"172.21.15.55:6834","nonce":1501264038}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/3311546358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":3311546358},{"type":"v1","addr":"172.21.15.55:6835","nonce":3311546358}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4282,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/138819105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6835","nonce":138819105},{"type":"v1","addr":"172.21.15.72:6837","nonce":138819105}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-27T12:32:41.727353+0000","modified":"2024-05-27T12:32:43.723059+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.72:6836/70510151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":70510151},{"type":"v1","addr":"172.21.15.72:6836","nonce":70510151}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4290,"qdb_cluster":[4290]},"id":1}]} 2024-05-27T12:33:24.334 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 6 2024-05-27T12:33:24.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.336+0000 7f73b1810640 1 -- 172.21.15.55:0/54375059 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f738c06c8f0 msgr2=0x7f738c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:24.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.336+0000 7f73b1810640 1 --2- 172.21.15.55:0/54375059 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f738c06c8f0 0x7f738c06edb0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f73a4005520 tx=0x7f73a4009040 comp rx=0 tx=0).stop 2024-05-27T12:33:24.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.336+0000 7f73b1810640 1 -- 172.21.15.55:0/54375059 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73ac0d0890 msgr2=0x7f73ac06f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:24.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.336+0000 7f73b1810640 1 --2- 172.21.15.55:0/54375059 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73ac0d0890 0x7f73ac06f5d0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f739400c400 tx=0x7f739400c8c0 comp rx=0 tx=0).stop 2024-05-27T12:33:24.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.336+0000 7f73b1810640 1 -- 172.21.15.55:0/54375059 shutdown_connections 2024-05-27T12:33:24.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.336+0000 7f73b1810640 1 --2- 172.21.15.55:0/54375059 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f738c06c8f0 0x7f738c06edb0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:24.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.336+0000 7f73b1810640 1 --2- 172.21.15.55:0/54375059 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f73ac1680e0 0x7f73ac159bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:24.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.336+0000 7f73b1810640 1 --2- 172.21.15.55:0/54375059 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73ac0d0890 0x7f73ac06f5d0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:24.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.336+0000 7f73b1810640 1 --2- 172.21.15.55:0/54375059 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f73ac0cd670 0x7f73ac167b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:24.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.336+0000 7f73b1810640 1 -- 172.21.15.55:0/54375059 >> 172.21.15.55:0/54375059 conn(0x7f73ac09aa30 msgr2=0x7f73ac15f9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:24.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.337+0000 7f73b1810640 1 -- 172.21.15.55:0/54375059 shutdown_connections 2024-05-27T12:33:24.337 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.337+0000 7f73b1810640 1 -- 172.21.15.55:0/54375059 wait complete. 2024-05-27T12:33:24.347 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-27T12:33:24.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.452+0000 7f8279279640 1 Processor -- start 2024-05-27T12:33:24.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.452+0000 7f8279279640 1 -- start start 2024-05-27T12:33:24.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.453+0000 7f8279279640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f827415eb00 0x7f827415f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:24.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.453+0000 7f8279279640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f82740d1630 0x7f827409aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:24.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.453+0000 7f8279279640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82740d08b0 con 0x7f827409af70 2024-05-27T12:33:24.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.453+0000 7f8279279640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f82740d1a50 con 0x7f82740d1630 2024-05-27T12:33:24.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.453+0000 7f8279279640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f82740d0b50 con 0x7f827415eb00 2024-05-27T12:33:24.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.453+0000 7f82727fc640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f82740d1630 0x7f827409aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:24.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.453+0000 7f82727fc640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f82740d1630 0x7f827409aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33202/0 (socket says 172.21.15.55:33202) 2024-05-27T12:33:24.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.453+0000 7f82727fc640 1 -- 172.21.15.55:0/4098261943 learned_addr learned my addr 172.21.15.55:0/4098261943 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:33:24.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.453+0000 7f8272ffd640 1 --2- 172.21.15.55:0/4098261943 >> v2:172.21.15.72:3300/0 conn(0x7f827415eb00 0x7f827415f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:24.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.454+0000 7f82727fc640 1 -- 172.21.15.55:0/4098261943 >> v2:172.21.15.72:3300/0 conn(0x7f827415eb00 msgr2=0x7f827415f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:24.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.454+0000 7f82727fc640 1 --2- 172.21.15.55:0/4098261943 >> v2:172.21.15.72:3300/0 conn(0x7f827415eb00 0x7f827415f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:24.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.454+0000 7f82727fc640 1 -- 172.21.15.55:0/4098261943 >> v1:172.21.15.55:6789/0 conn(0x7f827409af70 legacy=0x7f827406cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:24.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.454+0000 7f82727fc640 1 -- 172.21.15.55:0/4098261943 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82740d0e30 con 0x7f82740d1630 2024-05-27T12:33:24.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.454+0000 7f8271ffb640 1 -- 172.21.15.55:0/4098261943 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 297252688 0 0) 0x7f82740d08b0 con 0x7f827409af70 2024-05-27T12:33:24.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.454+0000 7f82727fc640 1 --2- 172.21.15.55:0/4098261943 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f82740d1630 0x7f827409aa30 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f8274073d80 tx=0x7f825c02a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1180cf21793a57ca server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:24.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.454+0000 7f8271ffb640 1 -- 172.21.15.55:0/4098261943 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f825c037070 con 0x7f82740d1630 2024-05-27T12:33:24.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.454+0000 7f8271ffb640 1 -- 172.21.15.55:0/4098261943 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f825c02ae50 con 0x7f82740d1630 2024-05-27T12:33:24.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.454+0000 7f8271ffb640 1 -- 172.21.15.55:0/4098261943 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f825c032860 con 0x7f82740d1630 2024-05-27T12:33:24.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.455+0000 7f8279279640 1 -- 172.21.15.55:0/4098261943 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f82740d1630 msgr2=0x7f827409aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:24.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.455+0000 7f8279279640 1 --2- 172.21.15.55:0/4098261943 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f82740d1630 0x7f827409aa30 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f8274073d80 tx=0x7f825c02a300 comp rx=0 tx=0).stop 2024-05-27T12:33:24.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.455+0000 7f8279279640 1 -- 172.21.15.55:0/4098261943 shutdown_connections 2024-05-27T12:33:24.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.455+0000 7f8279279640 1 --2- 172.21.15.55:0/4098261943 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f82740d1630 0x7f827409aa30 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:24.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.455+0000 7f8279279640 1 --2- 172.21.15.55:0/4098261943 >> v2:172.21.15.72:3300/0 conn(0x7f827415eb00 0x7f827415f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:24.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.455+0000 7f8279279640 1 -- 172.21.15.55:0/4098261943 >> 172.21.15.55:0/4098261943 conn(0x7f82740b4100 msgr2=0x7f82740b4510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:24.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.455+0000 7f8279279640 1 -- 172.21.15.55:0/4098261943 shutdown_connections 2024-05-27T12:33:24.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.455+0000 7f8279279640 1 -- 172.21.15.55:0/4098261943 wait complete. 2024-05-27T12:33:24.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.456+0000 7f8279279640 1 Processor -- start 2024-05-27T12:33:24.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.456+0000 7f8279279640 1 -- start start 2024-05-27T12:33:24.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.457+0000 7f8279279640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f827409af70 0x7f82740b7e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:24.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.457+0000 7f8279279640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f82740d1630 0x7f82740b5dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:24.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.457+0000 7f8279279640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f827415eb00 0x7f82741f7ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:24.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.457+0000 7f8279279640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f827409b3c0 con 0x7f82740d1630 2024-05-27T12:33:24.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.457+0000 7f8279279640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f8274160040 con 0x7f827409af70 2024-05-27T12:33:24.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.457+0000 7f8279279640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f827409b540 con 0x7f827415eb00 2024-05-27T12:33:24.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.457+0000 7f82727fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f82740d1630 0x7f82740b5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:24.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.457+0000 7f82727fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f82740d1630 0x7f82740b5dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33210/0 (socket says 172.21.15.55:33210) 2024-05-27T12:33:24.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.457+0000 7f82727fc640 1 -- 172.21.15.55:0/3845010945 learned_addr learned my addr 172.21.15.55:0/3845010945 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:33:24.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.457+0000 7f8272ffd640 1 --2- 172.21.15.55:0/3845010945 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f827409af70 0x7f82740b7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:24.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.457+0000 7f82737fe640 1 --2- 172.21.15.55:0/3845010945 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f827415eb00 0x7f82741f7ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:24.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.458+0000 7f82727fc640 1 -- 172.21.15.55:0/3845010945 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f827415eb00 msgr2=0x7f82741f7ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:24.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.458+0000 7f82727fc640 1 --2- 172.21.15.55:0/3845010945 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f827415eb00 0x7f82741f7ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:24.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.458+0000 7f82727fc640 1 -- 172.21.15.55:0/3845010945 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f827409af70 msgr2=0x7f82740b7e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:24.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.458+0000 7f82727fc640 1 --2- 172.21.15.55:0/3845010945 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f827409af70 0x7f82740b7e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:24.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.458+0000 7f82727fc640 1 -- 172.21.15.55:0/3845010945 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82740b7090 con 0x7f82740d1630 2024-05-27T12:33:24.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.458+0000 7f8272ffd640 1 --2- 172.21.15.55:0/3845010945 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f827409af70 0x7f82740b7e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T12:33:24.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.458+0000 7f82727fc640 1 --2- 172.21.15.55:0/3845010945 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f82740d1630 0x7f82740b5dc0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f825c0090b0 tx=0x7f825c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:24.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.458+0000 7f826b7fe640 1 -- 172.21.15.55:0/3845010945 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f825c037040 con 0x7f82740d1630 2024-05-27T12:33:24.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.458+0000 7f826b7fe640 1 -- 172.21.15.55:0/3845010945 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f825c004030 con 0x7f82740d1630 2024-05-27T12:33:24.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.458+0000 7f8279279640 1 -- 172.21.15.55:0/3845010945 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82740b7370 con 0x7f82740d1630 2024-05-27T12:33:24.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.458+0000 7f826b7fe640 1 -- 172.21.15.55:0/3845010945 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f825c004400 con 0x7f82740d1630 2024-05-27T12:33:24.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.458+0000 7f8279279640 1 -- 172.21.15.55:0/3845010945 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82740cc390 con 0x7f82740d1630 2024-05-27T12:33:24.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.459+0000 7f8279279640 1 -- 172.21.15.55:0/3845010945 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8274075460 con 0x7f82740d1630 2024-05-27T12:33:24.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.459+0000 7f826b7fe640 1 -- 172.21.15.55:0/3845010945 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f825c03a070 con 0x7f82740d1630 2024-05-27T12:33:24.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.460+0000 7f826b7fe640 1 --2- 172.21.15.55:0/3845010945 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f825406c8f0 0x7f825406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:24.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.460+0000 7f826b7fe640 1 -- 172.21.15.55:0/3845010945 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7f825c0ac1f0 con 0x7f82740d1630 2024-05-27T12:33:24.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.460+0000 7f8272ffd640 1 --2- 172.21.15.55:0/3845010945 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f825406c8f0 0x7f825406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:24.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.461+0000 7f8272ffd640 1 --2- 172.21.15.55:0/3845010945 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f825406c8f0 0x7f825406edb0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f8264009a80 tx=0x7f82640039d0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:24.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.464+0000 7f826b7fe640 1 -- 172.21.15.55:0/3845010945 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f825c041020 con 0x7f82740d1630 2024-05-27T12:33:24.649 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.650+0000 7f8279279640 1 -- 172.21.15.55:0/3845010945 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f827406e0b0 con 0x7f82740d1630 2024-05-27T12:33:24.650 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.651+0000 7f826b7fe640 1 -- 172.21.15.55:0/3845010945 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+16805 (secure 0 0 0) 0x7f825c07a630 con 0x7f82740d1630 2024-05-27T12:33:24.650 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-27T12:33:24.650 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":25,"fsid":"c3ff4e3b-8dae-4856-9593-e5cc66c59982","created":"2024-05-27T12:32:17.019097+0000","modified":"2024-05-27T12:33:22.578415+0000","last_up_change":"2024-05-27T12:32:28.109744+0000","last_in_change":"2024-05-27T12:32:19.309872+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-27T12:32:29.277895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-27T12:32:39.442745+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-27T12:32:40.672118+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e607b598-061b-4b6f-92ff-95c20b330599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":807572567},{"type":"v1","addr":"172.21.15.55:6801","nonce":807572567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":807572567},{"type":"v1","addr":"172.21.15.55:6803","nonce":807572567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":807572567},{"type":"v1","addr":"172.21.15.55:6807","nonce":807572567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":807572567},{"type":"v1","addr":"172.21.15.55:6805","nonce":807572567}]},"public_addr":"172.21.15.55:6801/807572567","cluster_addr":"172.21.15.55:6803/807572567","heartbeat_back_addr":"172.21.15.55:6807/807572567","heartbeat_front_addr":"172.21.15.55:6805/807572567","state":["exists","up"]},{"osd":1,"uuid":"ba2b5b1d-71a9-4ecc-9a48-55aa7fe54261","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":3426897300},{"type":"v1","addr":"172.21.15.55:6825","nonce":3426897300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":3426897300},{"type":"v1","addr":"172.21.15.55:6827","nonce":3426897300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":3426897300},{"type":"v1","addr":"172.21.15.55:6831","nonce":3426897300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":3426897300},{"type":"v1","addr":"172.21.15.55:6829","nonce":3426897300}]},"public_addr":"172.21.15.55:6825/3426897300","cluster_addr":"172.21.15.55:6827/3426897300","heartbeat_back_addr":"172.21.15.55:6831/3426897300","heartbeat_front_addr":"172.21.15.55:6829/3426897300","state":["exists","up"]},{"osd":2,"uuid":"e6b81cc6-4ff1-45d0-87eb-9f04ccf986a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3510271725},{"type":"v1","addr":"172.21.15.55:6809","nonce":3510271725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3510271725},{"type":"v1","addr":"172.21.15.55:6811","nonce":3510271725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3510271725},{"type":"v1","addr":"172.21.15.55:6815","nonce":3510271725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3510271725},{"type":"v1","addr":"172.21.15.55:6813","nonce":3510271725}]},"public_addr":"172.21.15.55:6809/3510271725","cluster_addr":"172.21.15.55:6811/3510271725","heartbeat_back_addr":"172.21.15.55:6815/3510271725","heartbeat_front_addr":"172.21.15.55:6813/3510271725","state":["exists","up"]},{"osd":3,"uuid":"b6a34b75-807d-4693-b1c3-903cb4c618d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":1066693520},{"type":"v1","addr":"172.21.15.55:6817","nonce":1066693520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":1066693520},{"type":"v1","addr":"172.21.15.55:6819","nonce":1066693520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":1066693520},{"type":"v1","addr":"172.21.15.55:6823","nonce":1066693520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":1066693520},{"type":"v1","addr":"172.21.15.55:6821","nonce":1066693520}]},"public_addr":"172.21.15.55:6817/1066693520","cluster_addr":"172.21.15.55:6819/1066693520","heartbeat_back_addr":"172.21.15.55:6823/1066693520","heartbeat_front_addr":"172.21.15.55:6821/1066693520","state":["exists","up"]},{"osd":4,"uuid":"272ec937-56b4-4f0a-b2e1-b0bc189c9d79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":4190771237},{"type":"v1","addr":"172.21.15.72:6820","nonce":4190771237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":4190771237},{"type":"v1","addr":"172.21.15.72:6824","nonce":4190771237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":4190771237},{"type":"v1","addr":"172.21.15.72:6831","nonce":4190771237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":4190771237},{"type":"v1","addr":"172.21.15.72:6828","nonce":4190771237}]},"public_addr":"172.21.15.72:6820/4190771237","cluster_addr":"172.21.15.72:6824/4190771237","heartbeat_back_addr":"172.21.15.72:6831/4190771237","heartbeat_front_addr":"172.21.15.72:6828/4190771237","state":["exists","up"]},{"osd":5,"uuid":"56439854-72a0-4ef4-81ff-184a3d924a5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":2421889184},{"type":"v1","addr":"172.21.15.72:6801","nonce":2421889184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6803","nonce":2421889184},{"type":"v1","addr":"172.21.15.72:6805","nonce":2421889184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":2421889184},{"type":"v1","addr":"172.21.15.72:6813","nonce":2421889184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6807","nonce":2421889184},{"type":"v1","addr":"172.21.15.72:6809","nonce":2421889184}]},"public_addr":"172.21.15.72:6801/2421889184","cluster_addr":"172.21.15.72:6805/2421889184","heartbeat_back_addr":"172.21.15.72:6813/2421889184","heartbeat_front_addr":"172.21.15.72:6809/2421889184","state":["exists","up"]},{"osd":6,"uuid":"e248e2be-3b6e-49cf-8c8a-1a4152827582","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3796994599},{"type":"v1","addr":"172.21.15.72:6804","nonce":3796994599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":3796994599},{"type":"v1","addr":"172.21.15.72:6808","nonce":3796994599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":3796994599},{"type":"v1","addr":"172.21.15.72:6815","nonce":3796994599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":3796994599},{"type":"v1","addr":"172.21.15.72:6812","nonce":3796994599}]},"public_addr":"172.21.15.72:6804/3796994599","cluster_addr":"172.21.15.72:6808/3796994599","heartbeat_back_addr":"172.21.15.72:6815/3796994599","heartbeat_front_addr":"172.21.15.72:6812/3796994599","state":["exists","up"]},{"osd":7,"uuid":"505a62d3-322b-4629-b4fd-187a55563709","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":3024877895},{"type":"v1","addr":"172.21.15.72:6817","nonce":3024877895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":3024877895},{"type":"v1","addr":"172.21.15.72:6821","nonce":3024877895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6827","nonce":3024877895},{"type":"v1","addr":"172.21.15.72:6829","nonce":3024877895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6823","nonce":3024877895},{"type":"v1","addr":"172.21.15.72:6825","nonce":3024877895}]},"public_addr":"172.21.15.72:6817/3024877895","cluster_addr":"172.21.15.72:6821/3024877895","heartbeat_back_addr":"172.21.15.72:6829/3024877895","heartbeat_front_addr":"172.21.15.72:6825/3024877895","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.241014+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.450799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.465018+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.507647+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.534763+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.495895+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.427110+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.547466+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.b","mappings":[{"from":3,"to":1}]},{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.12","mappings":[{"from":0,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-27T12:33:24.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.653+0000 7f8279279640 1 -- 172.21.15.55:0/3845010945 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f825406c8f0 msgr2=0x7f825406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:24.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.653+0000 7f8279279640 1 --2- 172.21.15.55:0/3845010945 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f825406c8f0 0x7f825406edb0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f8264009a80 tx=0x7f82640039d0 comp rx=0 tx=0).stop 2024-05-27T12:33:24.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.653+0000 7f8279279640 1 -- 172.21.15.55:0/3845010945 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f82740d1630 msgr2=0x7f82740b5dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:24.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.653+0000 7f8279279640 1 --2- 172.21.15.55:0/3845010945 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f82740d1630 0x7f82740b5dc0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f825c0090b0 tx=0x7f825c0046c0 comp rx=0 tx=0).stop 2024-05-27T12:33:24.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.653+0000 7f8279279640 1 -- 172.21.15.55:0/3845010945 shutdown_connections 2024-05-27T12:33:24.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.653+0000 7f8279279640 1 --2- 172.21.15.55:0/3845010945 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f827415eb00 0x7f82741f7ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:24.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.653+0000 7f8279279640 1 --2- 172.21.15.55:0/3845010945 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f82740d1630 0x7f82740b5dc0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:24.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.653+0000 7f8279279640 1 --2- 172.21.15.55:0/3845010945 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f825406c8f0 0x7f825406edb0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:24.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.653+0000 7f8279279640 1 --2- 172.21.15.55:0/3845010945 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f827409af70 0x7f82740b7e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:24.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.653+0000 7f8279279640 1 -- 172.21.15.55:0/3845010945 >> 172.21.15.55:0/3845010945 conn(0x7f82740b4100 msgr2=0x7f82740b39f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:24.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.653+0000 7f8279279640 1 -- 172.21.15.55:0/3845010945 shutdown_connections 2024-05-27T12:33:24.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.653+0000 7f8279279640 1 -- 172.21.15.55:0/3845010945 wait complete. 2024-05-27T12:33:24.664 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-27T12:33:24.664 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-27T12:33:24.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.768+0000 7fdfed0c2640 1 Processor -- start 2024-05-27T12:33:24.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.769+0000 7fdfed0c2640 1 -- start start 2024-05-27T12:33:24.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.769+0000 7fdfed0c2640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fdfe815ec00 0x7fdfe80b3db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:24.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.769+0000 7fdfed0c2640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fdfe80b6370 0x7fdfe80b67c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:24.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.769+0000 7fdfed0c2640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdfe81632f0 con 0x7fdfe80b3860 2024-05-27T12:33:24.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.769+0000 7fdfed0c2640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7fdfe80b6d00 con 0x7fdfe80b6370 2024-05-27T12:33:24.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.769+0000 7fdfed0c2640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fdfe80cf2e0 con 0x7fdfe815ec00 2024-05-27T12:33:24.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.770+0000 7fdfe759e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fdfe80b6370 0x7fdfe80b67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:24.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.770+0000 7fdfe659c640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fdfe80b3860 0x7fdfe80cfd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:50284/0 (socket says 172.21.15.55:50284) 2024-05-27T12:33:24.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.770+0000 7fdfe659c640 1 -- 172.21.15.55:0/1347640903 learned_addr learned my addr 172.21.15.55:0/1347640903 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-27T12:33:24.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.770+0000 7fdfe6d9d640 1 --2- 172.21.15.55:0/1347640903 >> v2:172.21.15.72:3300/0 conn(0x7fdfe815ec00 0x7fdfe80b3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:24.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.770+0000 7fdfe759e640 1 -- 172.21.15.55:0/1347640903 >> v2:172.21.15.72:3300/0 conn(0x7fdfe815ec00 msgr2=0x7fdfe80b3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:24.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.770+0000 7fdfe759e640 1 --2- 172.21.15.55:0/1347640903 >> v2:172.21.15.72:3300/0 conn(0x7fdfe815ec00 0x7fdfe80b3db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:24.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.770+0000 7fdfe759e640 1 -- 172.21.15.55:0/1347640903 >> v1:172.21.15.55:6789/0 conn(0x7fdfe80b3860 legacy=0x7fdfe80cfd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:24.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.770+0000 7fdfe5d9b640 1 -- 172.21.15.55:0/1347640903 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3756510932 0 0) 0x7fdfe81632f0 con 0x7fdfe80b3860 2024-05-27T12:33:24.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.770+0000 7fdfe759e640 1 -- 172.21.15.55:0/1347640903 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfe81635d0 con 0x7fdfe80b6370 2024-05-27T12:33:24.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.771+0000 7fdfe759e640 1 --2- 172.21.15.55:0/1347640903 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdfe80b6370 0x7fdfe80b67c0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fdfe80b7310 tx=0x7fdfe002a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c1800b0674be995 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:24.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.771+0000 7fdfe5d9b640 1 -- 172.21.15.55:0/1347640903 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfe0007740 con 0x7fdfe80b6370 2024-05-27T12:33:24.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.771+0000 7fdfe5d9b640 1 -- 172.21.15.55:0/1347640903 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfe00078e0 con 0x7fdfe80b6370 2024-05-27T12:33:24.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.771+0000 7fdfe5d9b640 1 -- 172.21.15.55:0/1347640903 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfe0007cb0 con 0x7fdfe80b6370 2024-05-27T12:33:24.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.771+0000 7fdfed0c2640 1 -- 172.21.15.55:0/1347640903 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdfe80b6370 msgr2=0x7fdfe80b67c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:24.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.771+0000 7fdfed0c2640 1 --2- 172.21.15.55:0/1347640903 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdfe80b6370 0x7fdfe80b67c0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fdfe80b7310 tx=0x7fdfe002a680 comp rx=0 tx=0).stop 2024-05-27T12:33:24.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.771+0000 7fdfed0c2640 1 -- 172.21.15.55:0/1347640903 shutdown_connections 2024-05-27T12:33:24.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.771+0000 7fdfed0c2640 1 --2- 172.21.15.55:0/1347640903 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdfe80b6370 0x7fdfe80b67c0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:24.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.771+0000 7fdfed0c2640 1 --2- 172.21.15.55:0/1347640903 >> v2:172.21.15.72:3300/0 conn(0x7fdfe815ec00 0x7fdfe80b3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:24.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.771+0000 7fdfed0c2640 1 -- 172.21.15.55:0/1347640903 >> 172.21.15.55:0/1347640903 conn(0x7fdfe80d1370 msgr2=0x7fdfe80d1780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:24.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.771+0000 7fdfed0c2640 1 -- 172.21.15.55:0/1347640903 shutdown_connections 2024-05-27T12:33:24.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.771+0000 7fdfed0c2640 1 -- 172.21.15.55:0/1347640903 wait complete. 2024-05-27T12:33:24.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.773+0000 7fdfed0c2640 1 Processor -- start 2024-05-27T12:33:24.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.773+0000 7fdfed0c2640 1 -- start start 2024-05-27T12:33:24.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.773+0000 7fdfed0c2640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdfe80b3860 0x7fdfe80cc600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:24.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.774+0000 7fdfed0c2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdfe80b6370 0x7fdfe80ca400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:24.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.774+0000 7fdfed0c2640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdfe815ec00 0x7fdfe80b3d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:24.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.774+0000 7fdfed0c2640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7fdfe80b3530 con 0x7fdfe80b6370 2024-05-27T12:33:24.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.774+0000 7fdfed0c2640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fdfe80cf810 con 0x7fdfe80b3860 2024-05-27T12:33:24.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.774+0000 7fdfed0c2640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fdfe815efe0 con 0x7fdfe815ec00 2024-05-27T12:33:24.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.774+0000 7fdfe659c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdfe80b6370 0x7fdfe80ca400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:24.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.774+0000 7fdfe659c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdfe80b6370 0x7fdfe80ca400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33224/0 (socket says 172.21.15.55:33224) 2024-05-27T12:33:24.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.774+0000 7fdfe659c640 1 -- 172.21.15.55:0/3060772511 learned_addr learned my addr 172.21.15.55:0/3060772511 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:33:24.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.774+0000 7fdfe6d9d640 1 --2- 172.21.15.55:0/3060772511 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdfe80b3860 0x7fdfe80cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:24.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.774+0000 7fdfe659c640 1 -- 172.21.15.55:0/3060772511 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdfe815ec00 msgr2=0x7fdfe80b3d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:24.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.774+0000 7fdfe659c640 1 --2- 172.21.15.55:0/3060772511 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdfe815ec00 0x7fdfe80b3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:24.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.774+0000 7fdfe659c640 1 -- 172.21.15.55:0/3060772511 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdfe80b3860 msgr2=0x7fdfe80cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:24.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.774+0000 7fdfe659c640 1 --2- 172.21.15.55:0/3060772511 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdfe80b3860 0x7fdfe80cc600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:24.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.774+0000 7fdfe659c640 1 -- 172.21.15.55:0/3060772511 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfe80cd3c0 con 0x7fdfe80b6370 2024-05-27T12:33:24.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.774+0000 7fdfe659c640 1 --2- 172.21.15.55:0/3060772511 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdfe80b6370 0x7fdfe80ca400 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fdfdc00c4d0 tx=0x7fdfdc00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:24.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.774+0000 7fdfcf7fe640 1 -- 172.21.15.55:0/3060772511 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfdc018070 con 0x7fdfe80b6370 2024-05-27T12:33:24.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.774+0000 7fdfcf7fe640 1 -- 172.21.15.55:0/3060772511 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfdc007500 con 0x7fdfe80b6370 2024-05-27T12:33:24.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.774+0000 7fdfed0c2640 1 -- 172.21.15.55:0/3060772511 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfe80cd6a0 con 0x7fdfe80b6370 2024-05-27T12:33:24.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.774+0000 7fdfcf7fe640 1 -- 172.21.15.55:0/3060772511 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfdc004a20 con 0x7fdfe80b6370 2024-05-27T12:33:24.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.774+0000 7fdfed0c2640 1 -- 172.21.15.55:0/3060772511 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfe80cdc60 con 0x7fdfe80b6370 2024-05-27T12:33:24.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.775+0000 7fdfed0c2640 1 -- 172.21.15.55:0/3060772511 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdfe806db20 con 0x7fdfe80b6370 2024-05-27T12:33:24.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.776+0000 7fdfcf7fe640 1 -- 172.21.15.55:0/3060772511 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fdfdc01b070 con 0x7fdfe80b6370 2024-05-27T12:33:24.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.776+0000 7fdfcf7fe640 1 --2- 172.21.15.55:0/3060772511 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fdfd406c8f0 0x7fdfd406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:24.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.776+0000 7fdfcf7fe640 1 -- 172.21.15.55:0/3060772511 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7fdfdc08ae80 con 0x7fdfe80b6370 2024-05-27T12:33:24.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.776+0000 7fdfe6d9d640 1 --2- 172.21.15.55:0/3060772511 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fdfd406c8f0 0x7fdfd406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:24.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.777+0000 7fdfe6d9d640 1 --2- 172.21.15.55:0/3060772511 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fdfd406c8f0 0x7fdfd406edb0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fdfd8006fd0 tx=0x7fdfd8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:24.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:24.780+0000 7fdfcf7fe640 1 -- 172.21.15.55:0/3060772511 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fdfe806db20 con 0x7fdfe80b6370 2024-05-27T12:33:25.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.004+0000 7fdfed0c2640 1 -- 172.21.15.55:0/3060772511 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdfe8075460 con 0x7fdfe80b6370 2024-05-27T12:33:25.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.004+0000 7fdfcf7fe640 1 -- 172.21.15.55:0/3060772511 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5166 (secure 0 0 0) 0x7fdfdc0592c0 con 0x7fdfe80b6370 2024-05-27T12:33:25.004 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-27T12:33:25.004 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/1501264038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":1501264038},{"type":"v1","addr":"172.21.15.55:6834","nonce":1501264038}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/3311546358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":3311546358},{"type":"v1","addr":"172.21.15.55:6835","nonce":3311546358}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4282,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/138819105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6835","nonce":138819105},{"type":"v1","addr":"172.21.15.72:6837","nonce":138819105}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-27T12:32:41.727353+0000","modified":"2024-05-27T12:32:43.723059+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.72:6836/70510151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":70510151},{"type":"v1","addr":"172.21.15.72:6836","nonce":70510151}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4290,"qdb_cluster":[4290]},"id":1}]} 2024-05-27T12:33:25.004 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 6 2024-05-27T12:33:25.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.006+0000 7fdfed0c2640 1 -- 172.21.15.55:0/3060772511 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fdfd406c8f0 msgr2=0x7fdfd406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:25.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.006+0000 7fdfed0c2640 1 --2- 172.21.15.55:0/3060772511 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fdfd406c8f0 0x7fdfd406edb0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fdfd8006fd0 tx=0x7fdfd8008040 comp rx=0 tx=0).stop 2024-05-27T12:33:25.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.006+0000 7fdfed0c2640 1 -- 172.21.15.55:0/3060772511 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdfe80b6370 msgr2=0x7fdfe80ca400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:25.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.006+0000 7fdfed0c2640 1 --2- 172.21.15.55:0/3060772511 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdfe80b6370 0x7fdfe80ca400 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fdfdc00c4d0 tx=0x7fdfdc00c990 comp rx=0 tx=0).stop 2024-05-27T12:33:25.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.006+0000 7fdfed0c2640 1 -- 172.21.15.55:0/3060772511 shutdown_connections 2024-05-27T12:33:25.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.006+0000 7fdfed0c2640 1 --2- 172.21.15.55:0/3060772511 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdfe815ec00 0x7fdfe80b3d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:25.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.006+0000 7fdfed0c2640 1 --2- 172.21.15.55:0/3060772511 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdfe80b6370 0x7fdfe80ca400 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:25.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.006+0000 7fdfed0c2640 1 --2- 172.21.15.55:0/3060772511 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fdfd406c8f0 0x7fdfd406edb0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:25.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.006+0000 7fdfed0c2640 1 --2- 172.21.15.55:0/3060772511 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdfe80b3860 0x7fdfe80cc600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:25.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.006+0000 7fdfed0c2640 1 -- 172.21.15.55:0/3060772511 >> 172.21.15.55:0/3060772511 conn(0x7fdfe80d1370 msgr2=0x7fdfe80d1750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:25.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.006+0000 7fdfed0c2640 1 -- 172.21.15.55:0/3060772511 shutdown_connections 2024-05-27T12:33:25.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.006+0000 7fdfed0c2640 1 -- 172.21.15.55:0/3060772511 wait complete. 2024-05-27T12:33:25.017 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-27T12:33:25.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.121+0000 7f2aa40a0640 1 Processor -- start 2024-05-27T12:33:25.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.121+0000 7f2aa40a0640 1 -- start start 2024-05-27T12:33:25.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.122+0000 7f2aa40a0640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2a9c15ec00 0x7f2a9c0b3db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:25.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.122+0000 7f2aa40a0640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2a9c0b6370 0x7f2a9c0b67c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:25.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.122+0000 7f2aa40a0640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a9c1632f0 con 0x7f2a9c0b3860 2024-05-27T12:33:25.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.122+0000 7f2aa40a0640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f2a9c0b6d00 con 0x7f2a9c15ec00 2024-05-27T12:33:25.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.122+0000 7f2aa40a0640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f2a9c0cf2e0 con 0x7f2a9c0b6370 2024-05-27T12:33:25.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.122+0000 7f2aa1e3c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2a9c15ec00 0x7f2a9c0b3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:25.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.122+0000 7f2aa1e3c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2a9c15ec00 0x7f2a9c0b3db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33230/0 (socket says 172.21.15.55:33230) 2024-05-27T12:33:25.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.122+0000 7f2aa1e3c640 1 -- 172.21.15.55:0/4188219063 learned_addr learned my addr 172.21.15.55:0/4188219063 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:33:25.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.123+0000 7f2aa263d640 1 --2- 172.21.15.55:0/4188219063 >> v2:172.21.15.72:3300/0 conn(0x7f2a9c0b6370 0x7f2a9c0b67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:25.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.123+0000 7f2aa1e3c640 1 -- 172.21.15.55:0/4188219063 >> v2:172.21.15.72:3300/0 conn(0x7f2a9c0b6370 msgr2=0x7f2a9c0b67c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:25.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.123+0000 7f2aa1e3c640 1 --2- 172.21.15.55:0/4188219063 >> v2:172.21.15.72:3300/0 conn(0x7f2a9c0b6370 0x7f2a9c0b67c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:25.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.123+0000 7f2aa1e3c640 1 -- 172.21.15.55:0/4188219063 >> v1:172.21.15.72:6789/0 conn(0x7f2a9c0b3860 legacy=0x7f2a9c0cfd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:25.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.123+0000 7f2aa1e3c640 1 -- 172.21.15.55:0/4188219063 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a9c1635d0 con 0x7f2a9c15ec00 2024-05-27T12:33:25.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.123+0000 7f2aa263d640 1 --2- 172.21.15.55:0/4188219063 >> v2:172.21.15.72:3300/0 conn(0x7f2a9c0b6370 0x7f2a9c0b67c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T12:33:25.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.123+0000 7f2aa1e3c640 1 --2- 172.21.15.55:0/4188219063 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2a9c15ec00 0x7f2a9c0b3db0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f2a9c0b77d0 tx=0x7f2a9402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad29855d4d422457 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:25.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.124+0000 7f2aa0e3a640 1 -- 172.21.15.55:0/4188219063 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a94037070 con 0x7f2a9c15ec00 2024-05-27T12:33:25.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.124+0000 7f2aa0e3a640 1 -- 172.21.15.55:0/4188219063 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a94032440 con 0x7f2a9c15ec00 2024-05-27T12:33:25.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.124+0000 7f2aa0e3a640 1 -- 172.21.15.55:0/4188219063 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a94032810 con 0x7f2a9c15ec00 2024-05-27T12:33:25.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.124+0000 7f2aa40a0640 1 -- 172.21.15.55:0/4188219063 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2a9c15ec00 msgr2=0x7f2a9c0b3db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:25.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.124+0000 7f2aa40a0640 1 --2- 172.21.15.55:0/4188219063 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2a9c15ec00 0x7f2a9c0b3db0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f2a9c0b77d0 tx=0x7f2a9402a270 comp rx=0 tx=0).stop 2024-05-27T12:33:25.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.124+0000 7f2aa40a0640 1 -- 172.21.15.55:0/4188219063 shutdown_connections 2024-05-27T12:33:25.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.124+0000 7f2aa40a0640 1 --2- 172.21.15.55:0/4188219063 >> v2:172.21.15.72:3300/0 conn(0x7f2a9c0b6370 0x7f2a9c0b67c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:25.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.124+0000 7f2aa40a0640 1 --2- 172.21.15.55:0/4188219063 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2a9c15ec00 0x7f2a9c0b3db0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:25.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.124+0000 7f2aa40a0640 1 -- 172.21.15.55:0/4188219063 >> 172.21.15.55:0/4188219063 conn(0x7f2a9c0d1370 msgr2=0x7f2a9c0d1780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:25.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.124+0000 7f2aa40a0640 1 -- 172.21.15.55:0/4188219063 shutdown_connections 2024-05-27T12:33:25.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.124+0000 7f2aa40a0640 1 -- 172.21.15.55:0/4188219063 wait complete. 2024-05-27T12:33:25.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.126+0000 7f2aa40a0640 1 Processor -- start 2024-05-27T12:33:25.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.126+0000 7f2aa40a0640 1 -- start start 2024-05-27T12:33:25.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.126+0000 7f2aa40a0640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2a9c0b3860 0x7f2a9c1e8690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:25.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.126+0000 7f2aa40a0640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2a9c0b6370 0x7f2a9c1f40b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:25.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.126+0000 7f2aa40a0640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a9c15ec00 0x7f2a9c1f45f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:25.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.126+0000 7f2aa40a0640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f2a9c0b3530 con 0x7f2a9c0b6370 2024-05-27T12:33:25.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.126+0000 7f2aa40a0640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f2a9c0cf810 con 0x7f2a9c15ec00 2024-05-27T12:33:25.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.126+0000 7f2aa40a0640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f2a9c15efe0 con 0x7f2a9c0b3860 2024-05-27T12:33:25.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.126+0000 7f2aa163b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2a9c0b6370 0x7f2a9c1f40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:25.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.126+0000 7f2aa163b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2a9c0b6370 0x7f2a9c1f40b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33232/0 (socket says 172.21.15.55:33232) 2024-05-27T12:33:25.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.127+0000 7f2aa163b640 1 -- 172.21.15.55:0/1023603645 learned_addr learned my addr 172.21.15.55:0/1023603645 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:33:25.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.127+0000 7f2aa263d640 1 --2- 172.21.15.55:0/1023603645 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a9c15ec00 0x7f2a9c1f45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:25.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.127+0000 7f2aa163b640 1 -- 172.21.15.55:0/1023603645 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2a9c0b3860 msgr2=0x7f2a9c1e8690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:25.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.127+0000 7f2aa1e3c640 1 --2- 172.21.15.55:0/1023603645 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2a9c0b3860 0x7f2a9c1e8690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:25.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.127+0000 7f2aa163b640 1 --2- 172.21.15.55:0/1023603645 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2a9c0b3860 0x7f2a9c1e8690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:25.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.127+0000 7f2aa163b640 1 -- 172.21.15.55:0/1023603645 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a9c15ec00 msgr2=0x7f2a9c1f45f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:25.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.127+0000 7f2aa163b640 1 --2- 172.21.15.55:0/1023603645 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a9c15ec00 0x7f2a9c1f45f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:25.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.127+0000 7f2aa163b640 1 -- 172.21.15.55:0/1023603645 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a9c161e50 con 0x7f2a9c0b6370 2024-05-27T12:33:25.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.127+0000 7f2aa263d640 1 --2- 172.21.15.55:0/1023603645 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a9c15ec00 0x7f2a9c1f45f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T12:33:25.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.127+0000 7f2aa163b640 1 --2- 172.21.15.55:0/1023603645 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2a9c0b6370 0x7f2a9c1f40b0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f2a9000c400 tx=0x7f2a9000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:25.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.127+0000 7f2a9a7fc640 1 -- 172.21.15.55:0/1023603645 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a900052d0 con 0x7f2a9c0b6370 2024-05-27T12:33:25.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.127+0000 7f2a9a7fc640 1 -- 172.21.15.55:0/1023603645 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a90005490 con 0x7f2a9c0b6370 2024-05-27T12:33:25.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.127+0000 7f2a9a7fc640 1 -- 172.21.15.55:0/1023603645 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a90007260 con 0x7f2a9c0b6370 2024-05-27T12:33:25.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.127+0000 7f2aa40a0640 1 -- 172.21.15.55:0/1023603645 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a9c1418d0 con 0x7f2a9c0b6370 2024-05-27T12:33:25.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.127+0000 7f2aa40a0640 1 -- 172.21.15.55:0/1023603645 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a9c141e90 con 0x7f2a9c0b6370 2024-05-27T12:33:25.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.128+0000 7f2aa40a0640 1 -- 172.21.15.55:0/1023603645 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a9c06db20 con 0x7f2a9c0b6370 2024-05-27T12:33:25.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.129+0000 7f2a9a7fc640 1 -- 172.21.15.55:0/1023603645 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2a90007400 con 0x7f2a9c0b6370 2024-05-27T12:33:25.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.129+0000 7f2a9a7fc640 1 --2- 172.21.15.55:0/1023603645 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f2a8806c8f0 0x7f2a8806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:25.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.129+0000 7f2a9a7fc640 1 -- 172.21.15.55:0/1023603645 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7f2a9008b0d0 con 0x7f2a9c0b6370 2024-05-27T12:33:25.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.129+0000 7f2aa1e3c640 1 --2- 172.21.15.55:0/1023603645 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f2a8806c8f0 0x7f2a8806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:25.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.130+0000 7f2aa1e3c640 1 --2- 172.21.15.55:0/1023603645 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f2a8806c8f0 0x7f2a8806edb0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2a94034000 tx=0x7f2a9402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:25.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.133+0000 7f2a9a7fc640 1 -- 172.21.15.55:0/1023603645 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2a9c06db20 con 0x7f2a9c0b6370 2024-05-27T12:33:25.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.359+0000 7f2aa40a0640 1 -- 172.21.15.55:0/1023603645 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2a9c142090 con 0x7f2a9c0b6370 2024-05-27T12:33:25.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.359+0000 7f2a9a7fc640 1 -- 172.21.15.55:0/1023603645 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5166 (secure 0 0 0) 0x7f2a9c142090 con 0x7f2a9c0b6370 2024-05-27T12:33:25.359 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-27T12:33:25.360 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/1501264038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":1501264038},{"type":"v1","addr":"172.21.15.55:6834","nonce":1501264038}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/3311546358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":3311546358},{"type":"v1","addr":"172.21.15.55:6835","nonce":3311546358}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4282,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/138819105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6835","nonce":138819105},{"type":"v1","addr":"172.21.15.72:6837","nonce":138819105}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-27T12:32:41.727353+0000","modified":"2024-05-27T12:32:43.723059+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.72:6836/70510151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":70510151},{"type":"v1","addr":"172.21.15.72:6836","nonce":70510151}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4290,"qdb_cluster":[4290]},"id":1}]} 2024-05-27T12:33:25.360 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 6 2024-05-27T12:33:25.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.362+0000 7f2aa40a0640 1 -- 172.21.15.55:0/1023603645 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f2a8806c8f0 msgr2=0x7f2a8806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:25.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.362+0000 7f2aa40a0640 1 --2- 172.21.15.55:0/1023603645 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f2a8806c8f0 0x7f2a8806edb0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2a94034000 tx=0x7f2a9402e000 comp rx=0 tx=0).stop 2024-05-27T12:33:25.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.362+0000 7f2aa40a0640 1 -- 172.21.15.55:0/1023603645 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2a9c0b6370 msgr2=0x7f2a9c1f40b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:25.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.362+0000 7f2aa40a0640 1 --2- 172.21.15.55:0/1023603645 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2a9c0b6370 0x7f2a9c1f40b0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f2a9000c400 tx=0x7f2a9000c8c0 comp rx=0 tx=0).stop 2024-05-27T12:33:25.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.362+0000 7f2aa40a0640 1 -- 172.21.15.55:0/1023603645 shutdown_connections 2024-05-27T12:33:25.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.362+0000 7f2aa40a0640 1 --2- 172.21.15.55:0/1023603645 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f2a8806c8f0 0x7f2a8806edb0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:25.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.362+0000 7f2aa40a0640 1 --2- 172.21.15.55:0/1023603645 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a9c15ec00 0x7f2a9c1f45f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:25.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.362+0000 7f2aa40a0640 1 --2- 172.21.15.55:0/1023603645 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2a9c0b6370 0x7f2a9c1f40b0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:25.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.362+0000 7f2aa40a0640 1 --2- 172.21.15.55:0/1023603645 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2a9c0b3860 0x7f2a9c1e8690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:25.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.362+0000 7f2aa40a0640 1 -- 172.21.15.55:0/1023603645 >> 172.21.15.55:0/1023603645 conn(0x7f2a9c0d1370 msgr2=0x7f2a9c0b70d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:25.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.362+0000 7f2aa40a0640 1 -- 172.21.15.55:0/1023603645 shutdown_connections 2024-05-27T12:33:25.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.362+0000 7f2aa40a0640 1 -- 172.21.15.55:0/1023603645 wait complete. 2024-05-27T12:33:25.372 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-27T12:33:25.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.476+0000 7fb83174f640 1 Processor -- start 2024-05-27T12:33:25.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.477+0000 7fb83174f640 1 -- start start 2024-05-27T12:33:25.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.477+0000 7fb83174f640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb82c15ec00 0x7fb82c0b3db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:25.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.477+0000 7fb83174f640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb82c0b6370 0x7fb82c0b6800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:25.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.477+0000 7fb83174f640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb82c1632f0 con 0x7fb82c0b3860 2024-05-27T12:33:25.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.477+0000 7fb83174f640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7fb82c0cf2e0 con 0x7fb82c0b6370 2024-05-27T12:33:25.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.477+0000 7fb83174f640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fb82c1635d0 con 0x7fb82c15ec00 2024-05-27T12:33:25.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.478+0000 7fb82b7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb82c0b6370 0x7fb82c0b6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:25.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.478+0000 7fb82b7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb82c0b6370 0x7fb82c0b6800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33244/0 (socket says 172.21.15.55:33244) 2024-05-27T12:33:25.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.478+0000 7fb82b7fe640 1 -- 172.21.15.55:0/2328586128 learned_addr learned my addr 172.21.15.55:0/2328586128 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:33:25.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.478+0000 7fb82affd640 1 --2- 172.21.15.55:0/2328586128 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb82c15ec00 0x7fb82c0b3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:25.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.478+0000 7fb82b7fe640 1 -- 172.21.15.55:0/2328586128 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb82c15ec00 msgr2=0x7fb82c0b3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:25.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.478+0000 7fb82b7fe640 1 --2- 172.21.15.55:0/2328586128 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb82c15ec00 0x7fb82c0b3db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:25.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.478+0000 7fb82b7fe640 1 -- 172.21.15.55:0/2328586128 >> v1:172.21.15.72:6789/0 conn(0x7fb82c0b3860 legacy=0x7fb82c0cfd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:25.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.478+0000 7fb82b7fe640 1 -- 172.21.15.55:0/2328586128 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb82c0cf530 con 0x7fb82c0b6370 2024-05-27T12:33:25.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.479+0000 7fb82b7fe640 1 --2- 172.21.15.55:0/2328586128 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb82c0b6370 0x7fb82c0b6800 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fb824009e50 tx=0x7fb82402a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b11e3d542c227926 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:25.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.479+0000 7fb82a7fc640 1 -- 172.21.15.55:0/2328586128 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb824036070 con 0x7fb82c0b6370 2024-05-27T12:33:25.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.479+0000 7fb82a7fc640 1 -- 172.21.15.55:0/2328586128 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb824031600 con 0x7fb82c0b6370 2024-05-27T12:33:25.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.479+0000 7fb82a7fc640 1 -- 172.21.15.55:0/2328586128 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8240319d0 con 0x7fb82c0b6370 2024-05-27T12:33:25.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.479+0000 7fb83174f640 1 -- 172.21.15.55:0/2328586128 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb82c0b6370 msgr2=0x7fb82c0b6800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:25.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.479+0000 7fb83174f640 1 --2- 172.21.15.55:0/2328586128 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb82c0b6370 0x7fb82c0b6800 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fb824009e50 tx=0x7fb82402a710 comp rx=0 tx=0).stop 2024-05-27T12:33:25.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.479+0000 7fb83174f640 1 -- 172.21.15.55:0/2328586128 shutdown_connections 2024-05-27T12:33:25.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.479+0000 7fb83174f640 1 --2- 172.21.15.55:0/2328586128 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb82c0b6370 0x7fb82c0b6800 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:25.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.479+0000 7fb83174f640 1 --2- 172.21.15.55:0/2328586128 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb82c15ec00 0x7fb82c0b3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:25.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.479+0000 7fb83174f640 1 -- 172.21.15.55:0/2328586128 >> 172.21.15.55:0/2328586128 conn(0x7fb82c0d1370 msgr2=0x7fb82c0d1780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:25.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.479+0000 7fb83174f640 1 -- 172.21.15.55:0/2328586128 shutdown_connections 2024-05-27T12:33:25.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.479+0000 7fb83174f640 1 -- 172.21.15.55:0/2328586128 wait complete. 2024-05-27T12:33:25.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.481+0000 7fb83174f640 1 Processor -- start 2024-05-27T12:33:25.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.481+0000 7fb83174f640 1 -- start start 2024-05-27T12:33:25.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.481+0000 7fb83174f640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb82c0b3860 0x7fb82c159f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:25.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.481+0000 7fb83174f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb82c0b6370 0x7fb82c1e8620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:25.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.481+0000 7fb83174f640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb82c15ec00 0x7fb82c0b8b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:25.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.481+0000 7fb83174f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7fb82c15efe0 con 0x7fb82c0b6370 2024-05-27T12:33:25.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.481+0000 7fb83174f640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fb82c0b3530 con 0x7fb82c15ec00 2024-05-27T12:33:25.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.481+0000 7fb83174f640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fb82c15f160 con 0x7fb82c0b3860 2024-05-27T12:33:25.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.482+0000 7fb823fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb82c0b6370 0x7fb82c1e8620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:25.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.482+0000 7fb823fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb82c0b6370 0x7fb82c1e8620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33254/0 (socket says 172.21.15.55:33254) 2024-05-27T12:33:25.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.482+0000 7fb823fff640 1 -- 172.21.15.55:0/3042210657 learned_addr learned my addr 172.21.15.55:0/3042210657 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:33:25.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.482+0000 7fb82affd640 1 --2- 172.21.15.55:0/3042210657 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb82c0b3860 0x7fb82c159f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:25.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.482+0000 7fb82b7fe640 1 --2- 172.21.15.55:0/3042210657 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb82c15ec00 0x7fb82c0b8b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:25.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.482+0000 7fb823fff640 1 -- 172.21.15.55:0/3042210657 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb82c0b3860 msgr2=0x7fb82c159f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:25.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.482+0000 7fb823fff640 1 --2- 172.21.15.55:0/3042210657 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb82c0b3860 0x7fb82c159f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:25.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.482+0000 7fb823fff640 1 -- 172.21.15.55:0/3042210657 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb82c15ec00 msgr2=0x7fb82c0b8b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:25.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.482+0000 7fb823fff640 1 --2- 172.21.15.55:0/3042210657 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb82c15ec00 0x7fb82c0b8b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:25.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.482+0000 7fb823fff640 1 -- 172.21.15.55:0/3042210657 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb82c1e8f90 con 0x7fb82c0b6370 2024-05-27T12:33:25.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.482+0000 7fb823fff640 1 --2- 172.21.15.55:0/3042210657 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb82c0b6370 0x7fb82c1e8620 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fb81400c430 tx=0x7fb81400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:25.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.482+0000 7fb8237fe640 1 -- 172.21.15.55:0/3042210657 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8140052d0 con 0x7fb82c0b6370 2024-05-27T12:33:25.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.482+0000 7fb8237fe640 1 -- 172.21.15.55:0/3042210657 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb814005490 con 0x7fb82c0b6370 2024-05-27T12:33:25.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.482+0000 7fb83174f640 1 -- 172.21.15.55:0/3042210657 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb82c1e9270 con 0x7fb82c0b6370 2024-05-27T12:33:25.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.482+0000 7fb8237fe640 1 -- 172.21.15.55:0/3042210657 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb814007260 con 0x7fb82c0b6370 2024-05-27T12:33:25.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.482+0000 7fb83174f640 1 -- 172.21.15.55:0/3042210657 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb82c15f950 con 0x7fb82c0b6370 2024-05-27T12:33:25.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.483+0000 7fb83174f640 1 -- 172.21.15.55:0/3042210657 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb82c06db20 con 0x7fb82c0b6370 2024-05-27T12:33:25.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.484+0000 7fb8237fe640 1 -- 172.21.15.55:0/3042210657 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb814007400 con 0x7fb82c0b6370 2024-05-27T12:33:25.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.484+0000 7fb8237fe640 1 --2- 172.21.15.55:0/3042210657 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fb80c06c8f0 0x7fb80c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:25.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.485+0000 7fb8237fe640 1 -- 172.21.15.55:0/3042210657 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7fb81408b040 con 0x7fb82c0b6370 2024-05-27T12:33:25.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.485+0000 7fb82affd640 1 --2- 172.21.15.55:0/3042210657 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fb80c06c8f0 0x7fb80c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:25.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.485+0000 7fb82affd640 1 --2- 172.21.15.55:0/3042210657 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fb80c06c8f0 0x7fb80c06edb0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fb81c009aa0 tx=0x7fb81c009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:25.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.489+0000 7fb8237fe640 1 -- 172.21.15.55:0/3042210657 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb82c06db20 con 0x7fb82c0b6370 2024-05-27T12:33:25.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.675+0000 7fb83174f640 1 -- 172.21.15.55:0/3042210657 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb82c075460 con 0x7fb82c0b6370 2024-05-27T12:33:25.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.676+0000 7fb8237fe640 1 -- 172.21.15.55:0/3042210657 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+16805 (secure 0 0 0) 0x7fb814058da0 con 0x7fb82c0b6370 2024-05-27T12:33:25.676 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-27T12:33:25.676 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":25,"fsid":"c3ff4e3b-8dae-4856-9593-e5cc66c59982","created":"2024-05-27T12:32:17.019097+0000","modified":"2024-05-27T12:33:22.578415+0000","last_up_change":"2024-05-27T12:32:28.109744+0000","last_in_change":"2024-05-27T12:32:19.309872+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-27T12:32:29.277895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-27T12:32:39.442745+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-27T12:32:40.672118+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e607b598-061b-4b6f-92ff-95c20b330599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":807572567},{"type":"v1","addr":"172.21.15.55:6801","nonce":807572567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":807572567},{"type":"v1","addr":"172.21.15.55:6803","nonce":807572567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":807572567},{"type":"v1","addr":"172.21.15.55:6807","nonce":807572567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":807572567},{"type":"v1","addr":"172.21.15.55:6805","nonce":807572567}]},"public_addr":"172.21.15.55:6801/807572567","cluster_addr":"172.21.15.55:6803/807572567","heartbeat_back_addr":"172.21.15.55:6807/807572567","heartbeat_front_addr":"172.21.15.55:6805/807572567","state":["exists","up"]},{"osd":1,"uuid":"ba2b5b1d-71a9-4ecc-9a48-55aa7fe54261","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":3426897300},{"type":"v1","addr":"172.21.15.55:6825","nonce":3426897300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":3426897300},{"type":"v1","addr":"172.21.15.55:6827","nonce":3426897300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":3426897300},{"type":"v1","addr":"172.21.15.55:6831","nonce":3426897300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":3426897300},{"type":"v1","addr":"172.21.15.55:6829","nonce":3426897300}]},"public_addr":"172.21.15.55:6825/3426897300","cluster_addr":"172.21.15.55:6827/3426897300","heartbeat_back_addr":"172.21.15.55:6831/3426897300","heartbeat_front_addr":"172.21.15.55:6829/3426897300","state":["exists","up"]},{"osd":2,"uuid":"e6b81cc6-4ff1-45d0-87eb-9f04ccf986a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3510271725},{"type":"v1","addr":"172.21.15.55:6809","nonce":3510271725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3510271725},{"type":"v1","addr":"172.21.15.55:6811","nonce":3510271725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3510271725},{"type":"v1","addr":"172.21.15.55:6815","nonce":3510271725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3510271725},{"type":"v1","addr":"172.21.15.55:6813","nonce":3510271725}]},"public_addr":"172.21.15.55:6809/3510271725","cluster_addr":"172.21.15.55:6811/3510271725","heartbeat_back_addr":"172.21.15.55:6815/3510271725","heartbeat_front_addr":"172.21.15.55:6813/3510271725","state":["exists","up"]},{"osd":3,"uuid":"b6a34b75-807d-4693-b1c3-903cb4c618d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":1066693520},{"type":"v1","addr":"172.21.15.55:6817","nonce":1066693520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":1066693520},{"type":"v1","addr":"172.21.15.55:6819","nonce":1066693520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":1066693520},{"type":"v1","addr":"172.21.15.55:6823","nonce":1066693520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":1066693520},{"type":"v1","addr":"172.21.15.55:6821","nonce":1066693520}]},"public_addr":"172.21.15.55:6817/1066693520","cluster_addr":"172.21.15.55:6819/1066693520","heartbeat_back_addr":"172.21.15.55:6823/1066693520","heartbeat_front_addr":"172.21.15.55:6821/1066693520","state":["exists","up"]},{"osd":4,"uuid":"272ec937-56b4-4f0a-b2e1-b0bc189c9d79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":4190771237},{"type":"v1","addr":"172.21.15.72:6820","nonce":4190771237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":4190771237},{"type":"v1","addr":"172.21.15.72:6824","nonce":4190771237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":4190771237},{"type":"v1","addr":"172.21.15.72:6831","nonce":4190771237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":4190771237},{"type":"v1","addr":"172.21.15.72:6828","nonce":4190771237}]},"public_addr":"172.21.15.72:6820/4190771237","cluster_addr":"172.21.15.72:6824/4190771237","heartbeat_back_addr":"172.21.15.72:6831/4190771237","heartbeat_front_addr":"172.21.15.72:6828/4190771237","state":["exists","up"]},{"osd":5,"uuid":"56439854-72a0-4ef4-81ff-184a3d924a5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":2421889184},{"type":"v1","addr":"172.21.15.72:6801","nonce":2421889184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6803","nonce":2421889184},{"type":"v1","addr":"172.21.15.72:6805","nonce":2421889184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":2421889184},{"type":"v1","addr":"172.21.15.72:6813","nonce":2421889184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6807","nonce":2421889184},{"type":"v1","addr":"172.21.15.72:6809","nonce":2421889184}]},"public_addr":"172.21.15.72:6801/2421889184","cluster_addr":"172.21.15.72:6805/2421889184","heartbeat_back_addr":"172.21.15.72:6813/2421889184","heartbeat_front_addr":"172.21.15.72:6809/2421889184","state":["exists","up"]},{"osd":6,"uuid":"e248e2be-3b6e-49cf-8c8a-1a4152827582","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3796994599},{"type":"v1","addr":"172.21.15.72:6804","nonce":3796994599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":3796994599},{"type":"v1","addr":"172.21.15.72:6808","nonce":3796994599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":3796994599},{"type":"v1","addr":"172.21.15.72:6815","nonce":3796994599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":3796994599},{"type":"v1","addr":"172.21.15.72:6812","nonce":3796994599}]},"public_addr":"172.21.15.72:6804/3796994599","cluster_addr":"172.21.15.72:6808/3796994599","heartbeat_back_addr":"172.21.15.72:6815/3796994599","heartbeat_front_addr":"172.21.15.72:6812/3796994599","state":["exists","up"]},{"osd":7,"uuid":"505a62d3-322b-4629-b4fd-187a55563709","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":3024877895},{"type":"v1","addr":"172.21.15.72:6817","nonce":3024877895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":3024877895},{"type":"v1","addr":"172.21.15.72:6821","nonce":3024877895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6827","nonce":3024877895},{"type":"v1","addr":"172.21.15.72:6829","nonce":3024877895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6823","nonce":3024877895},{"type":"v1","addr":"172.21.15.72:6825","nonce":3024877895}]},"public_addr":"172.21.15.72:6817/3024877895","cluster_addr":"172.21.15.72:6821/3024877895","heartbeat_back_addr":"172.21.15.72:6829/3024877895","heartbeat_front_addr":"172.21.15.72:6825/3024877895","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.241014+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.450799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.465018+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.507647+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.534763+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.495895+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.427110+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.547466+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.b","mappings":[{"from":3,"to":1}]},{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.12","mappings":[{"from":0,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-27T12:33:25.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.678+0000 7fb83174f640 1 -- 172.21.15.55:0/3042210657 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fb80c06c8f0 msgr2=0x7fb80c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:25.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.678+0000 7fb83174f640 1 --2- 172.21.15.55:0/3042210657 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fb80c06c8f0 0x7fb80c06edb0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fb81c009aa0 tx=0x7fb81c009190 comp rx=0 tx=0).stop 2024-05-27T12:33:25.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.678+0000 7fb83174f640 1 -- 172.21.15.55:0/3042210657 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb82c0b6370 msgr2=0x7fb82c1e8620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:25.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.678+0000 7fb83174f640 1 --2- 172.21.15.55:0/3042210657 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb82c0b6370 0x7fb82c1e8620 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fb81400c430 tx=0x7fb81400c8f0 comp rx=0 tx=0).stop 2024-05-27T12:33:25.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.678+0000 7fb83174f640 1 -- 172.21.15.55:0/3042210657 shutdown_connections 2024-05-27T12:33:25.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.678+0000 7fb83174f640 1 --2- 172.21.15.55:0/3042210657 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fb80c06c8f0 0x7fb80c06edb0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:25.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.678+0000 7fb83174f640 1 --2- 172.21.15.55:0/3042210657 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb82c15ec00 0x7fb82c0b8b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:25.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.678+0000 7fb83174f640 1 --2- 172.21.15.55:0/3042210657 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb82c0b6370 0x7fb82c1e8620 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:25.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.678+0000 7fb83174f640 1 --2- 172.21.15.55:0/3042210657 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb82c0b3860 0x7fb82c159f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:25.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.678+0000 7fb83174f640 1 -- 172.21.15.55:0/3042210657 >> 172.21.15.55:0/3042210657 conn(0x7fb82c0d1370 msgr2=0x7fb82c0d3cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:25.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.678+0000 7fb83174f640 1 -- 172.21.15.55:0/3042210657 shutdown_connections 2024-05-27T12:33:25.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.678+0000 7fb83174f640 1 -- 172.21.15.55:0/3042210657 wait complete. 2024-05-27T12:33:25.689 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-27T12:33:25.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.794+0000 7f256d576640 1 Processor -- start 2024-05-27T12:33:25.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.794+0000 7f256d576640 1 -- start start 2024-05-27T12:33:25.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.795+0000 7f256d576640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f25680b64e0 0x7f25680b7920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:25.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.795+0000 7f256d576640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f25680b35e0 0x7f25680d1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:25.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.795+0000 7f256d576640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25680cff20 con 0x7f25680b68c0 2024-05-27T12:33:25.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.795+0000 7f256d576640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f25680b3df0 con 0x7f25680b35e0 2024-05-27T12:33:25.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.795+0000 7f256d576640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f25680cf960 con 0x7f25680b64e0 2024-05-27T12:33:25.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.795+0000 7f25677fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f25680b35e0 0x7f25680d1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:25.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.795+0000 7f25677fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f25680b35e0 0x7f25680d1da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33258/0 (socket says 172.21.15.55:33258) 2024-05-27T12:33:25.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.795+0000 7f25677fe640 1 -- 172.21.15.55:0/3320846470 learned_addr learned my addr 172.21.15.55:0/3320846470 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:33:25.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.795+0000 7f25667fc640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f25680b68c0 0x7f2568161b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:50300/0 (socket says 172.21.15.55:50300) 2024-05-27T12:33:25.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.795+0000 7f2566ffd640 1 --2- 172.21.15.55:0/3320846470 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f25680b64e0 0x7f25680b7920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:25.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.796+0000 7f25677fe640 1 -- 172.21.15.55:0/3320846470 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f25680b64e0 msgr2=0x7f25680b7920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:25.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.796+0000 7f25677fe640 1 --2- 172.21.15.55:0/3320846470 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f25680b64e0 0x7f25680b7920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:25.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.796+0000 7f25677fe640 1 -- 172.21.15.55:0/3320846470 >> v1:172.21.15.55:6789/0 conn(0x7f25680b68c0 legacy=0x7f2568161b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:25.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.796+0000 7f25677fe640 1 -- 172.21.15.55:0/3320846470 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25680cfc40 con 0x7f25680b35e0 2024-05-27T12:33:25.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.796+0000 7f2565ffb640 1 -- 172.21.15.55:0/3320846470 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1358222696 0 0) 0x7f25680cff20 con 0x7f25680b68c0 2024-05-27T12:33:25.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.796+0000 7f2566ffd640 1 --2- 172.21.15.55:0/3320846470 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f25680b64e0 0x7f25680b7920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T12:33:25.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.796+0000 7f25677fe640 1 --2- 172.21.15.55:0/3320846470 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25680b35e0 0x7f25680d1da0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f2560009870 tx=0x7f256002a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1be4af3595c3a5e0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:25.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.796+0000 7f2565ffb640 1 -- 172.21.15.55:0/3320846470 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2560037070 con 0x7f25680b35e0 2024-05-27T12:33:25.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.796+0000 7f2565ffb640 1 -- 172.21.15.55:0/3320846470 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2560032440 con 0x7f25680b35e0 2024-05-27T12:33:25.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.796+0000 7f2565ffb640 1 -- 172.21.15.55:0/3320846470 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2560032810 con 0x7f25680b35e0 2024-05-27T12:33:25.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.797+0000 7f256d576640 1 -- 172.21.15.55:0/3320846470 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25680b35e0 msgr2=0x7f25680d1da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:25.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.797+0000 7f256d576640 1 --2- 172.21.15.55:0/3320846470 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25680b35e0 0x7f25680d1da0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f2560009870 tx=0x7f256002a1c0 comp rx=0 tx=0).stop 2024-05-27T12:33:25.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.797+0000 7f256d576640 1 -- 172.21.15.55:0/3320846470 shutdown_connections 2024-05-27T12:33:25.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.797+0000 7f256d576640 1 --2- 172.21.15.55:0/3320846470 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25680b35e0 0x7f25680d1da0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:25.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.797+0000 7f256d576640 1 --2- 172.21.15.55:0/3320846470 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f25680b64e0 0x7f25680b7920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:25.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.797+0000 7f256d576640 1 -- 172.21.15.55:0/3320846470 >> 172.21.15.55:0/3320846470 conn(0x7f2568067a50 msgr2=0x7f2568067e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:25.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.797+0000 7f256d576640 1 -- 172.21.15.55:0/3320846470 shutdown_connections 2024-05-27T12:33:25.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.797+0000 7f256d576640 1 -- 172.21.15.55:0/3320846470 wait complete. 2024-05-27T12:33:25.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.798+0000 7f256d576640 1 Processor -- start 2024-05-27T12:33:25.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.798+0000 7f256d576640 1 -- start start 2024-05-27T12:33:25.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.799+0000 7f256d576640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f25680b35e0 0x7f25680cd390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:25.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.799+0000 7f256d576640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25680b64e0 0x7f25680cb8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:25.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.799+0000 7f256d576640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25680b68c0 0x7f25681f7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:25.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.799+0000 7f256d576640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f25681623f0 con 0x7f25680b68c0 2024-05-27T12:33:25.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.799+0000 7f256d576640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f2568162270 con 0x7f25680b64e0 2024-05-27T12:33:25.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.799+0000 7f256d576640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f2568162570 con 0x7f25680b35e0 2024-05-27T12:33:25.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.799+0000 7f25677fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25680b68c0 0x7f25681f7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:25.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.799+0000 7f25677fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25680b68c0 0x7f25681f7dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33262/0 (socket says 172.21.15.55:33262) 2024-05-27T12:33:25.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.799+0000 7f25677fe640 1 -- 172.21.15.55:0/4036724161 learned_addr learned my addr 172.21.15.55:0/4036724161 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:33:25.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.799+0000 7f2566ffd640 1 --2- 172.21.15.55:0/4036724161 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f25680b35e0 0x7f25680cd390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:25.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.799+0000 7f25667fc640 1 --2- 172.21.15.55:0/4036724161 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25680b64e0 0x7f25680cb8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:25.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.800+0000 7f25677fe640 1 -- 172.21.15.55:0/4036724161 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f25680b35e0 msgr2=0x7f25680cd390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:25.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.800+0000 7f25677fe640 1 --2- 172.21.15.55:0/4036724161 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f25680b35e0 0x7f25680cd390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:25.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.800+0000 7f25677fe640 1 -- 172.21.15.55:0/4036724161 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25680b64e0 msgr2=0x7f25680cb8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:25.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.800+0000 7f25677fe640 1 --2- 172.21.15.55:0/4036724161 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25680b64e0 0x7f25680cb8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:25.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.800+0000 7f25677fe640 1 -- 172.21.15.55:0/4036724161 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25680cc2f0 con 0x7f25680b68c0 2024-05-27T12:33:25.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.800+0000 7f25667fc640 1 --2- 172.21.15.55:0/4036724161 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25680b64e0 0x7f25680cb8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T12:33:25.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.800+0000 7f25677fe640 1 --2- 172.21.15.55:0/4036724161 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25680b68c0 0x7f25681f7dd0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f2560009870 tx=0x7f25600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:25.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.800+0000 7f255f7fe640 1 -- 172.21.15.55:0/4036724161 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2560037040 con 0x7f25680b68c0 2024-05-27T12:33:25.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.800+0000 7f255f7fe640 1 -- 172.21.15.55:0/4036724161 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2560042070 con 0x7f25680b68c0 2024-05-27T12:33:25.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.800+0000 7f256d576640 1 -- 172.21.15.55:0/4036724161 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25680cc5d0 con 0x7f25680b68c0 2024-05-27T12:33:25.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.800+0000 7f255f7fe640 1 -- 172.21.15.55:0/4036724161 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2560030920 con 0x7f25680b68c0 2024-05-27T12:33:25.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.800+0000 7f256d576640 1 -- 172.21.15.55:0/4036724161 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25680ccb90 con 0x7f25680b68c0 2024-05-27T12:33:25.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.801+0000 7f256d576640 1 -- 172.21.15.55:0/4036724161 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25680b9d50 con 0x7f25680b68c0 2024-05-27T12:33:25.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.801+0000 7f255f7fe640 1 -- 172.21.15.55:0/4036724161 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f256002ad10 con 0x7f25680b68c0 2024-05-27T12:33:25.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.802+0000 7f255f7fe640 1 --2- 172.21.15.55:0/4036724161 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f254806c8f0 0x7f254806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:25.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.802+0000 7f255f7fe640 1 -- 172.21.15.55:0/4036724161 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5825+0+0 (secure 0 0 0) 0x7f25600ac180 con 0x7f25680b68c0 2024-05-27T12:33:25.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.802+0000 7f2566ffd640 1 --2- 172.21.15.55:0/4036724161 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f254806c8f0 0x7f254806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:25.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.803+0000 7f2566ffd640 1 --2- 172.21.15.55:0/4036724161 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f254806c8f0 0x7f254806edb0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2558003fd0 tx=0x7f25580039f0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:25.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:25.806+0000 7f255f7fe640 1 -- 172.21.15.55:0/4036724161 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f25680b9d50 con 0x7f25680b68c0 2024-05-27T12:33:26.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:26.027+0000 7f256d576640 1 -- 172.21.15.55:0/4036724161 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f256815be90 con 0x7f25680b68c0 2024-05-27T12:33:26.027 INFO:tasks.ceph.mon.a.smithi055.stderr:2024-05-27T12:33:26.028+0000 7f66e8c3d640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-27T12:33:26.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:26.034+0000 7f255f7fe640 1 -- 172.21.15.55:0/4036724161 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v7) ==== 161+0+0 (secure 0 0 0) 0x7f2560079ee0 con 0x7f25680b68c0 2024-05-27T12:33:26.033 INFO:teuthology.orchestra.run.smithi055.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-27T12:33:26.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:26.036+0000 7f256d576640 1 -- 172.21.15.55:0/4036724161 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f254806c8f0 msgr2=0x7f254806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:26.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:26.036+0000 7f256d576640 1 --2- 172.21.15.55:0/4036724161 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f254806c8f0 0x7f254806edb0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2558003fd0 tx=0x7f25580039f0 comp rx=0 tx=0).stop 2024-05-27T12:33:26.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:26.036+0000 7f256d576640 1 -- 172.21.15.55:0/4036724161 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25680b68c0 msgr2=0x7f25681f7dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:26.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:26.036+0000 7f256d576640 1 --2- 172.21.15.55:0/4036724161 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25680b68c0 0x7f25681f7dd0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f2560009870 tx=0x7f25600046c0 comp rx=0 tx=0).stop 2024-05-27T12:33:26.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:26.036+0000 7f256d576640 1 -- 172.21.15.55:0/4036724161 shutdown_connections 2024-05-27T12:33:26.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:26.036+0000 7f256d576640 1 --2- 172.21.15.55:0/4036724161 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25680b68c0 0x7f25681f7dd0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:26.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:26.036+0000 7f256d576640 1 --2- 172.21.15.55:0/4036724161 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f254806c8f0 0x7f254806edb0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:26.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:26.036+0000 7f256d576640 1 --2- 172.21.15.55:0/4036724161 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25680b64e0 0x7f25680cb8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:26.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:26.036+0000 7f256d576640 1 --2- 172.21.15.55:0/4036724161 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f25680b35e0 0x7f25680cd390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:26.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:26.036+0000 7f256d576640 1 -- 172.21.15.55:0/4036724161 >> 172.21.15.55:0/4036724161 conn(0x7f2568067a50 msgr2=0x7f25680d5060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:26.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:26.036+0000 7f256d576640 1 -- 172.21.15.55:0/4036724161 shutdown_connections 2024-05-27T12:33:26.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:26.036+0000 7f256d576640 1 -- 172.21.15.55:0/4036724161 wait complete. 2024-05-27T12:33:26.041 INFO:tasks.ceph.mds.b.smithi072.stderr: -7540> 2024-05-27T12:32:45.901+0000 7f87a288a640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-27T12:33:26.047 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-05-27T12:33:26.075 INFO:tasks.ceph.mds.b.smithi072.stdout:starting mds.b at 2024-05-27T12:33:26.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:26.154+0000 7f964fca7640 1 Processor -- start 2024-05-27T12:33:26.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:26.154+0000 7f964fca7640 1 -- start start 2024-05-27T12:33:26.155 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:26.155+0000 7f964fca7640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f964815cb20 0x7f96480d12e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:26.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:26.155+0000 7f964fca7640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f964809b790 con 0x7f96480b1f90 2024-05-27T12:33:26.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:26.155+0000 7f964fca7640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f964809ba70 con 0x7f96480b2400 2024-05-27T12:33:26.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:26.155+0000 7f964fca7640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f964809bd50 con 0x7f964815cb20 2024-05-27T12:33:26.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:26.155+0000 7f964da43640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f964815cb20 0x7f96480d12e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:26.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:26.155+0000 7f964d242640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f96480b1f90 0x7f96480cdb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:50302/0 (socket says 172.21.15.55:50302) 2024-05-27T12:33:26.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:26.155+0000 7f964d242640 1 -- 172.21.15.55:0/3934806793 learned_addr learned my addr 172.21.15.55:0/3934806793 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-27T12:33:26.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:26.155+0000 7f964da43640 1 -- 172.21.15.55:0/3934806793 >> v1:172.21.15.72:6789/0 conn(0x7f96480b2400 legacy=0x7f96481604e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:26.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:26.156+0000 7f964da43640 1 -- 172.21.15.55:0/3934806793 >> v1:172.21.15.55:6789/0 conn(0x7f96480b1f90 legacy=0x7f96480cdb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:26.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:26.156+0000 7f964da43640 1 -- 172.21.15.55:0/3934806793 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96480cd320 con 0x7f964815cb20 2024-05-27T12:33:26.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:26.156+0000 7f964ca41640 1 -- 172.21.15.55:0/3934806793 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1047756936 0 0) 0x7f964809b790 con 0x7f96480b1f90 2024-05-27T12:33:26.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:26.156+0000 7f964da43640 1 --2- 172.21.15.55:0/3934806793 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f964815cb20 0x7f96480d12e0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f96400097a0 tx=0x7f964002a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21095ea25822e603 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:26.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:26.156+0000 7f964ca41640 1 -- 172.21.15.55:0/3934806793 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9640037070 con 0x7f964815cb20 2024-05-27T12:33:26.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:26.156+0000 7f964ca41640 1 -- 172.21.15.55:0/3934806793 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f964002adc0 con 0x7f964815cb20 2024-05-27T12:33:26.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:26.156+0000 7f964ca41640 1 -- 172.21.15.55:0/3934806793 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9640032660 con 0x7f964815cb20 2024-05-27T12:33:26.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:26.157+0000 7f964fca7640 1 -- 172.21.15.55:0/3934806793 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f964815cb20 msgr2=0x7f96480d12e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:26.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:26.157+0000 7f964fca7640 1 --2- 172.21.15.55:0/3934806793 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f964815cb20 0x7f96480d12e0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f96400097a0 tx=0x7f964002a0b0 comp rx=0 tx=0).stop 2024-05-27T12:33:26.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:26.157+0000 7f964fca7640 1 -- 172.21.15.55:0/3934806793 shutdown_connections 2024-05-27T12:33:26.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:26.157+0000 7f964fca7640 1 --2- 172.21.15.55:0/3934806793 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f964815cb20 0x7f96480d12e0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:26.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:26.157+0000 7f964fca7640 1 -- 172.21.15.55:0/3934806793 >> 172.21.15.55:0/3934806793 conn(0x7f96480b4160 msgr2=0x7f96480b4570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:26.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:26.157+0000 7f964fca7640 1 -- 172.21.15.55:0/3934806793 shutdown_connections 2024-05-27T12:33:26.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:26.157+0000 7f964fca7640 1 -- 172.21.15.55:0/3934806793 wait complete. 2024-05-27T12:33:26.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:26.158+0000 7f964fca7640 1 Processor -- start 2024-05-27T12:33:26.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:26.158+0000 7f964fca7640 1 -- start start 2024-05-27T12:33:26.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:26.159+0000 7f964fca7640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96480b1f90 0x7f9648150b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:26.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:26.159+0000 7f964fca7640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f96480b2400 0x7f964815cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:26.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:26.159+0000 7f964fca7640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f964815cb20 0x7f964815d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:26.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:26.159+0000 7f964fca7640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f96480ce3b0 con 0x7f96480b1f90 2024-05-27T12:33:26.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:26.159+0000 7f964fca7640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f96480ce230 con 0x7f964815cb20 2024-05-27T12:33:26.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:26.159+0000 7f964fca7640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f96480ce530 con 0x7f96480b2400 2024-05-27T12:33:26.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:26.159+0000 7f964da43640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96480b1f90 0x7f9648150b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:26.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:26.159+0000 7f964da43640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96480b1f90 0x7f9648150b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33274/0 (socket says 172.21.15.55:33274) 2024-05-27T12:33:26.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:26.159+0000 7f964da43640 1 -- 172.21.15.55:0/2814778038 learned_addr learned my addr 172.21.15.55:0/2814778038 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:33:26.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:26.159+0000 7f964d242640 1 --2- 172.21.15.55:0/2814778038 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f96480b2400 0x7f964815cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:26.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:26.159+0000 7f964e244640 1 --2- 172.21.15.55:0/2814778038 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f964815cb20 0x7f964815d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:26.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:26.159+0000 7f964da43640 1 -- 172.21.15.55:0/2814778038 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f96480b2400 msgr2=0x7f964815cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:26.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:26.159+0000 7f964da43640 1 --2- 172.21.15.55:0/2814778038 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f96480b2400 0x7f964815cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:26.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:26.159+0000 7f964da43640 1 -- 172.21.15.55:0/2814778038 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f964815cb20 msgr2=0x7f964815d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:26.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:26.159+0000 7f964da43640 1 --2- 172.21.15.55:0/2814778038 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f964815cb20 0x7f964815d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:26.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:26.159+0000 7f964da43640 1 -- 172.21.15.55:0/2814778038 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f964815fd40 con 0x7f96480b1f90 2024-05-27T12:33:26.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:26.160+0000 7f964da43640 1 --2- 172.21.15.55:0/2814778038 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96480b1f90 0x7f9648150b60 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f96400097a0 tx=0x7f96400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:26.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:26.160+0000 7f96467fc640 1 -- 172.21.15.55:0/2814778038 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9640041070 con 0x7f96480b1f90 2024-05-27T12:33:26.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:26.160+0000 7f96467fc640 1 -- 172.21.15.55:0/2814778038 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f964003c670 con 0x7f96480b1f90 2024-05-27T12:33:26.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:26.160+0000 7f964fca7640 1 -- 172.21.15.55:0/2814778038 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96480c6d60 con 0x7f96480b1f90 2024-05-27T12:33:26.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:26.160+0000 7f96467fc640 1 -- 172.21.15.55:0/2814778038 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9640037040 con 0x7f96480b1f90 2024-05-27T12:33:26.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:26.160+0000 7f964fca7640 1 -- 172.21.15.55:0/2814778038 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96480c7320 con 0x7f96480b1f90 2024-05-27T12:33:26.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:26.161+0000 7f964fca7640 1 -- 172.21.15.55:0/2814778038 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9648070790 con 0x7f96480b1f90 2024-05-27T12:33:26.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:26.161+0000 7f96467fc640 1 -- 172.21.15.55:0/2814778038 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9640044070 con 0x7f96480b1f90 2024-05-27T12:33:26.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:26.162+0000 7f96467fc640 1 --2- 172.21.15.55:0/2814778038 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f963406c920 0x7f963406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:26.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:26.162+0000 7f96467fc640 1 -- 172.21.15.55:0/2814778038 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 5911+0+0 (secure 0 0 0) 0x7f96400ac300 con 0x7f96480b1f90 2024-05-27T12:33:26.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:26.162+0000 7f964d242640 1 --2- 172.21.15.55:0/2814778038 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f963406c920 0x7f963406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:26.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:26.162+0000 7f964d242640 1 --2- 172.21.15.55:0/2814778038 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f963406c920 0x7f963406ede0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f96480cc740 tx=0x7f963c007de0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:26.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:26.166+0000 7f96467fc640 1 -- 172.21.15.55:0/2814778038 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9648070790 con 0x7f96480b1f90 2024-05-27T12:33:26.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:26.397+0000 7f964fca7640 1 -- 172.21.15.55:0/2814778038 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f9648068a70 con 0x7f96480b1f90 2024-05-27T12:33:27.038 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:27.040+0000 7f96467fc640 1 -- 172.21.15.55:0/2814778038 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v8) ==== 104+0+0 (secure 0 0 0) 0x7f964007a010 con 0x7f96480b1f90 2024-05-27T12:33:27.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:27.042+0000 7f964fca7640 1 -- 172.21.15.55:0/2814778038 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f963406c920 msgr2=0x7f963406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:27.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:27.042+0000 7f964fca7640 1 --2- 172.21.15.55:0/2814778038 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f963406c920 0x7f963406ede0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f96480cc740 tx=0x7f963c007de0 comp rx=0 tx=0).stop 2024-05-27T12:33:27.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:27.042+0000 7f964fca7640 1 -- 172.21.15.55:0/2814778038 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96480b1f90 msgr2=0x7f9648150b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:27.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:27.042+0000 7f964fca7640 1 --2- 172.21.15.55:0/2814778038 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96480b1f90 0x7f9648150b60 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f96400097a0 tx=0x7f96400046c0 comp rx=0 tx=0).stop 2024-05-27T12:33:27.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:27.042+0000 7f964fca7640 1 -- 172.21.15.55:0/2814778038 shutdown_connections 2024-05-27T12:33:27.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:27.042+0000 7f964fca7640 1 --2- 172.21.15.55:0/2814778038 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f963406c920 0x7f963406ede0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:27.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:27.042+0000 7f964fca7640 1 --2- 172.21.15.55:0/2814778038 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f964815cb20 0x7f964815d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:27.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:27.042+0000 7f964fca7640 1 --2- 172.21.15.55:0/2814778038 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f96480b2400 0x7f964815cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:27.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:27.042+0000 7f964fca7640 1 --2- 172.21.15.55:0/2814778038 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96480b1f90 0x7f9648150b60 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:27.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:27.042+0000 7f964fca7640 1 -- 172.21.15.55:0/2814778038 >> 172.21.15.55:0/2814778038 conn(0x7f96480b4160 msgr2=0x7f9648070080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:27.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:27.042+0000 7f964fca7640 1 -- 172.21.15.55:0/2814778038 shutdown_connections 2024-05-27T12:33:27.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:27.042+0000 7f964fca7640 1 -- 172.21.15.55:0/2814778038 wait complete. 2024-05-27T12:33:27.054 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-05-27T12:33:27.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:27.169+0000 7f8406059640 1 Processor -- start 2024-05-27T12:33:27.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:27.169+0000 7f8406059640 1 -- start start 2024-05-27T12:33:27.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:27.169+0000 7f8406059640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f84000d12e0 0x7f84000cdb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:27.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:27.169+0000 7f8406059640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f84000ce060 0x7f84001604e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:27.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:27.169+0000 7f8406059640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f840009b790 con 0x7f840015cb20 2024-05-27T12:33:27.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:27.169+0000 7f8406059640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f84000b26a0 con 0x7f84000d12e0 2024-05-27T12:33:27.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:27.169+0000 7f8406059640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f840009ba70 con 0x7f84000ce060 2024-05-27T12:33:27.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:27.170+0000 7f83f6ffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f84000d12e0 0x7f84000cdb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:27.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:27.170+0000 7f83ff7fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f840015cb20 0x7f84000b1f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:50318/0 (socket says 172.21.15.55:50318) 2024-05-27T12:33:27.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:27.170+0000 7f83f6ffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f84000d12e0 0x7f84000cdb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33278/0 (socket says 172.21.15.55:33278) 2024-05-27T12:33:27.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:27.170+0000 7f83ff7fe640 1 -- 172.21.15.55:0/3612618578 learned_addr learned my addr 172.21.15.55:0/3612618578 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-27T12:33:27.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:27.170+0000 7f83fffff640 1 --2- 172.21.15.55:0/3612618578 >> v2:172.21.15.72:3300/0 conn(0x7f84000ce060 0x7f84001604e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:27.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:27.170+0000 7f83f6ffd640 1 -- 172.21.15.55:0/3612618578 >> v2:172.21.15.72:3300/0 conn(0x7f84000ce060 msgr2=0x7f84001604e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:27.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:27.170+0000 7f83f6ffd640 1 --2- 172.21.15.55:0/3612618578 >> v2:172.21.15.72:3300/0 conn(0x7f84000ce060 0x7f84001604e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:27.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:27.170+0000 7f83f6ffd640 1 -- 172.21.15.55:0/3612618578 >> v1:172.21.15.55:6789/0 conn(0x7f840015cb20 legacy=0x7f84000b1f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:27.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:27.170+0000 7f83feffd640 1 -- 172.21.15.55:0/3612618578 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 709231798 0 0) 0x7f840009b790 con 0x7f840015cb20 2024-05-27T12:33:27.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:27.170+0000 7f83f6ffd640 1 -- 172.21.15.55:0/3612618578 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f840009bd50 con 0x7f84000d12e0 2024-05-27T12:33:27.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:27.171+0000 7f83f6ffd640 1 --2- 172.21.15.55:0/3612618578 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84000d12e0 0x7f84000cdb20 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f8400073da0 tx=0x7f83e802a080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5f662f44dded214 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:27.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:27.171+0000 7f83feffd640 1 -- 172.21.15.55:0/3612618578 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83e8037070 con 0x7f84000d12e0 2024-05-27T12:33:27.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:27.171+0000 7f83feffd640 1 -- 172.21.15.55:0/3612618578 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83e802add0 con 0x7f84000d12e0 2024-05-27T12:33:27.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:27.171+0000 7f83feffd640 1 -- 172.21.15.55:0/3612618578 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83e8032660 con 0x7f84000d12e0 2024-05-27T12:33:27.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:27.171+0000 7f8406059640 1 -- 172.21.15.55:0/3612618578 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84000d12e0 msgr2=0x7f84000cdb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:27.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:27.171+0000 7f8406059640 1 --2- 172.21.15.55:0/3612618578 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84000d12e0 0x7f84000cdb20 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f8400073da0 tx=0x7f83e802a080 comp rx=0 tx=0).stop 2024-05-27T12:33:27.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:27.172+0000 7f8406059640 1 -- 172.21.15.55:0/3612618578 shutdown_connections 2024-05-27T12:33:27.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:27.172+0000 7f8406059640 1 --2- 172.21.15.55:0/3612618578 >> v2:172.21.15.72:3300/0 conn(0x7f84000ce060 0x7f84001604e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:27.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:27.172+0000 7f8406059640 1 --2- 172.21.15.55:0/3612618578 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84000d12e0 0x7f84000cdb20 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:27.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:27.172+0000 7f8406059640 1 -- 172.21.15.55:0/3612618578 >> 172.21.15.55:0/3612618578 conn(0x7f84000b4160 msgr2=0x7f84000b4570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:27.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:27.172+0000 7f8406059640 1 -- 172.21.15.55:0/3612618578 shutdown_connections 2024-05-27T12:33:27.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:27.172+0000 7f8406059640 1 -- 172.21.15.55:0/3612618578 wait complete. 2024-05-27T12:33:27.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:27.173+0000 7f8406059640 1 Processor -- start 2024-05-27T12:33:27.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:27.173+0000 7f8406059640 1 -- start start 2024-05-27T12:33:27.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:27.174+0000 7f8406059640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84000ce060 0x7f84000c5470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:27.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:27.174+0000 7f8406059640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f84000d12e0 0x7f8400155f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:27.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:27.174+0000 7f8406059640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f840015cb20 0x7f8400074bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:27.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:27.174+0000 7f8406059640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f840009b410 con 0x7f84000ce060 2024-05-27T12:33:27.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:27.174+0000 7f8406059640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f84000ce490 con 0x7f84000d12e0 2024-05-27T12:33:27.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:27.174+0000 7f8406059640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f8400160a20 con 0x7f840015cb20 2024-05-27T12:33:27.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:27.174+0000 7f83ff7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84000ce060 0x7f84000c5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:27.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:27.174+0000 7f83ff7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84000ce060 0x7f84000c5470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33282/0 (socket says 172.21.15.55:33282) 2024-05-27T12:33:27.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:27.174+0000 7f83ff7fe640 1 -- 172.21.15.55:0/565589090 learned_addr learned my addr 172.21.15.55:0/565589090 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:33:27.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:27.174+0000 7f83fffff640 1 --2- 172.21.15.55:0/565589090 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f840015cb20 0x7f8400074bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:27.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:27.174+0000 7f83f6ffd640 1 --2- 172.21.15.55:0/565589090 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f84000d12e0 0x7f8400155f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:27.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:27.174+0000 7f83ff7fe640 1 -- 172.21.15.55:0/565589090 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f840015cb20 msgr2=0x7f8400074bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:27.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:27.174+0000 7f83ff7fe640 1 --2- 172.21.15.55:0/565589090 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f840015cb20 0x7f8400074bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:27.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:27.174+0000 7f83ff7fe640 1 -- 172.21.15.55:0/565589090 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f84000d12e0 msgr2=0x7f8400155f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:27.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:27.174+0000 7f83ff7fe640 1 --2- 172.21.15.55:0/565589090 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f84000d12e0 0x7f8400155f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:27.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:27.174+0000 7f83ff7fe640 1 -- 172.21.15.55:0/565589090 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f840006e960 con 0x7f84000ce060 2024-05-27T12:33:27.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:27.174+0000 7f83fffff640 1 --2- 172.21.15.55:0/565589090 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f840015cb20 0x7f8400074bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T12:33:27.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:27.174+0000 7f83f6ffd640 1 --2- 172.21.15.55:0/565589090 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f84000d12e0 0x7f8400155f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T12:33:27.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:27.175+0000 7f83ff7fe640 1 --2- 172.21.15.55:0/565589090 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84000ce060 0x7f84000c5470 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f83f000c460 tx=0x7f83f000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:27.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:27.175+0000 7f83fcff9640 1 -- 172.21.15.55:0/565589090 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83f0018070 con 0x7f84000ce060 2024-05-27T12:33:27.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:27.175+0000 7f83fcff9640 1 -- 172.21.15.55:0/565589090 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83f0007500 con 0x7f84000ce060 2024-05-27T12:33:27.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:27.175+0000 7f8406059640 1 -- 172.21.15.55:0/565589090 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84001f5660 con 0x7f84000ce060 2024-05-27T12:33:27.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:27.175+0000 7f83fcff9640 1 -- 172.21.15.55:0/565589090 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83f0004a20 con 0x7f84000ce060 2024-05-27T12:33:27.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:27.175+0000 7f8406059640 1 -- 172.21.15.55:0/565589090 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8400155780 con 0x7f84000ce060 2024-05-27T12:33:27.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:27.176+0000 7f8406059640 1 -- 172.21.15.55:0/565589090 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8400068a70 con 0x7f84000ce060 2024-05-27T12:33:27.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:27.176+0000 7f83fcff9640 1 -- 172.21.15.55:0/565589090 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f83f001b070 con 0x7f84000ce060 2024-05-27T12:33:27.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:27.177+0000 7f83fcff9640 1 --2- 172.21.15.55:0/565589090 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f83e006c920 0x7f83e006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:27.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:27.177+0000 7f83fcff9640 1 -- 172.21.15.55:0/565589090 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 5911+0+0 (secure 0 0 0) 0x7f83f008ad80 con 0x7f84000ce060 2024-05-27T12:33:27.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:27.177+0000 7f83f6ffd640 1 --2- 172.21.15.55:0/565589090 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f83e006c920 0x7f83e006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:27.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:27.178+0000 7f83f6ffd640 1 --2- 172.21.15.55:0/565589090 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f83e006c920 0x7f83e006ede0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f83e8034000 tx=0x7f83e802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:27.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:27.181+0000 7f83fcff9640 1 -- 172.21.15.55:0/565589090 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f840006e960 con 0x7f84000ce060 2024-05-27T12:33:27.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:27.370+0000 7f8406059640 1 -- 172.21.15.55:0/565589090 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f840006e030 con 0x7f84000ce060 2024-05-27T12:33:28.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:28.051+0000 7f83fcff9640 1 -- 172.21.15.55:0/565589090 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v27) ==== 181+0+0 (secure 0 0 0) 0x7f83f0059170 con 0x7f84000ce060 2024-05-27T12:33:28.050 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_metadata' removed 2024-05-27T12:33:28.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:28.054+0000 7f8406059640 1 -- 172.21.15.55:0/565589090 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f83e006c920 msgr2=0x7f83e006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:28.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:28.054+0000 7f8406059640 1 --2- 172.21.15.55:0/565589090 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f83e006c920 0x7f83e006ede0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f83e8034000 tx=0x7f83e802e000 comp rx=0 tx=0).stop 2024-05-27T12:33:28.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:28.055+0000 7f8406059640 1 -- 172.21.15.55:0/565589090 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84000ce060 msgr2=0x7f84000c5470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:28.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:28.055+0000 7f8406059640 1 --2- 172.21.15.55:0/565589090 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84000ce060 0x7f84000c5470 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f83f000c460 tx=0x7f83f000c920 comp rx=0 tx=0).stop 2024-05-27T12:33:28.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:28.055+0000 7f8406059640 1 -- 172.21.15.55:0/565589090 shutdown_connections 2024-05-27T12:33:28.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:28.055+0000 7f8406059640 1 --2- 172.21.15.55:0/565589090 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f840015cb20 0x7f8400074bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:28.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:28.055+0000 7f8406059640 1 --2- 172.21.15.55:0/565589090 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f83e006c920 0x7f83e006ede0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:28.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:28.055+0000 7f8406059640 1 --2- 172.21.15.55:0/565589090 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f84000d12e0 0x7f8400155f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:28.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:28.055+0000 7f8406059640 1 --2- 172.21.15.55:0/565589090 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84000ce060 0x7f84000c5470 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:28.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:28.055+0000 7f8406059640 1 -- 172.21.15.55:0/565589090 >> 172.21.15.55:0/565589090 conn(0x7f84000b4160 msgr2=0x7f8400154be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:28.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:28.055+0000 7f8406059640 1 -- 172.21.15.55:0/565589090 shutdown_connections 2024-05-27T12:33:28.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:28.055+0000 7f8406059640 1 -- 172.21.15.55:0/565589090 wait complete. 2024-05-27T12:33:28.068 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-05-27T12:33:28.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:28.182+0000 7fc9c6ccb640 1 Processor -- start 2024-05-27T12:33:28.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:28.182+0000 7fc9c6ccb640 1 -- start start 2024-05-27T12:33:28.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:28.183+0000 7fc9c6ccb640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc9c00cfb40 0x7fc9c00d1830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:28.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:28.183+0000 7fc9c6ccb640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc9c00d1d70 0x7fc9c00b78f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:28.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:28.183+0000 7fc9c6ccb640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9c015eee0 con 0x7fc9c015eb00 2024-05-27T12:33:28.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:28.183+0000 7fc9c6ccb640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fc9c00d5700 con 0x7fc9c00d1d70 2024-05-27T12:33:28.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:28.183+0000 7fc9c6ccb640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fc9c00d21a0 con 0x7fc9c00cfb40 2024-05-27T12:33:28.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:28.183+0000 7fc9c4a67640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fc9c015eb00 0x7fc9c00d3e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:50334/0 (socket says 172.21.15.55:50334) 2024-05-27T12:33:28.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:28.183+0000 7fc9c4a67640 1 -- 172.21.15.55:0/4166942710 learned_addr learned my addr 172.21.15.55:0/4166942710 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-27T12:33:28.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:28.183+0000 7fc9bffff640 1 --2- 172.21.15.55:0/4166942710 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc9c00cfb40 0x7fc9c00d1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:28.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:28.183+0000 7fc9c5268640 1 --2- 172.21.15.55:0/4166942710 >> v2:172.21.15.72:3300/0 conn(0x7fc9c00d1d70 0x7fc9c00b78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:28.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:28.184+0000 7fc9bf7fe640 1 -- 172.21.15.55:0/4166942710 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2836628306 0 0) 0x7fc9c015eee0 con 0x7fc9c015eb00 2024-05-27T12:33:28.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:28.184+0000 7fc9bf7fe640 1 -- 172.21.15.55:0/4166942710 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc9ac003520 con 0x7fc9c015eb00 2024-05-27T12:33:28.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:28.184+0000 7fc9bf7fe640 1 -- 172.21.15.55:0/4166942710 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1095194823 0 0) 0x7fc9ac003520 con 0x7fc9c015eb00 2024-05-27T12:33:28.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:28.184+0000 7fc9bf7fe640 1 -- 172.21.15.55:0/4166942710 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc9c00cfb40 msgr2=0x7fc9c00d1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:28.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:28.184+0000 7fc9bf7fe640 1 --2- 172.21.15.55:0/4166942710 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc9c00cfb40 0x7fc9c00d1830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:28.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:28.184+0000 7fc9bf7fe640 1 -- 172.21.15.55:0/4166942710 >> v2:172.21.15.72:3300/0 conn(0x7fc9c00d1d70 msgr2=0x7fc9c00b78f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:28.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:28.184+0000 7fc9bf7fe640 1 --2- 172.21.15.55:0/4166942710 >> v2:172.21.15.72:3300/0 conn(0x7fc9c00d1d70 0x7fc9c00b78f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:28.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:28.184+0000 7fc9bf7fe640 1 -- 172.21.15.55:0/4166942710 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9c00d4660 con 0x7fc9c015eb00 2024-05-27T12:33:28.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:28.184+0000 7fc9bf7fe640 1 -- 172.21.15.55:0/4166942710 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 793017739 0 0) 0x7fc9b8001670 con 0x7fc9c015eb00 2024-05-27T12:33:28.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:28.184+0000 7fc9bf7fe640 1 -- 172.21.15.55:0/4166942710 >> v1:172.21.15.55:6789/0 conn(0x7fc9c015eb00 legacy=0x7fc9c00d3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:28.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:28.184+0000 7fc9bf7fe640 1 --2- 172.21.15.55:0/4166942710 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc9ac0039e0 0x7fc9ac003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:28.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:28.184+0000 7fc9bf7fe640 1 --2- 172.21.15.55:0/4166942710 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc9c00cfb40 0x7fc9ac004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:28.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:28.184+0000 7fc9bf7fe640 1 --2- 172.21.15.55:0/4166942710 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9ac004d40 0x7fc9ac0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:28.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:28.184+0000 7fc9bf7fe640 1 -- 172.21.15.55:0/4166942710 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7fc9c00d5700 con 0x7fc9ac004d40 2024-05-27T12:33:28.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:28.184+0000 7fc9bf7fe640 1 -- 172.21.15.55:0/4166942710 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fc9c00d21a0 con 0x7fc9ac0039e0 2024-05-27T12:33:28.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:28.184+0000 7fc9bf7fe640 1 -- 172.21.15.55:0/4166942710 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fc9ac00b9f0 con 0x7fc9c00cfb40 2024-05-27T12:33:28.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:28.184+0000 7fc9c5268640 1 --2- 172.21.15.55:0/4166942710 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9ac004d40 0x7fc9ac0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:28.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:28.184+0000 7fc9c4a67640 1 --2- 172.21.15.55:0/4166942710 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc9ac0039e0 0x7fc9ac003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:28.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:28.184+0000 7fc9bffff640 1 --2- 172.21.15.55:0/4166942710 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc9c00cfb40 0x7fc9ac004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:28.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:28.184+0000 7fc9c5268640 1 -- 172.21.15.55:0/4166942710 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc9c00cfb40 msgr2=0x7fc9ac004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:28.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:28.184+0000 7fc9c5268640 1 --2- 172.21.15.55:0/4166942710 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc9c00cfb40 0x7fc9ac004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:28.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:28.184+0000 7fc9c5268640 1 -- 172.21.15.55:0/4166942710 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc9ac0039e0 msgr2=0x7fc9ac003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:28.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:28.184+0000 7fc9c5268640 1 --2- 172.21.15.55:0/4166942710 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc9ac0039e0 0x7fc9ac003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:28.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:28.184+0000 7fc9c5268640 1 -- 172.21.15.55:0/4166942710 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9ac003520 con 0x7fc9ac004d40 2024-05-27T12:33:28.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:28.185+0000 7fc9c5268640 1 --2- 172.21.15.55:0/4166942710 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9ac004d40 0x7fc9ac0051c0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fc9a8009ac0 tx=0x7fc9ac005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f97ac8a4722dff17 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:28.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:28.185+0000 7fc9bf7fe640 1 -- 172.21.15.55:0/4166942710 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9a8036070 con 0x7fc9ac004d40 2024-05-27T12:33:28.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:28.185+0000 7fc9bf7fe640 1 -- 172.21.15.55:0/4166942710 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9a8031400 con 0x7fc9ac004d40 2024-05-27T12:33:28.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:28.185+0000 7fc9bf7fe640 1 -- 172.21.15.55:0/4166942710 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9a8009690 con 0x7fc9ac004d40 2024-05-27T12:33:28.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:28.186+0000 7fc9c6ccb640 1 -- 172.21.15.55:0/4166942710 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9ac004d40 msgr2=0x7fc9ac0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:28.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:28.186+0000 7fc9c6ccb640 1 --2- 172.21.15.55:0/4166942710 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9ac004d40 0x7fc9ac0051c0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fc9a8009ac0 tx=0x7fc9ac005830 comp rx=0 tx=0).stop 2024-05-27T12:33:28.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:28.186+0000 7fc9c5268640 1 -- 172.21.15.55:0/4166942710 reap_dead start 2024-05-27T12:33:28.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:28.186+0000 7fc9c6ccb640 1 -- 172.21.15.55:0/4166942710 shutdown_connections 2024-05-27T12:33:28.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:28.186+0000 7fc9c6ccb640 1 -- 172.21.15.55:0/4166942710 >> 172.21.15.55:0/4166942710 conn(0x7fc9c0067a50 msgr2=0x7fc9c0067e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:28.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:28.186+0000 7fc9c6ccb640 1 -- 172.21.15.55:0/4166942710 shutdown_connections 2024-05-27T12:33:28.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:28.186+0000 7fc9c6ccb640 1 -- 172.21.15.55:0/4166942710 wait complete. 2024-05-27T12:33:28.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:28.187+0000 7fc9c6ccb640 1 Processor -- start 2024-05-27T12:33:28.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:28.187+0000 7fc9c6ccb640 1 -- start start 2024-05-27T12:33:28.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:28.188+0000 7fc9c6ccb640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc9ac004d40 0x7fc9c0147280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:28.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:28.188+0000 7fc9c6ccb640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9c0149f50 0x7fc9c015f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:28.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:28.188+0000 7fc9c6ccb640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc9c014a3d0 0x7fc9c015f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:28.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:28.188+0000 7fc9c6ccb640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7fc9c00d4f00 con 0x7fc9c0149f50 2024-05-27T12:33:28.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:28.188+0000 7fc9c6ccb640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fc9c00d4c20 con 0x7fc9ac004d40 2024-05-27T12:33:28.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:28.188+0000 7fc9c6ccb640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fc9c00d51e0 con 0x7fc9c014a3d0 2024-05-27T12:33:28.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:28.188+0000 7fc9bffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9c0149f50 0x7fc9c015f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:28.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:28.188+0000 7fc9bffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9c0149f50 0x7fc9c015f0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33308/0 (socket says 172.21.15.55:33308) 2024-05-27T12:33:28.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:28.188+0000 7fc9bffff640 1 -- 172.21.15.55:0/713194648 learned_addr learned my addr 172.21.15.55:0/713194648 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:33:28.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:28.188+0000 7fc9c4a67640 1 --2- 172.21.15.55:0/713194648 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc9ac004d40 0x7fc9c0147280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:28.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:28.188+0000 7fc9c5268640 1 --2- 172.21.15.55:0/713194648 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc9c014a3d0 0x7fc9c015f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:28.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:28.188+0000 7fc9bffff640 1 -- 172.21.15.55:0/713194648 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc9c014a3d0 msgr2=0x7fc9c015f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:28.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:28.188+0000 7fc9bffff640 1 --2- 172.21.15.55:0/713194648 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc9c014a3d0 0x7fc9c015f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:28.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:28.188+0000 7fc9bffff640 1 -- 172.21.15.55:0/713194648 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc9ac004d40 msgr2=0x7fc9c0147280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:28.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:28.188+0000 7fc9bffff640 1 --2- 172.21.15.55:0/713194648 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc9ac004d40 0x7fc9c0147280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:28.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:28.188+0000 7fc9bffff640 1 -- 172.21.15.55:0/713194648 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9c00c8af0 con 0x7fc9c0149f50 2024-05-27T12:33:28.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:28.189+0000 7fc9bffff640 1 --2- 172.21.15.55:0/713194648 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9c0149f50 0x7fc9c015f0d0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fc9b0011e30 tx=0x7fc9b000f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:28.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:28.189+0000 7fc9bd7fa640 1 -- 172.21.15.55:0/713194648 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9b0015430 con 0x7fc9c0149f50 2024-05-27T12:33:28.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:28.189+0000 7fc9bd7fa640 1 -- 172.21.15.55:0/713194648 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9b00155d0 con 0x7fc9c0149f50 2024-05-27T12:33:28.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:28.189+0000 7fc9c6ccb640 1 -- 172.21.15.55:0/713194648 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9c01477c0 con 0x7fc9c0149f50 2024-05-27T12:33:28.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:28.189+0000 7fc9bd7fa640 1 -- 172.21.15.55:0/713194648 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9b00159a0 con 0x7fc9c0149f50 2024-05-27T12:33:28.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:28.189+0000 7fc9c6ccb640 1 -- 172.21.15.55:0/713194648 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9c0161530 con 0x7fc9c0149f50 2024-05-27T12:33:28.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:28.190+0000 7fc9c6ccb640 1 -- 172.21.15.55:0/713194648 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9c0068a70 con 0x7fc9c0149f50 2024-05-27T12:33:28.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:28.190+0000 7fc9bd7fa640 1 -- 172.21.15.55:0/713194648 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc9b0015b40 con 0x7fc9c0149f50 2024-05-27T12:33:28.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:28.191+0000 7fc9bd7fa640 1 --2- 172.21.15.55:0/713194648 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fc9a006c920 0x7fc9a006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:28.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:28.191+0000 7fc9bd7fa640 1 -- 172.21.15.55:0/713194648 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5473+0+0 (secure 0 0 0) 0x7fc9b008c9c0 con 0x7fc9c0149f50 2024-05-27T12:33:28.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:28.191+0000 7fc9c4a67640 1 --2- 172.21.15.55:0/713194648 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fc9a006c920 0x7fc9a006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:28.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:28.191+0000 7fc9c4a67640 1 --2- 172.21.15.55:0/713194648 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fc9a006c920 0x7fc9a006ede0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc9c00ce5d0 tx=0x7fc9b8001c40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:28.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:28.195+0000 7fc9bd7fa640 1 -- 172.21.15.55:0/713194648 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc9b008ee20 con 0x7fc9c0149f50 2024-05-27T12:33:28.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:28.380+0000 7fc9c6ccb640 1 -- 172.21.15.55:0/713194648 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fc9c00b4240 con 0x7fc9c0149f50 2024-05-27T12:33:29.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:29.059+0000 7fc9bd7fa640 1 -- 172.21.15.55:0/713194648 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v28) ==== 169+0+0 (secure 0 0 0) 0x7fc9b0019030 con 0x7fc9c0149f50 2024-05-27T12:33:29.058 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_data' removed 2024-05-27T12:33:29.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:29.062+0000 7fc9c6ccb640 1 -- 172.21.15.55:0/713194648 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fc9a006c920 msgr2=0x7fc9a006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:29.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:29.062+0000 7fc9c6ccb640 1 --2- 172.21.15.55:0/713194648 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fc9a006c920 0x7fc9a006ede0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc9c00ce5d0 tx=0x7fc9b8001c40 comp rx=0 tx=0).stop 2024-05-27T12:33:29.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:29.062+0000 7fc9c6ccb640 1 -- 172.21.15.55:0/713194648 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9c0149f50 msgr2=0x7fc9c015f0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:29.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:29.062+0000 7fc9c6ccb640 1 --2- 172.21.15.55:0/713194648 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9c0149f50 0x7fc9c015f0d0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fc9b0011e30 tx=0x7fc9b000f580 comp rx=0 tx=0).stop 2024-05-27T12:33:29.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:29.062+0000 7fc9c6ccb640 1 -- 172.21.15.55:0/713194648 shutdown_connections 2024-05-27T12:33:29.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:29.062+0000 7fc9c6ccb640 1 --2- 172.21.15.55:0/713194648 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc9c014a3d0 0x7fc9c015f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:29.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:29.062+0000 7fc9c6ccb640 1 --2- 172.21.15.55:0/713194648 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9c0149f50 0x7fc9c015f0d0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:29.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:29.062+0000 7fc9c6ccb640 1 --2- 172.21.15.55:0/713194648 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fc9a006c920 0x7fc9a006ede0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:29.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:29.062+0000 7fc9c6ccb640 1 --2- 172.21.15.55:0/713194648 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc9ac004d40 0x7fc9c0147280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:29.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:29.062+0000 7fc9c6ccb640 1 -- 172.21.15.55:0/713194648 >> 172.21.15.55:0/713194648 conn(0x7fc9c0067a50 msgr2=0x7fc9c00b4a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:29.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:29.062+0000 7fc9c6ccb640 1 -- 172.21.15.55:0/713194648 shutdown_connections 2024-05-27T12:33:29.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:29.062+0000 7fc9c6ccb640 1 -- 172.21.15.55:0/713194648 wait complete. 2024-05-27T12:33:29.080 INFO:tasks.ceph.mds.a:Restarting daemon 2024-05-27T12:33:29.080 INFO:tasks.ceph.mds.a:Stopping old one... 2024-05-27T12:33:29.080 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-05-27T12:33:29.080 INFO:teuthology.orchestra.run:waiting for 300 2024-05-27T12:33:29.081 INFO:tasks.ceph.mds.c:Restarting daemon 2024-05-27T12:33:29.081 INFO:tasks.ceph.mds.c:Stopping old one... 2024-05-27T12:33:29.081 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-05-27T12:33:29.082 INFO:teuthology.orchestra.run:waiting for 300 2024-05-27T12:33:29.082 INFO:tasks.ceph.mds.b:Restarting daemon 2024-05-27T12:33:29.082 INFO:tasks.ceph.mds.b:Stopping old one... 2024-05-27T12:33:29.083 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-05-27T12:33:29.083 INFO:teuthology.orchestra.run:waiting for 300 2024-05-27T12:33:29.083 INFO:tasks.ceph.mds.d:Restarting daemon 2024-05-27T12:33:29.083 INFO:tasks.ceph.mds.d:Stopping old one... 2024-05-27T12:33:29.083 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-05-27T12:33:29.083 INFO:teuthology.orchestra.run:waiting for 300 2024-05-27T12:33:29.091 INFO:tasks.ceph.mds.a:Stopped 2024-05-27T12:33:29.091 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-05-27T12:33:29.092 INFO:tasks.ceph.mds.c:Stopped 2024-05-27T12:33:29.093 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-05-27T12:33:29.094 INFO:tasks.ceph.mds.b:Stopped 2024-05-27T12:33:29.094 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-05-27T12:33:29.095 INFO:tasks.ceph.mds.d:Stopped 2024-05-27T12:33:29.096 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-05-27T12:33:29.135 INFO:tasks.ceph.mds.a:Started 2024-05-27T12:33:29.136 DEBUG:teuthology.parallel:result is None 2024-05-27T12:33:29.137 INFO:tasks.ceph.mds.c:Started 2024-05-27T12:33:29.137 DEBUG:teuthology.parallel:result is None 2024-05-27T12:33:29.138 INFO:tasks.ceph.mds.b:Started 2024-05-27T12:33:29.138 DEBUG:teuthology.parallel:result is None 2024-05-27T12:33:29.139 INFO:tasks.ceph.mds.d:Started 2024-05-27T12:33:29.139 DEBUG:teuthology.parallel:result is None 2024-05-27T12:33:29.139 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-05-27T12:33:29.217 INFO:tasks.ceph.mds.d.smithi072.stdout:starting mds.d at 2024-05-27T12:33:29.217 INFO:tasks.ceph.mds.b.smithi072.stdout:starting mds.b at 2024-05-27T12:33:29.218 INFO:tasks.ceph.mds.a.smithi055.stdout:starting mds.a at 2024-05-27T12:33:29.220 INFO:tasks.ceph.mds.c.smithi055.stdout:starting mds.c at 2024-05-27T12:33:29.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:29.255+0000 7f8977136640 1 Processor -- start 2024-05-27T12:33:29.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:29.255+0000 7f8977136640 1 -- start start 2024-05-27T12:33:29.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:29.256+0000 7f8977136640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f897015ebb0 0x7f89700cf770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:29.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:29.256+0000 7f8977136640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f89700d42f0 0x7f89700ba2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:29.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:29.256+0000 7f8977136640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89700d3530 con 0x7f89700d15d0 2024-05-27T12:33:29.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:29.256+0000 7f8977136640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f89700d3810 con 0x7f89700d42f0 2024-05-27T12:33:29.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:29.256+0000 7f8977136640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f89700d3af0 con 0x7f897015ebb0 2024-05-27T12:33:29.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:29.256+0000 7f896ffff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f89700d42f0 0x7f89700ba2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:29.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:29.256+0000 7f89756d3640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f89700d15d0 0x7f89700b6290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:50354/0 (socket says 172.21.15.55:50354) 2024-05-27T12:33:29.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:29.256+0000 7f89756d3640 1 -- 172.21.15.55:0/2119184409 learned_addr learned my addr 172.21.15.55:0/2119184409 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-27T12:33:29.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:29.256+0000 7f8974ed2640 1 --2- 172.21.15.55:0/2119184409 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f897015ebb0 0x7f89700cf770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:29.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:29.256+0000 7f896ffff640 1 -- 172.21.15.55:0/2119184409 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f897015ebb0 msgr2=0x7f89700cf770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:29.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:29.256+0000 7f896ffff640 1 --2- 172.21.15.55:0/2119184409 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f897015ebb0 0x7f89700cf770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:29.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:29.256+0000 7f896ffff640 1 -- 172.21.15.55:0/2119184409 >> v1:172.21.15.55:6789/0 conn(0x7f89700d15d0 legacy=0x7f89700b6290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:29.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:29.256+0000 7f896ffff640 1 -- 172.21.15.55:0/2119184409 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89700d3dd0 con 0x7f89700d42f0 2024-05-27T12:33:29.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:29.257+0000 7f896ffff640 1 --2- 172.21.15.55:0/2119184409 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89700d42f0 0x7f89700ba2c0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f895c0097d0 tx=0x7f895c02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c273f1538a2253 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:29.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:29.257+0000 7f896f7fe640 1 -- 172.21.15.55:0/2119184409 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f895c037070 con 0x7f89700d42f0 2024-05-27T12:33:29.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:29.257+0000 7f896f7fe640 1 -- 172.21.15.55:0/2119184409 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f895c032440 con 0x7f89700d42f0 2024-05-27T12:33:29.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:29.257+0000 7f896f7fe640 1 -- 172.21.15.55:0/2119184409 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f895c032810 con 0x7f89700d42f0 2024-05-27T12:33:29.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:29.258+0000 7f8977136640 1 -- 172.21.15.55:0/2119184409 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89700d42f0 msgr2=0x7f89700ba2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:29.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:29.258+0000 7f8977136640 1 --2- 172.21.15.55:0/2119184409 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89700d42f0 0x7f89700ba2c0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f895c0097d0 tx=0x7f895c02a1c0 comp rx=0 tx=0).stop 2024-05-27T12:33:29.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:29.258+0000 7f8977136640 1 -- 172.21.15.55:0/2119184409 shutdown_connections 2024-05-27T12:33:29.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:29.258+0000 7f8977136640 1 --2- 172.21.15.55:0/2119184409 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89700d42f0 0x7f89700ba2c0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:29.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:29.258+0000 7f8977136640 1 --2- 172.21.15.55:0/2119184409 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f897015ebb0 0x7f89700cf770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:29.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:29.258+0000 7f8977136640 1 -- 172.21.15.55:0/2119184409 >> 172.21.15.55:0/2119184409 conn(0x7f8970067810 msgr2=0x7f8970067c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:29.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:29.258+0000 7f8977136640 1 -- 172.21.15.55:0/2119184409 shutdown_connections 2024-05-27T12:33:29.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:29.258+0000 7f8977136640 1 -- 172.21.15.55:0/2119184409 wait complete. 2024-05-27T12:33:29.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:29.259+0000 7f8977136640 1 Processor -- start 2024-05-27T12:33:29.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:29.259+0000 7f8977136640 1 -- start start 2024-05-27T12:33:29.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:29.260+0000 7f8977136640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f89700d15d0 0x7f897015b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:29.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:29.260+0000 7f8977136640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f89700d42f0 0x7f89700cb8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:29.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:29.260+0000 7f8977136640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f897015ebb0 0x7f8970157c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:29.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:29.260+0000 7f8977136640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f89700d1a60 con 0x7f897015ebb0 2024-05-27T12:33:29.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:29.260+0000 7f8977136640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f89700cfe50 con 0x7f89700d42f0 2024-05-27T12:33:29.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:29.260+0000 7f8977136640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f89700d1be0 con 0x7f89700d15d0 2024-05-27T12:33:29.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:29.260+0000 7f89756d3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f897015ebb0 0x7f8970157c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:29.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:29.260+0000 7f89756d3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f897015ebb0 0x7f8970157c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33326/0 (socket says 172.21.15.55:33326) 2024-05-27T12:33:29.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:29.260+0000 7f896ffff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f89700d42f0 0x7f89700cb8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:29.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:29.260+0000 7f89756d3640 1 -- 172.21.15.55:0/3381559960 learned_addr learned my addr 172.21.15.55:0/3381559960 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:33:29.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:29.260+0000 7f8974ed2640 1 --2- 172.21.15.55:0/3381559960 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f89700d15d0 0x7f897015b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:29.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:29.261+0000 7f89756d3640 1 -- 172.21.15.55:0/3381559960 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f89700d15d0 msgr2=0x7f897015b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:29.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:29.261+0000 7f89756d3640 1 --2- 172.21.15.55:0/3381559960 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f89700d15d0 0x7f897015b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:29.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:29.261+0000 7f89756d3640 1 -- 172.21.15.55:0/3381559960 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f89700d42f0 msgr2=0x7f89700cb8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:29.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:29.261+0000 7f89756d3640 1 --2- 172.21.15.55:0/3381559960 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f89700d42f0 0x7f89700cb8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:29.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:29.261+0000 7f89756d3640 1 -- 172.21.15.55:0/3381559960 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89700cbe20 con 0x7f897015ebb0 2024-05-27T12:33:29.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:29.261+0000 7f896ffff640 1 --2- 172.21.15.55:0/3381559960 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f89700d42f0 0x7f89700cb8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T12:33:29.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:29.261+0000 7f89756d3640 1 --2- 172.21.15.55:0/3381559960 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f897015ebb0 0x7f8970157c50 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f896800cbc0 tx=0x7f896800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:29.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:29.261+0000 7f896d7fa640 1 -- 172.21.15.55:0/3381559960 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8968017070 con 0x7f897015ebb0 2024-05-27T12:33:29.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:29.261+0000 7f896d7fa640 1 -- 172.21.15.55:0/3381559960 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f896800ad40 con 0x7f897015ebb0 2024-05-27T12:33:29.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:29.261+0000 7f8977136640 1 -- 172.21.15.55:0/3381559960 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89700cd300 con 0x7f897015ebb0 2024-05-27T12:33:29.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:29.261+0000 7f896d7fa640 1 -- 172.21.15.55:0/3381559960 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8968012600 con 0x7f897015ebb0 2024-05-27T12:33:29.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:29.261+0000 7f8977136640 1 -- 172.21.15.55:0/3381559960 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89700cc3a0 con 0x7f897015ebb0 2024-05-27T12:33:29.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:29.262+0000 7f8977136640 1 -- 172.21.15.55:0/3381559960 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89700cd4d0 con 0x7f897015ebb0 2024-05-27T12:33:29.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:29.262+0000 7f896d7fa640 1 -- 172.21.15.55:0/3381559960 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f896801a070 con 0x7f897015ebb0 2024-05-27T12:33:29.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:29.263+0000 7f896d7fa640 1 --2- 172.21.15.55:0/3381559960 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f895406c8f0 0x7f895406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:29.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:29.263+0000 7f896d7fa640 1 -- 172.21.15.55:0/3381559960 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4943+0+0 (secure 0 0 0) 0x7f896808b4f0 con 0x7f897015ebb0 2024-05-27T12:33:29.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:29.263+0000 7f8974ed2640 1 --2- 172.21.15.55:0/3381559960 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f895406c8f0 0x7f895406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:29.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:29.263+0000 7f8974ed2640 1 --2- 172.21.15.55:0/3381559960 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f895406c8f0 0x7f895406edb0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f8964009aa0 tx=0x7f8964009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:29.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:29.267+0000 7f896d7fa640 1 -- 172.21.15.55:0/3381559960 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f89680595d0 con 0x7f897015ebb0 2024-05-27T12:33:29.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:29.465+0000 7f8977136640 1 -- 172.21.15.55:0/3381559960 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f8970075460 con 0x7f897015ebb0 2024-05-27T12:33:30.071 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.072+0000 7f896d7fa640 1 -- 172.21.15.55:0/3381559960 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v30) ==== 97+0+0 (secure 0 0 0) 0x7f896805d8d0 con 0x7f897015ebb0 2024-05-27T12:33:30.071 INFO:teuthology.orchestra.run.smithi055.stderr: removed all blocklist entries 2024-05-27T12:33:30.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.075+0000 7f8977136640 1 -- 172.21.15.55:0/3381559960 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f895406c8f0 msgr2=0x7f895406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:30.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.075+0000 7f8977136640 1 --2- 172.21.15.55:0/3381559960 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f895406c8f0 0x7f895406edb0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f8964009aa0 tx=0x7f8964009190 comp rx=0 tx=0).stop 2024-05-27T12:33:30.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.075+0000 7f8977136640 1 -- 172.21.15.55:0/3381559960 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f897015ebb0 msgr2=0x7f8970157c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:30.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.075+0000 7f8977136640 1 --2- 172.21.15.55:0/3381559960 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f897015ebb0 0x7f8970157c50 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f896800cbc0 tx=0x7f896800a430 comp rx=0 tx=0).stop 2024-05-27T12:33:30.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.075+0000 7f8977136640 1 -- 172.21.15.55:0/3381559960 shutdown_connections 2024-05-27T12:33:30.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.075+0000 7f8977136640 1 --2- 172.21.15.55:0/3381559960 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f897015ebb0 0x7f8970157c50 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:30.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.075+0000 7f8977136640 1 --2- 172.21.15.55:0/3381559960 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f895406c8f0 0x7f895406edb0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:30.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.075+0000 7f8977136640 1 --2- 172.21.15.55:0/3381559960 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f89700d42f0 0x7f89700cb8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:30.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.075+0000 7f8977136640 1 --2- 172.21.15.55:0/3381559960 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f89700d15d0 0x7f897015b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:30.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.075+0000 7f8977136640 1 -- 172.21.15.55:0/3381559960 >> 172.21.15.55:0/3381559960 conn(0x7f8970067810 msgr2=0x7f897015dd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:30.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.075+0000 7f8977136640 1 -- 172.21.15.55:0/3381559960 shutdown_connections 2024-05-27T12:33:30.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.075+0000 7f8977136640 1 -- 172.21.15.55:0/3381559960 wait complete. 2024-05-27T12:33:30.089 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-05-27T12:33:30.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.198+0000 7fe4f9395640 1 Processor -- start 2024-05-27T12:33:30.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.198+0000 7fe4f9395640 1 -- start start 2024-05-27T12:33:30.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.198+0000 7fe4f9395640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe4f4144bb0 0x7fe4f40cd180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:30.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.199+0000 7fe4f9395640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe4f40cd6c0 0x7fe4f4071f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:30.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.199+0000 7fe4f9395640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4f40ce200 con 0x7fe4f4072460 2024-05-27T12:33:30.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.199+0000 7fe4f9395640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7fe4f4144f90 con 0x7fe4f40cd6c0 2024-05-27T12:33:30.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.199+0000 7fe4f9395640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fe4f40cdc40 con 0x7fe4f4144bb0 2024-05-27T12:33:30.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.199+0000 7fe4f27fc640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe4f40cd6c0 0x7fe4f4071f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:30.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.199+0000 7fe4f27fc640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe4f40cd6c0 0x7fe4f4071f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33332/0 (socket says 172.21.15.55:33332) 2024-05-27T12:33:30.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.199+0000 7fe4f27fc640 1 -- 172.21.15.55:0/3378257706 learned_addr learned my addr 172.21.15.55:0/3378257706 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:33:30.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.199+0000 7fe4f2ffd640 1 --2- 172.21.15.55:0/3378257706 >> v2:172.21.15.72:3300/0 conn(0x7fe4f4144bb0 0x7fe4f40cd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:30.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.199+0000 7fe4f27fc640 1 -- 172.21.15.55:0/3378257706 >> v2:172.21.15.72:3300/0 conn(0x7fe4f4144bb0 msgr2=0x7fe4f40cd180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:30.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.199+0000 7fe4f27fc640 1 --2- 172.21.15.55:0/3378257706 >> v2:172.21.15.72:3300/0 conn(0x7fe4f4144bb0 0x7fe4f40cd180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:30.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.199+0000 7fe4f27fc640 1 -- 172.21.15.55:0/3378257706 >> v1:172.21.15.72:6789/0 conn(0x7fe4f4072460 legacy=0x7fe4f415f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:30.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.199+0000 7fe4f27fc640 1 -- 172.21.15.55:0/3378257706 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4f40cdf20 con 0x7fe4f40cd6c0 2024-05-27T12:33:30.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.199+0000 7fe4f2ffd640 1 --2- 172.21.15.55:0/3378257706 >> v2:172.21.15.72:3300/0 conn(0x7fe4f4144bb0 0x7fe4f40cd180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T12:33:30.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.200+0000 7fe4f27fc640 1 --2- 172.21.15.55:0/3378257706 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe4f40cd6c0 0x7fe4f4071f20 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fe4f406f760 tx=0x7fe4e802c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20ac254508d5b9c2 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:30.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.200+0000 7fe4f1ffb640 1 -- 172.21.15.55:0/3378257706 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4e80325a0 con 0x7fe4f40cd6c0 2024-05-27T12:33:30.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.200+0000 7fe4f1ffb640 1 -- 172.21.15.55:0/3378257706 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4e8038070 con 0x7fe4f40cd6c0 2024-05-27T12:33:30.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.200+0000 7fe4f1ffb640 1 -- 172.21.15.55:0/3378257706 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4e8032960 con 0x7fe4f40cd6c0 2024-05-27T12:33:30.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.200+0000 7fe4f9395640 1 -- 172.21.15.55:0/3378257706 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe4f40cd6c0 msgr2=0x7fe4f4071f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:30.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.200+0000 7fe4f9395640 1 --2- 172.21.15.55:0/3378257706 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe4f40cd6c0 0x7fe4f4071f20 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fe4f406f760 tx=0x7fe4e802c8e0 comp rx=0 tx=0).stop 2024-05-27T12:33:30.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.201+0000 7fe4f9395640 1 -- 172.21.15.55:0/3378257706 shutdown_connections 2024-05-27T12:33:30.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.201+0000 7fe4f9395640 1 --2- 172.21.15.55:0/3378257706 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe4f40cd6c0 0x7fe4f4071f20 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:30.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.201+0000 7fe4f9395640 1 --2- 172.21.15.55:0/3378257706 >> v2:172.21.15.72:3300/0 conn(0x7fe4f4144bb0 0x7fe4f40cd180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:30.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.201+0000 7fe4f9395640 1 -- 172.21.15.55:0/3378257706 >> 172.21.15.55:0/3378257706 conn(0x7fe4f40b3830 msgr2=0x7fe4f40b3c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:30.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.201+0000 7fe4f9395640 1 -- 172.21.15.55:0/3378257706 shutdown_connections 2024-05-27T12:33:30.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.201+0000 7fe4f9395640 1 -- 172.21.15.55:0/3378257706 wait complete. 2024-05-27T12:33:30.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.202+0000 7fe4f9395640 1 Processor -- start 2024-05-27T12:33:30.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.202+0000 7fe4f9395640 1 -- start start 2024-05-27T12:33:30.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.203+0000 7fe4f9395640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe4f4072460 0x7fe4f413de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:30.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.203+0000 7fe4f9395640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe4f40cd6c0 0x7fe4f4143240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:30.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.203+0000 7fe4f9395640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4f4144bb0 0x7fe4f41d9060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:30.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.203+0000 7fe4f9395640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7fe4f4145330 con 0x7fe4f40cd6c0 2024-05-27T12:33:30.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.203+0000 7fe4f9395640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fe4f40ceb20 con 0x7fe4f4144bb0 2024-05-27T12:33:30.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.203+0000 7fe4f9395640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fe4f40d0050 con 0x7fe4f4072460 2024-05-27T12:33:30.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.203+0000 7fe4f27fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe4f40cd6c0 0x7fe4f4143240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:30.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.203+0000 7fe4f27fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe4f40cd6c0 0x7fe4f4143240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33334/0 (socket says 172.21.15.55:33334) 2024-05-27T12:33:30.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.203+0000 7fe4f27fc640 1 -- 172.21.15.55:0/3796141998 learned_addr learned my addr 172.21.15.55:0/3796141998 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:33:30.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.203+0000 7fe4f27fc640 1 -- 172.21.15.55:0/3796141998 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe4f4072460 msgr2=0x7fe4f413de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:30.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.203+0000 7fe4f27fc640 1 --2- 172.21.15.55:0/3796141998 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe4f4072460 0x7fe4f413de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:30.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.203+0000 7fe4f37fe640 1 --2- 172.21.15.55:0/3796141998 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4f4144bb0 0x7fe4f41d9060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:30.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.203+0000 7fe4f27fc640 1 -- 172.21.15.55:0/3796141998 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4f4144bb0 msgr2=0x7fe4f41d9060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:30.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.203+0000 7fe4f27fc640 1 --2- 172.21.15.55:0/3796141998 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4f4144bb0 0x7fe4f41d9060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:30.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.203+0000 7fe4f27fc640 1 -- 172.21.15.55:0/3796141998 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4f41421a0 con 0x7fe4f40cd6c0 2024-05-27T12:33:30.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.203+0000 7fe4f37fe640 1 --2- 172.21.15.55:0/3796141998 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4f4144bb0 0x7fe4f41d9060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T12:33:30.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.203+0000 7fe4f27fc640 1 --2- 172.21.15.55:0/3796141998 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe4f40cd6c0 0x7fe4f4143240 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fe4e802c920 tx=0x7fe4e8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:30.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.203+0000 7fe4db7fe640 1 -- 172.21.15.55:0/3796141998 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4e8043070 con 0x7fe4f40cd6c0 2024-05-27T12:33:30.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.204+0000 7fe4db7fe640 1 -- 172.21.15.55:0/3796141998 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4e8033c90 con 0x7fe4f40cd6c0 2024-05-27T12:33:30.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.204+0000 7fe4f9395640 1 -- 172.21.15.55:0/3796141998 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4f4142480 con 0x7fe4f40cd6c0 2024-05-27T12:33:30.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.204+0000 7fe4db7fe640 1 -- 172.21.15.55:0/3796141998 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4e803c660 con 0x7fe4f40cd6c0 2024-05-27T12:33:30.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.204+0000 7fe4f9395640 1 -- 172.21.15.55:0/3796141998 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4f4142a40 con 0x7fe4f40cd6c0 2024-05-27T12:33:30.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.205+0000 7fe4f9395640 1 -- 172.21.15.55:0/3796141998 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4f40708f0 con 0x7fe4f40cd6c0 2024-05-27T12:33:30.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.205+0000 7fe4db7fe640 1 -- 172.21.15.55:0/3796141998 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe4e8046070 con 0x7fe4f40cd6c0 2024-05-27T12:33:30.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.206+0000 7fe4db7fe640 1 --2- 172.21.15.55:0/3796141998 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fe4e006c8f0 0x7fe4e006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:30.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.206+0000 7fe4db7fe640 1 -- 172.21.15.55:0/3796141998 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 4857+0+0 (secure 0 0 0) 0x7fe4e8030020 con 0x7fe4f40cd6c0 2024-05-27T12:33:30.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.206+0000 7fe4f2ffd640 1 --2- 172.21.15.55:0/3796141998 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fe4e006c8f0 0x7fe4e006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:30.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.207+0000 7fe4f2ffd640 1 --2- 172.21.15.55:0/3796141998 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fe4e006c8f0 0x7fe4e006edb0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe4e4006fd0 tx=0x7fe4e4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:30.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.210+0000 7fe4db7fe640 1 -- 172.21.15.55:0/3796141998 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe4f40708f0 con 0x7fe4f40cd6c0 2024-05-27T12:33:30.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.467+0000 7fe4f9395640 1 -- 172.21.15.55:0/3796141998 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fe4f40b2730 con 0x7fe4f40cd6c0 2024-05-27T12:33:30.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.467+0000 7fe4db7fe640 1 -- 172.21.15.55:0/3796141998 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) ==== 80+0+6645 (secure 0 0 0) 0x7fe4e804d030 con 0x7fe4f40cd6c0 2024-05-27T12:33:30.466 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-27T12:33:30.467 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-05-27T12:33:30.467 INFO:teuthology.orchestra.run.smithi055.stdout: "auth_dump": [ 2024-05-27T12:33:30.467 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-05-27T12:33:30.467 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.a", 2024-05-27T12:33:30.467 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQAsfVRmmuYsAhAAhhu6/bL6pb53jKaMVlMEFg==", 2024-05-27T12:33:30.467 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-05-27T12:33:30.467 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2024-05-27T12:33:30.467 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2024-05-27T12:33:30.467 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2024-05-27T12:33:30.467 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-05-27T12:33:30.467 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-05-27T12:33:30.467 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-05-27T12:33:30.467 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-05-27T12:33:30.468 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.b", 2024-05-27T12:33:30.468 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQAsfVRmD38jDhAA2IVtrkMz+IxwY6dzyXMpSg==", 2024-05-27T12:33:30.468 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-05-27T12:33:30.468 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2024-05-27T12:33:30.468 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2024-05-27T12:33:30.468 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2024-05-27T12:33:30.468 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-05-27T12:33:30.468 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-05-27T12:33:30.468 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-05-27T12:33:30.468 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-05-27T12:33:30.468 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.c", 2024-05-27T12:33:30.468 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQAsfVRmCxVZCRAACN3XE9s+jqwww5gifWIdqw==", 2024-05-27T12:33:30.468 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-05-27T12:33:30.468 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2024-05-27T12:33:30.468 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2024-05-27T12:33:30.469 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2024-05-27T12:33:30.469 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-05-27T12:33:30.469 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-05-27T12:33:30.469 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-05-27T12:33:30.469 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-05-27T12:33:30.469 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.d", 2024-05-27T12:33:30.469 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQAsfVRmCgMsFRAAM4AMNQSwfLsySOOEDjTfEg==", 2024-05-27T12:33:30.469 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-05-27T12:33:30.469 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2024-05-27T12:33:30.469 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2024-05-27T12:33:30.469 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2024-05-27T12:33:30.469 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-05-27T12:33:30.469 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-05-27T12:33:30.469 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-05-27T12:33:30.470 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-05-27T12:33:30.470 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.0", 2024-05-27T12:33:30.470 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQAzfVRmFFjjBhAApDXvZ6m3Zr++1/dXX4tpLQ==", 2024-05-27T12:33:30.470 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-05-27T12:33:30.470 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2024-05-27T12:33:30.470 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2024-05-27T12:33:30.470 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-05-27T12:33:30.470 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-05-27T12:33:30.470 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-05-27T12:33:30.470 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-05-27T12:33:30.470 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.1", 2024-05-27T12:33:30.470 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQA2fVRmqMGCBhAAYgt3tK17ik7/hp0piD6ztw==", 2024-05-27T12:33:30.470 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-05-27T12:33:30.470 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2024-05-27T12:33:30.471 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2024-05-27T12:33:30.471 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-05-27T12:33:30.471 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-05-27T12:33:30.471 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-05-27T12:33:30.471 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-05-27T12:33:30.471 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.2", 2024-05-27T12:33:30.471 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQA5fVRm/FnxBhAARLlQ54xir+qliKYDWY7nbg==", 2024-05-27T12:33:30.471 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-05-27T12:33:30.471 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2024-05-27T12:33:30.471 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2024-05-27T12:33:30.471 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-05-27T12:33:30.471 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-05-27T12:33:30.471 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-05-27T12:33:30.471 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-05-27T12:33:30.472 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.3", 2024-05-27T12:33:30.472 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQA8fVRmbcP9BhAAPE7oC6wdcqbK13HcpZINkg==", 2024-05-27T12:33:30.472 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-05-27T12:33:30.472 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2024-05-27T12:33:30.472 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2024-05-27T12:33:30.472 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-05-27T12:33:30.472 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-05-27T12:33:30.472 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-05-27T12:33:30.472 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-05-27T12:33:30.472 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.4", 2024-05-27T12:33:30.472 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQBCfVRmZD0sDRAAw2aNRb14iJwmHDrZIG8u1Q==", 2024-05-27T12:33:30.472 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-05-27T12:33:30.472 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2024-05-27T12:33:30.473 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2024-05-27T12:33:30.473 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-05-27T12:33:30.473 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-05-27T12:33:30.473 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-05-27T12:33:30.473 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-05-27T12:33:30.473 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.5", 2024-05-27T12:33:30.473 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQBFfVRmj4XACxAAKhItF0GvmQUQdf6/OGd3OA==", 2024-05-27T12:33:30.473 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-05-27T12:33:30.473 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2024-05-27T12:33:30.473 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2024-05-27T12:33:30.473 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-05-27T12:33:30.473 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-05-27T12:33:30.473 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-05-27T12:33:30.474 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-05-27T12:33:30.474 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.6", 2024-05-27T12:33:30.474 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQBIfVRmmH/zChAAkge2bDBqTBIuyQ+PNrnOAw==", 2024-05-27T12:33:30.474 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-05-27T12:33:30.474 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2024-05-27T12:33:30.474 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2024-05-27T12:33:30.474 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-05-27T12:33:30.474 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-05-27T12:33:30.474 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-05-27T12:33:30.474 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-05-27T12:33:30.474 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.7", 2024-05-27T12:33:30.474 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQBLfVRmfZLJCBAAwHAzXG7o/bNfhEegA+dsoQ==", 2024-05-27T12:33:30.474 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-05-27T12:33:30.474 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2024-05-27T12:33:30.474 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2024-05-27T12:33:30.475 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-05-27T12:33:30.475 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-05-27T12:33:30.475 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-05-27T12:33:30.475 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-05-27T12:33:30.475 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.0", 2024-05-27T12:33:30.475 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQAsfVRmIz9dGRAAjAf3liTmQK1aXNskyzdRyQ==", 2024-05-27T12:33:30.475 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-05-27T12:33:30.475 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2024-05-27T12:33:30.475 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2024-05-27T12:33:30.475 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2024-05-27T12:33:30.475 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2024-05-27T12:33:30.475 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-05-27T12:33:30.475 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-05-27T12:33:30.475 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-05-27T12:33:30.476 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.1", 2024-05-27T12:33:30.476 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQAsfVRmoipIIhAAyurpcSEPW1QVVZuf69hWNQ==", 2024-05-27T12:33:30.476 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-05-27T12:33:30.476 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2024-05-27T12:33:30.476 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2024-05-27T12:33:30.476 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2024-05-27T12:33:30.476 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2024-05-27T12:33:30.476 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-05-27T12:33:30.476 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-05-27T12:33:30.476 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-05-27T12:33:30.476 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.2", 2024-05-27T12:33:30.476 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQAsfVRm6f4RHxAAmfTdGbAPsF4KMgEv/JWzZQ==", 2024-05-27T12:33:30.476 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-05-27T12:33:30.476 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2024-05-27T12:33:30.477 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2024-05-27T12:33:30.477 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2024-05-27T12:33:30.477 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2024-05-27T12:33:30.477 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-05-27T12:33:30.477 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-05-27T12:33:30.477 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-05-27T12:33:30.477 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.3", 2024-05-27T12:33:30.477 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQAsfVRmCPbXJxAAtcAuYEQlV8GUMAzhL0rCWQ==", 2024-05-27T12:33:30.477 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-05-27T12:33:30.477 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2024-05-27T12:33:30.477 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2024-05-27T12:33:30.477 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2024-05-27T12:33:30.477 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2024-05-27T12:33:30.477 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-05-27T12:33:30.478 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-05-27T12:33:30.478 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-05-27T12:33:30.478 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.admin", 2024-05-27T12:33:30.478 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQArfVRmXenYIRAATWhRVLIRSnNCrtIias6LHA==", 2024-05-27T12:33:30.478 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-05-27T12:33:30.478 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow *", 2024-05-27T12:33:30.478 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2024-05-27T12:33:30.478 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2024-05-27T12:33:30.478 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-05-27T12:33:30.478 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-05-27T12:33:30.478 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-05-27T12:33:30.478 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-05-27T12:33:30.478 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.bootstrap-mds", 2024-05-27T12:33:30.478 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQBRfVRmE1ArARAA6HVZMBfHOqHv8burFM3J+Q==", 2024-05-27T12:33:30.479 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-05-27T12:33:30.479 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile bootstrap-mds" 2024-05-27T12:33:30.479 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-05-27T12:33:30.479 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-05-27T12:33:30.479 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-05-27T12:33:30.479 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.bootstrap-mgr", 2024-05-27T12:33:30.479 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQBRfVRml1orARAAi8vxhoPfib6I37CK7JUcrQ==", 2024-05-27T12:33:30.479 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-05-27T12:33:30.479 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile bootstrap-mgr" 2024-05-27T12:33:30.479 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-05-27T12:33:30.479 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-05-27T12:33:30.479 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-05-27T12:33:30.479 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.bootstrap-osd", 2024-05-27T12:33:30.479 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQBRfVRm8WIrARAAKV0N/7QIjQPilEUovMhvWA==", 2024-05-27T12:33:30.479 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-05-27T12:33:30.480 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile bootstrap-osd" 2024-05-27T12:33:30.480 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-05-27T12:33:30.480 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-05-27T12:33:30.480 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-05-27T12:33:30.480 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.bootstrap-rbd", 2024-05-27T12:33:30.480 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQBRfVRmsWorARAAhjXtZmCJ5pYOHcDS/0wsPw==", 2024-05-27T12:33:30.480 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-05-27T12:33:30.480 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile bootstrap-rbd" 2024-05-27T12:33:30.480 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-05-27T12:33:30.480 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-05-27T12:33:30.480 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-05-27T12:33:30.480 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-05-27T12:33:30.480 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQBRfVRmzXIrARAAlbV3wsOdb2uXrq1VRqqYiA==", 2024-05-27T12:33:30.480 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-05-27T12:33:30.481 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-05-27T12:33:30.481 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-05-27T12:33:30.481 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-05-27T12:33:30.481 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-05-27T12:33:30.481 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.bootstrap-rgw", 2024-05-27T12:33:30.481 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQBRfVRmK3srARAATyvyWn0++S3sNpLtrun45A==", 2024-05-27T12:33:30.481 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-05-27T12:33:30.481 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile bootstrap-rgw" 2024-05-27T12:33:30.481 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-05-27T12:33:30.481 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-05-27T12:33:30.481 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-05-27T12:33:30.481 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mgr.x", 2024-05-27T12:33:30.481 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQArfVRmTs50OhAA8vBWPn6mEvL46NzZNyqu8w==", 2024-05-27T12:33:30.481 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-05-27T12:33:30.482 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow *", 2024-05-27T12:33:30.482 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile mgr", 2024-05-27T12:33:30.482 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-05-27T12:33:30.482 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-05-27T12:33:30.482 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-05-27T12:33:30.482 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-05-27T12:33:30.482 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mgr.y", 2024-05-27T12:33:30.482 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQArfVRmSmXCNhAAKdJWtW4aY+SPuQ2nSJ1vWQ==", 2024-05-27T12:33:30.482 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-05-27T12:33:30.482 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow *", 2024-05-27T12:33:30.482 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile mgr", 2024-05-27T12:33:30.482 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-05-27T12:33:30.483 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-05-27T12:33:30.483 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-05-27T12:33:30.483 INFO:teuthology.orchestra.run.smithi055.stdout: ] 2024-05-27T12:33:30.483 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-05-27T12:33:30.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.469+0000 7fe4f9395640 1 -- 172.21.15.55:0/3796141998 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fe4e006c8f0 msgr2=0x7fe4e006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:30.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.469+0000 7fe4f9395640 1 --2- 172.21.15.55:0/3796141998 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fe4e006c8f0 0x7fe4e006edb0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe4e4006fd0 tx=0x7fe4e4008040 comp rx=0 tx=0).stop 2024-05-27T12:33:30.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.469+0000 7fe4f9395640 1 -- 172.21.15.55:0/3796141998 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe4f40cd6c0 msgr2=0x7fe4f4143240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:30.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.469+0000 7fe4f9395640 1 --2- 172.21.15.55:0/3796141998 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe4f40cd6c0 0x7fe4f4143240 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fe4e802c920 tx=0x7fe4e8004730 comp rx=0 tx=0).stop 2024-05-27T12:33:30.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.469+0000 7fe4f9395640 1 -- 172.21.15.55:0/3796141998 shutdown_connections 2024-05-27T12:33:30.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.469+0000 7fe4f9395640 1 --2- 172.21.15.55:0/3796141998 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fe4e006c8f0 0x7fe4e006edb0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:30.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.469+0000 7fe4f9395640 1 --2- 172.21.15.55:0/3796141998 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4f4144bb0 0x7fe4f41d9060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:30.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.469+0000 7fe4f9395640 1 --2- 172.21.15.55:0/3796141998 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe4f40cd6c0 0x7fe4f4143240 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:30.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.469+0000 7fe4f9395640 1 --2- 172.21.15.55:0/3796141998 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe4f4072460 0x7fe4f413de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:30.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.469+0000 7fe4f9395640 1 -- 172.21.15.55:0/3796141998 >> 172.21.15.55:0/3796141998 conn(0x7fe4f40b3830 msgr2=0x7fe4f41d8780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:30.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.469+0000 7fe4f9395640 1 -- 172.21.15.55:0/3796141998 shutdown_connections 2024-05-27T12:33:30.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.469+0000 7fe4f9395640 1 -- 172.21.15.55:0/3796141998 wait complete. 2024-05-27T12:33:30.485 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-05-27T12:33:30.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.591+0000 7fcb96330640 1 Processor -- start 2024-05-27T12:33:30.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.591+0000 7fcb96330640 1 -- start start 2024-05-27T12:33:30.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.592+0000 7fcb96330640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fcb9006ca40 0x7fcb9009aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:30.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.592+0000 7fcb96330640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb9009b380 con 0x7fcb90162150 2024-05-27T12:33:30.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.592+0000 7fcb96330640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb900d2020 con 0x7fcb9009af70 2024-05-27T12:33:30.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.592+0000 7fcb96330640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fcb900d1d40 con 0x7fcb9006ca40 2024-05-27T12:33:30.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.592+0000 7fcb8ffff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fcb90162150 0x7fcb900d14f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:50356/0 (socket says 172.21.15.55:50356) 2024-05-27T12:33:30.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.592+0000 7fcb8ffff640 1 -- 172.21.15.55:0/1171391970 learned_addr learned my addr 172.21.15.55:0/1171391970 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-27T12:33:30.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.592+0000 7fcb8effd640 1 -- 172.21.15.55:0/1171391970 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 154962394 0 0) 0x7fcb80001110 con 0x7fcb90162150 2024-05-27T12:33:30.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.592+0000 7fcb8effd640 1 -- 172.21.15.55:0/1171391970 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcb78003520 con 0x7fcb90162150 2024-05-27T12:33:30.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.592+0000 7fcb8f7fe640 1 --2- 172.21.15.55:0/1171391970 >> v2:172.21.15.72:3300/0 conn(0x7fcb9006ca40 0x7fcb9009aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:30.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.592+0000 7fcb8effd640 1 -- 172.21.15.55:0/1171391970 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2366020514 0 0) 0x7fcb78003520 con 0x7fcb90162150 2024-05-27T12:33:30.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.592+0000 7fcb8effd640 1 -- 172.21.15.55:0/1171391970 >> v2:172.21.15.72:3300/0 conn(0x7fcb9006ca40 msgr2=0x7fcb9009aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:30.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.592+0000 7fcb8effd640 1 --2- 172.21.15.55:0/1171391970 >> v2:172.21.15.72:3300/0 conn(0x7fcb9006ca40 0x7fcb9009aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:30.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.592+0000 7fcb8effd640 1 -- 172.21.15.55:0/1171391970 >> v1:172.21.15.72:6789/0 conn(0x7fcb9009af70 legacy=0x7fcb900cd840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:30.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.592+0000 7fcb8effd640 1 -- 172.21.15.55:0/1171391970 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb900ccd60 con 0x7fcb90162150 2024-05-27T12:33:30.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.592+0000 7fcb8effd640 1 -- 172.21.15.55:0/1171391970 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 793017739 0 0) 0x7fcb80001840 con 0x7fcb90162150 2024-05-27T12:33:30.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.592+0000 7fcb8effd640 1 -- 172.21.15.55:0/1171391970 >> v1:172.21.15.55:6789/0 conn(0x7fcb90162150 legacy=0x7fcb900d14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:30.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.592+0000 7fcb8effd640 1 --2- 172.21.15.55:0/1171391970 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcb780039b0 0x7fcb78003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:30.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.592+0000 7fcb8effd640 1 --2- 172.21.15.55:0/1171391970 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb78004800 0x7fcb78004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:30.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.592+0000 7fcb8effd640 1 --2- 172.21.15.55:0/1171391970 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb780051c0 0x7fcb7800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:30.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.592+0000 7fcb8effd640 1 -- 172.21.15.55:0/1171391970 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7fcb900d1d40 con 0x7fcb78004800 2024-05-27T12:33:30.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.592+0000 7fcb8effd640 1 -- 172.21.15.55:0/1171391970 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fcb7800c110 con 0x7fcb780051c0 2024-05-27T12:33:30.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.592+0000 7fcb8effd640 1 -- 172.21.15.55:0/1171391970 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fcb7800c310 con 0x7fcb780039b0 2024-05-27T12:33:30.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.593+0000 7fcb8f7fe640 1 --2- 172.21.15.55:0/1171391970 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb78004800 0x7fcb78004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:30.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.593+0000 7fcb948cd640 1 --2- 172.21.15.55:0/1171391970 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb780051c0 0x7fcb7800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:30.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.593+0000 7fcb8ffff640 1 --2- 172.21.15.55:0/1171391970 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcb780039b0 0x7fcb78003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:30.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.593+0000 7fcb8f7fe640 1 -- 172.21.15.55:0/1171391970 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcb780039b0 msgr2=0x7fcb78003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:30.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.593+0000 7fcb8f7fe640 1 --2- 172.21.15.55:0/1171391970 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcb780039b0 0x7fcb78003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:30.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.593+0000 7fcb8f7fe640 1 -- 172.21.15.55:0/1171391970 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb780051c0 msgr2=0x7fcb7800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:30.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.593+0000 7fcb8f7fe640 1 --2- 172.21.15.55:0/1171391970 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb780051c0 0x7fcb7800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:30.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.593+0000 7fcb948cd640 1 -- 172.21.15.55:0/1171391970 reap_dead start 2024-05-27T12:33:30.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.593+0000 7fcb8f7fe640 1 -- 172.21.15.55:0/1171391970 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb78003520 con 0x7fcb78004800 2024-05-27T12:33:30.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.593+0000 7fcb8ffff640 1 --2- 172.21.15.55:0/1171391970 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcb780039b0 0x7fcb78003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T12:33:30.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.594+0000 7fcb8f7fe640 1 --2- 172.21.15.55:0/1171391970 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb78004800 0x7fcb78004c80 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fcb8400ba30 tx=0x7fcb78005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e827df9582f3e1fc server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:30.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.594+0000 7fcb8effd640 1 -- 172.21.15.55:0/1171391970 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb84030070 con 0x7fcb78004800 2024-05-27T12:33:30.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.594+0000 7fcb8effd640 1 -- 172.21.15.55:0/1171391970 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb8402ade0 con 0x7fcb78004800 2024-05-27T12:33:30.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.594+0000 7fcb8effd640 1 -- 172.21.15.55:0/1171391970 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb8400b600 con 0x7fcb78004800 2024-05-27T12:33:30.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.594+0000 7fcb96330640 1 -- 172.21.15.55:0/1171391970 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb78004800 msgr2=0x7fcb78004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:30.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.594+0000 7fcb96330640 1 --2- 172.21.15.55:0/1171391970 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb78004800 0x7fcb78004c80 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fcb8400ba30 tx=0x7fcb78005830 comp rx=0 tx=0).stop 2024-05-27T12:33:30.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.594+0000 7fcb96330640 1 -- 172.21.15.55:0/1171391970 shutdown_connections 2024-05-27T12:33:30.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.594+0000 7fcb96330640 1 --2- 172.21.15.55:0/1171391970 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb78004800 0x7fcb78004c80 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:30.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.594+0000 7fcb96330640 1 -- 172.21.15.55:0/1171391970 >> 172.21.15.55:0/1171391970 conn(0x7fcb900b4160 msgr2=0x7fcb900b4570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:30.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.594+0000 7fcb96330640 1 -- 172.21.15.55:0/1171391970 shutdown_connections 2024-05-27T12:33:30.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.594+0000 7fcb96330640 1 -- 172.21.15.55:0/1171391970 wait complete. 2024-05-27T12:33:30.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.595+0000 7fcb96330640 1 Processor -- start 2024-05-27T12:33:30.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.596+0000 7fcb96330640 1 -- start start 2024-05-27T12:33:30.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.596+0000 7fcb96330640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb78004800 0x7fcb90159780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:30.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.596+0000 7fcb96330640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb900c9740 0x7fcb900c9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:30.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.596+0000 7fcb96330640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcb900af300 0x7fcb900af780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:30.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.596+0000 7fcb96330640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7fcb9009aa30 con 0x7fcb78004800 2024-05-27T12:33:30.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.596+0000 7fcb96330640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fcb900cd320 con 0x7fcb900c9740 2024-05-27T12:33:30.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.596+0000 7fcb96330640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fcb9009abb0 con 0x7fcb900af300 2024-05-27T12:33:30.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.597+0000 7fcb8ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb78004800 0x7fcb90159780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:30.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.597+0000 7fcb8ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb78004800 0x7fcb90159780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33358/0 (socket says 172.21.15.55:33358) 2024-05-27T12:33:30.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.597+0000 7fcb8ffff640 1 -- 172.21.15.55:0/1329909666 learned_addr learned my addr 172.21.15.55:0/1329909666 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:33:30.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.597+0000 7fcb8f7fe640 1 --2- 172.21.15.55:0/1329909666 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb900c9740 0x7fcb900c9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:30.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.597+0000 7fcb948cd640 1 --2- 172.21.15.55:0/1329909666 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcb900af300 0x7fcb900af780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:30.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.597+0000 7fcb8ffff640 1 -- 172.21.15.55:0/1329909666 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcb900af300 msgr2=0x7fcb900af780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:30.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.597+0000 7fcb8ffff640 1 --2- 172.21.15.55:0/1329909666 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcb900af300 0x7fcb900af780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:30.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.597+0000 7fcb8ffff640 1 -- 172.21.15.55:0/1329909666 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb900c9740 msgr2=0x7fcb900c9bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:30.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.597+0000 7fcb8ffff640 1 --2- 172.21.15.55:0/1329909666 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb900c9740 0x7fcb900c9bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:30.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.597+0000 7fcb8ffff640 1 -- 172.21.15.55:0/1329909666 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb900afee0 con 0x7fcb78004800 2024-05-27T12:33:30.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.597+0000 7fcb8f7fe640 1 --2- 172.21.15.55:0/1329909666 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb900c9740 0x7fcb900c9bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T12:33:30.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.597+0000 7fcb8ffff640 1 --2- 172.21.15.55:0/1329909666 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb78004800 0x7fcb90159780 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fcb800019b0 tx=0x7fcb800074e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:30.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.597+0000 7fcb8cff9640 1 -- 172.21.15.55:0/1329909666 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb8000e6e0 con 0x7fcb78004800 2024-05-27T12:33:30.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.597+0000 7fcb8cff9640 1 -- 172.21.15.55:0/1329909666 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb80018070 con 0x7fcb78004800 2024-05-27T12:33:30.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.597+0000 7fcb96330640 1 -- 172.21.15.55:0/1329909666 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb900b01c0 con 0x7fcb78004800 2024-05-27T12:33:30.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.597+0000 7fcb8cff9640 1 -- 172.21.15.55:0/1329909666 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb8000eaa0 con 0x7fcb78004800 2024-05-27T12:33:30.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.597+0000 7fcb96330640 1 -- 172.21.15.55:0/1329909666 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb900b0780 con 0x7fcb78004800 2024-05-27T12:33:30.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.598+0000 7fcb96330640 1 -- 172.21.15.55:0/1329909666 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb90068a70 con 0x7fcb78004800 2024-05-27T12:33:30.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.599+0000 7fcb8cff9640 1 -- 172.21.15.55:0/1329909666 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fcb8001d460 con 0x7fcb78004800 2024-05-27T12:33:30.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.599+0000 7fcb8cff9640 1 --2- 172.21.15.55:0/1329909666 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fcb7c06c8f0 0x7fcb7c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:30.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.599+0000 7fcb8cff9640 1 -- 172.21.15.55:0/1329909666 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 4857+0+0 (secure 0 0 0) 0x7fcb8008b970 con 0x7fcb78004800 2024-05-27T12:33:30.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.600+0000 7fcb8f7fe640 1 --2- 172.21.15.55:0/1329909666 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fcb7c06c8f0 0x7fcb7c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:30.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.600+0000 7fcb8f7fe640 1 --2- 172.21.15.55:0/1329909666 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fcb7c06c8f0 0x7fcb7c06edb0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fcb8400ba00 tx=0x7fcb84030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:30.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.603+0000 7fcb8cff9640 1 -- 172.21.15.55:0/1329909666 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fcb9009b380 con 0x7fcb78004800 2024-05-27T12:33:30.860 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.861+0000 7fcb96330640 1 -- 172.21.15.55:0/1329909666 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) -- 0x7fcb90160c40 con 0x7fcb78004800 2024-05-27T12:33:30.866 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.867+0000 7fcb8cff9640 1 -- 172.21.15.55:0/1329909666 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v5) ==== 90+0+0 (secure 0 0 0) 0x7fcb80059aa0 con 0x7fcb78004800 2024-05-27T12:33:30.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.869+0000 7fcb96330640 1 -- 172.21.15.55:0/1329909666 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fcb7c06c8f0 msgr2=0x7fcb7c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:30.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.869+0000 7fcb96330640 1 --2- 172.21.15.55:0/1329909666 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fcb7c06c8f0 0x7fcb7c06edb0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fcb8400ba00 tx=0x7fcb84030000 comp rx=0 tx=0).stop 2024-05-27T12:33:30.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.869+0000 7fcb96330640 1 -- 172.21.15.55:0/1329909666 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb78004800 msgr2=0x7fcb90159780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:30.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.869+0000 7fcb96330640 1 --2- 172.21.15.55:0/1329909666 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb78004800 0x7fcb90159780 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fcb800019b0 tx=0x7fcb800074e0 comp rx=0 tx=0).stop 2024-05-27T12:33:30.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.869+0000 7fcb96330640 1 -- 172.21.15.55:0/1329909666 shutdown_connections 2024-05-27T12:33:30.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.869+0000 7fcb96330640 1 --2- 172.21.15.55:0/1329909666 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcb900af300 0x7fcb900af780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:30.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.869+0000 7fcb96330640 1 --2- 172.21.15.55:0/1329909666 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fcb7c06c8f0 0x7fcb7c06edb0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:30.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.869+0000 7fcb96330640 1 --2- 172.21.15.55:0/1329909666 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb900c9740 0x7fcb900c9bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:30.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.869+0000 7fcb96330640 1 --2- 172.21.15.55:0/1329909666 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb78004800 0x7fcb90159780 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:30.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.869+0000 7fcb96330640 1 -- 172.21.15.55:0/1329909666 >> 172.21.15.55:0/1329909666 conn(0x7fcb900b4160 msgr2=0x7fcb90161320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:30.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.869+0000 7fcb96330640 1 -- 172.21.15.55:0/1329909666 shutdown_connections 2024-05-27T12:33:30.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.869+0000 7fcb96330640 1 -- 172.21.15.55:0/1329909666 wait complete. 2024-05-27T12:33:30.879 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-05-27T12:33:30.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.984+0000 7f871b8c2640 1 Processor -- start 2024-05-27T12:33:30.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.985+0000 7f871b8c2640 1 -- start start 2024-05-27T12:33:30.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.985+0000 7f871b8c2640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f87140cfb40 0x7f87140d1830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:30.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.985+0000 7f871b8c2640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f87140d1d70 0x7f87140b78f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:30.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.985+0000 7f871b8c2640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f871415eee0 con 0x7f871415eb00 2024-05-27T12:33:30.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.985+0000 7f871b8c2640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f87140d5700 con 0x7f87140d1d70 2024-05-27T12:33:30.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.985+0000 7f871b8c2640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f87140d21a0 con 0x7f87140cfb40 2024-05-27T12:33:30.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.986+0000 7f8719e5f640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f87140d1d70 0x7f87140b78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:30.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.986+0000 7f871965e640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f871415eb00 0x7f87140d3e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:50360/0 (socket says 172.21.15.55:50360) 2024-05-27T12:33:30.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.986+0000 7f8719e5f640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f87140d1d70 0x7f87140b78f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33360/0 (socket says 172.21.15.55:33360) 2024-05-27T12:33:30.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.986+0000 7f871965e640 1 -- 172.21.15.55:0/2440039618 learned_addr learned my addr 172.21.15.55:0/2440039618 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-27T12:33:30.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.986+0000 7f8718e5d640 1 --2- 172.21.15.55:0/2440039618 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f87140cfb40 0x7f87140d1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:30.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.986+0000 7f8719e5f640 1 -- 172.21.15.55:0/2440039618 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f87140cfb40 msgr2=0x7f87140d1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:30.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.986+0000 7f8719e5f640 1 --2- 172.21.15.55:0/2440039618 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f87140cfb40 0x7f87140d1830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:30.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.986+0000 7f8719e5f640 1 -- 172.21.15.55:0/2440039618 >> v1:172.21.15.55:6789/0 conn(0x7f871415eb00 legacy=0x7f87140d3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:30.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.986+0000 7f8713fff640 1 -- 172.21.15.55:0/2440039618 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3968479417 0 0) 0x7f871415eee0 con 0x7f871415eb00 2024-05-27T12:33:30.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.986+0000 7f8719e5f640 1 -- 172.21.15.55:0/2440039618 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87140d4660 con 0x7f87140d1d70 2024-05-27T12:33:30.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.987+0000 7f8719e5f640 1 --2- 172.21.15.55:0/2440039618 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87140d1d70 0x7f87140b78f0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f8704009dc0 tx=0x7f870402a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdbec87e99c21399 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:30.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.987+0000 7f8713fff640 1 -- 172.21.15.55:0/2440039618 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8704007740 con 0x7f87140d1d70 2024-05-27T12:33:30.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.987+0000 7f8713fff640 1 -- 172.21.15.55:0/2440039618 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87040078e0 con 0x7f87140d1d70 2024-05-27T12:33:30.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.987+0000 7f8713fff640 1 -- 172.21.15.55:0/2440039618 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8704007cb0 con 0x7f87140d1d70 2024-05-27T12:33:30.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.987+0000 7f871b8c2640 1 -- 172.21.15.55:0/2440039618 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87140d1d70 msgr2=0x7f87140b78f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:30.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.987+0000 7f871b8c2640 1 --2- 172.21.15.55:0/2440039618 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87140d1d70 0x7f87140b78f0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f8704009dc0 tx=0x7f870402a710 comp rx=0 tx=0).stop 2024-05-27T12:33:30.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.987+0000 7f871b8c2640 1 -- 172.21.15.55:0/2440039618 shutdown_connections 2024-05-27T12:33:30.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.987+0000 7f871b8c2640 1 --2- 172.21.15.55:0/2440039618 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f87140cfb40 0x7f87140d1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:30.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.987+0000 7f871b8c2640 1 --2- 172.21.15.55:0/2440039618 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87140d1d70 0x7f87140b78f0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:30.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.987+0000 7f871b8c2640 1 -- 172.21.15.55:0/2440039618 >> 172.21.15.55:0/2440039618 conn(0x7f8714067a50 msgr2=0x7f8714067e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:30.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.988+0000 7f871b8c2640 1 -- 172.21.15.55:0/2440039618 shutdown_connections 2024-05-27T12:33:30.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.988+0000 7f871b8c2640 1 -- 172.21.15.55:0/2440039618 wait complete. 2024-05-27T12:33:30.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.989+0000 7f871b8c2640 1 Processor -- start 2024-05-27T12:33:30.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.989+0000 7f871b8c2640 1 -- start start 2024-05-27T12:33:30.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.989+0000 7f871b8c2640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f87140cfb40 0x7f8714161da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:30.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.989+0000 7f871b8c2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87140d1d70 0x7f871415f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:30.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.990+0000 7f871b8c2640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f871415eb00 0x7f87140b3f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:30.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.990+0000 7f871b8c2640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f87140d4f00 con 0x7f87140d1d70 2024-05-27T12:33:30.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.990+0000 7f871b8c2640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f87140d4c20 con 0x7f871415eb00 2024-05-27T12:33:30.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.990+0000 7f871b8c2640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f87140d51e0 con 0x7f87140cfb40 2024-05-27T12:33:30.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.990+0000 7f8718e5d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87140d1d70 0x7f871415f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:30.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.990+0000 7f8718e5d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87140d1d70 0x7f871415f0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33372/0 (socket says 172.21.15.55:33372) 2024-05-27T12:33:30.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.990+0000 7f8718e5d640 1 -- 172.21.15.55:0/561569702 learned_addr learned my addr 172.21.15.55:0/561569702 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:33:30.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.990+0000 7f871965e640 1 --2- 172.21.15.55:0/561569702 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f87140cfb40 0x7f8714161da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:30.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.990+0000 7f8719e5f640 1 --2- 172.21.15.55:0/561569702 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f871415eb00 0x7f87140b3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:30.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.990+0000 7f8718e5d640 1 -- 172.21.15.55:0/561569702 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f87140cfb40 msgr2=0x7f8714161da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:30.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.990+0000 7f8718e5d640 1 --2- 172.21.15.55:0/561569702 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f87140cfb40 0x7f8714161da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:30.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.990+0000 7f8718e5d640 1 -- 172.21.15.55:0/561569702 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f871415eb00 msgr2=0x7f87140b3f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:30.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.990+0000 7f8718e5d640 1 --2- 172.21.15.55:0/561569702 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f871415eb00 0x7f87140b3f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:30.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.990+0000 7f8718e5d640 1 -- 172.21.15.55:0/561569702 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f871415f610 con 0x7f87140d1d70 2024-05-27T12:33:30.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.990+0000 7f8718e5d640 1 --2- 172.21.15.55:0/561569702 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87140d1d70 0x7f871415f0d0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f870800c7f0 tx=0x7f870800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:30.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.990+0000 7f8711ffb640 1 -- 172.21.15.55:0/561569702 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8708015070 con 0x7f87140d1d70 2024-05-27T12:33:30.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.990+0000 7f8711ffb640 1 -- 172.21.15.55:0/561569702 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8708004240 con 0x7f87140d1d70 2024-05-27T12:33:30.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.990+0000 7f8711ffb640 1 -- 172.21.15.55:0/561569702 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8708007620 con 0x7f87140d1d70 2024-05-27T12:33:30.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.990+0000 7f871b8c2640 1 -- 172.21.15.55:0/561569702 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87141f44f0 con 0x7f87140d1d70 2024-05-27T12:33:30.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.991+0000 7f871b8c2640 1 -- 172.21.15.55:0/561569702 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87141612c0 con 0x7f87140d1d70 2024-05-27T12:33:30.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.992+0000 7f871b8c2640 1 -- 172.21.15.55:0/561569702 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8714068a70 con 0x7f87140d1d70 2024-05-27T12:33:30.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.992+0000 7f8711ffb640 1 -- 172.21.15.55:0/561569702 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f87080079d0 con 0x7f87140d1d70 2024-05-27T12:33:30.993 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.992+0000 7f8711ffb640 1 --2- 172.21.15.55:0/561569702 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f870006c8f0 0x7f870006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:30.993 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.993+0000 7f8711ffb640 1 -- 172.21.15.55:0/561569702 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 4857+0+0 (secure 0 0 0) 0x7f870808b7c0 con 0x7f87140d1d70 2024-05-27T12:33:30.993 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.993+0000 7f871965e640 1 --2- 172.21.15.55:0/561569702 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f870006c8f0 0x7f870006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:30.993 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.993+0000 7f871965e640 1 --2- 172.21.15.55:0/561569702 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f870006c8f0 0x7f870006edb0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f870c007fd0 tx=0x7f870c007de0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:30.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:30.997+0000 7f8711ffb640 1 -- 172.21.15.55:0/561569702 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f87080598f0 con 0x7f87140d1d70 2024-05-27T12:33:31.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.262+0000 7f871b8c2640 1 -- 172.21.15.55:0/561569702 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) -- 0x7f87140cec30 con 0x7f87140d1d70 2024-05-27T12:33:31.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.264+0000 7f8711ffb640 1 -- 172.21.15.55:0/561569702 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v6) ==== 90+0+0 (secure 0 0 0) 0x7f870805dbf0 con 0x7f87140d1d70 2024-05-27T12:33:31.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.266+0000 7f871b8c2640 1 -- 172.21.15.55:0/561569702 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f870006c8f0 msgr2=0x7f870006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:31.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.266+0000 7f871b8c2640 1 --2- 172.21.15.55:0/561569702 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f870006c8f0 0x7f870006edb0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f870c007fd0 tx=0x7f870c007de0 comp rx=0 tx=0).stop 2024-05-27T12:33:31.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.266+0000 7f871b8c2640 1 -- 172.21.15.55:0/561569702 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87140d1d70 msgr2=0x7f871415f0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:31.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.266+0000 7f871b8c2640 1 --2- 172.21.15.55:0/561569702 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87140d1d70 0x7f871415f0d0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f870800c7f0 tx=0x7f870800ccb0 comp rx=0 tx=0).stop 2024-05-27T12:33:31.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.266+0000 7f871b8c2640 1 -- 172.21.15.55:0/561569702 shutdown_connections 2024-05-27T12:33:31.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.266+0000 7f871b8c2640 1 --2- 172.21.15.55:0/561569702 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f870006c8f0 0x7f870006edb0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:31.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.266+0000 7f871b8c2640 1 --2- 172.21.15.55:0/561569702 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f871415eb00 0x7f87140b3f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:31.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.266+0000 7f871b8c2640 1 --2- 172.21.15.55:0/561569702 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87140d1d70 0x7f871415f0d0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:31.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.266+0000 7f871b8c2640 1 --2- 172.21.15.55:0/561569702 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f87140cfb40 0x7f8714161da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:31.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.266+0000 7f871b8c2640 1 -- 172.21.15.55:0/561569702 >> 172.21.15.55:0/561569702 conn(0x7f8714067a50 msgr2=0x7f871415ddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:31.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.266+0000 7f871b8c2640 1 -- 172.21.15.55:0/561569702 shutdown_connections 2024-05-27T12:33:31.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.266+0000 7f871b8c2640 1 -- 172.21.15.55:0/561569702 wait complete. 2024-05-27T12:33:31.277 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-05-27T12:33:31.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.383+0000 7f857b5e8640 1 Processor -- start 2024-05-27T12:33:31.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.383+0000 7f857b5e8640 1 -- start start 2024-05-27T12:33:31.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.384+0000 7f857b5e8640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f857415eb60 0x7f857406d930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:31.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.384+0000 7f857b5e8640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f857409b980 0x7f85740d1390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:31.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.384+0000 7f857b5e8640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f857409aa30 0x7f857409aec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:31.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.384+0000 7f857b5e8640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f85740d1cc0 con 0x7f857409b980 2024-05-27T12:33:31.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.384+0000 7f857b5e8640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f857406cb70 con 0x7f857415eb60 2024-05-27T12:33:31.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.384+0000 7f857b5e8640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f857406ce50 con 0x7f857409aa30 2024-05-27T12:33:31.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.384+0000 7f8578b83640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f857409b980 0x7f85740d1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:31.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.384+0000 7f8578b83640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f857409b980 0x7f85740d1390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33386/0 (socket says 172.21.15.55:33386) 2024-05-27T12:33:31.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.384+0000 7f8578b83640 1 -- 172.21.15.55:0/2077851081 learned_addr learned my addr 172.21.15.55:0/2077851081 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:33:31.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.384+0000 7f8579384640 1 --2- 172.21.15.55:0/2077851081 >> v2:172.21.15.72:3300/0 conn(0x7f857415eb60 0x7f857406d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:31.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.384+0000 7f8579b85640 1 --2- 172.21.15.55:0/2077851081 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f857409aa30 0x7f857409aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:31.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.384+0000 7f8578b83640 1 -- 172.21.15.55:0/2077851081 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f857409aa30 msgr2=0x7f857409aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:31.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.384+0000 7f8578b83640 1 --2- 172.21.15.55:0/2077851081 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f857409aa30 0x7f857409aec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:31.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.384+0000 7f8578b83640 1 -- 172.21.15.55:0/2077851081 >> v2:172.21.15.72:3300/0 conn(0x7f857415eb60 msgr2=0x7f857406d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:31.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.384+0000 7f8578b83640 1 --2- 172.21.15.55:0/2077851081 >> v2:172.21.15.72:3300/0 conn(0x7f857415eb60 0x7f857406d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:31.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.384+0000 7f8578b83640 1 -- 172.21.15.55:0/2077851081 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f857406d130 con 0x7f857409b980 2024-05-27T12:33:31.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.384+0000 7f8579384640 1 --2- 172.21.15.55:0/2077851081 >> v2:172.21.15.72:3300/0 conn(0x7f857415eb60 0x7f857406d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T12:33:31.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.385+0000 7f8578b83640 1 --2- 172.21.15.55:0/2077851081 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f857409b980 0x7f85740d1390 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f857406fe80 tx=0x7f856402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41cee109e2f63358 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:31.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.385+0000 7f856bfff640 1 -- 172.21.15.55:0/2077851081 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8564037070 con 0x7f857409b980 2024-05-27T12:33:31.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.385+0000 7f856bfff640 1 -- 172.21.15.55:0/2077851081 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8564032440 con 0x7f857409b980 2024-05-27T12:33:31.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.385+0000 7f856bfff640 1 -- 172.21.15.55:0/2077851081 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8564032810 con 0x7f857409b980 2024-05-27T12:33:31.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.386+0000 7f857b5e8640 1 -- 172.21.15.55:0/2077851081 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f857409b980 msgr2=0x7f85740d1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:31.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.386+0000 7f857b5e8640 1 --2- 172.21.15.55:0/2077851081 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f857409b980 0x7f85740d1390 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f857406fe80 tx=0x7f856402a140 comp rx=0 tx=0).stop 2024-05-27T12:33:31.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.386+0000 7f857b5e8640 1 -- 172.21.15.55:0/2077851081 shutdown_connections 2024-05-27T12:33:31.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.386+0000 7f857b5e8640 1 --2- 172.21.15.55:0/2077851081 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f857409aa30 0x7f857409aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:31.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.386+0000 7f857b5e8640 1 --2- 172.21.15.55:0/2077851081 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f857409b980 0x7f85740d1390 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:31.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.386+0000 7f857b5e8640 1 --2- 172.21.15.55:0/2077851081 >> v2:172.21.15.72:3300/0 conn(0x7f857415eb60 0x7f857406d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:31.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.386+0000 7f857b5e8640 1 -- 172.21.15.55:0/2077851081 >> 172.21.15.55:0/2077851081 conn(0x7f85740b4160 msgr2=0x7f85740b4570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:31.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.386+0000 7f857b5e8640 1 -- 172.21.15.55:0/2077851081 shutdown_connections 2024-05-27T12:33:31.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.386+0000 7f857b5e8640 1 -- 172.21.15.55:0/2077851081 wait complete. 2024-05-27T12:33:31.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.387+0000 7f857b5e8640 1 Processor -- start 2024-05-27T12:33:31.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.387+0000 7f857b5e8640 1 -- start start 2024-05-27T12:33:31.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.388+0000 7f857b5e8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f857409aa30 0x7f857415adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:31.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.388+0000 7f857b5e8640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f857409b980 0x7f85740b5060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:31.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.388+0000 7f857b5e8640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f857415eb60 0x7f85740c8440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:31.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.388+0000 7f857b5e8640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f85740d18d0 con 0x7f857409aa30 2024-05-27T12:33:31.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.388+0000 7f857b5e8640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f857406de70 con 0x7f857415eb60 2024-05-27T12:33:31.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.388+0000 7f857b5e8640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f85740d1a50 con 0x7f857409b980 2024-05-27T12:33:31.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.388+0000 7f8579384640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f857409aa30 0x7f857415adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:31.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.388+0000 7f8579384640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f857409aa30 0x7f857415adb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33398/0 (socket says 172.21.15.55:33398) 2024-05-27T12:33:31.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.388+0000 7f8579384640 1 -- 172.21.15.55:0/570129254 learned_addr learned my addr 172.21.15.55:0/570129254 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:33:31.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.388+0000 7f8578b83640 1 --2- 172.21.15.55:0/570129254 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f857409b980 0x7f85740b5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:31.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.388+0000 7f8579b85640 1 --2- 172.21.15.55:0/570129254 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f857415eb60 0x7f85740c8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:31.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.388+0000 7f8579384640 1 -- 172.21.15.55:0/570129254 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f857409b980 msgr2=0x7f85740b5060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:31.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.388+0000 7f8579384640 1 --2- 172.21.15.55:0/570129254 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f857409b980 0x7f85740b5060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:31.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.388+0000 7f8579384640 1 -- 172.21.15.55:0/570129254 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f857415eb60 msgr2=0x7f85740c8440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:31.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.388+0000 7f8579384640 1 --2- 172.21.15.55:0/570129254 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f857415eb60 0x7f85740c8440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:31.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.388+0000 7f8579384640 1 -- 172.21.15.55:0/570129254 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85740b55a0 con 0x7f857409aa30 2024-05-27T12:33:31.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.389+0000 7f8579384640 1 --2- 172.21.15.55:0/570129254 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f857409aa30 0x7f857415adb0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f857000e7e0 tx=0x7f857000eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:31.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.389+0000 7f8569ffb640 1 -- 172.21.15.55:0/570129254 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f857000f040 con 0x7f857409aa30 2024-05-27T12:33:31.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.389+0000 7f8569ffb640 1 -- 172.21.15.55:0/570129254 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8570004030 con 0x7f857409aa30 2024-05-27T12:33:31.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.389+0000 7f857b5e8640 1 -- 172.21.15.55:0/570129254 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85740c61a0 con 0x7f857409aa30 2024-05-27T12:33:31.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.389+0000 7f8569ffb640 1 -- 172.21.15.55:0/570129254 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8570004400 con 0x7f857409aa30 2024-05-27T12:33:31.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.389+0000 7f857b5e8640 1 -- 172.21.15.55:0/570129254 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8574156940 con 0x7f857409aa30 2024-05-27T12:33:31.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.390+0000 7f857b5e8640 1 -- 172.21.15.55:0/570129254 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8574068a70 con 0x7f857409aa30 2024-05-27T12:33:31.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.390+0000 7f8569ffb640 1 -- 172.21.15.55:0/570129254 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f857000c6d0 con 0x7f857409aa30 2024-05-27T12:33:31.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.391+0000 7f8569ffb640 1 --2- 172.21.15.55:0/570129254 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f855806c8f0 0x7f855806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:31.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.391+0000 7f8569ffb640 1 -- 172.21.15.55:0/570129254 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 4857+0+0 (secure 0 0 0) 0x7f857008b610 con 0x7f857409aa30 2024-05-27T12:33:31.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.391+0000 7f8578b83640 1 --2- 172.21.15.55:0/570129254 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f855806c8f0 0x7f855806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:31.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.392+0000 7f8578b83640 1 --2- 172.21.15.55:0/570129254 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f855806c8f0 0x7f855806edb0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f8564034000 tx=0x7f856402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:31.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.395+0000 7f8569ffb640 1 -- 172.21.15.55:0/570129254 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8570017020 con 0x7f857409aa30 2024-05-27T12:33:31.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.659+0000 7f857b5e8640 1 -- 172.21.15.55:0/570129254 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) -- 0x7f85740d0d60 con 0x7f857409aa30 2024-05-27T12:33:31.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.665+0000 7f8569ffb640 1 -- 172.21.15.55:0/570129254 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v7) ==== 90+0+0 (secure 0 0 0) 0x7f8570059d90 con 0x7f857409aa30 2024-05-27T12:33:31.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.667+0000 7f857b5e8640 1 -- 172.21.15.55:0/570129254 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f855806c8f0 msgr2=0x7f855806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:31.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.667+0000 7f857b5e8640 1 --2- 172.21.15.55:0/570129254 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f855806c8f0 0x7f855806edb0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f8564034000 tx=0x7f856402e000 comp rx=0 tx=0).stop 2024-05-27T12:33:31.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.667+0000 7f857b5e8640 1 -- 172.21.15.55:0/570129254 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f857409aa30 msgr2=0x7f857415adb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:31.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.667+0000 7f857b5e8640 1 --2- 172.21.15.55:0/570129254 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f857409aa30 0x7f857415adb0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f857000e7e0 tx=0x7f857000eca0 comp rx=0 tx=0).stop 2024-05-27T12:33:31.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.668+0000 7f857b5e8640 1 -- 172.21.15.55:0/570129254 shutdown_connections 2024-05-27T12:33:31.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.668+0000 7f857b5e8640 1 --2- 172.21.15.55:0/570129254 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f855806c8f0 0x7f855806edb0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:31.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.668+0000 7f857b5e8640 1 --2- 172.21.15.55:0/570129254 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f857415eb60 0x7f85740c8440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:31.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.668+0000 7f857b5e8640 1 --2- 172.21.15.55:0/570129254 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f857409b980 0x7f85740b5060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:31.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.668+0000 7f857b5e8640 1 --2- 172.21.15.55:0/570129254 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f857409aa30 0x7f857415adb0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:31.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.668+0000 7f857b5e8640 1 -- 172.21.15.55:0/570129254 >> 172.21.15.55:0/570129254 conn(0x7f85740b4160 msgr2=0x7f85741576c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:31.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.668+0000 7f857b5e8640 1 -- 172.21.15.55:0/570129254 shutdown_connections 2024-05-27T12:33:31.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.668+0000 7f857b5e8640 1 -- 172.21.15.55:0/570129254 wait complete. 2024-05-27T12:33:31.678 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-05-27T12:33:31.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.783+0000 7fc755ee8640 1 Processor -- start 2024-05-27T12:33:31.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.783+0000 7fc755ee8640 1 -- start start 2024-05-27T12:33:31.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.784+0000 7fc755ee8640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc75015b700 0x7fc7500ce3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:31.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.784+0000 7fc755ee8640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc75006c040 0x7fc7500b4300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:31.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.784+0000 7fc755ee8640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc75015bae0 con 0x7fc75006fe70 2024-05-27T12:33:31.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.784+0000 7fc755ee8640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7fc7500cf6e0 con 0x7fc75015b700 2024-05-27T12:33:31.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.784+0000 7fc755ee8640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fc7500b3540 con 0x7fc75006c040 2024-05-27T12:33:31.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.784+0000 7fc74f7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc75015b700 0x7fc7500ce3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:31.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.784+0000 7fc74effd640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fc75006fe70 0x7fc75006b930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:50362/0 (socket says 172.21.15.55:50362) 2024-05-27T12:33:31.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.784+0000 7fc74effd640 1 -- 172.21.15.55:0/2639604625 learned_addr learned my addr 172.21.15.55:0/2639604625 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-27T12:33:31.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.784+0000 7fc74f7fe640 1 -- 172.21.15.55:0/2639604625 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc75006c040 msgr2=0x7fc7500b4300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:31.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.784+0000 7fc74ffff640 1 --2- 172.21.15.55:0/2639604625 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc75006c040 0x7fc7500b4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:31.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.784+0000 7fc74e7fc640 1 -- 172.21.15.55:0/2639604625 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 324499248 0 0) 0x7fc75015bae0 con 0x7fc75006fe70 2024-05-27T12:33:31.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.784+0000 7fc74f7fe640 1 --2- 172.21.15.55:0/2639604625 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc75006c040 0x7fc7500b4300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:31.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.784+0000 7fc74f7fe640 1 -- 172.21.15.55:0/2639604625 >> v1:172.21.15.55:6789/0 conn(0x7fc75006fe70 legacy=0x7fc75006b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:31.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.784+0000 7fc74f7fe640 1 -- 172.21.15.55:0/2639604625 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7500b3820 con 0x7fc75015b700 2024-05-27T12:33:31.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.784+0000 7fc74ffff640 1 --2- 172.21.15.55:0/2639604625 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc75006c040 0x7fc7500b4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T12:33:31.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.785+0000 7fc74f7fe640 1 --2- 172.21.15.55:0/2639604625 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc75015b700 0x7fc7500ce3b0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fc7400097a0 tx=0x7fc74002a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25240cc82ef6b335 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:31.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.785+0000 7fc74e7fc640 1 -- 172.21.15.55:0/2639604625 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc740037070 con 0x7fc75015b700 2024-05-27T12:33:31.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.785+0000 7fc74e7fc640 1 -- 172.21.15.55:0/2639604625 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc74002ae50 con 0x7fc75015b700 2024-05-27T12:33:31.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.785+0000 7fc74e7fc640 1 -- 172.21.15.55:0/2639604625 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc740032660 con 0x7fc75015b700 2024-05-27T12:33:31.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.786+0000 7fc755ee8640 1 -- 172.21.15.55:0/2639604625 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc75015b700 msgr2=0x7fc7500ce3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:31.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.786+0000 7fc755ee8640 1 --2- 172.21.15.55:0/2639604625 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc75015b700 0x7fc7500ce3b0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fc7400097a0 tx=0x7fc74002a100 comp rx=0 tx=0).stop 2024-05-27T12:33:31.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.786+0000 7fc755ee8640 1 -- 172.21.15.55:0/2639604625 shutdown_connections 2024-05-27T12:33:31.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.786+0000 7fc755ee8640 1 --2- 172.21.15.55:0/2639604625 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc75006c040 0x7fc7500b4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:31.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.786+0000 7fc755ee8640 1 --2- 172.21.15.55:0/2639604625 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc75015b700 0x7fc7500ce3b0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:31.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.786+0000 7fc755ee8640 1 -- 172.21.15.55:0/2639604625 >> 172.21.15.55:0/2639604625 conn(0x7fc7500b2240 msgr2=0x7fc7500b2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:31.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.786+0000 7fc755ee8640 1 -- 172.21.15.55:0/2639604625 shutdown_connections 2024-05-27T12:33:31.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.786+0000 7fc755ee8640 1 -- 172.21.15.55:0/2639604625 wait complete. 2024-05-27T12:33:31.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.787+0000 7fc755ee8640 1 Processor -- start 2024-05-27T12:33:31.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.787+0000 7fc755ee8640 1 -- start start 2024-05-27T12:33:31.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.788+0000 7fc755ee8640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc75006c040 0x7fc7501e5e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:31.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.788+0000 7fc755ee8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc75006fe70 0x7fc7500720d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:31.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.788+0000 7fc755ee8640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc75015b700 0x7fc750157100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:31.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.788+0000 7fc755ee8640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7fc7500cf3a0 con 0x7fc75006fe70 2024-05-27T12:33:31.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.788+0000 7fc755ee8640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fc7500b3de0 con 0x7fc75006c040 2024-05-27T12:33:31.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.788+0000 7fc755ee8640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fc7500b4840 con 0x7fc75015b700 2024-05-27T12:33:31.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.788+0000 7fc74effd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc75006fe70 0x7fc7500720d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:31.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.788+0000 7fc74effd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc75006fe70 0x7fc7500720d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33412/0 (socket says 172.21.15.55:33412) 2024-05-27T12:33:31.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.788+0000 7fc74effd640 1 -- 172.21.15.55:0/1255358040 learned_addr learned my addr 172.21.15.55:0/1255358040 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:33:31.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.788+0000 7fc74f7fe640 1 --2- 172.21.15.55:0/1255358040 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc75006c040 0x7fc7501e5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:31.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.788+0000 7fc74ffff640 1 --2- 172.21.15.55:0/1255358040 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc75015b700 0x7fc750157100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:31.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.788+0000 7fc74effd640 1 -- 172.21.15.55:0/1255358040 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc75015b700 msgr2=0x7fc750157100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:31.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.788+0000 7fc74effd640 1 --2- 172.21.15.55:0/1255358040 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc75015b700 0x7fc750157100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:31.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.788+0000 7fc74effd640 1 -- 172.21.15.55:0/1255358040 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc75006c040 msgr2=0x7fc7501e5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:31.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.788+0000 7fc74effd640 1 --2- 172.21.15.55:0/1255358040 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc75006c040 0x7fc7501e5e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:31.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.788+0000 7fc74effd640 1 -- 172.21.15.55:0/1255358040 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7501e6370 con 0x7fc75006fe70 2024-05-27T12:33:31.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.788+0000 7fc74f7fe640 1 --2- 172.21.15.55:0/1255358040 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc75006c040 0x7fc7501e5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T12:33:31.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.788+0000 7fc74ffff640 1 --2- 172.21.15.55:0/1255358040 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc75015b700 0x7fc750157100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T12:33:31.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.789+0000 7fc74effd640 1 --2- 172.21.15.55:0/1255358040 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc75006fe70 0x7fc7500720d0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fc74400c500 tx=0x7fc74400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:31.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.789+0000 7fc737fff640 1 -- 172.21.15.55:0/1255358040 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc744018070 con 0x7fc75006fe70 2024-05-27T12:33:31.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.789+0000 7fc737fff640 1 -- 172.21.15.55:0/1255358040 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc744007580 con 0x7fc75006fe70 2024-05-27T12:33:31.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.789+0000 7fc755ee8640 1 -- 172.21.15.55:0/1255358040 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc750158d70 con 0x7fc75006fe70 2024-05-27T12:33:31.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.789+0000 7fc737fff640 1 -- 172.21.15.55:0/1255358040 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc744004a20 con 0x7fc75006fe70 2024-05-27T12:33:31.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.789+0000 7fc755ee8640 1 -- 172.21.15.55:0/1255358040 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc750159330 con 0x7fc75006fe70 2024-05-27T12:33:31.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.790+0000 7fc755ee8640 1 -- 172.21.15.55:0/1255358040 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc750068a70 con 0x7fc75006fe70 2024-05-27T12:33:31.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.790+0000 7fc737fff640 1 -- 172.21.15.55:0/1255358040 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc74401b070 con 0x7fc75006fe70 2024-05-27T12:33:31.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.791+0000 7fc737fff640 1 --2- 172.21.15.55:0/1255358040 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fc73c06c8f0 0x7fc73c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:31.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.791+0000 7fc737fff640 1 -- 172.21.15.55:0/1255358040 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 4857+0+0 (secure 0 0 0) 0x7fc74408aa70 con 0x7fc75006fe70 2024-05-27T12:33:31.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.791+0000 7fc74f7fe640 1 --2- 172.21.15.55:0/1255358040 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fc73c06c8f0 0x7fc73c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:31.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.792+0000 7fc74f7fe640 1 --2- 172.21.15.55:0/1255358040 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fc73c06c8f0 0x7fc73c06edb0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc740034000 tx=0x7fc74002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:31.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:31.795+0000 7fc737fff640 1 -- 172.21.15.55:0/1255358040 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc7501e6370 con 0x7fc75006fe70 2024-05-27T12:33:32.049 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.050+0000 7fc755ee8640 1 -- 172.21.15.55:0/1255358040 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) -- 0x7fc7500cea80 con 0x7fc75006fe70 2024-05-27T12:33:32.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.052+0000 7fc737fff640 1 -- 172.21.15.55:0/1255358040 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v8) ==== 90+0+0 (secure 0 0 0) 0x7fc744059280 con 0x7fc75006fe70 2024-05-27T12:33:32.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.054+0000 7fc755ee8640 1 -- 172.21.15.55:0/1255358040 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fc73c06c8f0 msgr2=0x7fc73c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:32.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.054+0000 7fc755ee8640 1 --2- 172.21.15.55:0/1255358040 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fc73c06c8f0 0x7fc73c06edb0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc740034000 tx=0x7fc74002e000 comp rx=0 tx=0).stop 2024-05-27T12:33:32.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.054+0000 7fc755ee8640 1 -- 172.21.15.55:0/1255358040 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc75006fe70 msgr2=0x7fc7500720d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:32.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.054+0000 7fc755ee8640 1 --2- 172.21.15.55:0/1255358040 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc75006fe70 0x7fc7500720d0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fc74400c500 tx=0x7fc74400c9c0 comp rx=0 tx=0).stop 2024-05-27T12:33:32.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.054+0000 7fc755ee8640 1 -- 172.21.15.55:0/1255358040 shutdown_connections 2024-05-27T12:33:32.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.054+0000 7fc755ee8640 1 --2- 172.21.15.55:0/1255358040 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc75015b700 0x7fc750157100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:32.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.054+0000 7fc755ee8640 1 --2- 172.21.15.55:0/1255358040 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc75006fe70 0x7fc7500720d0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:32.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.054+0000 7fc755ee8640 1 --2- 172.21.15.55:0/1255358040 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fc73c06c8f0 0x7fc73c06edb0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:32.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.054+0000 7fc755ee8640 1 --2- 172.21.15.55:0/1255358040 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc75006c040 0x7fc7501e5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:32.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.054+0000 7fc755ee8640 1 -- 172.21.15.55:0/1255358040 >> 172.21.15.55:0/1255358040 conn(0x7fc7500b2240 msgr2=0x7fc75015dd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:32.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.055+0000 7fc755ee8640 1 -- 172.21.15.55:0/1255358040 shutdown_connections 2024-05-27T12:33:32.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.055+0000 7fc755ee8640 1 -- 172.21.15.55:0/1255358040 wait complete. 2024-05-27T12:33:32.065 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-05-27T12:33:32.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.171+0000 7f6f3557d640 1 Processor -- start 2024-05-27T12:33:32.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.171+0000 7f6f3557d640 1 -- start start 2024-05-27T12:33:32.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.172+0000 7f6f3557d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6f3015c8d0 0x7f6f300ccfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:32.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.172+0000 7f6f3557d640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6f3009b140 0x7f6f300ceb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:32.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.172+0000 7f6f3557d640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f300cda60 con 0x7f6f300b3760 2024-05-27T12:33:32.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.172+0000 7f6f3557d640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f6f300cdd40 con 0x7f6f3015c8d0 2024-05-27T12:33:32.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.172+0000 7f6f3557d640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f6f300ce020 con 0x7f6f3009b140 2024-05-27T12:33:32.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.172+0000 7f6f2effd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6f3015c8d0 0x7f6f300ccfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:32.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.172+0000 7f6f2effd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6f3015c8d0 0x7f6f300ccfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33422/0 (socket says 172.21.15.55:33422) 2024-05-27T12:33:32.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.172+0000 7f6f2effd640 1 -- 172.21.15.55:0/2841068338 learned_addr learned my addr 172.21.15.55:0/2841068338 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:33:32.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.173+0000 7f6f2effd640 1 -- 172.21.15.55:0/2841068338 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6f3009b140 msgr2=0x7f6f300ceb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:32.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.173+0000 7f6f2f7fe640 1 --2- 172.21.15.55:0/2841068338 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6f3009b140 0x7f6f300ceb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:32.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.173+0000 7f6f2effd640 1 --2- 172.21.15.55:0/2841068338 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6f3009b140 0x7f6f300ceb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:32.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.173+0000 7f6f2effd640 1 -- 172.21.15.55:0/2841068338 >> v1:172.21.15.72:6789/0 conn(0x7f6f300b3760 legacy=0x7f6f3009aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:32.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.173+0000 7f6f2effd640 1 -- 172.21.15.55:0/2841068338 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f300ce300 con 0x7f6f3015c8d0 2024-05-27T12:33:32.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.173+0000 7f6f2effd640 1 --2- 172.21.15.55:0/2841068338 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f3015c8d0 0x7f6f300ccfc0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f6f28009870 tx=0x7f6f2802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2881a6a48dc105e6 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:32.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.173+0000 7f6f2dffb640 1 -- 172.21.15.55:0/2841068338 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f28037070 con 0x7f6f3015c8d0 2024-05-27T12:33:32.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.174+0000 7f6f2dffb640 1 -- 172.21.15.55:0/2841068338 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f28032440 con 0x7f6f3015c8d0 2024-05-27T12:33:32.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.174+0000 7f6f2dffb640 1 -- 172.21.15.55:0/2841068338 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f28032810 con 0x7f6f3015c8d0 2024-05-27T12:33:32.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.174+0000 7f6f3557d640 1 -- 172.21.15.55:0/2841068338 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f3015c8d0 msgr2=0x7f6f300ccfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:32.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.174+0000 7f6f3557d640 1 --2- 172.21.15.55:0/2841068338 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f3015c8d0 0x7f6f300ccfc0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f6f28009870 tx=0x7f6f2802a210 comp rx=0 tx=0).stop 2024-05-27T12:33:32.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.174+0000 7f6f3557d640 1 -- 172.21.15.55:0/2841068338 shutdown_connections 2024-05-27T12:33:32.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.174+0000 7f6f3557d640 1 --2- 172.21.15.55:0/2841068338 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6f3009b140 0x7f6f300ceb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:32.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.174+0000 7f6f3557d640 1 --2- 172.21.15.55:0/2841068338 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f3015c8d0 0x7f6f300ccfc0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:32.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.174+0000 7f6f3557d640 1 -- 172.21.15.55:0/2841068338 >> 172.21.15.55:0/2841068338 conn(0x7f6f300d25e0 msgr2=0x7f6f300d29c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:32.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.174+0000 7f6f3557d640 1 -- 172.21.15.55:0/2841068338 shutdown_connections 2024-05-27T12:33:32.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.174+0000 7f6f3557d640 1 -- 172.21.15.55:0/2841068338 wait complete. 2024-05-27T12:33:32.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.175+0000 7f6f3557d640 1 Processor -- start 2024-05-27T12:33:32.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.175+0000 7f6f3557d640 1 -- start start 2024-05-27T12:33:32.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.176+0000 7f6f3557d640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f3009b140 0x7f6f30151d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:32.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.176+0000 7f6f3557d640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6f300b3760 0x7f6f300cb850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:32.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.176+0000 7f6f3557d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f3015c8d0 0x7f6f300c8470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:32.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.176+0000 7f6f3557d640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f6f300af290 con 0x7f6f3015c8d0 2024-05-27T12:33:32.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.176+0000 7f6f3557d640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f6f3015ccb0 con 0x7f6f3009b140 2024-05-27T12:33:32.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.176+0000 7f6f3557d640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f6f300af410 con 0x7f6f300b3760 2024-05-27T12:33:32.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.176+0000 7f6f2f7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f3015c8d0 0x7f6f300c8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:32.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.176+0000 7f6f2effd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f3009b140 0x7f6f30151d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:32.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.176+0000 7f6f2f7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f3015c8d0 0x7f6f300c8470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33430/0 (socket says 172.21.15.55:33430) 2024-05-27T12:33:32.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.176+0000 7f6f2f7fe640 1 -- 172.21.15.55:0/2913156800 learned_addr learned my addr 172.21.15.55:0/2913156800 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:33:32.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.176+0000 7f6f2e7fc640 1 --2- 172.21.15.55:0/2913156800 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6f300b3760 0x7f6f300cb850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:32.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.177+0000 7f6f2f7fe640 1 -- 172.21.15.55:0/2913156800 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6f300b3760 msgr2=0x7f6f300cb850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:32.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.177+0000 7f6f2f7fe640 1 --2- 172.21.15.55:0/2913156800 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6f300b3760 0x7f6f300cb850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:32.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.177+0000 7f6f2f7fe640 1 -- 172.21.15.55:0/2913156800 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f3009b140 msgr2=0x7f6f30151d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:32.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.177+0000 7f6f2f7fe640 1 --2- 172.21.15.55:0/2913156800 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f3009b140 0x7f6f30151d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:32.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.177+0000 7f6f2f7fe640 1 -- 172.21.15.55:0/2913156800 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f300b5ea0 con 0x7f6f3015c8d0 2024-05-27T12:33:32.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.177+0000 7f6f2f7fe640 1 --2- 172.21.15.55:0/2913156800 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f3015c8d0 0x7f6f300c8470 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f6f2000cdc0 tx=0x7f6f2000a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:32.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.177+0000 7f6f277fe640 1 -- 172.21.15.55:0/2913156800 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f20003b90 con 0x7f6f3015c8d0 2024-05-27T12:33:32.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.177+0000 7f6f277fe640 1 -- 172.21.15.55:0/2913156800 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f20003d50 con 0x7f6f3015c8d0 2024-05-27T12:33:32.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.177+0000 7f6f3557d640 1 -- 172.21.15.55:0/2913156800 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f301522d0 con 0x7f6f3015c8d0 2024-05-27T12:33:32.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.177+0000 7f6f277fe640 1 -- 172.21.15.55:0/2913156800 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f20004260 con 0x7f6f3015c8d0 2024-05-27T12:33:32.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.177+0000 7f6f3557d640 1 -- 172.21.15.55:0/2913156800 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f300c7310 con 0x7f6f3015c8d0 2024-05-27T12:33:32.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.178+0000 7f6f3557d640 1 -- 172.21.15.55:0/2913156800 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f30075460 con 0x7f6f3015c8d0 2024-05-27T12:33:32.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.179+0000 7f6f277fe640 1 -- 172.21.15.55:0/2913156800 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6f20004400 con 0x7f6f3015c8d0 2024-05-27T12:33:32.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.179+0000 7f6f277fe640 1 --2- 172.21.15.55:0/2913156800 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f6f1006c8f0 0x7f6f1006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:32.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.179+0000 7f6f277fe640 1 -- 172.21.15.55:0/2913156800 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 4857+0+0 (secure 0 0 0) 0x7f6f2008c0a0 con 0x7f6f3015c8d0 2024-05-27T12:33:32.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.179+0000 7f6f2effd640 1 --2- 172.21.15.55:0/2913156800 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f6f1006c8f0 0x7f6f1006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:32.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.180+0000 7f6f2effd640 1 --2- 172.21.15.55:0/2913156800 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f6f1006c8f0 0x7f6f1006edb0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f6f28034000 tx=0x7f6f2802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:32.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.184+0000 7f6f277fe640 1 -- 172.21.15.55:0/2913156800 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6f300b5ea0 con 0x7f6f3015c8d0 2024-05-27T12:33:32.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.439+0000 7f6f3557d640 1 -- 172.21.15.55:0/2913156800 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) -- 0x7f6f300b84a0 con 0x7f6f3015c8d0 2024-05-27T12:33:32.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.445+0000 7f6f277fe640 1 -- 172.21.15.55:0/2913156800 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v9) ==== 97+0+0 (secure 0 0 0) 0x7f6f2005a1d0 con 0x7f6f3015c8d0 2024-05-27T12:33:32.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.447+0000 7f6f3557d640 1 -- 172.21.15.55:0/2913156800 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f6f1006c8f0 msgr2=0x7f6f1006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:32.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.447+0000 7f6f3557d640 1 --2- 172.21.15.55:0/2913156800 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f6f1006c8f0 0x7f6f1006edb0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f6f28034000 tx=0x7f6f2802e000 comp rx=0 tx=0).stop 2024-05-27T12:33:32.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.447+0000 7f6f3557d640 1 -- 172.21.15.55:0/2913156800 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f3015c8d0 msgr2=0x7f6f300c8470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:32.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.447+0000 7f6f3557d640 1 --2- 172.21.15.55:0/2913156800 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f3015c8d0 0x7f6f300c8470 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f6f2000cdc0 tx=0x7f6f2000a660 comp rx=0 tx=0).stop 2024-05-27T12:33:32.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.447+0000 7f6f3557d640 1 -- 172.21.15.55:0/2913156800 shutdown_connections 2024-05-27T12:33:32.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.447+0000 7f6f3557d640 1 --2- 172.21.15.55:0/2913156800 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f3015c8d0 0x7f6f300c8470 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:32.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.447+0000 7f6f3557d640 1 --2- 172.21.15.55:0/2913156800 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6f300b3760 0x7f6f300cb850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:32.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.447+0000 7f6f3557d640 1 --2- 172.21.15.55:0/2913156800 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f6f1006c8f0 0x7f6f1006edb0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:32.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.447+0000 7f6f3557d640 1 --2- 172.21.15.55:0/2913156800 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f3009b140 0x7f6f30151d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:32.448 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.447+0000 7f6f3557d640 1 -- 172.21.15.55:0/2913156800 >> 172.21.15.55:0/2913156800 conn(0x7f6f300d25e0 msgr2=0x7f6f300701a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:32.448 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.447+0000 7f6f3557d640 1 -- 172.21.15.55:0/2913156800 shutdown_connections 2024-05-27T12:33:32.448 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.447+0000 7f6f3557d640 1 -- 172.21.15.55:0/2913156800 wait complete. 2024-05-27T12:33:32.458 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-05-27T12:33:32.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.563+0000 7feb9e1ad640 1 Processor -- start 2024-05-27T12:33:32.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.564+0000 7feb9e1ad640 1 -- start start 2024-05-27T12:33:32.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.564+0000 7feb9e1ad640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feb980cfb40 0x7feb980d1830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:32.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.564+0000 7feb9e1ad640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7feb980d1d70 0x7feb980b78f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:32.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.564+0000 7feb9e1ad640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb9815eee0 con 0x7feb9815eb00 2024-05-27T12:33:32.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.564+0000 7feb9e1ad640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7feb980d5700 con 0x7feb980d1d70 2024-05-27T12:33:32.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.564+0000 7feb9e1ad640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7feb980d21a0 con 0x7feb980cfb40 2024-05-27T12:33:32.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.564+0000 7feb977fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7feb9815eb00 0x7feb980d3e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:50366/0 (socket says 172.21.15.55:50366) 2024-05-27T12:33:32.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.564+0000 7feb977fe640 1 -- 172.21.15.55:0/3430819545 learned_addr learned my addr 172.21.15.55:0/3430819545 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-27T12:33:32.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.565+0000 7feb97fff640 1 --2- 172.21.15.55:0/3430819545 >> v2:172.21.15.72:3300/0 conn(0x7feb980d1d70 0x7feb980b78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:32.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.565+0000 7feb96ffd640 1 --2- 172.21.15.55:0/3430819545 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feb980cfb40 0x7feb980d1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:32.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.565+0000 7feb967fc640 1 -- 172.21.15.55:0/3430819545 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1712379480 0 0) 0x7feb9815eee0 con 0x7feb9815eb00 2024-05-27T12:33:32.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.565+0000 7feb967fc640 1 -- 172.21.15.55:0/3430819545 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feb80003520 con 0x7feb9815eb00 2024-05-27T12:33:32.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.565+0000 7feb967fc640 1 -- 172.21.15.55:0/3430819545 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1989491643 0 0) 0x7feb80003520 con 0x7feb9815eb00 2024-05-27T12:33:32.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.565+0000 7feb967fc640 1 -- 172.21.15.55:0/3430819545 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feb980cfb40 msgr2=0x7feb980d1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:32.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.565+0000 7feb967fc640 1 --2- 172.21.15.55:0/3430819545 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feb980cfb40 0x7feb980d1830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:32.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.565+0000 7feb967fc640 1 -- 172.21.15.55:0/3430819545 >> v2:172.21.15.72:3300/0 conn(0x7feb980d1d70 msgr2=0x7feb980b78f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:32.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.565+0000 7feb967fc640 1 --2- 172.21.15.55:0/3430819545 >> v2:172.21.15.72:3300/0 conn(0x7feb980d1d70 0x7feb980b78f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:32.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.565+0000 7feb967fc640 1 -- 172.21.15.55:0/3430819545 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb980d4660 con 0x7feb9815eb00 2024-05-27T12:33:32.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.565+0000 7feb967fc640 1 -- 172.21.15.55:0/3430819545 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 793017739 0 0) 0x7feb88001670 con 0x7feb9815eb00 2024-05-27T12:33:32.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.565+0000 7feb967fc640 1 -- 172.21.15.55:0/3430819545 >> v1:172.21.15.55:6789/0 conn(0x7feb9815eb00 legacy=0x7feb980d3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:32.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.565+0000 7feb967fc640 1 --2- 172.21.15.55:0/3430819545 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feb980cfb40 0x7feb800039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:32.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.565+0000 7feb967fc640 1 --2- 172.21.15.55:0/3430819545 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb80003f60 0x7feb80004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:32.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.565+0000 7feb967fc640 1 --2- 172.21.15.55:0/3430819545 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb80004d40 0x7feb800051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:32.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.565+0000 7feb967fc640 1 -- 172.21.15.55:0/3430819545 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7feb980d5700 con 0x7feb80003f60 2024-05-27T12:33:32.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.565+0000 7feb967fc640 1 -- 172.21.15.55:0/3430819545 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7feb980d21a0 con 0x7feb80004d40 2024-05-27T12:33:32.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.565+0000 7feb967fc640 1 -- 172.21.15.55:0/3430819545 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7feb8000ba40 con 0x7feb980cfb40 2024-05-27T12:33:32.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.565+0000 7feb96ffd640 1 --2- 172.21.15.55:0/3430819545 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb80003f60 0x7feb80004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:32.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.565+0000 7feb977fe640 1 --2- 172.21.15.55:0/3430819545 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feb980cfb40 0x7feb800039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:32.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.565+0000 7feb97fff640 1 --2- 172.21.15.55:0/3430819545 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb80004d40 0x7feb800051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:32.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.566+0000 7feb96ffd640 1 -- 172.21.15.55:0/3430819545 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feb980cfb40 msgr2=0x7feb800039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:32.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.566+0000 7feb96ffd640 1 --2- 172.21.15.55:0/3430819545 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feb980cfb40 0x7feb800039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:32.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.566+0000 7feb96ffd640 1 -- 172.21.15.55:0/3430819545 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb80004d40 msgr2=0x7feb800051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:32.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.566+0000 7feb96ffd640 1 --2- 172.21.15.55:0/3430819545 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb80004d40 0x7feb800051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:32.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.566+0000 7feb96ffd640 1 -- 172.21.15.55:0/3430819545 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb80003520 con 0x7feb80003f60 2024-05-27T12:33:32.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.566+0000 7feb97fff640 1 --2- 172.21.15.55:0/3430819545 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb80004d40 0x7feb800051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T12:33:32.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.566+0000 7feb96ffd640 1 --2- 172.21.15.55:0/3430819545 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb80003f60 0x7feb80004800 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7feb8c009ac0 tx=0x7feb80005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64a6d7e5f8b6c9f9 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:32.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.566+0000 7feb967fc640 1 -- 172.21.15.55:0/3430819545 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb8c036070 con 0x7feb80003f60 2024-05-27T12:33:32.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.566+0000 7feb967fc640 1 -- 172.21.15.55:0/3430819545 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb8c031400 con 0x7feb80003f60 2024-05-27T12:33:32.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.566+0000 7feb967fc640 1 -- 172.21.15.55:0/3430819545 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb8c009690 con 0x7feb80003f60 2024-05-27T12:33:32.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.567+0000 7feb9e1ad640 1 -- 172.21.15.55:0/3430819545 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb80003f60 msgr2=0x7feb80004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:32.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.567+0000 7feb9e1ad640 1 --2- 172.21.15.55:0/3430819545 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb80003f60 0x7feb80004800 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7feb8c009ac0 tx=0x7feb80005830 comp rx=0 tx=0).stop 2024-05-27T12:33:32.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.567+0000 7feb97fff640 1 -- 172.21.15.55:0/3430819545 reap_dead start 2024-05-27T12:33:32.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.567+0000 7feb9e1ad640 1 -- 172.21.15.55:0/3430819545 shutdown_connections 2024-05-27T12:33:32.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.567+0000 7feb9e1ad640 1 -- 172.21.15.55:0/3430819545 >> 172.21.15.55:0/3430819545 conn(0x7feb98067a50 msgr2=0x7feb98067e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:32.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.567+0000 7feb9e1ad640 1 -- 172.21.15.55:0/3430819545 shutdown_connections 2024-05-27T12:33:32.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.567+0000 7feb9e1ad640 1 -- 172.21.15.55:0/3430819545 wait complete. 2024-05-27T12:33:32.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.568+0000 7feb9e1ad640 1 Processor -- start 2024-05-27T12:33:32.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.568+0000 7feb9e1ad640 1 -- start start 2024-05-27T12:33:32.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.569+0000 7feb9e1ad640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feb80003f60 0x7feb98153df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:32.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.569+0000 7feb9e1ad640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb980b7890 0x7feb980b7d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:32.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.569+0000 7feb9e1ad640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb98155770 0x7feb98155bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:32.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.569+0000 7feb9e1ad640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7feb980d4f00 con 0x7feb980b7890 2024-05-27T12:33:32.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.569+0000 7feb9e1ad640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7feb980d4c20 con 0x7feb98155770 2024-05-27T12:33:32.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.569+0000 7feb9e1ad640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7feb980d51e0 con 0x7feb80003f60 2024-05-27T12:33:32.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.569+0000 7feb96ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb980b7890 0x7feb980b7d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:32.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.569+0000 7feb96ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb980b7890 0x7feb980b7d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33454/0 (socket says 172.21.15.55:33454) 2024-05-27T12:33:32.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.569+0000 7feb96ffd640 1 -- 172.21.15.55:0/687097541 learned_addr learned my addr 172.21.15.55:0/687097541 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:33:32.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.569+0000 7feb977fe640 1 --2- 172.21.15.55:0/687097541 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feb80003f60 0x7feb98153df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:32.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.569+0000 7feb97fff640 1 --2- 172.21.15.55:0/687097541 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb98155770 0x7feb98155bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:32.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.569+0000 7feb96ffd640 1 -- 172.21.15.55:0/687097541 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feb80003f60 msgr2=0x7feb98153df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:32.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.569+0000 7feb96ffd640 1 --2- 172.21.15.55:0/687097541 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feb80003f60 0x7feb98153df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:32.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.569+0000 7feb96ffd640 1 -- 172.21.15.55:0/687097541 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb98155770 msgr2=0x7feb98155bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:32.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.569+0000 7feb96ffd640 1 --2- 172.21.15.55:0/687097541 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb98155770 0x7feb98155bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:32.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.569+0000 7feb96ffd640 1 -- 172.21.15.55:0/687097541 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb98154330 con 0x7feb980b7890 2024-05-27T12:33:32.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.569+0000 7feb97fff640 1 --2- 172.21.15.55:0/687097541 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb98155770 0x7feb98155bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T12:33:32.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.570+0000 7feb96ffd640 1 --2- 172.21.15.55:0/687097541 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb980b7890 0x7feb980b7d10 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7feb8c034040 tx=0x7feb8c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:32.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.570+0000 7feb7ffff640 1 -- 172.21.15.55:0/687097541 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb8c040020 con 0x7feb980b7890 2024-05-27T12:33:32.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.570+0000 7feb7ffff640 1 -- 172.21.15.55:0/687097541 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb8c003c60 con 0x7feb980b7890 2024-05-27T12:33:32.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.570+0000 7feb7ffff640 1 -- 172.21.15.55:0/687097541 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb8c036040 con 0x7feb980b7890 2024-05-27T12:33:32.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.570+0000 7feb9e1ad640 1 -- 172.21.15.55:0/687097541 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb981610e0 con 0x7feb980b7890 2024-05-27T12:33:32.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.570+0000 7feb9e1ad640 1 -- 172.21.15.55:0/687097541 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb981616a0 con 0x7feb980b7890 2024-05-27T12:33:32.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.571+0000 7feb9e1ad640 1 -- 172.21.15.55:0/687097541 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb980b8250 con 0x7feb980b7890 2024-05-27T12:33:32.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.571+0000 7feb7ffff640 1 -- 172.21.15.55:0/687097541 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7feb8c043020 con 0x7feb980b7890 2024-05-27T12:33:32.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.572+0000 7feb7ffff640 1 --2- 172.21.15.55:0/687097541 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7feb8406c920 0x7feb8406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:32.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.572+0000 7feb7ffff640 1 -- 172.21.15.55:0/687097541 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 4857+0+0 (secure 0 0 0) 0x7feb8c0ab780 con 0x7feb980b7890 2024-05-27T12:33:32.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.572+0000 7feb977fe640 1 --2- 172.21.15.55:0/687097541 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7feb8406c920 0x7feb8406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:32.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.573+0000 7feb977fe640 1 --2- 172.21.15.55:0/687097541 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7feb8406c920 0x7feb8406ede0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7feb88001eb0 tx=0x7feb88009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:32.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.576+0000 7feb7ffff640 1 -- 172.21.15.55:0/687097541 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7feb8c04a070 con 0x7feb980b7890 2024-05-27T12:33:32.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.842+0000 7feb9e1ad640 1 -- 172.21.15.55:0/687097541 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) -- 0x7feb98068a70 con 0x7feb980b7890 2024-05-27T12:33:32.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.844+0000 7feb7ffff640 1 -- 172.21.15.55:0/687097541 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v10) ==== 90+0+0 (secure 0 0 0) 0x7feb98154330 con 0x7feb980b7890 2024-05-27T12:33:32.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.846+0000 7feb9e1ad640 1 -- 172.21.15.55:0/687097541 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7feb8406c920 msgr2=0x7feb8406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:32.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.846+0000 7feb9e1ad640 1 --2- 172.21.15.55:0/687097541 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7feb8406c920 0x7feb8406ede0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7feb88001eb0 tx=0x7feb88009040 comp rx=0 tx=0).stop 2024-05-27T12:33:32.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.846+0000 7feb9e1ad640 1 -- 172.21.15.55:0/687097541 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb980b7890 msgr2=0x7feb980b7d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:32.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.846+0000 7feb9e1ad640 1 --2- 172.21.15.55:0/687097541 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb980b7890 0x7feb980b7d10 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7feb8c034040 tx=0x7feb8c004730 comp rx=0 tx=0).stop 2024-05-27T12:33:32.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.847+0000 7feb9e1ad640 1 -- 172.21.15.55:0/687097541 shutdown_connections 2024-05-27T12:33:32.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.847+0000 7feb9e1ad640 1 --2- 172.21.15.55:0/687097541 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7feb8406c920 0x7feb8406ede0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:32.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.847+0000 7feb9e1ad640 1 --2- 172.21.15.55:0/687097541 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb98155770 0x7feb98155bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:32.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.847+0000 7feb9e1ad640 1 --2- 172.21.15.55:0/687097541 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb980b7890 0x7feb980b7d10 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:32.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.847+0000 7feb9e1ad640 1 --2- 172.21.15.55:0/687097541 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feb80003f60 0x7feb98153df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:32.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.847+0000 7feb9e1ad640 1 -- 172.21.15.55:0/687097541 >> 172.21.15.55:0/687097541 conn(0x7feb98067a50 msgr2=0x7feb980b4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:32.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.847+0000 7feb9e1ad640 1 -- 172.21.15.55:0/687097541 shutdown_connections 2024-05-27T12:33:32.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.847+0000 7feb9e1ad640 1 -- 172.21.15.55:0/687097541 wait complete. 2024-05-27T12:33:32.857 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-27T12:33:32.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.961+0000 7f57131ad640 1 Processor -- start 2024-05-27T12:33:32.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.961+0000 7f57131ad640 1 -- start start 2024-05-27T12:33:32.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.962+0000 7f57131ad640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f570c15f9b0 0x7f570c0d1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:32.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.962+0000 7f57131ad640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f570c09b140 0x7f570c1684f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:32.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.962+0000 7f57131ad640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f570c15fdd0 con 0x7f570c15eb00 2024-05-27T12:33:32.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.962+0000 7f57131ad640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f570c0d08b0 con 0x7f570c15f9b0 2024-05-27T12:33:32.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.962+0000 7f57131ad640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f570c0d0b50 con 0x7f570c09b140 2024-05-27T12:33:32.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.962+0000 7f5710f49640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f570c15eb00 0x7f570c09aa30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:32838/0 (socket says 172.21.15.55:32838) 2024-05-27T12:33:32.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.962+0000 7f5710f49640 1 -- 172.21.15.55:0/1238283928 learned_addr learned my addr 172.21.15.55:0/1238283928 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-27T12:33:32.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.962+0000 7f571174a640 1 --2- 172.21.15.55:0/1238283928 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f570c09b140 0x7f570c1684f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:32.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.962+0000 7f570bfff640 1 --2- 172.21.15.55:0/1238283928 >> v2:172.21.15.72:3300/0 conn(0x7f570c15f9b0 0x7f570c0d1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:32.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.962+0000 7f570b7fe640 1 -- 172.21.15.55:0/1238283928 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3919183175 0 0) 0x7f570c15fdd0 con 0x7f570c15eb00 2024-05-27T12:33:32.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.962+0000 7f570b7fe640 1 -- 172.21.15.55:0/1238283928 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f56f8003520 con 0x7f570c15eb00 2024-05-27T12:33:32.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.963+0000 7f570b7fe640 1 -- 172.21.15.55:0/1238283928 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2086257043 0 0) 0x7f56f8003520 con 0x7f570c15eb00 2024-05-27T12:33:32.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.963+0000 7f570b7fe640 1 -- 172.21.15.55:0/1238283928 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f570c09b140 msgr2=0x7f570c1684f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:32.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.963+0000 7f570b7fe640 1 --2- 172.21.15.55:0/1238283928 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f570c09b140 0x7f570c1684f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:32.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.963+0000 7f570b7fe640 1 -- 172.21.15.55:0/1238283928 >> v2:172.21.15.72:3300/0 conn(0x7f570c15f9b0 msgr2=0x7f570c0d1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:32.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.963+0000 7f570b7fe640 1 --2- 172.21.15.55:0/1238283928 >> v2:172.21.15.72:3300/0 conn(0x7f570c15f9b0 0x7f570c0d1630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:32.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.963+0000 7f570b7fe640 1 -- 172.21.15.55:0/1238283928 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f570c0d0e30 con 0x7f570c15eb00 2024-05-27T12:33:32.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.963+0000 7f570b7fe640 1 -- 172.21.15.55:0/1238283928 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 793017739 0 0) 0x7f56fc0019f0 con 0x7f570c15eb00 2024-05-27T12:33:32.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.963+0000 7f570b7fe640 1 -- 172.21.15.55:0/1238283928 >> v1:172.21.15.55:6789/0 conn(0x7f570c15eb00 legacy=0x7f570c09aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:32.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.963+0000 7f570b7fe640 1 --2- 172.21.15.55:0/1238283928 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f56f8003a90 0x7f56f8003eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:32.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.963+0000 7f570b7fe640 1 --2- 172.21.15.55:0/1238283928 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56f8004800 0x7f56f8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:32.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.963+0000 7f570b7fe640 1 --2- 172.21.15.55:0/1238283928 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f56f80051c0 0x7f56f800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:32.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.963+0000 7f570b7fe640 1 -- 172.21.15.55:0/1238283928 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f570c0d08b0 con 0x7f56f8004800 2024-05-27T12:33:32.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.963+0000 7f570b7fe640 1 -- 172.21.15.55:0/1238283928 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f570c0d0b50 con 0x7f56f80051c0 2024-05-27T12:33:32.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.963+0000 7f570b7fe640 1 -- 172.21.15.55:0/1238283928 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f56f800bf50 con 0x7f56f8003a90 2024-05-27T12:33:32.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.963+0000 7f570bfff640 1 --2- 172.21.15.55:0/1238283928 >> v2:172.21.15.72:3300/0 conn(0x7f570c15f9b0 0x7f570c0d1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T12:33:32.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.963+0000 7f571174a640 1 --2- 172.21.15.55:0/1238283928 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f570c09b140 0x7f570c1684f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T12:33:32.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.963+0000 7f570bfff640 1 --2- 172.21.15.55:0/1238283928 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56f8004800 0x7f56f8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:32.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.963+0000 7f5710f49640 1 --2- 172.21.15.55:0/1238283928 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f56f8003a90 0x7f56f8003eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:32.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.963+0000 7f571174a640 1 --2- 172.21.15.55:0/1238283928 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f56f80051c0 0x7f56f800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:32.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.963+0000 7f570bfff640 1 -- 172.21.15.55:0/1238283928 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f56f8003a90 msgr2=0x7f56f8003eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:32.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.963+0000 7f570bfff640 1 --2- 172.21.15.55:0/1238283928 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f56f8003a90 0x7f56f8003eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:32.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.963+0000 7f570bfff640 1 -- 172.21.15.55:0/1238283928 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f56f80051c0 msgr2=0x7f56f800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:32.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.963+0000 7f570bfff640 1 --2- 172.21.15.55:0/1238283928 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f56f80051c0 0x7f56f800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:32.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.963+0000 7f570bfff640 1 -- 172.21.15.55:0/1238283928 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56f8003520 con 0x7f56f8004800 2024-05-27T12:33:32.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.963+0000 7f571174a640 1 --2- 172.21.15.55:0/1238283928 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f56f80051c0 0x7f56f800b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T12:33:32.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.964+0000 7f570bfff640 1 --2- 172.21.15.55:0/1238283928 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56f8004800 0x7f56f8004c80 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f56f4009ca0 tx=0x7f56f8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0c3f7ec6086725f server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:32.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.964+0000 7f570b7fe640 1 -- 172.21.15.55:0/1238283928 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56f4009840 con 0x7f56f8004800 2024-05-27T12:33:32.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.964+0000 7f570b7fe640 1 -- 172.21.15.55:0/1238283928 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56f4004020 con 0x7f56f8004800 2024-05-27T12:33:32.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.964+0000 7f570b7fe640 1 -- 172.21.15.55:0/1238283928 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56f40043d0 con 0x7f56f8004800 2024-05-27T12:33:32.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.965+0000 7f57131ad640 1 -- 172.21.15.55:0/1238283928 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56f8004800 msgr2=0x7f56f8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:32.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.965+0000 7f57131ad640 1 --2- 172.21.15.55:0/1238283928 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56f8004800 0x7f56f8004c80 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f56f4009ca0 tx=0x7f56f8005830 comp rx=0 tx=0).stop 2024-05-27T12:33:32.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.965+0000 7f571174a640 1 -- 172.21.15.55:0/1238283928 reap_dead start 2024-05-27T12:33:32.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.965+0000 7f57131ad640 1 -- 172.21.15.55:0/1238283928 shutdown_connections 2024-05-27T12:33:32.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.965+0000 7f57131ad640 1 -- 172.21.15.55:0/1238283928 >> 172.21.15.55:0/1238283928 conn(0x7f570c0b4100 msgr2=0x7f570c0b4510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:32.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.965+0000 7f57131ad640 1 -- 172.21.15.55:0/1238283928 shutdown_connections 2024-05-27T12:33:32.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.965+0000 7f57131ad640 1 -- 172.21.15.55:0/1238283928 wait complete. 2024-05-27T12:33:32.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.966+0000 7f57131ad640 1 Processor -- start 2024-05-27T12:33:32.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.966+0000 7f57131ad640 1 -- start start 2024-05-27T12:33:32.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.967+0000 7f57131ad640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56f8004800 0x7f570c1f45c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:32.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.967+0000 7f57131ad640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f570c0c8cf0 0x7f570c0cb8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:32.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.967+0000 7f57131ad640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f570c1f4b00 0x7f570c0cbdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:32.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.967+0000 7f57131ad640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f570c09b5d0 con 0x7f56f8004800 2024-05-27T12:33:32.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.967+0000 7f57131ad640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f570c160040 con 0x7f570c1f4b00 2024-05-27T12:33:32.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.967+0000 7f57131ad640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f570c156390 con 0x7f570c0c8cf0 2024-05-27T12:33:32.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.967+0000 7f5710f49640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56f8004800 0x7f570c1f45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:32.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.967+0000 7f5710f49640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56f8004800 0x7f570c1f45c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50976/0 (socket says 172.21.15.55:50976) 2024-05-27T12:33:32.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.967+0000 7f5710f49640 1 -- 172.21.15.55:0/2353930000 learned_addr learned my addr 172.21.15.55:0/2353930000 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:33:32.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.967+0000 7f570bfff640 1 --2- 172.21.15.55:0/2353930000 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f570c0c8cf0 0x7f570c0cb8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:32.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.967+0000 7f571174a640 1 --2- 172.21.15.55:0/2353930000 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f570c1f4b00 0x7f570c0cbdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:32.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.967+0000 7f5710f49640 1 -- 172.21.15.55:0/2353930000 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f570c0c8cf0 msgr2=0x7f570c0cb8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:32.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.967+0000 7f5710f49640 1 --2- 172.21.15.55:0/2353930000 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f570c0c8cf0 0x7f570c0cb8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:32.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.967+0000 7f5710f49640 1 -- 172.21.15.55:0/2353930000 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f570c1f4b00 msgr2=0x7f570c0cbdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:32.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.967+0000 7f5710f49640 1 --2- 172.21.15.55:0/2353930000 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f570c1f4b00 0x7f570c0cbdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:32.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.967+0000 7f5710f49640 1 -- 172.21.15.55:0/2353930000 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f570c1f5060 con 0x7f56f8004800 2024-05-27T12:33:32.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.968+0000 7f5710f49640 1 --2- 172.21.15.55:0/2353930000 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56f8004800 0x7f570c1f45c0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f56fc007750 tx=0x7f56fc00a380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:32.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.968+0000 7f57097fa640 1 -- 172.21.15.55:0/2353930000 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56fc00ad00 con 0x7f56f8004800 2024-05-27T12:33:32.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.968+0000 7f57097fa640 1 -- 172.21.15.55:0/2353930000 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56fc018070 con 0x7f56f8004800 2024-05-27T12:33:32.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.968+0000 7f57097fa640 1 -- 172.21.15.55:0/2353930000 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56fc013630 con 0x7f56f8004800 2024-05-27T12:33:32.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.968+0000 7f57131ad640 1 -- 172.21.15.55:0/2353930000 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f570c1f5340 con 0x7f56f8004800 2024-05-27T12:33:32.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.968+0000 7f57131ad640 1 -- 172.21.15.55:0/2353930000 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f570c0c7d10 con 0x7f56f8004800 2024-05-27T12:33:32.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.969+0000 7f57131ad640 1 -- 172.21.15.55:0/2353930000 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f570c06e020 con 0x7f56f8004800 2024-05-27T12:33:32.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.969+0000 7f57097fa640 1 -- 172.21.15.55:0/2353930000 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f56fc0137d0 con 0x7f56f8004800 2024-05-27T12:33:32.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.970+0000 7f57097fa640 1 --2- 172.21.15.55:0/2353930000 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f56ec06c920 0x7f56ec06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:32.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.970+0000 7f57097fa640 1 -- 172.21.15.55:0/2353930000 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 4857+0+0 (secure 0 0 0) 0x7f56fc08bfc0 con 0x7f56f8004800 2024-05-27T12:33:32.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.970+0000 7f570bfff640 1 --2- 172.21.15.55:0/2353930000 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f56ec06c920 0x7f56ec06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:32.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.970+0000 7f570bfff640 1 --2- 172.21.15.55:0/2353930000 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f56ec06c920 0x7f56ec06ede0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f56f4032000 tx=0x7f56f4008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:32.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:32.974+0000 7f57097fa640 1 -- 172.21.15.55:0/2353930000 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f570c06e020 con 0x7f56f8004800 2024-05-27T12:33:33.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.162+0000 7f57131ad640 1 -- 172.21.15.55:0/2353930000 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f570c075460 con 0x7f56f8004800 2024-05-27T12:33:33.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.163+0000 7f57097fa640 1 -- 172.21.15.55:0/2353930000 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) ==== 74+0+12843 (secure 0 0 0) 0x7f56fc05a730 con 0x7f56f8004800 2024-05-27T12:33:33.162 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-27T12:33:33.162 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":32,"fsid":"c3ff4e3b-8dae-4856-9593-e5cc66c59982","created":"2024-05-27T12:32:17.019097+0000","modified":"2024-05-27T12:33:30.081798+0000","last_up_change":"2024-05-27T12:32:28.109744+0000","last_in_change":"2024-05-27T12:32:19.309872+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-27T12:32:29.277895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e607b598-061b-4b6f-92ff-95c20b330599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":807572567},{"type":"v1","addr":"172.21.15.55:6801","nonce":807572567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":807572567},{"type":"v1","addr":"172.21.15.55:6803","nonce":807572567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":807572567},{"type":"v1","addr":"172.21.15.55:6807","nonce":807572567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":807572567},{"type":"v1","addr":"172.21.15.55:6805","nonce":807572567}]},"public_addr":"172.21.15.55:6801/807572567","cluster_addr":"172.21.15.55:6803/807572567","heartbeat_back_addr":"172.21.15.55:6807/807572567","heartbeat_front_addr":"172.21.15.55:6805/807572567","state":["exists","up"]},{"osd":1,"uuid":"ba2b5b1d-71a9-4ecc-9a48-55aa7fe54261","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":3426897300},{"type":"v1","addr":"172.21.15.55:6825","nonce":3426897300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":3426897300},{"type":"v1","addr":"172.21.15.55:6827","nonce":3426897300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":3426897300},{"type":"v1","addr":"172.21.15.55:6831","nonce":3426897300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":3426897300},{"type":"v1","addr":"172.21.15.55:6829","nonce":3426897300}]},"public_addr":"172.21.15.55:6825/3426897300","cluster_addr":"172.21.15.55:6827/3426897300","heartbeat_back_addr":"172.21.15.55:6831/3426897300","heartbeat_front_addr":"172.21.15.55:6829/3426897300","state":["exists","up"]},{"osd":2,"uuid":"e6b81cc6-4ff1-45d0-87eb-9f04ccf986a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3510271725},{"type":"v1","addr":"172.21.15.55:6809","nonce":3510271725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3510271725},{"type":"v1","addr":"172.21.15.55:6811","nonce":3510271725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3510271725},{"type":"v1","addr":"172.21.15.55:6815","nonce":3510271725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3510271725},{"type":"v1","addr":"172.21.15.55:6813","nonce":3510271725}]},"public_addr":"172.21.15.55:6809/3510271725","cluster_addr":"172.21.15.55:6811/3510271725","heartbeat_back_addr":"172.21.15.55:6815/3510271725","heartbeat_front_addr":"172.21.15.55:6813/3510271725","state":["exists","up"]},{"osd":3,"uuid":"b6a34b75-807d-4693-b1c3-903cb4c618d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":1066693520},{"type":"v1","addr":"172.21.15.55:6817","nonce":1066693520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":1066693520},{"type":"v1","addr":"172.21.15.55:6819","nonce":1066693520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":1066693520},{"type":"v1","addr":"172.21.15.55:6823","nonce":1066693520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":1066693520},{"type":"v1","addr":"172.21.15.55:6821","nonce":1066693520}]},"public_addr":"172.21.15.55:6817/1066693520","cluster_addr":"172.21.15.55:6819/1066693520","heartbeat_back_addr":"172.21.15.55:6823/1066693520","heartbeat_front_addr":"172.21.15.55:6821/1066693520","state":["exists","up"]},{"osd":4,"uuid":"272ec937-56b4-4f0a-b2e1-b0bc189c9d79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":4190771237},{"type":"v1","addr":"172.21.15.72:6820","nonce":4190771237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":4190771237},{"type":"v1","addr":"172.21.15.72:6824","nonce":4190771237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":4190771237},{"type":"v1","addr":"172.21.15.72:6831","nonce":4190771237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":4190771237},{"type":"v1","addr":"172.21.15.72:6828","nonce":4190771237}]},"public_addr":"172.21.15.72:6820/4190771237","cluster_addr":"172.21.15.72:6824/4190771237","heartbeat_back_addr":"172.21.15.72:6831/4190771237","heartbeat_front_addr":"172.21.15.72:6828/4190771237","state":["exists","up"]},{"osd":5,"uuid":"56439854-72a0-4ef4-81ff-184a3d924a5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":2421889184},{"type":"v1","addr":"172.21.15.72:6801","nonce":2421889184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6803","nonce":2421889184},{"type":"v1","addr":"172.21.15.72:6805","nonce":2421889184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":2421889184},{"type":"v1","addr":"172.21.15.72:6813","nonce":2421889184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6807","nonce":2421889184},{"type":"v1","addr":"172.21.15.72:6809","nonce":2421889184}]},"public_addr":"172.21.15.72:6801/2421889184","cluster_addr":"172.21.15.72:6805/2421889184","heartbeat_back_addr":"172.21.15.72:6813/2421889184","heartbeat_front_addr":"172.21.15.72:6809/2421889184","state":["exists","up"]},{"osd":6,"uuid":"e248e2be-3b6e-49cf-8c8a-1a4152827582","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3796994599},{"type":"v1","addr":"172.21.15.72:6804","nonce":3796994599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":3796994599},{"type":"v1","addr":"172.21.15.72:6808","nonce":3796994599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":3796994599},{"type":"v1","addr":"172.21.15.72:6815","nonce":3796994599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":3796994599},{"type":"v1","addr":"172.21.15.72:6812","nonce":3796994599}]},"public_addr":"172.21.15.72:6804/3796994599","cluster_addr":"172.21.15.72:6808/3796994599","heartbeat_back_addr":"172.21.15.72:6815/3796994599","heartbeat_front_addr":"172.21.15.72:6812/3796994599","state":["exists","up"]},{"osd":7,"uuid":"505a62d3-322b-4629-b4fd-187a55563709","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":3024877895},{"type":"v1","addr":"172.21.15.72:6817","nonce":3024877895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":3024877895},{"type":"v1","addr":"172.21.15.72:6821","nonce":3024877895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6827","nonce":3024877895},{"type":"v1","addr":"172.21.15.72:6829","nonce":3024877895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6823","nonce":3024877895},{"type":"v1","addr":"172.21.15.72:6825","nonce":3024877895}]},"public_addr":"172.21.15.72:6817/3024877895","cluster_addr":"172.21.15.72:6821/3024877895","heartbeat_back_addr":"172.21.15.72:6829/3024877895","heartbeat_front_addr":"172.21.15.72:6825/3024877895","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.241014+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.450799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.465018+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.507647+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.534763+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.495895+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.427110+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.547466+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-27T12:33:33.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.165+0000 7f57131ad640 1 -- 172.21.15.55:0/2353930000 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f56ec06c920 msgr2=0x7f56ec06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:33.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.165+0000 7f57131ad640 1 --2- 172.21.15.55:0/2353930000 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f56ec06c920 0x7f56ec06ede0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f56f4032000 tx=0x7f56f4008030 comp rx=0 tx=0).stop 2024-05-27T12:33:33.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.165+0000 7f57131ad640 1 -- 172.21.15.55:0/2353930000 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56f8004800 msgr2=0x7f570c1f45c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:33.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.165+0000 7f57131ad640 1 --2- 172.21.15.55:0/2353930000 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56f8004800 0x7f570c1f45c0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f56fc007750 tx=0x7f56fc00a380 comp rx=0 tx=0).stop 2024-05-27T12:33:33.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.165+0000 7f57131ad640 1 -- 172.21.15.55:0/2353930000 shutdown_connections 2024-05-27T12:33:33.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.165+0000 7f57131ad640 1 --2- 172.21.15.55:0/2353930000 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f56ec06c920 0x7f56ec06ede0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:33.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.165+0000 7f57131ad640 1 --2- 172.21.15.55:0/2353930000 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f570c1f4b00 0x7f570c0cbdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:33.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.165+0000 7f57131ad640 1 --2- 172.21.15.55:0/2353930000 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f570c0c8cf0 0x7f570c0cb8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:33.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.165+0000 7f57131ad640 1 --2- 172.21.15.55:0/2353930000 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56f8004800 0x7f570c1f45c0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:33.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.165+0000 7f57131ad640 1 -- 172.21.15.55:0/2353930000 >> 172.21.15.55:0/2353930000 conn(0x7f570c0b4100 msgr2=0x7f570c0b2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:33.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.165+0000 7f57131ad640 1 -- 172.21.15.55:0/2353930000 shutdown_connections 2024-05-27T12:33:33.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.165+0000 7f57131ad640 1 -- 172.21.15.55:0/2353930000 wait complete. 2024-05-27T12:33:33.176 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-27T12:32:29.277895+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-27T12:33:33.176 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-27T12:33:33.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.284+0000 7f15b5d9b640 1 Processor -- start 2024-05-27T12:33:33.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.284+0000 7f15b5d9b640 1 -- start start 2024-05-27T12:33:33.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.285+0000 7f15b5d9b640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f15b00cfb40 0x7f15b00d1830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:33.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.285+0000 7f15b5d9b640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15b00d2180 con 0x7f15b00d1d70 2024-05-27T12:33:33.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.285+0000 7f15b5d9b640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15b015eee0 con 0x7f15b015eb00 2024-05-27T12:33:33.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.285+0000 7f15b5d9b640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f15b00d5700 con 0x7f15b00cfb40 2024-05-27T12:33:33.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.285+0000 7f15affff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f15b00d1d70 0x7f15b00b78f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:32850/0 (socket says 172.21.15.55:32850) 2024-05-27T12:33:33.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.285+0000 7f15affff640 1 -- 172.21.15.55:0/1204580967 learned_addr learned my addr 172.21.15.55:0/1204580967 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-27T12:33:33.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.286+0000 7f15aeffd640 1 --2- 172.21.15.55:0/1204580967 >> v2:172.21.15.72:3300/0 conn(0x7f15b00cfb40 0x7f15b00d1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:33.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.286+0000 7f15ae7fc640 1 -- 172.21.15.55:0/1204580967 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 212196857 0 0) 0x7f15a8001490 con 0x7f15b00d1d70 2024-05-27T12:33:33.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.286+0000 7f15ae7fc640 1 -- 172.21.15.55:0/1204580967 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1598003520 con 0x7f15b00d1d70 2024-05-27T12:33:33.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.286+0000 7f15ae7fc640 1 -- 172.21.15.55:0/1204580967 <== mon.1 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 523867639 0 0) 0x7f15b015eee0 con 0x7f15b015eb00 2024-05-27T12:33:33.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.286+0000 7f15ae7fc640 1 -- 172.21.15.55:0/1204580967 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f15a8001490 con 0x7f15b015eb00 2024-05-27T12:33:33.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.286+0000 7f15ae7fc640 1 -- 172.21.15.55:0/1204580967 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 637140504 0 0) 0x7f1598003520 con 0x7f15b00d1d70 2024-05-27T12:33:33.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.286+0000 7f15aeffd640 1 -- 172.21.15.55:0/1204580967 >> v1:172.21.15.72:6789/0 conn(0x7f15b015eb00 legacy=0x7f15b00d3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:33.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.286+0000 7f15aeffd640 1 -- 172.21.15.55:0/1204580967 >> v1:172.21.15.55:6789/0 conn(0x7f15b00d1d70 legacy=0x7f15b00b78f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:33.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.286+0000 7f15aeffd640 1 -- 172.21.15.55:0/1204580967 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15b00d4660 con 0x7f15b00cfb40 2024-05-27T12:33:33.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.287+0000 7f15aeffd640 1 --2- 172.21.15.55:0/1204580967 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f15b00cfb40 0x7f15b00d1830 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f15a40097a0 tx=0x7f15a402a250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eae824c3b1ee6e1a server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:33.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.287+0000 7f15ae7fc640 1 -- 172.21.15.55:0/1204580967 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15a4037070 con 0x7f15b00cfb40 2024-05-27T12:33:33.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.287+0000 7f15ae7fc640 1 -- 172.21.15.55:0/1204580967 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15a402ace0 con 0x7f15b00cfb40 2024-05-27T12:33:33.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.287+0000 7f15ae7fc640 1 -- 172.21.15.55:0/1204580967 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15a8001bc0 con 0x7f15b00cfb40 2024-05-27T12:33:33.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.287+0000 7f15b5d9b640 1 -- 172.21.15.55:0/1204580967 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f15b00cfb40 msgr2=0x7f15b00d1830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:33.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.287+0000 7f15b5d9b640 1 --2- 172.21.15.55:0/1204580967 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f15b00cfb40 0x7f15b00d1830 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f15a40097a0 tx=0x7f15a402a250 comp rx=0 tx=0).stop 2024-05-27T12:33:33.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.287+0000 7f15b5d9b640 1 -- 172.21.15.55:0/1204580967 shutdown_connections 2024-05-27T12:33:33.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.287+0000 7f15b5d9b640 1 --2- 172.21.15.55:0/1204580967 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f15b00cfb40 0x7f15b00d1830 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:33.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.287+0000 7f15b5d9b640 1 -- 172.21.15.55:0/1204580967 >> 172.21.15.55:0/1204580967 conn(0x7f15b0067a50 msgr2=0x7f15b0067e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:33.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.288+0000 7f15b5d9b640 1 -- 172.21.15.55:0/1204580967 shutdown_connections 2024-05-27T12:33:33.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.288+0000 7f15b5d9b640 1 -- 172.21.15.55:0/1204580967 wait complete. 2024-05-27T12:33:33.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.289+0000 7f15b5d9b640 1 Processor -- start 2024-05-27T12:33:33.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.289+0000 7f15b5d9b640 1 -- start start 2024-05-27T12:33:33.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.290+0000 7f15b5d9b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15b00cfb40 0x7f15b0153d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:33.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.290+0000 7f15b5d9b640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f15b00d1d70 0x7f15b00b93c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:33.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.290+0000 7f15b5d9b640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f15b015eb00 0x7f15b00ab370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:33.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.290+0000 7f15b5d9b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f15b00d4f00 con 0x7f15b00cfb40 2024-05-27T12:33:33.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.290+0000 7f15b5d9b640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f15b00d4c20 con 0x7f15b00d1d70 2024-05-27T12:33:33.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.290+0000 7f15b5d9b640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f15b00d51e0 con 0x7f15b015eb00 2024-05-27T12:33:33.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.290+0000 7f15af7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15b00cfb40 0x7f15b0153d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:33.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.290+0000 7f15af7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15b00cfb40 0x7f15b0153d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50980/0 (socket says 172.21.15.55:50980) 2024-05-27T12:33:33.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.290+0000 7f15af7fe640 1 -- 172.21.15.55:0/266258920 learned_addr learned my addr 172.21.15.55:0/266258920 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:33:33.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.290+0000 7f15aeffd640 1 --2- 172.21.15.55:0/266258920 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f15b00d1d70 0x7f15b00b93c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:33.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.290+0000 7f15affff640 1 --2- 172.21.15.55:0/266258920 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f15b015eb00 0x7f15b00ab370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:33.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.290+0000 7f15af7fe640 1 -- 172.21.15.55:0/266258920 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f15b015eb00 msgr2=0x7f15b00ab370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:33.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.290+0000 7f15af7fe640 1 --2- 172.21.15.55:0/266258920 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f15b015eb00 0x7f15b00ab370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:33.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.290+0000 7f15af7fe640 1 -- 172.21.15.55:0/266258920 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f15b00d1d70 msgr2=0x7f15b00b93c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:33.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.290+0000 7f15af7fe640 1 --2- 172.21.15.55:0/266258920 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f15b00d1d70 0x7f15b00b93c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:33.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.290+0000 7f15af7fe640 1 -- 172.21.15.55:0/266258920 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15b015fc20 con 0x7f15b00cfb40 2024-05-27T12:33:33.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.290+0000 7f15af7fe640 1 --2- 172.21.15.55:0/266258920 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15b00cfb40 0x7f15b0153d80 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f15a000c430 tx=0x7f15a000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:33.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.290+0000 7f1597fff640 1 -- 172.21.15.55:0/266258920 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15a0017070 con 0x7f15b00cfb40 2024-05-27T12:33:33.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.290+0000 7f1597fff640 1 -- 172.21.15.55:0/266258920 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15a00052f0 con 0x7f15b00cfb40 2024-05-27T12:33:33.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.290+0000 7f1597fff640 1 -- 172.21.15.55:0/266258920 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15a0003830 con 0x7f15b00cfb40 2024-05-27T12:33:33.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.290+0000 7f15b5d9b640 1 -- 172.21.15.55:0/266258920 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15b015ff00 con 0x7f15b00cfb40 2024-05-27T12:33:33.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.290+0000 7f15b5d9b640 1 -- 172.21.15.55:0/266258920 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15b00b86f0 con 0x7f15b00cfb40 2024-05-27T12:33:33.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.291+0000 7f15b5d9b640 1 -- 172.21.15.55:0/266258920 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15b00d00e0 con 0x7f15b00cfb40 2024-05-27T12:33:33.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.292+0000 7f1597fff640 1 -- 172.21.15.55:0/266258920 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f15a001a070 con 0x7f15b00cfb40 2024-05-27T12:33:33.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.292+0000 7f1597fff640 1 --2- 172.21.15.55:0/266258920 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f159c06c920 0x7f159c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:33.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.292+0000 7f1597fff640 1 -- 172.21.15.55:0/266258920 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 4857+0+0 (secure 0 0 0) 0x7f15a008ab20 con 0x7f15b00cfb40 2024-05-27T12:33:33.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.293+0000 7f15aeffd640 1 --2- 172.21.15.55:0/266258920 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f159c06c920 0x7f159c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:33.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.293+0000 7f15aeffd640 1 --2- 172.21.15.55:0/266258920 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f159c06c920 0x7f159c06ede0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f15a4034000 tx=0x7f15a402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:33.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.297+0000 7f1597fff640 1 -- 172.21.15.55:0/266258920 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f15b00d00e0 con 0x7f15b00cfb40 2024-05-27T12:33:33.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.480+0000 7f15b5d9b640 1 -- 172.21.15.55:0/266258920 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f15b0068a70 con 0x7f15b00cfb40 2024-05-27T12:33:33.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.480+0000 7f1597fff640 1 -- 172.21.15.55:0/266258920 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v32) ==== 93+0+10 (secure 0 0 0) 0x7f15a0059330 con 0x7f15b00cfb40 2024-05-27T12:33:33.480 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-05-27T12:33:33.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.482+0000 7f15b5d9b640 1 -- 172.21.15.55:0/266258920 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f159c06c920 msgr2=0x7f159c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:33.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.482+0000 7f15b5d9b640 1 --2- 172.21.15.55:0/266258920 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f159c06c920 0x7f159c06ede0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f15a4034000 tx=0x7f15a402e000 comp rx=0 tx=0).stop 2024-05-27T12:33:33.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.482+0000 7f15b5d9b640 1 -- 172.21.15.55:0/266258920 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15b00cfb40 msgr2=0x7f15b0153d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:33.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.482+0000 7f15b5d9b640 1 --2- 172.21.15.55:0/266258920 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15b00cfb40 0x7f15b0153d80 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f15a000c430 tx=0x7f15a000c8f0 comp rx=0 tx=0).stop 2024-05-27T12:33:33.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.482+0000 7f15b5d9b640 1 -- 172.21.15.55:0/266258920 shutdown_connections 2024-05-27T12:33:33.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.482+0000 7f15b5d9b640 1 --2- 172.21.15.55:0/266258920 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f15b015eb00 0x7f15b00ab370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:33.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.482+0000 7f15b5d9b640 1 --2- 172.21.15.55:0/266258920 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f159c06c920 0x7f159c06ede0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:33.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.482+0000 7f15b5d9b640 1 --2- 172.21.15.55:0/266258920 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f15b00d1d70 0x7f15b00b93c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:33.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.482+0000 7f15b5d9b640 1 --2- 172.21.15.55:0/266258920 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15b00cfb40 0x7f15b0153d80 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:33.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.482+0000 7f15b5d9b640 1 -- 172.21.15.55:0/266258920 >> 172.21.15.55:0/266258920 conn(0x7f15b0067a50 msgr2=0x7f15b00cbc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:33.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.482+0000 7f15b5d9b640 1 -- 172.21.15.55:0/266258920 shutdown_connections 2024-05-27T12:33:33.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.482+0000 7f15b5d9b640 1 -- 172.21.15.55:0/266258920 wait complete. 2024-05-27T12:33:33.493 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-27T12:33:33.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.599+0000 7f99d5e42640 1 Processor -- start 2024-05-27T12:33:33.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.599+0000 7f99d5e42640 1 -- start start 2024-05-27T12:33:33.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.600+0000 7f99d5e42640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f99d006d590 0x7f99d00d3950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:33.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.600+0000 7f99d5e42640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99d00cffe0 con 0x7f99d01620b0 2024-05-27T12:33:33.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.600+0000 7f99d5e42640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99d00b39a0 con 0x7f99d00b79c0 2024-05-27T12:33:33.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.600+0000 7f99d5e42640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f99d00d56d0 con 0x7f99d006d590 2024-05-27T12:33:33.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.600+0000 7f99cf7fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f99d01620b0 0x7f99d00cf8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:32862/0 (socket says 172.21.15.55:32862) 2024-05-27T12:33:33.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.600+0000 7f99cf7fe640 1 -- 172.21.15.55:0/3261802468 learned_addr learned my addr 172.21.15.55:0/3261802468 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-27T12:33:33.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.600+0000 7f99cffff640 1 --2- 172.21.15.55:0/3261802468 >> v2:172.21.15.72:3300/0 conn(0x7f99d006d590 0x7f99d00d3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:33.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.600+0000 7f99ce7fc640 1 -- 172.21.15.55:0/3261802468 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1284298047 0 0) 0x7f99d00cffe0 con 0x7f99d01620b0 2024-05-27T12:33:33.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.600+0000 7f99ce7fc640 1 -- 172.21.15.55:0/3261802468 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f99b8003520 con 0x7f99d01620b0 2024-05-27T12:33:33.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.601+0000 7f99cffff640 1 -- 172.21.15.55:0/3261802468 >> v1:172.21.15.72:6789/0 conn(0x7f99d00b79c0 legacy=0x7f99d006ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:33.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.601+0000 7f99ce7fc640 1 -- 172.21.15.55:0/3261802468 <== mon.1 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3322227404 0 0) 0x7f99d00b39a0 con 0x7f99d00b79c0 2024-05-27T12:33:33.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.601+0000 7f99cffff640 1 -- 172.21.15.55:0/3261802468 >> v1:172.21.15.55:6789/0 conn(0x7f99d01620b0 legacy=0x7f99d00cf8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:33.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.601+0000 7f99cffff640 1 -- 172.21.15.55:0/3261802468 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99d00b3c80 con 0x7f99d006d590 2024-05-27T12:33:33.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.601+0000 7f99cffff640 1 --2- 172.21.15.55:0/3261802468 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f99d006d590 0x7f99d00d3950 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f99c8009d90 tx=0x7f99c802a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=555bc316a15c4628 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:33.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.602+0000 7f99ce7fc640 1 -- 172.21.15.55:0/3261802468 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99c8035020 con 0x7f99d006d590 2024-05-27T12:33:33.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.602+0000 7f99ce7fc640 1 -- 172.21.15.55:0/3261802468 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99c8007540 con 0x7f99d006d590 2024-05-27T12:33:33.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.602+0000 7f99ce7fc640 1 -- 172.21.15.55:0/3261802468 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99c0001670 con 0x7f99d006d590 2024-05-27T12:33:33.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.602+0000 7f99d5e42640 1 -- 172.21.15.55:0/3261802468 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f99d006d590 msgr2=0x7f99d00d3950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:33.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.602+0000 7f99d5e42640 1 --2- 172.21.15.55:0/3261802468 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f99d006d590 0x7f99d00d3950 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f99c8009d90 tx=0x7f99c802a660 comp rx=0 tx=0).stop 2024-05-27T12:33:33.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.602+0000 7f99d5e42640 1 -- 172.21.15.55:0/3261802468 shutdown_connections 2024-05-27T12:33:33.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.602+0000 7f99d5e42640 1 --2- 172.21.15.55:0/3261802468 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f99d006d590 0x7f99d00d3950 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:33.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.602+0000 7f99d5e42640 1 -- 172.21.15.55:0/3261802468 >> 172.21.15.55:0/3261802468 conn(0x7f99d00d1940 msgr2=0x7f99d00d4890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:33.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.602+0000 7f99d5e42640 1 -- 172.21.15.55:0/3261802468 shutdown_connections 2024-05-27T12:33:33.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.602+0000 7f99d5e42640 1 -- 172.21.15.55:0/3261802468 wait complete. 2024-05-27T12:33:33.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.603+0000 7f99d5e42640 1 Processor -- start 2024-05-27T12:33:33.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.604+0000 7f99d5e42640 1 -- start start 2024-05-27T12:33:33.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.604+0000 7f99d5e42640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f99d006d590 0x7f99d0161420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:33.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.604+0000 7f99d5e42640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f99d00b79c0 0x7f99d00cde40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:33.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.604+0000 7f99d5e42640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99d01620b0 0x7f99d00ca890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:33.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.604+0000 7f99d5e42640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f99d00d3430 con 0x7f99d01620b0 2024-05-27T12:33:33.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.604+0000 7f99d5e42640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f99d00d3150 con 0x7f99d00b79c0 2024-05-27T12:33:33.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.604+0000 7f99d5e42640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f99d00b7e50 con 0x7f99d006d590 2024-05-27T12:33:33.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.604+0000 7f99cffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99d01620b0 0x7f99d00ca890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:33.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.604+0000 7f99cffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99d01620b0 0x7f99d00ca890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50996/0 (socket says 172.21.15.55:50996) 2024-05-27T12:33:33.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.605+0000 7f99cffff640 1 -- 172.21.15.55:0/983624859 learned_addr learned my addr 172.21.15.55:0/983624859 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:33:33.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.605+0000 7f99cf7fe640 1 --2- 172.21.15.55:0/983624859 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f99d006d590 0x7f99d0161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:33.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.605+0000 7f99ceffd640 1 --2- 172.21.15.55:0/983624859 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f99d00b79c0 0x7f99d00cde40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:33.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.605+0000 7f99cffff640 1 -- 172.21.15.55:0/983624859 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f99d006d590 msgr2=0x7f99d0161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:33.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.605+0000 7f99cffff640 1 --2- 172.21.15.55:0/983624859 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f99d006d590 0x7f99d0161420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:33.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.605+0000 7f99cffff640 1 -- 172.21.15.55:0/983624859 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f99d00b79c0 msgr2=0x7f99d00cde40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:33.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.605+0000 7f99cffff640 1 --2- 172.21.15.55:0/983624859 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f99d00b79c0 0x7f99d00cde40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:33.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.605+0000 7f99cffff640 1 -- 172.21.15.55:0/983624859 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99d00ce380 con 0x7f99d01620b0 2024-05-27T12:33:33.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.605+0000 7f99ceffd640 1 --2- 172.21.15.55:0/983624859 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f99d00b79c0 0x7f99d00cde40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T12:33:33.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.605+0000 7f99cffff640 1 --2- 172.21.15.55:0/983624859 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99d01620b0 0x7f99d00ca890 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f99c8009eb0 tx=0x7f99c8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:33.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.605+0000 7f99b7fff640 1 -- 172.21.15.55:0/983624859 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99c803f070 con 0x7f99d01620b0 2024-05-27T12:33:33.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.605+0000 7f99b7fff640 1 -- 172.21.15.55:0/983624859 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99c8031bc0 con 0x7f99d01620b0 2024-05-27T12:33:33.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.605+0000 7f99d5e42640 1 -- 172.21.15.55:0/983624859 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99d00cd3c0 con 0x7f99d01620b0 2024-05-27T12:33:33.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.605+0000 7f99b7fff640 1 -- 172.21.15.55:0/983624859 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99c8035070 con 0x7f99d01620b0 2024-05-27T12:33:33.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.605+0000 7f99d5e42640 1 -- 172.21.15.55:0/983624859 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99d00cd660 con 0x7f99d01620b0 2024-05-27T12:33:33.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.606+0000 7f99d5e42640 1 -- 172.21.15.55:0/983624859 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99d0075460 con 0x7f99d01620b0 2024-05-27T12:33:33.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.607+0000 7f99b7fff640 1 -- 172.21.15.55:0/983624859 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f99c8042070 con 0x7f99d01620b0 2024-05-27T12:33:33.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.607+0000 7f99b7fff640 1 --2- 172.21.15.55:0/983624859 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f99bc06c8f0 0x7f99bc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:33.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.607+0000 7f99b7fff640 1 -- 172.21.15.55:0/983624859 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 4857+0+0 (secure 0 0 0) 0x7f99c80ac880 con 0x7f99d01620b0 2024-05-27T12:33:33.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.607+0000 7f99cf7fe640 1 --2- 172.21.15.55:0/983624859 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f99bc06c8f0 0x7f99bc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:33.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.608+0000 7f99cf7fe640 1 --2- 172.21.15.55:0/983624859 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f99bc06c8f0 0x7f99bc06edb0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f99c00011e0 tx=0x7f99c0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:33.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.611+0000 7f99b7fff640 1 -- 172.21.15.55:0/983624859 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f99d00ce380 con 0x7f99d01620b0 2024-05-27T12:33:33.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.796+0000 7f99d5e42640 1 -- 172.21.15.55:0/983624859 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f99d00b36e0 con 0x7f99d01620b0 2024-05-27T12:33:33.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.797+0000 7f99b7fff640 1 -- 172.21.15.55:0/983624859 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v32) ==== 84+0+65 (secure 0 0 0) 0x7f99c807b010 con 0x7f99d01620b0 2024-05-27T12:33:33.796 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-27T12:33:33.796 INFO:teuthology.orchestra.run.smithi055.stdout:[ 2024-05-27T12:33:33.796 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-05-27T12:33:33.797 INFO:teuthology.orchestra.run.smithi055.stdout: "poolnum": 1, 2024-05-27T12:33:33.797 INFO:teuthology.orchestra.run.smithi055.stdout: "poolname": ".mgr" 2024-05-27T12:33:33.797 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-05-27T12:33:33.797 INFO:teuthology.orchestra.run.smithi055.stdout:] 2024-05-27T12:33:33.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.798+0000 7f99d5e42640 1 -- 172.21.15.55:0/983624859 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f99bc06c8f0 msgr2=0x7f99bc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:33.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.798+0000 7f99d5e42640 1 --2- 172.21.15.55:0/983624859 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f99bc06c8f0 0x7f99bc06edb0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f99c00011e0 tx=0x7f99c0009040 comp rx=0 tx=0).stop 2024-05-27T12:33:33.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.798+0000 7f99d5e42640 1 -- 172.21.15.55:0/983624859 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99d01620b0 msgr2=0x7f99d00ca890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:33.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.798+0000 7f99d5e42640 1 --2- 172.21.15.55:0/983624859 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99d01620b0 0x7f99d00ca890 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f99c8009eb0 tx=0x7f99c8004a40 comp rx=0 tx=0).stop 2024-05-27T12:33:33.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.799+0000 7f99d5e42640 1 -- 172.21.15.55:0/983624859 shutdown_connections 2024-05-27T12:33:33.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.799+0000 7f99d5e42640 1 --2- 172.21.15.55:0/983624859 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99d01620b0 0x7f99d00ca890 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:33.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.799+0000 7f99d5e42640 1 --2- 172.21.15.55:0/983624859 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f99bc06c8f0 0x7f99bc06edb0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:33.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.799+0000 7f99d5e42640 1 --2- 172.21.15.55:0/983624859 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f99d00b79c0 0x7f99d00cde40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:33.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.799+0000 7f99d5e42640 1 --2- 172.21.15.55:0/983624859 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f99d006d590 0x7f99d0161420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:33.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.799+0000 7f99d5e42640 1 -- 172.21.15.55:0/983624859 >> 172.21.15.55:0/983624859 conn(0x7f99d00d1940 msgr2=0x7f99d00b6ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:33.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.799+0000 7f99d5e42640 1 -- 172.21.15.55:0/983624859 shutdown_connections 2024-05-27T12:33:33.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.799+0000 7f99d5e42640 1 -- 172.21.15.55:0/983624859 wait complete. 2024-05-27T12:33:33.809 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-27T12:33:33.809 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-27T12:33:33.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.918+0000 7f673ef29640 1 Processor -- start 2024-05-27T12:33:33.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.918+0000 7f673ef29640 1 -- start start 2024-05-27T12:33:33.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.919+0000 7f673ef29640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f67380b3f70 0x7f673806b930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:33.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.919+0000 7f673ef29640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f673806be70 0x7f6738072010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:33.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.919+0000 7f673ef29640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f673815cfd0 con 0x7f6738146060 2024-05-27T12:33:33.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.919+0000 7f673ef29640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f673815dbe0 con 0x7f67380b3f70 2024-05-27T12:33:33.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.919+0000 7f673ef29640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f673806c2c0 con 0x7f673806be70 2024-05-27T12:33:33.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.919+0000 7f672ffff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f67380b3f70 0x7f673806b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:33.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.919+0000 7f673ccc5640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f6738146060 0x7f67380cd8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:32866/0 (socket says 172.21.15.55:32866) 2024-05-27T12:33:33.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.919+0000 7f673ccc5640 1 -- 172.21.15.55:0/289531686 learned_addr learned my addr 172.21.15.55:0/289531686 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-27T12:33:33.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.919+0000 7f673d4c6640 1 --2- 172.21.15.55:0/289531686 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f673806be70 0x7f6738072010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:33.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.919+0000 7f672ffff640 1 -- 172.21.15.55:0/289531686 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f673806be70 msgr2=0x7f6738072010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:33.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.919+0000 7f672ffff640 1 --2- 172.21.15.55:0/289531686 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f673806be70 0x7f6738072010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:33.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.919+0000 7f672ffff640 1 -- 172.21.15.55:0/289531686 >> v1:172.21.15.55:6789/0 conn(0x7f6738146060 legacy=0x7f67380cd8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:33.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.919+0000 7f672ffff640 1 -- 172.21.15.55:0/289531686 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f673815d2b0 con 0x7f67380b3f70 2024-05-27T12:33:33.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.920+0000 7f672ffff640 1 --2- 172.21.15.55:0/289531686 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f67380b3f70 0x7f673806b930 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f67280097a0 tx=0x7f672802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c0148a2c08cd3af server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:33.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.920+0000 7f672f7fe640 1 -- 172.21.15.55:0/289531686 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6728037070 con 0x7f67380b3f70 2024-05-27T12:33:33.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.920+0000 7f672f7fe640 1 -- 172.21.15.55:0/289531686 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6728032440 con 0x7f67380b3f70 2024-05-27T12:33:33.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.920+0000 7f672f7fe640 1 -- 172.21.15.55:0/289531686 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6728032810 con 0x7f67380b3f70 2024-05-27T12:33:33.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.921+0000 7f673ef29640 1 -- 172.21.15.55:0/289531686 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f67380b3f70 msgr2=0x7f673806b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:33.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.921+0000 7f673ef29640 1 --2- 172.21.15.55:0/289531686 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f67380b3f70 0x7f673806b930 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f67280097a0 tx=0x7f672802a180 comp rx=0 tx=0).stop 2024-05-27T12:33:33.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.921+0000 7f673ef29640 1 -- 172.21.15.55:0/289531686 shutdown_connections 2024-05-27T12:33:33.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.921+0000 7f673ef29640 1 --2- 172.21.15.55:0/289531686 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f673806be70 0x7f6738072010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:33.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.921+0000 7f673ef29640 1 --2- 172.21.15.55:0/289531686 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f67380b3f70 0x7f673806b930 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:33.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.921+0000 7f673ef29640 1 -- 172.21.15.55:0/289531686 >> 172.21.15.55:0/289531686 conn(0x7f67380b2240 msgr2=0x7f67380b2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:33.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.921+0000 7f673ef29640 1 -- 172.21.15.55:0/289531686 shutdown_connections 2024-05-27T12:33:33.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.921+0000 7f673ef29640 1 -- 172.21.15.55:0/289531686 wait complete. 2024-05-27T12:33:33.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.922+0000 7f673ef29640 1 Processor -- start 2024-05-27T12:33:33.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.922+0000 7f673ef29640 1 -- start start 2024-05-27T12:33:33.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.923+0000 7f673ef29640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f673806be70 0x7f6738154770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:33.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.923+0000 7f673ef29640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f67380b3f70 0x7f673806de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:33.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.923+0000 7f673ef29640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6738146060 0x7f673813d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:33.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.923+0000 7f673ef29640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f67380cdfb0 con 0x7f673806be70 2024-05-27T12:33:33.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.923+0000 7f673ef29640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f673815d870 con 0x7f6738146060 2024-05-27T12:33:33.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.923+0000 7f673ef29640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f6738146440 con 0x7f67380b3f70 2024-05-27T12:33:33.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.923+0000 7f673ccc5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f673806be70 0x7f6738154770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:33.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.923+0000 7f673ccc5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f673806be70 0x7f6738154770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51020/0 (socket says 172.21.15.55:51020) 2024-05-27T12:33:33.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.923+0000 7f673ccc5640 1 -- 172.21.15.55:0/2807247925 learned_addr learned my addr 172.21.15.55:0/2807247925 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:33:33.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.923+0000 7f673ccc5640 1 -- 172.21.15.55:0/2807247925 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f67380b3f70 msgr2=0x7f673806de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:33.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.923+0000 7f673ccc5640 1 --2- 172.21.15.55:0/2807247925 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f67380b3f70 0x7f673806de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:33.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.923+0000 7f673ccc5640 1 -- 172.21.15.55:0/2807247925 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6738146060 msgr2=0x7f673813d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:33.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.923+0000 7f673ccc5640 1 --2- 172.21.15.55:0/2807247925 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6738146060 0x7f673813d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:33.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.923+0000 7f673ccc5640 1 -- 172.21.15.55:0/2807247925 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f673806e600 con 0x7f673806be70 2024-05-27T12:33:33.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.923+0000 7f673ccc5640 1 --2- 172.21.15.55:0/2807247925 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f673806be70 0x7f6738154770 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f673400c3c0 tx=0x7f673400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:33.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.924+0000 7f672d7fa640 1 -- 172.21.15.55:0/2807247925 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6734017070 con 0x7f673806be70 2024-05-27T12:33:33.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.924+0000 7f672d7fa640 1 -- 172.21.15.55:0/2807247925 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6734005ce0 con 0x7f673806be70 2024-05-27T12:33:33.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.924+0000 7f673ef29640 1 -- 172.21.15.55:0/2807247925 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f673806e8e0 con 0x7f673806be70 2024-05-27T12:33:33.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.924+0000 7f672d7fa640 1 -- 172.21.15.55:0/2807247925 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67340072f0 con 0x7f673806be70 2024-05-27T12:33:33.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.924+0000 7f673ef29640 1 -- 172.21.15.55:0/2807247925 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f673806eea0 con 0x7f673806be70 2024-05-27T12:33:33.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.925+0000 7f673ef29640 1 -- 172.21.15.55:0/2807247925 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6738068a70 con 0x7f673806be70 2024-05-27T12:33:33.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.925+0000 7f672d7fa640 1 -- 172.21.15.55:0/2807247925 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f673401a070 con 0x7f673806be70 2024-05-27T12:33:33.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.926+0000 7f672d7fa640 1 --2- 172.21.15.55:0/2807247925 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f672406c8f0 0x7f672406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:33.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.926+0000 7f672d7fa640 1 -- 172.21.15.55:0/2807247925 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 4857+0+0 (secure 0 0 0) 0x7f673408aba0 con 0x7f673806be70 2024-05-27T12:33:33.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.926+0000 7f672ffff640 1 --2- 172.21.15.55:0/2807247925 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f672406c8f0 0x7f672406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:33.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.926+0000 7f672ffff640 1 --2- 172.21.15.55:0/2807247925 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f672406c8f0 0x7f672406edb0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f6728034000 tx=0x7f672802c000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:33.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:33.930+0000 7f672d7fa640 1 -- 172.21.15.55:0/2807247925 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6734059320 con 0x7f673806be70 2024-05-27T12:33:34.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:34.117+0000 7f673ef29640 1 -- 172.21.15.55:0/2807247925 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f67380b3840 con 0x7f673806be70 2024-05-27T12:33:34.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:34.283+0000 7f672d7fa640 1 -- 172.21.15.55:0/2807247925 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v33) ==== 138+0+0 (secure 0 0 0) 0x7f6734058c20 con 0x7f673806be70 2024-05-27T12:33:34.282 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_metadata' created 2024-05-27T12:33:34.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:34.285+0000 7f673ef29640 1 -- 172.21.15.55:0/2807247925 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f672406c8f0 msgr2=0x7f672406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:34.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:34.285+0000 7f673ef29640 1 --2- 172.21.15.55:0/2807247925 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f672406c8f0 0x7f672406edb0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f6728034000 tx=0x7f672802c000 comp rx=0 tx=0).stop 2024-05-27T12:33:34.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:34.285+0000 7f673ef29640 1 -- 172.21.15.55:0/2807247925 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f673806be70 msgr2=0x7f6738154770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:34.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:34.285+0000 7f673ef29640 1 --2- 172.21.15.55:0/2807247925 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f673806be70 0x7f6738154770 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f673400c3c0 tx=0x7f673400c880 comp rx=0 tx=0).stop 2024-05-27T12:33:34.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:34.285+0000 7f673ef29640 1 -- 172.21.15.55:0/2807247925 shutdown_connections 2024-05-27T12:33:34.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:34.285+0000 7f673ef29640 1 --2- 172.21.15.55:0/2807247925 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f672406c8f0 0x7f672406edb0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:34.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:34.285+0000 7f673ef29640 1 --2- 172.21.15.55:0/2807247925 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6738146060 0x7f673813d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:34.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:34.285+0000 7f673ef29640 1 --2- 172.21.15.55:0/2807247925 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f67380b3f70 0x7f673806de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:34.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:34.285+0000 7f673ef29640 1 --2- 172.21.15.55:0/2807247925 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f673806be70 0x7f6738154770 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:34.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:34.285+0000 7f673ef29640 1 -- 172.21.15.55:0/2807247925 >> 172.21.15.55:0/2807247925 conn(0x7f67380b2240 msgr2=0x7f673815f180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:34.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:34.285+0000 7f673ef29640 1 -- 172.21.15.55:0/2807247925 shutdown_connections 2024-05-27T12:33:34.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:34.285+0000 7f673ef29640 1 -- 172.21.15.55:0/2807247925 wait complete. 2024-05-27T12:33:34.298 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-05-27T12:33:34.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:34.409+0000 7f33ef15c640 1 Processor -- start 2024-05-27T12:33:34.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:34.410+0000 7f33ef15c640 1 -- start start 2024-05-27T12:33:34.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:34.410+0000 7f33ef15c640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f33e815edd0 0x7f33e80b63a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:34.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:34.410+0000 7f33ef15c640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f33e80b68e0 0x7f33e80d2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:34.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:34.410+0000 7f33ef15c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f33e80d3200 0x7f33e806ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:34.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:34.410+0000 7f33ef15c640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f33e80b6d40 con 0x7f33e80d3200 2024-05-27T12:33:34.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:34.410+0000 7f33ef15c640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f33e80d3690 con 0x7f33e815edd0 2024-05-27T12:33:34.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:34.410+0000 7f33ef15c640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f33e815f1b0 con 0x7f33e80b68e0 2024-05-27T12:33:34.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:34.411+0000 7f33ed6f9640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f33e80d3200 0x7f33e806ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:34.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:34.411+0000 7f33ed6f9640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f33e80d3200 0x7f33e806ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51034/0 (socket says 172.21.15.55:51034) 2024-05-27T12:33:34.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:34.411+0000 7f33ed6f9640 1 -- 172.21.15.55:0/3366369306 learned_addr learned my addr 172.21.15.55:0/3366369306 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:33:34.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:34.411+0000 7f33ecef8640 1 --2- 172.21.15.55:0/3366369306 >> v2:172.21.15.72:3300/0 conn(0x7f33e815edd0 0x7f33e80b63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:34.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:34.411+0000 7f33e7fff640 1 --2- 172.21.15.55:0/3366369306 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f33e80b68e0 0x7f33e80d2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:34.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:34.411+0000 7f33ed6f9640 1 -- 172.21.15.55:0/3366369306 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f33e80b68e0 msgr2=0x7f33e80d2cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:34.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:34.411+0000 7f33ed6f9640 1 --2- 172.21.15.55:0/3366369306 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f33e80b68e0 0x7f33e80d2cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:34.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:34.411+0000 7f33ed6f9640 1 -- 172.21.15.55:0/3366369306 >> v2:172.21.15.72:3300/0 conn(0x7f33e815edd0 msgr2=0x7f33e80b63a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:34.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:34.411+0000 7f33ed6f9640 1 --2- 172.21.15.55:0/3366369306 >> v2:172.21.15.72:3300/0 conn(0x7f33e815edd0 0x7f33e80b63a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:34.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:34.411+0000 7f33ed6f9640 1 -- 172.21.15.55:0/3366369306 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33e80d3940 con 0x7f33e80d3200 2024-05-27T12:33:34.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:34.411+0000 7f33ecef8640 1 --2- 172.21.15.55:0/3366369306 >> v2:172.21.15.72:3300/0 conn(0x7f33e815edd0 0x7f33e80b63a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T12:33:34.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:34.412+0000 7f33ed6f9640 1 --2- 172.21.15.55:0/3366369306 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f33e80d3200 0x7f33e806ce40 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f33e806ebd0 tx=0x7f33d802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dce2f771fe43f45 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:34.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:34.412+0000 7f33e77fe640 1 -- 172.21.15.55:0/3366369306 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33d8036070 con 0x7f33e80d3200 2024-05-27T12:33:34.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:34.412+0000 7f33e77fe640 1 -- 172.21.15.55:0/3366369306 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33d8031600 con 0x7f33e80d3200 2024-05-27T12:33:34.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:34.412+0000 7f33e77fe640 1 -- 172.21.15.55:0/3366369306 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33d80319d0 con 0x7f33e80d3200 2024-05-27T12:33:34.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:34.412+0000 7f33ef15c640 1 -- 172.21.15.55:0/3366369306 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f33e80d3200 msgr2=0x7f33e806ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:34.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:34.412+0000 7f33ef15c640 1 --2- 172.21.15.55:0/3366369306 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f33e80d3200 0x7f33e806ce40 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f33e806ebd0 tx=0x7f33d802a6a0 comp rx=0 tx=0).stop 2024-05-27T12:33:34.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:34.412+0000 7f33ef15c640 1 -- 172.21.15.55:0/3366369306 shutdown_connections 2024-05-27T12:33:34.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:34.412+0000 7f33ef15c640 1 --2- 172.21.15.55:0/3366369306 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f33e80d3200 0x7f33e806ce40 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:34.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:34.412+0000 7f33ef15c640 1 --2- 172.21.15.55:0/3366369306 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f33e80b68e0 0x7f33e80d2cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:34.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:34.412+0000 7f33ef15c640 1 --2- 172.21.15.55:0/3366369306 >> v2:172.21.15.72:3300/0 conn(0x7f33e815edd0 0x7f33e80b63a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:34.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:34.412+0000 7f33ef15c640 1 -- 172.21.15.55:0/3366369306 >> 172.21.15.55:0/3366369306 conn(0x7f33e80d13a0 msgr2=0x7f33e80d17b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:34.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:34.412+0000 7f33ef15c640 1 -- 172.21.15.55:0/3366369306 shutdown_connections 2024-05-27T12:33:34.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:34.412+0000 7f33ef15c640 1 -- 172.21.15.55:0/3366369306 wait complete. 2024-05-27T12:33:34.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:34.414+0000 7f33ef15c640 1 Processor -- start 2024-05-27T12:33:34.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:34.414+0000 7f33ef15c640 1 -- start start 2024-05-27T12:33:34.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:34.414+0000 7f33ef15c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33e80b68e0 0x7f33e81f4d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:34.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:34.414+0000 7f33ef15c640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f33e80d3200 0x7f33e81f79a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:34.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:34.415+0000 7f33ef15c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f33e815edd0 0x7f33e80b8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:34.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:34.415+0000 7f33ef15c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f33e80b80d0 con 0x7f33e815edd0 2024-05-27T12:33:34.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:34.415+0000 7f33ef15c640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f33e80d3f00 con 0x7f33e80b68e0 2024-05-27T12:33:34.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:34.415+0000 7f33ef15c640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f33e80b7d30 con 0x7f33e80d3200 2024-05-27T12:33:34.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:34.415+0000 7f33ed6f9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f33e815edd0 0x7f33e80b8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:34.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:34.415+0000 7f33ed6f9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f33e815edd0 0x7f33e80b8ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51050/0 (socket says 172.21.15.55:51050) 2024-05-27T12:33:34.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:34.415+0000 7f33ed6f9640 1 -- 172.21.15.55:0/3861955455 learned_addr learned my addr 172.21.15.55:0/3861955455 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:33:34.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:34.415+0000 7f33ecef8640 1 --2- 172.21.15.55:0/3861955455 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33e80b68e0 0x7f33e81f4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:34.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:34.415+0000 7f33e7fff640 1 --2- 172.21.15.55:0/3861955455 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f33e80d3200 0x7f33e81f79a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:34.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:34.415+0000 7f33ed6f9640 1 -- 172.21.15.55:0/3861955455 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f33e80d3200 msgr2=0x7f33e81f79a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:34.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:34.415+0000 7f33ed6f9640 1 --2- 172.21.15.55:0/3861955455 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f33e80d3200 0x7f33e81f79a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:34.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:34.415+0000 7f33ed6f9640 1 -- 172.21.15.55:0/3861955455 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33e80b68e0 msgr2=0x7f33e81f4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:34.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:34.415+0000 7f33ed6f9640 1 --2- 172.21.15.55:0/3861955455 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33e80b68e0 0x7f33e81f4d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:34.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:34.415+0000 7f33ed6f9640 1 -- 172.21.15.55:0/3861955455 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33e80ab610 con 0x7f33e815edd0 2024-05-27T12:33:34.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:34.415+0000 7f33ed6f9640 1 --2- 172.21.15.55:0/3861955455 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f33e815edd0 0x7f33e80b8ba0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f33d8034040 tx=0x7f33d8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:34.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:34.415+0000 7f33e57fa640 1 -- 172.21.15.55:0/3861955455 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33d8036050 con 0x7f33e815edd0 2024-05-27T12:33:34.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:34.415+0000 7f33e57fa640 1 -- 172.21.15.55:0/3861955455 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33d8042070 con 0x7f33e815edd0 2024-05-27T12:33:34.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:34.415+0000 7f33ef15c640 1 -- 172.21.15.55:0/3861955455 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33e8159280 con 0x7f33e815edd0 2024-05-27T12:33:34.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:34.415+0000 7f33e57fa640 1 -- 172.21.15.55:0/3861955455 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33d8009510 con 0x7f33e815edd0 2024-05-27T12:33:34.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:34.415+0000 7f33ef15c640 1 -- 172.21.15.55:0/3861955455 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33e815a220 con 0x7f33e815edd0 2024-05-27T12:33:34.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:34.416+0000 7f33ef15c640 1 -- 172.21.15.55:0/3861955455 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33e80d1780 con 0x7f33e815edd0 2024-05-27T12:33:34.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:34.417+0000 7f33e57fa640 1 -- 172.21.15.55:0/3861955455 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f33d8007bf0 con 0x7f33e815edd0 2024-05-27T12:33:34.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:34.418+0000 7f33e57fa640 1 --2- 172.21.15.55:0/3861955455 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f33c806c8f0 0x7f33c806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:34.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:34.418+0000 7f33e57fa640 1 -- 172.21.15.55:0/3861955455 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5227+0+0 (secure 0 0 0) 0x7f33d80ad2e0 con 0x7f33e815edd0 2024-05-27T12:33:34.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:34.418+0000 7f33ecef8640 1 --2- 172.21.15.55:0/3861955455 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f33c806c8f0 0x7f33c806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:34.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:34.418+0000 7f33ecef8640 1 --2- 172.21.15.55:0/3861955455 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f33c806c8f0 0x7f33c806edb0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f33e000aa40 tx=0x7f33e0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:34.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:34.422+0000 7f33e57fa640 1 -- 172.21.15.55:0/3861955455 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f33e80d1780 con 0x7f33e815edd0 2024-05-27T12:33:34.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:34.613+0000 7f33ef15c640 1 -- 172.21.15.55:0/3861955455 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f33e80ced50 con 0x7f33e815edd0 2024-05-27T12:33:35.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:35.294+0000 7f33e57fa640 1 -- 172.21.15.55:0/3861955455 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v34) ==== 170+0+0 (secure 0 0 0) 0x7f33e80ab610 con 0x7f33e815edd0 2024-05-27T12:33:35.293 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_data' created 2024-05-27T12:33:35.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:35.297+0000 7f33ef15c640 1 -- 172.21.15.55:0/3861955455 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f33c806c8f0 msgr2=0x7f33c806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:35.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:35.297+0000 7f33ef15c640 1 --2- 172.21.15.55:0/3861955455 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f33c806c8f0 0x7f33c806edb0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f33e000aa40 tx=0x7f33e0008040 comp rx=0 tx=0).stop 2024-05-27T12:33:35.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:35.297+0000 7f33ef15c640 1 -- 172.21.15.55:0/3861955455 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f33e815edd0 msgr2=0x7f33e80b8ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:35.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:35.297+0000 7f33ef15c640 1 --2- 172.21.15.55:0/3861955455 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f33e815edd0 0x7f33e80b8ba0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f33d8034040 tx=0x7f33d8004a40 comp rx=0 tx=0).stop 2024-05-27T12:33:35.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:35.297+0000 7f33ef15c640 1 -- 172.21.15.55:0/3861955455 shutdown_connections 2024-05-27T12:33:35.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:35.297+0000 7f33ef15c640 1 --2- 172.21.15.55:0/3861955455 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f33e815edd0 0x7f33e80b8ba0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:35.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:35.297+0000 7f33ef15c640 1 --2- 172.21.15.55:0/3861955455 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f33e80d3200 0x7f33e81f79a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:35.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:35.297+0000 7f33ef15c640 1 --2- 172.21.15.55:0/3861955455 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f33c806c8f0 0x7f33c806edb0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:35.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:35.297+0000 7f33ef15c640 1 --2- 172.21.15.55:0/3861955455 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33e80b68e0 0x7f33e81f4d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:35.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:35.297+0000 7f33ef15c640 1 -- 172.21.15.55:0/3861955455 >> 172.21.15.55:0/3861955455 conn(0x7f33e80d13a0 msgr2=0x7f33e80d4c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:35.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:35.297+0000 7f33ef15c640 1 -- 172.21.15.55:0/3861955455 shutdown_connections 2024-05-27T12:33:35.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:35.297+0000 7f33ef15c640 1 -- 172.21.15.55:0/3861955455 wait complete. 2024-05-27T12:33:35.320 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-27T12:33:35.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:35.432+0000 7f57be8c2640 1 Processor -- start 2024-05-27T12:33:35.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:35.432+0000 7f57be8c2640 1 -- start start 2024-05-27T12:33:35.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:35.433+0000 7f57be8c2640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f57b815eb00 0x7f57b80cfb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:35.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:35.433+0000 7f57be8c2640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f57b80d3e50 0x7f57b80d1830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:35.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:35.433+0000 7f57be8c2640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57b815eee0 con 0x7f57b80d1d70 2024-05-27T12:33:35.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:35.433+0000 7f57be8c2640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f57b80d5700 con 0x7f57b815eb00 2024-05-27T12:33:35.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:35.433+0000 7f57be8c2640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f57b80d21a0 con 0x7f57b80d3e50 2024-05-27T12:33:35.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:35.433+0000 7f57b7fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f57b815eb00 0x7f57b80cfb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:35.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:35.433+0000 7f57bce5f640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f57b80d1d70 0x7f57b80d2910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:32868/0 (socket says 172.21.15.55:32868) 2024-05-27T12:33:35.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:35.433+0000 7f57bce5f640 1 -- 172.21.15.55:0/607953764 learned_addr learned my addr 172.21.15.55:0/607953764 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-27T12:33:35.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:35.434+0000 7f57b77fe640 1 --2- 172.21.15.55:0/607953764 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f57b80d3e50 0x7f57b80d1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:35.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:35.434+0000 7f57b7fff640 1 -- 172.21.15.55:0/607953764 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f57b80d3e50 msgr2=0x7f57b80d1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:35.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:35.434+0000 7f57b7fff640 1 --2- 172.21.15.55:0/607953764 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f57b80d3e50 0x7f57b80d1830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:35.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:35.434+0000 7f57b7fff640 1 -- 172.21.15.55:0/607953764 >> v1:172.21.15.55:6789/0 conn(0x7f57b80d1d70 legacy=0x7f57b80d2910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:35.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:35.434+0000 7f57b7fff640 1 -- 172.21.15.55:0/607953764 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57b80d4660 con 0x7f57b815eb00 2024-05-27T12:33:35.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:35.434+0000 7f57b6ffd640 1 -- 172.21.15.55:0/607953764 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3241227502 0 0) 0x7f57b815eee0 con 0x7f57b80d1d70 2024-05-27T12:33:35.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:35.434+0000 7f57b77fe640 1 --2- 172.21.15.55:0/607953764 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f57b80d3e50 0x7f57b80d1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T12:33:35.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:35.434+0000 7f57b7fff640 1 --2- 172.21.15.55:0/607953764 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57b815eb00 0x7f57b80cfb40 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f57a80097d0 tx=0x7f57a802a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=151a939733358798 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:35.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:35.435+0000 7f57b6ffd640 1 -- 172.21.15.55:0/607953764 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57a8037070 con 0x7f57b815eb00 2024-05-27T12:33:35.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:35.435+0000 7f57b6ffd640 1 -- 172.21.15.55:0/607953764 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57a8032440 con 0x7f57b815eb00 2024-05-27T12:33:35.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:35.435+0000 7f57b6ffd640 1 -- 172.21.15.55:0/607953764 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57a8032810 con 0x7f57b815eb00 2024-05-27T12:33:35.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:35.435+0000 7f57be8c2640 1 -- 172.21.15.55:0/607953764 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57b815eb00 msgr2=0x7f57b80cfb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:35.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:35.435+0000 7f57be8c2640 1 --2- 172.21.15.55:0/607953764 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57b815eb00 0x7f57b80cfb40 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f57a80097d0 tx=0x7f57a802a250 comp rx=0 tx=0).stop 2024-05-27T12:33:35.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:35.435+0000 7f57be8c2640 1 -- 172.21.15.55:0/607953764 shutdown_connections 2024-05-27T12:33:35.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:35.435+0000 7f57be8c2640 1 --2- 172.21.15.55:0/607953764 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f57b80d3e50 0x7f57b80d1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:35.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:35.435+0000 7f57be8c2640 1 --2- 172.21.15.55:0/607953764 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57b815eb00 0x7f57b80cfb40 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:35.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:35.435+0000 7f57be8c2640 1 -- 172.21.15.55:0/607953764 >> 172.21.15.55:0/607953764 conn(0x7f57b8067a50 msgr2=0x7f57b8067e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:35.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:35.435+0000 7f57be8c2640 1 -- 172.21.15.55:0/607953764 shutdown_connections 2024-05-27T12:33:35.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:35.435+0000 7f57be8c2640 1 -- 172.21.15.55:0/607953764 wait complete. 2024-05-27T12:33:35.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:35.436+0000 7f57be8c2640 1 Processor -- start 2024-05-27T12:33:35.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:35.437+0000 7f57be8c2640 1 -- start start 2024-05-27T12:33:35.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:35.437+0000 7f57be8c2640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f57b80d1d70 0x7f57b80c78f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:35.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:35.437+0000 7f57be8c2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57b80d3e50 0x7f57b80c8390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:35.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:35.437+0000 7f57be8c2640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f57b815eb00 0x7f57b80c88d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:35.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:35.437+0000 7f57be8c2640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f57b80d4f00 con 0x7f57b80d3e50 2024-05-27T12:33:35.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:35.437+0000 7f57be8c2640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f57b80d4c20 con 0x7f57b80d1d70 2024-05-27T12:33:35.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:35.437+0000 7f57be8c2640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f57b80d51e0 con 0x7f57b815eb00 2024-05-27T12:33:35.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:35.437+0000 7f57b77fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57b80d3e50 0x7f57b80c8390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:35.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:35.437+0000 7f57b77fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57b80d3e50 0x7f57b80c8390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51066/0 (socket says 172.21.15.55:51066) 2024-05-27T12:33:35.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:35.437+0000 7f57b77fe640 1 -- 172.21.15.55:0/1941398255 learned_addr learned my addr 172.21.15.55:0/1941398255 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:33:35.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:35.438+0000 7f57b7fff640 1 --2- 172.21.15.55:0/1941398255 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f57b80d1d70 0x7f57b80c78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:35.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:35.438+0000 7f57bce5f640 1 --2- 172.21.15.55:0/1941398255 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f57b815eb00 0x7f57b80c88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:35.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:35.438+0000 7f57b77fe640 1 -- 172.21.15.55:0/1941398255 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f57b815eb00 msgr2=0x7f57b80c88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:35.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:35.438+0000 7f57b77fe640 1 --2- 172.21.15.55:0/1941398255 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f57b815eb00 0x7f57b80c88d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:35.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:35.438+0000 7f57b77fe640 1 -- 172.21.15.55:0/1941398255 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f57b80d1d70 msgr2=0x7f57b80c78f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:35.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:35.438+0000 7f57b77fe640 1 --2- 172.21.15.55:0/1941398255 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f57b80d1d70 0x7f57b80c78f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:35.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:35.438+0000 7f57b77fe640 1 -- 172.21.15.55:0/1941398255 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57b80cd920 con 0x7f57b80d3e50 2024-05-27T12:33:35.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:35.438+0000 7f57b7fff640 1 --2- 172.21.15.55:0/1941398255 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f57b80d1d70 0x7f57b80c78f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T12:33:35.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:35.438+0000 7f57b77fe640 1 --2- 172.21.15.55:0/1941398255 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57b80d3e50 0x7f57b80c8390 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f57ac00c820 tx=0x7f57ac00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:35.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:35.438+0000 7f57b4ff9640 1 -- 172.21.15.55:0/1941398255 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57ac015070 con 0x7f57b80d3e50 2024-05-27T12:33:35.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:35.438+0000 7f57b4ff9640 1 -- 172.21.15.55:0/1941398255 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57ac007a30 con 0x7f57b80d3e50 2024-05-27T12:33:35.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:35.438+0000 7f57be8c2640 1 -- 172.21.15.55:0/1941398255 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57b80cd640 con 0x7f57b80d3e50 2024-05-27T12:33:35.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:35.438+0000 7f57b4ff9640 1 -- 172.21.15.55:0/1941398255 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57ac007e00 con 0x7f57b80d3e50 2024-05-27T12:33:35.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:35.438+0000 7f57be8c2640 1 -- 172.21.15.55:0/1941398255 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57b8160050 con 0x7f57b80d3e50 2024-05-27T12:33:35.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:35.439+0000 7f57be8c2640 1 -- 172.21.15.55:0/1941398255 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57b8068a70 con 0x7f57b80d3e50 2024-05-27T12:33:35.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:35.440+0000 7f57b4ff9640 1 -- 172.21.15.55:0/1941398255 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f57ac018070 con 0x7f57b80d3e50 2024-05-27T12:33:35.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:35.440+0000 7f57b4ff9640 1 --2- 172.21.15.55:0/1941398255 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f57a406c8f0 0x7f57a406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:35.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:35.441+0000 7f57b4ff9640 1 -- 172.21.15.55:0/1941398255 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5609+0+0 (secure 0 0 0) 0x7f57ac08bac0 con 0x7f57b80d3e50 2024-05-27T12:33:35.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:35.441+0000 7f57b7fff640 1 --2- 172.21.15.55:0/1941398255 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f57a406c8f0 0x7f57a406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:35.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:35.441+0000 7f57b7fff640 1 --2- 172.21.15.55:0/1941398255 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f57a406c8f0 0x7f57a406edb0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f57a8034000 tx=0x7f57a802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:35.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:35.445+0000 7f57b4ff9640 1 -- 172.21.15.55:0/1941398255 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f57ac059f50 con 0x7f57b80d3e50 2024-05-27T12:33:35.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:35.669+0000 7f57be8c2640 1 -- 172.21.15.55:0/1941398255 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f57b80c7e30 con 0x7f57b80d3e50 2024-05-27T12:33:36.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.296+0000 7f57b4ff9640 1 -- 172.21.15.55:0/1941398255 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v11) ==== 172+0+0 (secure 0 0 0) 0x7f57ac059850 con 0x7f57b80d3e50 2024-05-27T12:33:36.295 INFO:teuthology.orchestra.run.smithi055.stderr:new fs with metadata pool 4 and data pool 5 2024-05-27T12:33:36.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.299+0000 7f57be8c2640 1 -- 172.21.15.55:0/1941398255 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f57a406c8f0 msgr2=0x7f57a406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:36.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.299+0000 7f57be8c2640 1 --2- 172.21.15.55:0/1941398255 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f57a406c8f0 0x7f57a406edb0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f57a8034000 tx=0x7f57a802e000 comp rx=0 tx=0).stop 2024-05-27T12:33:36.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.299+0000 7f57be8c2640 1 -- 172.21.15.55:0/1941398255 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57b80d3e50 msgr2=0x7f57b80c8390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:36.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.299+0000 7f57be8c2640 1 --2- 172.21.15.55:0/1941398255 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57b80d3e50 0x7f57b80c8390 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f57ac00c820 tx=0x7f57ac00cc20 comp rx=0 tx=0).stop 2024-05-27T12:33:36.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.299+0000 7f57be8c2640 1 -- 172.21.15.55:0/1941398255 shutdown_connections 2024-05-27T12:33:36.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.299+0000 7f57be8c2640 1 --2- 172.21.15.55:0/1941398255 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f57b815eb00 0x7f57b80c88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:36.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.299+0000 7f57be8c2640 1 --2- 172.21.15.55:0/1941398255 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57b80d3e50 0x7f57b80c8390 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:36.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.299+0000 7f57be8c2640 1 --2- 172.21.15.55:0/1941398255 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f57a406c8f0 0x7f57a406edb0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:36.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.299+0000 7f57be8c2640 1 --2- 172.21.15.55:0/1941398255 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f57b80d1d70 0x7f57b80c78f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:36.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.299+0000 7f57be8c2640 1 -- 172.21.15.55:0/1941398255 >> 172.21.15.55:0/1941398255 conn(0x7f57b8067a50 msgr2=0x7f57b80b7e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:36.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.299+0000 7f57be8c2640 1 -- 172.21.15.55:0/1941398255 shutdown_connections 2024-05-27T12:33:36.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.299+0000 7f57be8c2640 1 -- 172.21.15.55:0/1941398255 wait complete. 2024-05-27T12:33:36.326 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-27T12:33:36.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.437+0000 7fa02bdcd640 1 Processor -- start 2024-05-27T12:33:36.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.437+0000 7fa02bdcd640 1 -- start start 2024-05-27T12:33:36.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.438+0000 7fa02bdcd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa02406c940 0x7fa02406cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:36.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.438+0000 7fa02bdcd640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa024070b50 0x7fa024160470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:36.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.438+0000 7fa02bdcd640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa02406d260 con 0x7fa0241609b0 2024-05-27T12:33:36.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.438+0000 7fa02bdcd640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7fa02415d790 con 0x7fa02406c940 2024-05-27T12:33:36.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.438+0000 7fa02bdcd640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fa02415ce80 con 0x7fa024070b50 2024-05-27T12:33:36.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.438+0000 7fa029b69640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa02406c940 0x7fa02406cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:36.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.438+0000 7fa029b69640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa02406c940 0x7fa02406cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51072/0 (socket says 172.21.15.55:51072) 2024-05-27T12:33:36.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.438+0000 7fa029b69640 1 -- 172.21.15.55:0/4144951373 learned_addr learned my addr 172.21.15.55:0/4144951373 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:33:36.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.438+0000 7fa029b69640 1 -- 172.21.15.55:0/4144951373 >> v2:172.21.15.72:3300/0 conn(0x7fa024070b50 msgr2=0x7fa024160470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:36.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.438+0000 7fa029368640 1 --2- 172.21.15.55:0/4144951373 >> v2:172.21.15.72:3300/0 conn(0x7fa024070b50 0x7fa024160470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:36.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.438+0000 7fa029b69640 1 --2- 172.21.15.55:0/4144951373 >> v2:172.21.15.72:3300/0 conn(0x7fa024070b50 0x7fa024160470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:36.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.438+0000 7fa029b69640 1 -- 172.21.15.55:0/4144951373 >> v1:172.21.15.72:6789/0 conn(0x7fa0241609b0 legacy=0x7fa02415e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:36.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.438+0000 7fa029b69640 1 -- 172.21.15.55:0/4144951373 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0240b0440 con 0x7fa02406c940 2024-05-27T12:33:36.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.438+0000 7fa029368640 1 --2- 172.21.15.55:0/4144951373 >> v2:172.21.15.72:3300/0 conn(0x7fa024070b50 0x7fa024160470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T12:33:36.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.439+0000 7fa029b69640 1 --2- 172.21.15.55:0/4144951373 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa02406c940 0x7fa02406cd20 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fa02415dff0 tx=0x7fa02002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e2332c7b92b7391 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:36.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.439+0000 7fa028b67640 1 -- 172.21.15.55:0/4144951373 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa020037070 con 0x7fa02406c940 2024-05-27T12:33:36.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.439+0000 7fa028b67640 1 -- 172.21.15.55:0/4144951373 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa020032440 con 0x7fa02406c940 2024-05-27T12:33:36.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.439+0000 7fa028b67640 1 -- 172.21.15.55:0/4144951373 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa020032810 con 0x7fa02406c940 2024-05-27T12:33:36.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.440+0000 7fa02bdcd640 1 -- 172.21.15.55:0/4144951373 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa02406c940 msgr2=0x7fa02406cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:36.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.440+0000 7fa02bdcd640 1 --2- 172.21.15.55:0/4144951373 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa02406c940 0x7fa02406cd20 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fa02415dff0 tx=0x7fa02002a230 comp rx=0 tx=0).stop 2024-05-27T12:33:36.443 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.440+0000 7fa02bdcd640 1 -- 172.21.15.55:0/4144951373 shutdown_connections 2024-05-27T12:33:36.443 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.440+0000 7fa02bdcd640 1 --2- 172.21.15.55:0/4144951373 >> v2:172.21.15.72:3300/0 conn(0x7fa024070b50 0x7fa024160470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:36.443 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.440+0000 7fa02bdcd640 1 --2- 172.21.15.55:0/4144951373 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa02406c940 0x7fa02406cd20 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:36.443 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.440+0000 7fa02bdcd640 1 -- 172.21.15.55:0/4144951373 >> 172.21.15.55:0/4144951373 conn(0x7fa0240727b0 msgr2=0x7fa024072bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:36.443 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.440+0000 7fa02bdcd640 1 -- 172.21.15.55:0/4144951373 shutdown_connections 2024-05-27T12:33:36.443 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.440+0000 7fa02bdcd640 1 -- 172.21.15.55:0/4144951373 wait complete. 2024-05-27T12:33:36.443 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.441+0000 7fa02bdcd640 1 Processor -- start 2024-05-27T12:33:36.443 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.441+0000 7fa02bdcd640 1 -- start start 2024-05-27T12:33:36.443 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.442+0000 7fa02bdcd640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa02406c940 0x7fa02414e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:36.443 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.442+0000 7fa02bdcd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa024070b50 0x7fa02409d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:36.443 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.442+0000 7fa02bdcd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa0241609b0 0x7fa02409dd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:36.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.442+0000 7fa02bdcd640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7fa0240cd3c0 con 0x7fa024070b50 2024-05-27T12:33:36.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.442+0000 7fa02bdcd640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fa02415d420 con 0x7fa0241609b0 2024-05-27T12:33:36.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.442+0000 7fa02bdcd640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fa024160130 con 0x7fa02406c940 2024-05-27T12:33:36.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.442+0000 7fa029368640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa024070b50 0x7fa02409d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:36.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.442+0000 7fa029368640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa024070b50 0x7fa02409d850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51088/0 (socket says 172.21.15.55:51088) 2024-05-27T12:33:36.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.442+0000 7fa029368640 1 -- 172.21.15.55:0/2983226508 learned_addr learned my addr 172.21.15.55:0/2983226508 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:33:36.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.442+0000 7fa029b69640 1 --2- 172.21.15.55:0/2983226508 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa02406c940 0x7fa02414e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:36.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.442+0000 7fa02a36a640 1 --2- 172.21.15.55:0/2983226508 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa0241609b0 0x7fa02409dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:36.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.442+0000 7fa029368640 1 -- 172.21.15.55:0/2983226508 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa02406c940 msgr2=0x7fa02414e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:36.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.442+0000 7fa029368640 1 --2- 172.21.15.55:0/2983226508 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa02406c940 0x7fa02414e760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:36.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.442+0000 7fa029368640 1 -- 172.21.15.55:0/2983226508 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa0241609b0 msgr2=0x7fa02409dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:36.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.442+0000 7fa029368640 1 --2- 172.21.15.55:0/2983226508 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa0241609b0 0x7fa02409dd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:36.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.442+0000 7fa029368640 1 -- 172.21.15.55:0/2983226508 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa02414eca0 con 0x7fa024070b50 2024-05-27T12:33:36.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.442+0000 7fa02a36a640 1 --2- 172.21.15.55:0/2983226508 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa0241609b0 0x7fa02409dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T12:33:36.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.442+0000 7fa029368640 1 --2- 172.21.15.55:0/2983226508 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa024070b50 0x7fa02409d850 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fa01400c820 tx=0x7fa01400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:36.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.442+0000 7fa01a7fc640 1 -- 172.21.15.55:0/2983226508 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa014015070 con 0x7fa024070b50 2024-05-27T12:33:36.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.443+0000 7fa01a7fc640 1 -- 172.21.15.55:0/2983226508 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa014007a30 con 0x7fa024070b50 2024-05-27T12:33:36.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.443+0000 7fa02bdcd640 1 -- 172.21.15.55:0/2983226508 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa02409c020 con 0x7fa024070b50 2024-05-27T12:33:36.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.443+0000 7fa01a7fc640 1 -- 172.21.15.55:0/2983226508 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa014007e00 con 0x7fa024070b50 2024-05-27T12:33:36.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.443+0000 7fa02bdcd640 1 -- 172.21.15.55:0/2983226508 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0240c5c90 con 0x7fa024070b50 2024-05-27T12:33:36.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.443+0000 7fa02bdcd640 1 -- 172.21.15.55:0/2983226508 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa024075460 con 0x7fa024070b50 2024-05-27T12:33:36.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.444+0000 7fa01a7fc640 1 -- 172.21.15.55:0/2983226508 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa014018070 con 0x7fa024070b50 2024-05-27T12:33:36.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.445+0000 7fa01a7fc640 1 --2- 172.21.15.55:0/2983226508 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fa00806c8f0 0x7fa00806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:36.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.445+0000 7fa01a7fc640 1 -- 172.21.15.55:0/2983226508 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7fa01408ba90 con 0x7fa024070b50 2024-05-27T12:33:36.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.445+0000 7fa029b69640 1 --2- 172.21.15.55:0/2983226508 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fa00806c8f0 0x7fa00806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:36.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.445+0000 7fa029b69640 1 --2- 172.21.15.55:0/2983226508 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fa00806c8f0 0x7fa00806edb0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa020034000 tx=0x7fa02002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:36.448 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.449+0000 7fa01a7fc640 1 -- 172.21.15.55:0/2983226508 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa014059f50 con 0x7fa024070b50 2024-05-27T12:33:36.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.637+0000 7fa02bdcd640 1 -- 172.21.15.55:0/2983226508 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa0240ccc00 con 0x7fa024070b50 2024-05-27T12:33:36.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.638+0000 7fa01a7fc640 1 -- 172.21.15.55:0/2983226508 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) ==== 74+0+16634 (secure 0 0 0) 0x7fa014059850 con 0x7fa024070b50 2024-05-27T12:33:36.637 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-27T12:33:36.638 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":35,"fsid":"c3ff4e3b-8dae-4856-9593-e5cc66c59982","created":"2024-05-27T12:32:17.019097+0000","modified":"2024-05-27T12:33:35.670342+0000","last_up_change":"2024-05-27T12:32:28.109744+0000","last_in_change":"2024-05-27T12:32:19.309872+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-27T12:32:29.277895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-05-27T12:33:34.122092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-05-27T12:33:34.617553+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e607b598-061b-4b6f-92ff-95c20b330599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":807572567},{"type":"v1","addr":"172.21.15.55:6801","nonce":807572567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":807572567},{"type":"v1","addr":"172.21.15.55:6803","nonce":807572567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":807572567},{"type":"v1","addr":"172.21.15.55:6807","nonce":807572567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":807572567},{"type":"v1","addr":"172.21.15.55:6805","nonce":807572567}]},"public_addr":"172.21.15.55:6801/807572567","cluster_addr":"172.21.15.55:6803/807572567","heartbeat_back_addr":"172.21.15.55:6807/807572567","heartbeat_front_addr":"172.21.15.55:6805/807572567","state":["exists","up"]},{"osd":1,"uuid":"ba2b5b1d-71a9-4ecc-9a48-55aa7fe54261","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":3426897300},{"type":"v1","addr":"172.21.15.55:6825","nonce":3426897300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":3426897300},{"type":"v1","addr":"172.21.15.55:6827","nonce":3426897300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":3426897300},{"type":"v1","addr":"172.21.15.55:6831","nonce":3426897300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":3426897300},{"type":"v1","addr":"172.21.15.55:6829","nonce":3426897300}]},"public_addr":"172.21.15.55:6825/3426897300","cluster_addr":"172.21.15.55:6827/3426897300","heartbeat_back_addr":"172.21.15.55:6831/3426897300","heartbeat_front_addr":"172.21.15.55:6829/3426897300","state":["exists","up"]},{"osd":2,"uuid":"e6b81cc6-4ff1-45d0-87eb-9f04ccf986a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3510271725},{"type":"v1","addr":"172.21.15.55:6809","nonce":3510271725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3510271725},{"type":"v1","addr":"172.21.15.55:6811","nonce":3510271725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3510271725},{"type":"v1","addr":"172.21.15.55:6815","nonce":3510271725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3510271725},{"type":"v1","addr":"172.21.15.55:6813","nonce":3510271725}]},"public_addr":"172.21.15.55:6809/3510271725","cluster_addr":"172.21.15.55:6811/3510271725","heartbeat_back_addr":"172.21.15.55:6815/3510271725","heartbeat_front_addr":"172.21.15.55:6813/3510271725","state":["exists","up"]},{"osd":3,"uuid":"b6a34b75-807d-4693-b1c3-903cb4c618d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":1066693520},{"type":"v1","addr":"172.21.15.55:6817","nonce":1066693520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":1066693520},{"type":"v1","addr":"172.21.15.55:6819","nonce":1066693520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":1066693520},{"type":"v1","addr":"172.21.15.55:6823","nonce":1066693520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":1066693520},{"type":"v1","addr":"172.21.15.55:6821","nonce":1066693520}]},"public_addr":"172.21.15.55:6817/1066693520","cluster_addr":"172.21.15.55:6819/1066693520","heartbeat_back_addr":"172.21.15.55:6823/1066693520","heartbeat_front_addr":"172.21.15.55:6821/1066693520","state":["exists","up"]},{"osd":4,"uuid":"272ec937-56b4-4f0a-b2e1-b0bc189c9d79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":4190771237},{"type":"v1","addr":"172.21.15.72:6820","nonce":4190771237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":4190771237},{"type":"v1","addr":"172.21.15.72:6824","nonce":4190771237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":4190771237},{"type":"v1","addr":"172.21.15.72:6831","nonce":4190771237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":4190771237},{"type":"v1","addr":"172.21.15.72:6828","nonce":4190771237}]},"public_addr":"172.21.15.72:6820/4190771237","cluster_addr":"172.21.15.72:6824/4190771237","heartbeat_back_addr":"172.21.15.72:6831/4190771237","heartbeat_front_addr":"172.21.15.72:6828/4190771237","state":["exists","up"]},{"osd":5,"uuid":"56439854-72a0-4ef4-81ff-184a3d924a5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":2421889184},{"type":"v1","addr":"172.21.15.72:6801","nonce":2421889184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6803","nonce":2421889184},{"type":"v1","addr":"172.21.15.72:6805","nonce":2421889184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":2421889184},{"type":"v1","addr":"172.21.15.72:6813","nonce":2421889184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6807","nonce":2421889184},{"type":"v1","addr":"172.21.15.72:6809","nonce":2421889184}]},"public_addr":"172.21.15.72:6801/2421889184","cluster_addr":"172.21.15.72:6805/2421889184","heartbeat_back_addr":"172.21.15.72:6813/2421889184","heartbeat_front_addr":"172.21.15.72:6809/2421889184","state":["exists","up"]},{"osd":6,"uuid":"e248e2be-3b6e-49cf-8c8a-1a4152827582","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3796994599},{"type":"v1","addr":"172.21.15.72:6804","nonce":3796994599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":3796994599},{"type":"v1","addr":"172.21.15.72:6808","nonce":3796994599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":3796994599},{"type":"v1","addr":"172.21.15.72:6815","nonce":3796994599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":3796994599},{"type":"v1","addr":"172.21.15.72:6812","nonce":3796994599}]},"public_addr":"172.21.15.72:6804/3796994599","cluster_addr":"172.21.15.72:6808/3796994599","heartbeat_back_addr":"172.21.15.72:6815/3796994599","heartbeat_front_addr":"172.21.15.72:6812/3796994599","state":["exists","up"]},{"osd":7,"uuid":"505a62d3-322b-4629-b4fd-187a55563709","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":3024877895},{"type":"v1","addr":"172.21.15.72:6817","nonce":3024877895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":3024877895},{"type":"v1","addr":"172.21.15.72:6821","nonce":3024877895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6827","nonce":3024877895},{"type":"v1","addr":"172.21.15.72:6829","nonce":3024877895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6823","nonce":3024877895},{"type":"v1","addr":"172.21.15.72:6825","nonce":3024877895}]},"public_addr":"172.21.15.72:6817/3024877895","cluster_addr":"172.21.15.72:6821/3024877895","heartbeat_back_addr":"172.21.15.72:6829/3024877895","heartbeat_front_addr":"172.21.15.72:6825/3024877895","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.241014+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.450799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.465018+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.507647+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.534763+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.495895+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.427110+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.547466+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-27T12:33:36.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.640+0000 7fa02bdcd640 1 -- 172.21.15.55:0/2983226508 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fa00806c8f0 msgr2=0x7fa00806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:36.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.640+0000 7fa02bdcd640 1 --2- 172.21.15.55:0/2983226508 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fa00806c8f0 0x7fa00806edb0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa020034000 tx=0x7fa02002e000 comp rx=0 tx=0).stop 2024-05-27T12:33:36.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.640+0000 7fa02bdcd640 1 -- 172.21.15.55:0/2983226508 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa024070b50 msgr2=0x7fa02409d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:36.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.640+0000 7fa02bdcd640 1 --2- 172.21.15.55:0/2983226508 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa024070b50 0x7fa02409d850 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fa01400c820 tx=0x7fa01400cc20 comp rx=0 tx=0).stop 2024-05-27T12:33:36.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.640+0000 7fa02bdcd640 1 -- 172.21.15.55:0/2983226508 shutdown_connections 2024-05-27T12:33:36.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.640+0000 7fa02bdcd640 1 --2- 172.21.15.55:0/2983226508 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fa00806c8f0 0x7fa00806edb0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:36.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.640+0000 7fa02bdcd640 1 --2- 172.21.15.55:0/2983226508 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa0241609b0 0x7fa02409dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:36.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.640+0000 7fa02bdcd640 1 --2- 172.21.15.55:0/2983226508 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa024070b50 0x7fa02409d850 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:36.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.640+0000 7fa02bdcd640 1 --2- 172.21.15.55:0/2983226508 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa02406c940 0x7fa02414e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:36.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.640+0000 7fa02bdcd640 1 -- 172.21.15.55:0/2983226508 >> 172.21.15.55:0/2983226508 conn(0x7fa0240727b0 msgr2=0x7fa02415e370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:36.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.640+0000 7fa02bdcd640 1 -- 172.21.15.55:0/2983226508 shutdown_connections 2024-05-27T12:33:36.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.640+0000 7fa02bdcd640 1 -- 172.21.15.55:0/2983226508 wait complete. 2024-05-27T12:33:36.651 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-27T12:33:36.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.755+0000 7f6b70d15640 1 Processor -- start 2024-05-27T12:33:36.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.755+0000 7f6b70d15640 1 -- start start 2024-05-27T12:33:36.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.756+0000 7f6b70d15640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6b6c15ec00 0x7f6b6c0b3db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:36.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.756+0000 7f6b70d15640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b6c1632f0 con 0x7f6b6c0b3860 2024-05-27T12:33:36.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.756+0000 7f6b70d15640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b6c1635d0 con 0x7f6b6c0b6370 2024-05-27T12:33:36.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.756+0000 7f6b70d15640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f6b6c0cf2e0 con 0x7f6b6c15ec00 2024-05-27T12:33:36.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.757+0000 7f6b69d9b640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f6b6c0b3860 0x7f6b6c0cfd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:32870/0 (socket says 172.21.15.55:32870) 2024-05-27T12:33:36.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.757+0000 7f6b69d9b640 1 -- 172.21.15.55:0/229569417 learned_addr learned my addr 172.21.15.55:0/229569417 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-27T12:33:36.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.757+0000 7f6b6a59c640 1 --2- 172.21.15.55:0/229569417 >> v2:172.21.15.72:3300/0 conn(0x7f6b6c15ec00 0x7f6b6c0b3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:36.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.757+0000 7f6b6959a640 1 -- 172.21.15.55:0/229569417 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2882838414 0 0) 0x7f6b6c1632f0 con 0x7f6b6c0b3860 2024-05-27T12:33:36.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.757+0000 7f6b6959a640 1 -- 172.21.15.55:0/229569417 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6b58003520 con 0x7f6b6c0b3860 2024-05-27T12:33:36.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.757+0000 7f6b6959a640 1 -- 172.21.15.55:0/229569417 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3296234508 0 0) 0x7f6b58003520 con 0x7f6b6c0b3860 2024-05-27T12:33:36.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.757+0000 7f6b6959a640 1 -- 172.21.15.55:0/229569417 >> v2:172.21.15.72:3300/0 conn(0x7f6b6c15ec00 msgr2=0x7f6b6c0b3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:36.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.757+0000 7f6b6959a640 1 --2- 172.21.15.55:0/229569417 >> v2:172.21.15.72:3300/0 conn(0x7f6b6c15ec00 0x7f6b6c0b3db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:36.759 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.757+0000 7f6b6959a640 1 -- 172.21.15.55:0/229569417 >> v1:172.21.15.72:6789/0 conn(0x7f6b6c0b6370 legacy=0x7f6b6c0d2980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:36.759 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.757+0000 7f6b6959a640 1 -- 172.21.15.55:0/229569417 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b6c0cf530 con 0x7f6b6c0b3860 2024-05-27T12:33:36.759 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.757+0000 7f6b6959a640 1 -- 172.21.15.55:0/229569417 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 793017739 0 0) 0x7f6b54001670 con 0x7f6b6c0b3860 2024-05-27T12:33:36.759 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.757+0000 7f6b6959a640 1 -- 172.21.15.55:0/229569417 >> v1:172.21.15.55:6789/0 conn(0x7f6b6c0b3860 legacy=0x7f6b6c0cfd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:36.759 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.757+0000 7f6b6959a640 1 --2- 172.21.15.55:0/229569417 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b58003a90 0x7f6b58003eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:36.759 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.757+0000 7f6b6959a640 1 --2- 172.21.15.55:0/229569417 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6b58004800 0x7f6b58004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:36.759 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.757+0000 7f6b6959a640 1 --2- 172.21.15.55:0/229569417 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6b58005210 0x7f6b5800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:36.759 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.757+0000 7f6b6959a640 1 -- 172.21.15.55:0/229569417 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f6b6c0cf2e0 con 0x7f6b58003a90 2024-05-27T12:33:36.759 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.757+0000 7f6b6959a640 1 -- 172.21.15.55:0/229569417 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f6b5800c140 con 0x7f6b58004800 2024-05-27T12:33:36.759 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.757+0000 7f6b6959a640 1 -- 172.21.15.55:0/229569417 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f6b5800c340 con 0x7f6b58005210 2024-05-27T12:33:36.759 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.757+0000 7f6b6a59c640 1 --2- 172.21.15.55:0/229569417 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b58003a90 0x7f6b58003eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:36.759 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.757+0000 7f6b69d9b640 1 --2- 172.21.15.55:0/229569417 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6b58004800 0x7f6b58004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:36.759 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.757+0000 7f6b6ad9d640 1 --2- 172.21.15.55:0/229569417 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6b58005210 0x7f6b5800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:36.759 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.758+0000 7f6b6a59c640 1 -- 172.21.15.55:0/229569417 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6b58005210 msgr2=0x7f6b5800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:36.760 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.758+0000 7f6b6a59c640 1 --2- 172.21.15.55:0/229569417 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6b58005210 0x7f6b5800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:36.760 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.758+0000 7f6b6a59c640 1 -- 172.21.15.55:0/229569417 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6b58004800 msgr2=0x7f6b58004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:36.760 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.758+0000 7f6b6a59c640 1 --2- 172.21.15.55:0/229569417 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6b58004800 0x7f6b58004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:36.760 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.758+0000 7f6b6a59c640 1 -- 172.21.15.55:0/229569417 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b58003520 con 0x7f6b58003a90 2024-05-27T12:33:36.760 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.758+0000 7f6b6ad9d640 1 -- 172.21.15.55:0/229569417 reap_dead start 2024-05-27T12:33:36.760 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.758+0000 7f6b6a59c640 1 --2- 172.21.15.55:0/229569417 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b58003a90 0x7f6b58003eb0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f6b64009f90 tx=0x7f6b58005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7894341c318369ab server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:36.760 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.758+0000 7f6b6959a640 1 -- 172.21.15.55:0/229569417 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b64009c10 con 0x7f6b58003a90 2024-05-27T12:33:36.760 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.758+0000 7f6b6959a640 1 -- 172.21.15.55:0/229569417 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b64036070 con 0x7f6b58003a90 2024-05-27T12:33:36.760 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.758+0000 7f6b6959a640 1 -- 172.21.15.55:0/229569417 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b64031850 con 0x7f6b58003a90 2024-05-27T12:33:36.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.759+0000 7f6b70d15640 1 -- 172.21.15.55:0/229569417 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b58003a90 msgr2=0x7f6b58003eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:36.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.759+0000 7f6b70d15640 1 --2- 172.21.15.55:0/229569417 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b58003a90 0x7f6b58003eb0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f6b64009f90 tx=0x7f6b58005830 comp rx=0 tx=0).stop 2024-05-27T12:33:36.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.759+0000 7f6b70d15640 1 -- 172.21.15.55:0/229569417 shutdown_connections 2024-05-27T12:33:36.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.759+0000 7f6b70d15640 1 --2- 172.21.15.55:0/229569417 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b58003a90 0x7f6b58003eb0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:36.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.759+0000 7f6b70d15640 1 -- 172.21.15.55:0/229569417 >> 172.21.15.55:0/229569417 conn(0x7f6b6c0d1370 msgr2=0x7f6b6c0d1780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:36.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.759+0000 7f6b70d15640 1 -- 172.21.15.55:0/229569417 shutdown_connections 2024-05-27T12:33:36.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.759+0000 7f6b70d15640 1 -- 172.21.15.55:0/229569417 wait complete. 2024-05-27T12:33:36.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.760+0000 7f6b70d15640 1 Processor -- start 2024-05-27T12:33:36.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.761+0000 7f6b70d15640 1 -- start start 2024-05-27T12:33:36.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.761+0000 7f6b70d15640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6b58003a90 0x7f6b6c1613a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:36.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.761+0000 7f6b70d15640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6b6c0cd820 0x7f6b6c1f6450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:36.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.761+0000 7f6b70d15640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b6c0b9380 0x7f6b6c0b9800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:36.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.761+0000 7f6b70d15640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f6b6c15efe0 con 0x7f6b6c0b9380 2024-05-27T12:33:36.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.761+0000 7f6b70d15640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f6b6c0b3530 con 0x7f6b6c0cd820 2024-05-27T12:33:36.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.761+0000 7f6b70d15640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f6b6c15f160 con 0x7f6b58003a90 2024-05-27T12:33:36.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.761+0000 7f6b6ad9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b6c0b9380 0x7f6b6c0b9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:36.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.761+0000 7f6b6ad9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b6c0b9380 0x7f6b6c0b9800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51096/0 (socket says 172.21.15.55:51096) 2024-05-27T12:33:36.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.761+0000 7f6b6ad9d640 1 -- 172.21.15.55:0/3741684706 learned_addr learned my addr 172.21.15.55:0/3741684706 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:33:36.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.762+0000 7f6b69d9b640 1 --2- 172.21.15.55:0/3741684706 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6b6c0cd820 0x7f6b6c1f6450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:36.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.762+0000 7f6b6a59c640 1 --2- 172.21.15.55:0/3741684706 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6b58003a90 0x7f6b6c1613a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:36.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.762+0000 7f6b6ad9d640 1 -- 172.21.15.55:0/3741684706 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6b58003a90 msgr2=0x7f6b6c1613a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:36.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.762+0000 7f6b6ad9d640 1 --2- 172.21.15.55:0/3741684706 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6b58003a90 0x7f6b6c1613a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:36.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.762+0000 7f6b6ad9d640 1 -- 172.21.15.55:0/3741684706 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6b6c0cd820 msgr2=0x7f6b6c1f6450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:36.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.762+0000 7f6b6ad9d640 1 --2- 172.21.15.55:0/3741684706 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6b6c0cd820 0x7f6b6c1f6450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:36.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.762+0000 7f6b6ad9d640 1 -- 172.21.15.55:0/3741684706 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b6c0cbe30 con 0x7f6b6c0b9380 2024-05-27T12:33:36.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.762+0000 7f6b69d9b640 1 --2- 172.21.15.55:0/3741684706 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6b6c0cd820 0x7f6b6c1f6450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T12:33:36.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.762+0000 7f6b6ad9d640 1 --2- 172.21.15.55:0/3741684706 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b6c0b9380 0x7f6b6c0b9800 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f6b6c0baa60 tx=0x7f6b5c00f8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:36.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.762+0000 7f6b62ffd640 1 -- 172.21.15.55:0/3741684706 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b5c0052e0 con 0x7f6b6c0b9380 2024-05-27T12:33:36.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.762+0000 7f6b62ffd640 1 -- 172.21.15.55:0/3741684706 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b5c018070 con 0x7f6b6c0b9380 2024-05-27T12:33:36.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.762+0000 7f6b70d15640 1 -- 172.21.15.55:0/3741684706 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b6c0cc110 con 0x7f6b6c0b9380 2024-05-27T12:33:36.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.762+0000 7f6b62ffd640 1 -- 172.21.15.55:0/3741684706 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b5c003830 con 0x7f6b6c0b9380 2024-05-27T12:33:36.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.762+0000 7f6b70d15640 1 -- 172.21.15.55:0/3741684706 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b6c0cc6d0 con 0x7f6b6c0b9380 2024-05-27T12:33:36.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.763+0000 7f6b70d15640 1 -- 172.21.15.55:0/3741684706 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b6c0d3b00 con 0x7f6b6c0b9380 2024-05-27T12:33:36.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.764+0000 7f6b62ffd640 1 -- 172.21.15.55:0/3741684706 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6b5c0039d0 con 0x7f6b6c0b9380 2024-05-27T12:33:36.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.764+0000 7f6b62ffd640 1 --2- 172.21.15.55:0/3741684706 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f6b4c06c8f0 0x7f6b4c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:36.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.764+0000 7f6b62ffd640 1 -- 172.21.15.55:0/3741684706 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f6b5c08b5d0 con 0x7f6b6c0b9380 2024-05-27T12:33:36.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.765+0000 7f6b6a59c640 1 --2- 172.21.15.55:0/3741684706 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f6b4c06c8f0 0x7f6b4c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:36.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.765+0000 7f6b6a59c640 1 --2- 172.21.15.55:0/3741684706 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f6b4c06c8f0 0x7f6b4c06edb0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6b64035000 tx=0x7f6b6402f000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:36.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.769+0000 7f6b62ffd640 1 -- 172.21.15.55:0/3741684706 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6b6c0d3b00 con 0x7f6b6c0b9380 2024-05-27T12:33:36.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.962+0000 7f6b70d15640 1 -- 172.21.15.55:0/3741684706 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6b6c06db20 con 0x7f6b6c0b9380 2024-05-27T12:33:36.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.963+0000 7f6b62ffd640 1 -- 172.21.15.55:0/3741684706 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) ==== 74+0+16634 (secure 0 0 0) 0x7f6b6c06db20 con 0x7f6b6c0b9380 2024-05-27T12:33:36.963 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-27T12:33:36.963 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":35,"fsid":"c3ff4e3b-8dae-4856-9593-e5cc66c59982","created":"2024-05-27T12:32:17.019097+0000","modified":"2024-05-27T12:33:35.670342+0000","last_up_change":"2024-05-27T12:32:28.109744+0000","last_in_change":"2024-05-27T12:32:19.309872+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-27T12:32:29.277895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-05-27T12:33:34.122092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-05-27T12:33:34.617553+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e607b598-061b-4b6f-92ff-95c20b330599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":807572567},{"type":"v1","addr":"172.21.15.55:6801","nonce":807572567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":807572567},{"type":"v1","addr":"172.21.15.55:6803","nonce":807572567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":807572567},{"type":"v1","addr":"172.21.15.55:6807","nonce":807572567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":807572567},{"type":"v1","addr":"172.21.15.55:6805","nonce":807572567}]},"public_addr":"172.21.15.55:6801/807572567","cluster_addr":"172.21.15.55:6803/807572567","heartbeat_back_addr":"172.21.15.55:6807/807572567","heartbeat_front_addr":"172.21.15.55:6805/807572567","state":["exists","up"]},{"osd":1,"uuid":"ba2b5b1d-71a9-4ecc-9a48-55aa7fe54261","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":3426897300},{"type":"v1","addr":"172.21.15.55:6825","nonce":3426897300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":3426897300},{"type":"v1","addr":"172.21.15.55:6827","nonce":3426897300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":3426897300},{"type":"v1","addr":"172.21.15.55:6831","nonce":3426897300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":3426897300},{"type":"v1","addr":"172.21.15.55:6829","nonce":3426897300}]},"public_addr":"172.21.15.55:6825/3426897300","cluster_addr":"172.21.15.55:6827/3426897300","heartbeat_back_addr":"172.21.15.55:6831/3426897300","heartbeat_front_addr":"172.21.15.55:6829/3426897300","state":["exists","up"]},{"osd":2,"uuid":"e6b81cc6-4ff1-45d0-87eb-9f04ccf986a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3510271725},{"type":"v1","addr":"172.21.15.55:6809","nonce":3510271725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3510271725},{"type":"v1","addr":"172.21.15.55:6811","nonce":3510271725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3510271725},{"type":"v1","addr":"172.21.15.55:6815","nonce":3510271725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3510271725},{"type":"v1","addr":"172.21.15.55:6813","nonce":3510271725}]},"public_addr":"172.21.15.55:6809/3510271725","cluster_addr":"172.21.15.55:6811/3510271725","heartbeat_back_addr":"172.21.15.55:6815/3510271725","heartbeat_front_addr":"172.21.15.55:6813/3510271725","state":["exists","up"]},{"osd":3,"uuid":"b6a34b75-807d-4693-b1c3-903cb4c618d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":1066693520},{"type":"v1","addr":"172.21.15.55:6817","nonce":1066693520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":1066693520},{"type":"v1","addr":"172.21.15.55:6819","nonce":1066693520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":1066693520},{"type":"v1","addr":"172.21.15.55:6823","nonce":1066693520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":1066693520},{"type":"v1","addr":"172.21.15.55:6821","nonce":1066693520}]},"public_addr":"172.21.15.55:6817/1066693520","cluster_addr":"172.21.15.55:6819/1066693520","heartbeat_back_addr":"172.21.15.55:6823/1066693520","heartbeat_front_addr":"172.21.15.55:6821/1066693520","state":["exists","up"]},{"osd":4,"uuid":"272ec937-56b4-4f0a-b2e1-b0bc189c9d79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":4190771237},{"type":"v1","addr":"172.21.15.72:6820","nonce":4190771237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":4190771237},{"type":"v1","addr":"172.21.15.72:6824","nonce":4190771237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":4190771237},{"type":"v1","addr":"172.21.15.72:6831","nonce":4190771237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":4190771237},{"type":"v1","addr":"172.21.15.72:6828","nonce":4190771237}]},"public_addr":"172.21.15.72:6820/4190771237","cluster_addr":"172.21.15.72:6824/4190771237","heartbeat_back_addr":"172.21.15.72:6831/4190771237","heartbeat_front_addr":"172.21.15.72:6828/4190771237","state":["exists","up"]},{"osd":5,"uuid":"56439854-72a0-4ef4-81ff-184a3d924a5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":2421889184},{"type":"v1","addr":"172.21.15.72:6801","nonce":2421889184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6803","nonce":2421889184},{"type":"v1","addr":"172.21.15.72:6805","nonce":2421889184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":2421889184},{"type":"v1","addr":"172.21.15.72:6813","nonce":2421889184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6807","nonce":2421889184},{"type":"v1","addr":"172.21.15.72:6809","nonce":2421889184}]},"public_addr":"172.21.15.72:6801/2421889184","cluster_addr":"172.21.15.72:6805/2421889184","heartbeat_back_addr":"172.21.15.72:6813/2421889184","heartbeat_front_addr":"172.21.15.72:6809/2421889184","state":["exists","up"]},{"osd":6,"uuid":"e248e2be-3b6e-49cf-8c8a-1a4152827582","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3796994599},{"type":"v1","addr":"172.21.15.72:6804","nonce":3796994599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":3796994599},{"type":"v1","addr":"172.21.15.72:6808","nonce":3796994599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":3796994599},{"type":"v1","addr":"172.21.15.72:6815","nonce":3796994599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":3796994599},{"type":"v1","addr":"172.21.15.72:6812","nonce":3796994599}]},"public_addr":"172.21.15.72:6804/3796994599","cluster_addr":"172.21.15.72:6808/3796994599","heartbeat_back_addr":"172.21.15.72:6815/3796994599","heartbeat_front_addr":"172.21.15.72:6812/3796994599","state":["exists","up"]},{"osd":7,"uuid":"505a62d3-322b-4629-b4fd-187a55563709","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":3024877895},{"type":"v1","addr":"172.21.15.72:6817","nonce":3024877895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":3024877895},{"type":"v1","addr":"172.21.15.72:6821","nonce":3024877895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6827","nonce":3024877895},{"type":"v1","addr":"172.21.15.72:6829","nonce":3024877895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6823","nonce":3024877895},{"type":"v1","addr":"172.21.15.72:6825","nonce":3024877895}]},"public_addr":"172.21.15.72:6817/3024877895","cluster_addr":"172.21.15.72:6821/3024877895","heartbeat_back_addr":"172.21.15.72:6829/3024877895","heartbeat_front_addr":"172.21.15.72:6825/3024877895","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.241014+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.450799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.465018+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.507647+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.534763+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.495895+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.427110+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.547466+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-27T12:33:36.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.966+0000 7f6b70d15640 1 -- 172.21.15.55:0/3741684706 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f6b4c06c8f0 msgr2=0x7f6b4c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:36.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.966+0000 7f6b70d15640 1 --2- 172.21.15.55:0/3741684706 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f6b4c06c8f0 0x7f6b4c06edb0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6b64035000 tx=0x7f6b6402f000 comp rx=0 tx=0).stop 2024-05-27T12:33:36.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.966+0000 7f6b70d15640 1 -- 172.21.15.55:0/3741684706 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b6c0b9380 msgr2=0x7f6b6c0b9800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:36.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.966+0000 7f6b70d15640 1 --2- 172.21.15.55:0/3741684706 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b6c0b9380 0x7f6b6c0b9800 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f6b6c0baa60 tx=0x7f6b5c00f8a0 comp rx=0 tx=0).stop 2024-05-27T12:33:36.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.966+0000 7f6b70d15640 1 -- 172.21.15.55:0/3741684706 shutdown_connections 2024-05-27T12:33:36.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.966+0000 7f6b70d15640 1 --2- 172.21.15.55:0/3741684706 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b6c0b9380 0x7f6b6c0b9800 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:36.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.966+0000 7f6b70d15640 1 --2- 172.21.15.55:0/3741684706 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f6b4c06c8f0 0x7f6b4c06edb0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:36.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.966+0000 7f6b70d15640 1 --2- 172.21.15.55:0/3741684706 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6b6c0cd820 0x7f6b6c1f6450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:36.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.966+0000 7f6b70d15640 1 --2- 172.21.15.55:0/3741684706 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6b58003a90 0x7f6b6c1613a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:36.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.966+0000 7f6b70d15640 1 -- 172.21.15.55:0/3741684706 >> 172.21.15.55:0/3741684706 conn(0x7f6b6c0d1370 msgr2=0x7f6b6c1627d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:36.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.966+0000 7f6b70d15640 1 -- 172.21.15.55:0/3741684706 shutdown_connections 2024-05-27T12:33:36.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:36.966+0000 7f6b70d15640 1 -- 172.21.15.55:0/3741684706 wait complete. 2024-05-27T12:33:36.976 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-05-27T12:33:37.082 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:37.083+0000 7f8a50d07640 1 Processor -- start 2024-05-27T12:33:37.083 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:37.083+0000 7f8a50d07640 1 -- start start 2024-05-27T12:33:37.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:37.084+0000 7f8a50d07640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8a4c0cfb40 0x7f8a4c0d1830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:37.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:37.084+0000 7f8a50d07640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8a4c0d1d70 0x7f8a4c0b78f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:37.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:37.084+0000 7f8a50d07640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a4c15eee0 con 0x7f8a4c15eb00 2024-05-27T12:33:37.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:37.084+0000 7f8a50d07640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f8a4c0d5700 con 0x7f8a4c0d1d70 2024-05-27T12:33:37.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:37.084+0000 7f8a50d07640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f8a4c0d21a0 con 0x7f8a4c0cfb40 2024-05-27T12:33:37.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:37.084+0000 7f8a4ad9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8a4c0d1d70 0x7f8a4c0b78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:37.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:37.084+0000 7f8a4ad9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8a4c0d1d70 0x7f8a4c0b78f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51108/0 (socket says 172.21.15.55:51108) 2024-05-27T12:33:37.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:37.084+0000 7f8a4ad9d640 1 -- 172.21.15.55:0/2314695369 learned_addr learned my addr 172.21.15.55:0/2314695369 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:33:37.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:37.085+0000 7f8a49d9b640 1 --2- 172.21.15.55:0/2314695369 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8a4c0cfb40 0x7f8a4c0d1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:37.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:37.085+0000 7f8a4ad9d640 1 -- 172.21.15.55:0/2314695369 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8a4c0cfb40 msgr2=0x7f8a4c0d1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:37.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:37.085+0000 7f8a4ad9d640 1 --2- 172.21.15.55:0/2314695369 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8a4c0cfb40 0x7f8a4c0d1830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:37.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:37.085+0000 7f8a4ad9d640 1 -- 172.21.15.55:0/2314695369 >> v1:172.21.15.72:6789/0 conn(0x7f8a4c15eb00 legacy=0x7f8a4c0d3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:37.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:37.085+0000 7f8a4ad9d640 1 -- 172.21.15.55:0/2314695369 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a4c0d4660 con 0x7f8a4c0d1d70 2024-05-27T12:33:37.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:37.085+0000 7f8a4ad9d640 1 --2- 172.21.15.55:0/2314695369 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a4c0d1d70 0x7f8a4c0b78f0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f8a44009e80 tx=0x7f8a4402a7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abb5a37095268d57 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:37.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:37.086+0000 7f8a4959a640 1 -- 172.21.15.55:0/2314695369 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a44036070 con 0x7f8a4c0d1d70 2024-05-27T12:33:37.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:37.086+0000 7f8a4959a640 1 -- 172.21.15.55:0/2314695369 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a44031600 con 0x7f8a4c0d1d70 2024-05-27T12:33:37.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:37.086+0000 7f8a4959a640 1 -- 172.21.15.55:0/2314695369 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a440319d0 con 0x7f8a4c0d1d70 2024-05-27T12:33:37.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:37.086+0000 7f8a50d07640 1 -- 172.21.15.55:0/2314695369 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a4c0d1d70 msgr2=0x7f8a4c0b78f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:37.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:37.086+0000 7f8a50d07640 1 --2- 172.21.15.55:0/2314695369 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a4c0d1d70 0x7f8a4c0b78f0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f8a44009e80 tx=0x7f8a4402a7e0 comp rx=0 tx=0).stop 2024-05-27T12:33:37.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:37.086+0000 7f8a50d07640 1 -- 172.21.15.55:0/2314695369 shutdown_connections 2024-05-27T12:33:37.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:37.086+0000 7f8a50d07640 1 --2- 172.21.15.55:0/2314695369 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a4c0d1d70 0x7f8a4c0b78f0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:37.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:37.086+0000 7f8a50d07640 1 --2- 172.21.15.55:0/2314695369 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8a4c0cfb40 0x7f8a4c0d1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:37.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:37.086+0000 7f8a50d07640 1 -- 172.21.15.55:0/2314695369 >> 172.21.15.55:0/2314695369 conn(0x7f8a4c067a50 msgr2=0x7f8a4c067e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:37.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:37.086+0000 7f8a50d07640 1 -- 172.21.15.55:0/2314695369 shutdown_connections 2024-05-27T12:33:37.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:37.086+0000 7f8a50d07640 1 -- 172.21.15.55:0/2314695369 wait complete. 2024-05-27T12:33:37.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:37.088+0000 7f8a50d07640 1 Processor -- start 2024-05-27T12:33:37.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:37.088+0000 7f8a50d07640 1 -- start start 2024-05-27T12:33:37.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:37.088+0000 7f8a50d07640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a4c0cfb40 0x7f8a4c0cdee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:37.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:37.088+0000 7f8a50d07640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8a4c0d1d70 0x7f8a4c14a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:37.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:37.088+0000 7f8a50d07640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a4c15eb00 0x7f8a4c0ca840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:37.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:37.088+0000 7f8a50d07640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f8a4c0d4f00 con 0x7f8a4c15eb00 2024-05-27T12:33:37.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:37.088+0000 7f8a50d07640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f8a4c0d4c20 con 0x7f8a4c0cfb40 2024-05-27T12:33:37.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:37.088+0000 7f8a50d07640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f8a4c0d51e0 con 0x7f8a4c0d1d70 2024-05-27T12:33:37.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:37.089+0000 7f8a4ad9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a4c15eb00 0x7f8a4c0ca840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:37.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:37.089+0000 7f8a4ad9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a4c15eb00 0x7f8a4c0ca840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51118/0 (socket says 172.21.15.55:51118) 2024-05-27T12:33:37.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:37.089+0000 7f8a4ad9d640 1 -- 172.21.15.55:0/3742025676 learned_addr learned my addr 172.21.15.55:0/3742025676 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:33:37.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:37.089+0000 7f8a4a59c640 1 --2- 172.21.15.55:0/3742025676 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a4c0cfb40 0x7f8a4c0cdee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:37.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:37.089+0000 7f8a49d9b640 1 --2- 172.21.15.55:0/3742025676 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8a4c0d1d70 0x7f8a4c14a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:37.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:37.089+0000 7f8a4ad9d640 1 -- 172.21.15.55:0/3742025676 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8a4c0d1d70 msgr2=0x7f8a4c14a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:37.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:37.089+0000 7f8a4ad9d640 1 --2- 172.21.15.55:0/3742025676 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8a4c0d1d70 0x7f8a4c14a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:37.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:37.089+0000 7f8a4ad9d640 1 -- 172.21.15.55:0/3742025676 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a4c0cfb40 msgr2=0x7f8a4c0cdee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:37.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:37.089+0000 7f8a4ad9d640 1 --2- 172.21.15.55:0/3742025676 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a4c0cfb40 0x7f8a4c0cdee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:37.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:37.089+0000 7f8a4ad9d640 1 -- 172.21.15.55:0/3742025676 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a4c160260 con 0x7f8a4c15eb00 2024-05-27T12:33:37.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:37.089+0000 7f8a49d9b640 1 --2- 172.21.15.55:0/3742025676 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8a4c0d1d70 0x7f8a4c14a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T12:33:37.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:37.089+0000 7f8a4ad9d640 1 --2- 172.21.15.55:0/3742025676 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a4c15eb00 0x7f8a4c0ca840 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f8a4402ad50 tx=0x7f8a44004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:37.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:37.089+0000 7f8a42ffd640 1 -- 172.21.15.55:0/3742025676 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a44036050 con 0x7f8a4c15eb00 2024-05-27T12:33:37.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:37.089+0000 7f8a42ffd640 1 -- 172.21.15.55:0/3742025676 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a44042070 con 0x7f8a4c15eb00 2024-05-27T12:33:37.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:37.089+0000 7f8a50d07640 1 -- 172.21.15.55:0/3742025676 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a4c160520 con 0x7f8a4c15eb00 2024-05-27T12:33:37.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:37.089+0000 7f8a42ffd640 1 -- 172.21.15.55:0/3742025676 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a44009510 con 0x7f8a4c15eb00 2024-05-27T12:33:37.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:37.089+0000 7f8a50d07640 1 -- 172.21.15.55:0/3742025676 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a4c0c9cf0 con 0x7f8a4c15eb00 2024-05-27T12:33:37.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:37.090+0000 7f8a50d07640 1 -- 172.21.15.55:0/3742025676 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a4c0ce420 con 0x7f8a4c15eb00 2024-05-27T12:33:37.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:37.091+0000 7f8a42ffd640 1 -- 172.21.15.55:0/3742025676 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8a44007b70 con 0x7f8a4c15eb00 2024-05-27T12:33:37.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:37.091+0000 7f8a42ffd640 1 --2- 172.21.15.55:0/3742025676 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f8a2c06c8f0 0x7f8a2c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:37.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:37.091+0000 7f8a42ffd640 1 -- 172.21.15.55:0/3742025676 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f8a440ac9b0 con 0x7f8a4c15eb00 2024-05-27T12:33:37.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:37.092+0000 7f8a4a59c640 1 --2- 172.21.15.55:0/3742025676 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f8a2c06c8f0 0x7f8a2c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:37.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:37.092+0000 7f8a4a59c640 1 --2- 172.21.15.55:0/3742025676 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f8a2c06c8f0 0x7f8a2c06edb0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f8a3c007fd0 tx=0x7f8a3c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:37.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:37.096+0000 7f8a42ffd640 1 -- 172.21.15.55:0/3742025676 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8a44045360 con 0x7f8a4c15eb00 2024-05-27T12:33:37.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:37.323+0000 7f8a50d07640 1 -- 172.21.15.55:0/3742025676 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f8a4c0cad80 con 0x7f8a4c15eb00 2024-05-27T12:33:37.805 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T12:33:37.808 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T12:33:38.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:38.321+0000 7f8a42ffd640 1 -- 172.21.15.55:0/3742025676 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v13) ==== 118+0+0 (secure 0 0 0) 0x7f8a4407ae70 con 0x7f8a4c15eb00 2024-05-27T12:33:38.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:38.324+0000 7f8a50d07640 1 -- 172.21.15.55:0/3742025676 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f8a2c06c8f0 msgr2=0x7f8a2c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:38.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:38.324+0000 7f8a50d07640 1 --2- 172.21.15.55:0/3742025676 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f8a2c06c8f0 0x7f8a2c06edb0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f8a3c007fd0 tx=0x7f8a3c009040 comp rx=0 tx=0).stop 2024-05-27T12:33:38.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:38.324+0000 7f8a50d07640 1 -- 172.21.15.55:0/3742025676 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a4c15eb00 msgr2=0x7f8a4c0ca840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:38.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:38.324+0000 7f8a50d07640 1 --2- 172.21.15.55:0/3742025676 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a4c15eb00 0x7f8a4c0ca840 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f8a4402ad50 tx=0x7f8a44004a40 comp rx=0 tx=0).stop 2024-05-27T12:33:38.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:38.324+0000 7f8a50d07640 1 -- 172.21.15.55:0/3742025676 shutdown_connections 2024-05-27T12:33:38.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:38.324+0000 7f8a50d07640 1 --2- 172.21.15.55:0/3742025676 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a4c15eb00 0x7f8a4c0ca840 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:38.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:38.324+0000 7f8a50d07640 1 --2- 172.21.15.55:0/3742025676 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8a4c0d1d70 0x7f8a4c14a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:38.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:38.324+0000 7f8a50d07640 1 --2- 172.21.15.55:0/3742025676 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f8a2c06c8f0 0x7f8a2c06edb0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:38.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:38.324+0000 7f8a50d07640 1 --2- 172.21.15.55:0/3742025676 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a4c0cfb40 0x7f8a4c0cdee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:38.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:38.324+0000 7f8a50d07640 1 -- 172.21.15.55:0/3742025676 >> 172.21.15.55:0/3742025676 conn(0x7f8a4c067a50 msgr2=0x7f8a4c0d2910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:38.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:38.324+0000 7f8a50d07640 1 -- 172.21.15.55:0/3742025676 shutdown_connections 2024-05-27T12:33:38.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:38.324+0000 7f8a50d07640 1 -- 172.21.15.55:0/3742025676 wait complete. 2024-05-27T12:33:38.338 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-05-27T12:33:38.338 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-05-27T12:33:38.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:38.452+0000 7f7ab92e8640 1 Processor -- start 2024-05-27T12:33:38.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:38.452+0000 7f7ab92e8640 1 -- start start 2024-05-27T12:33:38.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:38.453+0000 7f7ab92e8640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7ab4070240 0x7f7ab4160d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:38.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:38.453+0000 7f7ab92e8640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7ab40add70 0x7f7ab40ae200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:38.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:38.453+0000 7f7ab92e8640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ab40b0320 con 0x7f7ab415a4d0 2024-05-27T12:33:38.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:38.453+0000 7f7ab92e8640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f7ab406d2c0 con 0x7f7ab40add70 2024-05-27T12:33:38.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:38.453+0000 7f7ab92e8640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f7ab415d2b0 con 0x7f7ab4070240 2024-05-27T12:33:38.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:38.453+0000 7f7ab37fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7ab40add70 0x7f7ab40ae200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:38.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:38.453+0000 7f7ab37fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7ab40add70 0x7f7ab40ae200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51130/0 (socket says 172.21.15.55:51130) 2024-05-27T12:33:38.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:38.453+0000 7f7ab37fe640 1 -- 172.21.15.55:0/1612530810 learned_addr learned my addr 172.21.15.55:0/1612530810 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:33:38.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:38.453+0000 7f7aaa7fc640 1 --2- 172.21.15.55:0/1612530810 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7ab4070240 0x7f7ab4160d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:38.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:38.453+0000 7f7ab37fe640 1 -- 172.21.15.55:0/1612530810 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7ab4070240 msgr2=0x7f7ab4160d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:38.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:38.453+0000 7f7ab37fe640 1 --2- 172.21.15.55:0/1612530810 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7ab4070240 0x7f7ab4160d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:38.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:38.453+0000 7f7ab37fe640 1 -- 172.21.15.55:0/1612530810 >> v1:172.21.15.72:6789/0 conn(0x7f7ab415a4d0 legacy=0x7f7ab415d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:38.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:38.453+0000 7f7ab37fe640 1 -- 172.21.15.55:0/1612530810 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ab40b0600 con 0x7f7ab40add70 2024-05-27T12:33:38.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:38.454+0000 7f7ab37fe640 1 --2- 172.21.15.55:0/1612530810 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7ab40add70 0x7f7ab40ae200 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f7aac009e50 tx=0x7f7aac02a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eed49b26d4dd9564 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:38.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:38.454+0000 7f7ab27fc640 1 -- 172.21.15.55:0/1612530810 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aac036070 con 0x7f7ab40add70 2024-05-27T12:33:38.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:38.454+0000 7f7ab27fc640 1 -- 172.21.15.55:0/1612530810 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7aac031600 con 0x7f7ab40add70 2024-05-27T12:33:38.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:38.454+0000 7f7ab27fc640 1 -- 172.21.15.55:0/1612530810 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aac0319d0 con 0x7f7ab40add70 2024-05-27T12:33:38.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:38.455+0000 7f7ab92e8640 1 -- 172.21.15.55:0/1612530810 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7ab40add70 msgr2=0x7f7ab40ae200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:38.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:38.455+0000 7f7ab92e8640 1 --2- 172.21.15.55:0/1612530810 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7ab40add70 0x7f7ab40ae200 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f7aac009e50 tx=0x7f7aac02a710 comp rx=0 tx=0).stop 2024-05-27T12:33:38.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:38.455+0000 7f7ab92e8640 1 -- 172.21.15.55:0/1612530810 shutdown_connections 2024-05-27T12:33:38.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:38.455+0000 7f7ab92e8640 1 --2- 172.21.15.55:0/1612530810 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7ab40add70 0x7f7ab40ae200 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:38.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:38.455+0000 7f7ab92e8640 1 --2- 172.21.15.55:0/1612530810 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7ab4070240 0x7f7ab4160d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:38.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:38.455+0000 7f7ab92e8640 1 -- 172.21.15.55:0/1612530810 >> 172.21.15.55:0/1612530810 conn(0x7f7ab40d0d70 msgr2=0x7f7ab40d1150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:38.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:38.455+0000 7f7ab92e8640 1 -- 172.21.15.55:0/1612530810 shutdown_connections 2024-05-27T12:33:38.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:38.455+0000 7f7ab92e8640 1 -- 172.21.15.55:0/1612530810 wait complete. 2024-05-27T12:33:38.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:38.456+0000 7f7ab92e8640 1 Processor -- start 2024-05-27T12:33:38.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:38.456+0000 7f7ab92e8640 1 -- start start 2024-05-27T12:33:38.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:38.457+0000 7f7ab92e8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7ab4070240 0x7f7ab41fc2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:38.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:38.457+0000 7f7ab92e8640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ab40add70 0x7f7ab41fc820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:38.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:38.457+0000 7f7ab92e8640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7ab409e990 0x7f7ab40b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:38.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:38.457+0000 7f7ab92e8640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f7ab406b930 con 0x7f7ab4070240 2024-05-27T12:33:38.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:38.457+0000 7f7ab92e8640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f7ab40afff0 con 0x7f7ab40add70 2024-05-27T12:33:38.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:38.457+0000 7f7ab92e8640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f7ab406bab0 con 0x7f7ab409e990 2024-05-27T12:33:38.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:38.457+0000 7f7ab2ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7ab4070240 0x7f7ab41fc2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:38.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:38.457+0000 7f7ab2ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7ab4070240 0x7f7ab41fc2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51144/0 (socket says 172.21.15.55:51144) 2024-05-27T12:33:38.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:38.457+0000 7f7ab2ffd640 1 -- 172.21.15.55:0/2088754149 learned_addr learned my addr 172.21.15.55:0/2088754149 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:33:38.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:38.457+0000 7f7aaa7fc640 1 --2- 172.21.15.55:0/2088754149 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ab40add70 0x7f7ab41fc820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:38.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:38.457+0000 7f7ab37fe640 1 --2- 172.21.15.55:0/2088754149 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7ab409e990 0x7f7ab40b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:38.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:38.457+0000 7f7ab2ffd640 1 -- 172.21.15.55:0/2088754149 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7ab409e990 msgr2=0x7f7ab40b47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:38.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:38.457+0000 7f7ab2ffd640 1 --2- 172.21.15.55:0/2088754149 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7ab409e990 0x7f7ab40b47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:38.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:38.457+0000 7f7ab2ffd640 1 -- 172.21.15.55:0/2088754149 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ab40add70 msgr2=0x7f7ab41fc820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:38.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:38.457+0000 7f7ab2ffd640 1 --2- 172.21.15.55:0/2088754149 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ab40add70 0x7f7ab41fc820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:38.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:38.457+0000 7f7ab2ffd640 1 -- 172.21.15.55:0/2088754149 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ab40b5500 con 0x7f7ab4070240 2024-05-27T12:33:38.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:38.457+0000 7f7ab2ffd640 1 --2- 172.21.15.55:0/2088754149 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7ab4070240 0x7f7ab41fc2e0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f7aa400c3c0 tx=0x7f7aa400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:38.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:38.458+0000 7f7aabfff640 1 -- 172.21.15.55:0/2088754149 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aa40052d0 con 0x7f7ab4070240 2024-05-27T12:33:38.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:38.458+0000 7f7aabfff640 1 -- 172.21.15.55:0/2088754149 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7aa4005490 con 0x7f7ab4070240 2024-05-27T12:33:38.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:38.458+0000 7f7ab92e8640 1 -- 172.21.15.55:0/2088754149 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ab40b57e0 con 0x7f7ab4070240 2024-05-27T12:33:38.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:38.458+0000 7f7aabfff640 1 -- 172.21.15.55:0/2088754149 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aa4007260 con 0x7f7ab4070240 2024-05-27T12:33:38.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:38.458+0000 7f7ab92e8640 1 -- 172.21.15.55:0/2088754149 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ab40b5da0 con 0x7f7ab4070240 2024-05-27T12:33:38.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:38.459+0000 7f7ab92e8640 1 -- 172.21.15.55:0/2088754149 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ab4068a70 con 0x7f7ab4070240 2024-05-27T12:33:38.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:38.459+0000 7f7aabfff640 1 -- 172.21.15.55:0/2088754149 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7aa4007400 con 0x7f7ab4070240 2024-05-27T12:33:38.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:38.460+0000 7f7aabfff640 1 --2- 172.21.15.55:0/2088754149 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f7a9406c8f0 0x7f7a9406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:38.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:38.460+0000 7f7aabfff640 1 -- 172.21.15.55:0/2088754149 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5709+0+0 (secure 0 0 0) 0x7f7aa408af10 con 0x7f7ab4070240 2024-05-27T12:33:38.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:38.460+0000 7f7aaa7fc640 1 --2- 172.21.15.55:0/2088754149 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f7a9406c8f0 0x7f7a9406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:38.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:38.460+0000 7f7aaa7fc640 1 --2- 172.21.15.55:0/2088754149 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f7a9406c8f0 0x7f7a9406edb0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f7ab41fc240 tx=0x7f7a9c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:38.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:38.464+0000 7f7aabfff640 1 -- 172.21.15.55:0/2088754149 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7aa4058d80 con 0x7f7ab4070240 2024-05-27T12:33:38.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:38.693+0000 7f7ab92e8640 1 -- 172.21.15.55:0/2088754149 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f7ab4067920 con 0x7f7ab4070240 2024-05-27T12:33:39.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.330+0000 7f7aabfff640 1 -- 172.21.15.55:0/2088754149 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v14) ==== 122+0+0 (secure 0 0 0) 0x7f7aa405d080 con 0x7f7ab4070240 2024-05-27T12:33:39.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.332+0000 7f7ab92e8640 1 -- 172.21.15.55:0/2088754149 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f7a9406c8f0 msgr2=0x7f7a9406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:39.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.332+0000 7f7ab92e8640 1 --2- 172.21.15.55:0/2088754149 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f7a9406c8f0 0x7f7a9406edb0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f7ab41fc240 tx=0x7f7a9c008040 comp rx=0 tx=0).stop 2024-05-27T12:33:39.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.332+0000 7f7ab92e8640 1 -- 172.21.15.55:0/2088754149 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7ab4070240 msgr2=0x7f7ab41fc2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:39.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.332+0000 7f7ab92e8640 1 --2- 172.21.15.55:0/2088754149 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7ab4070240 0x7f7ab41fc2e0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f7aa400c3c0 tx=0x7f7aa400c880 comp rx=0 tx=0).stop 2024-05-27T12:33:39.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.332+0000 7f7ab92e8640 1 -- 172.21.15.55:0/2088754149 shutdown_connections 2024-05-27T12:33:39.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.332+0000 7f7ab92e8640 1 --2- 172.21.15.55:0/2088754149 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7ab409e990 0x7f7ab40b47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:39.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.332+0000 7f7ab92e8640 1 --2- 172.21.15.55:0/2088754149 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f7a9406c8f0 0x7f7a9406edb0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:39.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.332+0000 7f7ab92e8640 1 --2- 172.21.15.55:0/2088754149 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ab40add70 0x7f7ab41fc820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:39.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.332+0000 7f7ab92e8640 1 --2- 172.21.15.55:0/2088754149 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7ab4070240 0x7f7ab41fc2e0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:39.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.332+0000 7f7ab92e8640 1 -- 172.21.15.55:0/2088754149 >> 172.21.15.55:0/2088754149 conn(0x7f7ab40d0d70 msgr2=0x7f7ab40ae150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:39.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.332+0000 7f7ab92e8640 1 -- 172.21.15.55:0/2088754149 shutdown_connections 2024-05-27T12:33:39.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.332+0000 7f7ab92e8640 1 -- 172.21.15.55:0/2088754149 wait complete. 2024-05-27T12:33:39.346 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-05-27T12:33:39.346 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-27T12:33:39.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.456+0000 7f7802d5d640 1 Processor -- start 2024-05-27T12:33:39.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.456+0000 7f7802d5d640 1 -- start start 2024-05-27T12:33:39.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.457+0000 7f7802d5d640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f77fc0b0bc0 0x7f77fc15ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:39.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.457+0000 7f7802d5d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f77fc15f280 0x7f77fc06b930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:39.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.457+0000 7f7802d5d640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77fc0b1050 con 0x7f77fc15e960 2024-05-27T12:33:39.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.457+0000 7f7802d5d640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f77fc15f780 con 0x7f77fc15f280 2024-05-27T12:33:39.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.457+0000 7f7802d5d640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f77fc15fa60 con 0x7f77fc0b0bc0 2024-05-27T12:33:39.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.457+0000 7f78012fa640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f77fc15f280 0x7f77fc06b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:39.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.457+0000 7f78012fa640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f77fc15f280 0x7f77fc06b930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51158/0 (socket says 172.21.15.55:51158) 2024-05-27T12:33:39.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.457+0000 7f78012fa640 1 -- 172.21.15.55:0/2425386365 learned_addr learned my addr 172.21.15.55:0/2425386365 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:33:39.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.457+0000 7f77f3fff640 1 --2- 172.21.15.55:0/2425386365 >> v2:172.21.15.72:3300/0 conn(0x7f77fc0b0bc0 0x7f77fc15ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:39.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.457+0000 7f78012fa640 1 -- 172.21.15.55:0/2425386365 >> v2:172.21.15.72:3300/0 conn(0x7f77fc0b0bc0 msgr2=0x7f77fc15ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:39.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.457+0000 7f77f37fe640 1 -- 172.21.15.55:0/2425386365 <== mon.1 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3143222860 0 0) 0x7f77fc0b1050 con 0x7f77fc15e960 2024-05-27T12:33:39.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.457+0000 7f78012fa640 1 --2- 172.21.15.55:0/2425386365 >> v2:172.21.15.72:3300/0 conn(0x7f77fc0b0bc0 0x7f77fc15ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:39.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.457+0000 7f78012fa640 1 -- 172.21.15.55:0/2425386365 >> v1:172.21.15.72:6789/0 conn(0x7f77fc15e960 legacy=0x7f77fc0707b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:39.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.457+0000 7f78012fa640 1 -- 172.21.15.55:0/2425386365 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77fc15fd40 con 0x7f77fc15f280 2024-05-27T12:33:39.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.458+0000 7f78012fa640 1 --2- 172.21.15.55:0/2425386365 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f77fc15f280 0x7f77fc06b930 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f77fc0b78a0 tx=0x7f77f402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc4a007e0ba810df server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:39.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.458+0000 7f77f37fe640 1 -- 172.21.15.55:0/2425386365 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77f4036070 con 0x7f77fc15f280 2024-05-27T12:33:39.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.458+0000 7f77f37fe640 1 -- 172.21.15.55:0/2425386365 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77f4031600 con 0x7f77fc15f280 2024-05-27T12:33:39.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.458+0000 7f77f37fe640 1 -- 172.21.15.55:0/2425386365 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77f40319d0 con 0x7f77fc15f280 2024-05-27T12:33:39.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.459+0000 7f7802d5d640 1 -- 172.21.15.55:0/2425386365 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f77fc15f280 msgr2=0x7f77fc06b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:39.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.459+0000 7f7802d5d640 1 --2- 172.21.15.55:0/2425386365 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f77fc15f280 0x7f77fc06b930 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f77fc0b78a0 tx=0x7f77f402a6a0 comp rx=0 tx=0).stop 2024-05-27T12:33:39.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.459+0000 7f7802d5d640 1 -- 172.21.15.55:0/2425386365 shutdown_connections 2024-05-27T12:33:39.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.459+0000 7f7802d5d640 1 --2- 172.21.15.55:0/2425386365 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f77fc15f280 0x7f77fc06b930 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:39.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.459+0000 7f7802d5d640 1 --2- 172.21.15.55:0/2425386365 >> v2:172.21.15.72:3300/0 conn(0x7f77fc0b0bc0 0x7f77fc15ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:39.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.459+0000 7f7802d5d640 1 -- 172.21.15.55:0/2425386365 >> 172.21.15.55:0/2425386365 conn(0x7f77fc0b3360 msgr2=0x7f77fc0b3770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:39.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.459+0000 7f7802d5d640 1 -- 172.21.15.55:0/2425386365 shutdown_connections 2024-05-27T12:33:39.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.459+0000 7f7802d5d640 1 -- 172.21.15.55:0/2425386365 wait complete. 2024-05-27T12:33:39.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.460+0000 7f7802d5d640 1 Processor -- start 2024-05-27T12:33:39.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.460+0000 7f7802d5d640 1 -- start start 2024-05-27T12:33:39.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.461+0000 7f7802d5d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f77fc0b0bc0 0x7f77fc1f4570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:39.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.461+0000 7f7802d5d640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f77fc15e960 0x7f77fc14fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:39.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.461+0000 7f7802d5d640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f77fc15f280 0x7f77fc0cc7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:39.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.461+0000 7f7802d5d640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f77fc06bff0 con 0x7f77fc0b0bc0 2024-05-27T12:33:39.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.461+0000 7f7802d5d640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f77fc06be70 con 0x7f77fc15f280 2024-05-27T12:33:39.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.461+0000 7f7802d5d640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f77fc06c170 con 0x7f77fc15e960 2024-05-27T12:33:39.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.461+0000 7f7800af9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f77fc0b0bc0 0x7f77fc1f4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:39.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.461+0000 7f7800af9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f77fc0b0bc0 0x7f77fc1f4570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51164/0 (socket says 172.21.15.55:51164) 2024-05-27T12:33:39.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.461+0000 7f7800af9640 1 -- 172.21.15.55:0/943143962 learned_addr learned my addr 172.21.15.55:0/943143962 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:33:39.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.461+0000 7f78012fa640 1 --2- 172.21.15.55:0/943143962 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f77fc15f280 0x7f77fc0cc7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:39.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.461+0000 7f77f3fff640 1 --2- 172.21.15.55:0/943143962 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f77fc15e960 0x7f77fc14fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:39.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.461+0000 7f7800af9640 1 -- 172.21.15.55:0/943143962 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f77fc15e960 msgr2=0x7f77fc14fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:39.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.461+0000 7f7800af9640 1 --2- 172.21.15.55:0/943143962 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f77fc15e960 0x7f77fc14fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:39.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.461+0000 7f7800af9640 1 -- 172.21.15.55:0/943143962 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f77fc15f280 msgr2=0x7f77fc0cc7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:39.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.461+0000 7f7800af9640 1 --2- 172.21.15.55:0/943143962 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f77fc15f280 0x7f77fc0cc7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:39.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.461+0000 7f7800af9640 1 -- 172.21.15.55:0/943143962 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77fc0cd340 con 0x7f77fc0b0bc0 2024-05-27T12:33:39.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.462+0000 7f7800af9640 1 --2- 172.21.15.55:0/943143962 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f77fc0b0bc0 0x7f77fc1f4570 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f77f800c4e0 tx=0x7f77f800c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:39.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.462+0000 7f77f17fa640 1 -- 172.21.15.55:0/943143962 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77f8017070 con 0x7f77fc0b0bc0 2024-05-27T12:33:39.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.462+0000 7f77f17fa640 1 -- 172.21.15.55:0/943143962 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77f80035f0 con 0x7f77fc0b0bc0 2024-05-27T12:33:39.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.462+0000 7f7802d5d640 1 -- 172.21.15.55:0/943143962 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77fc0cd620 con 0x7f77fc0b0bc0 2024-05-27T12:33:39.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.462+0000 7f77f17fa640 1 -- 172.21.15.55:0/943143962 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77f80039e0 con 0x7f77fc0b0bc0 2024-05-27T12:33:39.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.462+0000 7f7802d5d640 1 -- 172.21.15.55:0/943143962 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77fc150cb0 con 0x7f77fc0b0bc0 2024-05-27T12:33:39.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.463+0000 7f7802d5d640 1 -- 172.21.15.55:0/943143962 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77fc075460 con 0x7f77fc0b0bc0 2024-05-27T12:33:39.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.463+0000 7f77f17fa640 1 -- 172.21.15.55:0/943143962 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f77f801a070 con 0x7f77fc0b0bc0 2024-05-27T12:33:39.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.464+0000 7f77f17fa640 1 --2- 172.21.15.55:0/943143962 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f77e806c8f0 0x7f77e806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:39.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.464+0000 7f77f17fa640 1 -- 172.21.15.55:0/943143962 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5709+0+0 (secure 0 0 0) 0x7f77f808ae70 con 0x7f77fc0b0bc0 2024-05-27T12:33:39.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.464+0000 7f77f3fff640 1 --2- 172.21.15.55:0/943143962 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f77e806c8f0 0x7f77e806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:39.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.464+0000 7f77f3fff640 1 --2- 172.21.15.55:0/943143962 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f77e806c8f0 0x7f77e806edb0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f77fc1622c0 tx=0x7f77ec009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:39.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.468+0000 7f77f17fa640 1 -- 172.21.15.55:0/943143962 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f77f8058c40 con 0x7f77fc0b0bc0 2024-05-27T12:33:39.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.692+0000 7f7802d5d640 1 -- 172.21.15.55:0/943143962 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f77fc15cea0 con 0x7f77fc0b0bc0 2024-05-27T12:33:39.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.693+0000 7f77f17fa640 1 -- 172.21.15.55:0/943143962 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+5180 (secure 0 0 0) 0x7f77f805cf40 con 0x7f77fc0b0bc0 2024-05-27T12:33:39.693 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-27T12:33:39.694 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4760,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6836/1520859199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":1520859199},{"type":"v1","addr":"172.21.15.72:6836","nonce":1520859199}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":4769,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/4005455241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":4005455241},{"type":"v1","addr":"172.21.15.55:6835","nonce":4005455241}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":5002,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/3014759941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6835","nonce":3014759941},{"type":"v1","addr":"172.21.15.72:6837","nonce":3014759941}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-27T12:33:35.670308+0000","modified":"2024-05-27T12:33:38.696129+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5151},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5151":{"gid":5151,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6833/1971815735","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":1971815735},{"type":"v1","addr":"172.21.15.55:6833","nonce":1971815735}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5151,"qdb_cluster":[5151]},"id":2}]} 2024-05-27T12:33:39.694 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 14 2024-05-27T12:33:39.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.695+0000 7f7802d5d640 1 -- 172.21.15.55:0/943143962 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f77e806c8f0 msgr2=0x7f77e806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:39.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.695+0000 7f7802d5d640 1 --2- 172.21.15.55:0/943143962 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f77e806c8f0 0x7f77e806edb0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f77fc1622c0 tx=0x7f77ec009190 comp rx=0 tx=0).stop 2024-05-27T12:33:39.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.695+0000 7f7802d5d640 1 -- 172.21.15.55:0/943143962 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f77fc0b0bc0 msgr2=0x7f77fc1f4570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:39.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.695+0000 7f7802d5d640 1 --2- 172.21.15.55:0/943143962 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f77fc0b0bc0 0x7f77fc1f4570 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f77f800c4e0 tx=0x7f77f800c9a0 comp rx=0 tx=0).stop 2024-05-27T12:33:39.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.695+0000 7f7802d5d640 1 -- 172.21.15.55:0/943143962 shutdown_connections 2024-05-27T12:33:39.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.695+0000 7f7802d5d640 1 --2- 172.21.15.55:0/943143962 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f77e806c8f0 0x7f77e806edb0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:39.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.695+0000 7f7802d5d640 1 --2- 172.21.15.55:0/943143962 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f77fc15f280 0x7f77fc0cc7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:39.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.695+0000 7f7802d5d640 1 --2- 172.21.15.55:0/943143962 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f77fc15e960 0x7f77fc14fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:39.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.695+0000 7f7802d5d640 1 --2- 172.21.15.55:0/943143962 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f77fc0b0bc0 0x7f77fc1f4570 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:39.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.695+0000 7f7802d5d640 1 -- 172.21.15.55:0/943143962 >> 172.21.15.55:0/943143962 conn(0x7f77fc0b3360 msgr2=0x7f77fc0b5730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:39.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.695+0000 7f7802d5d640 1 -- 172.21.15.55:0/943143962 shutdown_connections 2024-05-27T12:33:39.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.695+0000 7f7802d5d640 1 -- 172.21.15.55:0/943143962 wait complete. 2024-05-27T12:33:39.706 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-27T12:33:39.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.810+0000 7f31d0fe2640 1 Processor -- start 2024-05-27T12:33:39.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.810+0000 7f31d0fe2640 1 -- start start 2024-05-27T12:33:39.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.811+0000 7f31d0fe2640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f31cc15e960 0x7f31cc0b0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:39.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.811+0000 7f31d0fe2640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f31cc0707b0 0x7f31cc15ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:39.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.811+0000 7f31d0fe2640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f31cc070c10 0x7f31cc06b930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:39.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.811+0000 7f31d0fe2640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f31cc0b1100 con 0x7f31cc15e960 2024-05-27T12:33:39.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.811+0000 7f31d0fe2640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f31cc15f780 con 0x7f31cc070c10 2024-05-27T12:33:39.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.811+0000 7f31d0fe2640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f31cc15fa60 con 0x7f31cc0707b0 2024-05-27T12:33:39.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.811+0000 7f31ca59c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f31cc15e960 0x7f31cc0b0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:39.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.811+0000 7f31ca59c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f31cc15e960 0x7f31cc0b0bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51166/0 (socket says 172.21.15.55:51166) 2024-05-27T12:33:39.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.811+0000 7f31ca59c640 1 -- 172.21.15.55:0/875221228 learned_addr learned my addr 172.21.15.55:0/875221228 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:33:39.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.811+0000 7f31c1d9b640 1 --2- 172.21.15.55:0/875221228 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f31cc0707b0 0x7f31cc15ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:39.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.811+0000 7f31cad9d640 1 --2- 172.21.15.55:0/875221228 >> v2:172.21.15.72:3300/0 conn(0x7f31cc070c10 0x7f31cc06b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:39.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.811+0000 7f31ca59c640 1 -- 172.21.15.55:0/875221228 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f31cc0707b0 msgr2=0x7f31cc15ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:39.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.811+0000 7f31ca59c640 1 --2- 172.21.15.55:0/875221228 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f31cc0707b0 0x7f31cc15ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:39.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.811+0000 7f31ca59c640 1 -- 172.21.15.55:0/875221228 >> v2:172.21.15.72:3300/0 conn(0x7f31cc070c10 msgr2=0x7f31cc06b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:39.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.811+0000 7f31ca59c640 1 --2- 172.21.15.55:0/875221228 >> v2:172.21.15.72:3300/0 conn(0x7f31cc070c10 0x7f31cc06b930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:39.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.811+0000 7f31ca59c640 1 -- 172.21.15.55:0/875221228 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31cc15fd40 con 0x7f31cc15e960 2024-05-27T12:33:39.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.811+0000 7f31cad9d640 1 --2- 172.21.15.55:0/875221228 >> v2:172.21.15.72:3300/0 conn(0x7f31cc070c10 0x7f31cc06b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T12:33:39.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.812+0000 7f31ca59c640 1 --2- 172.21.15.55:0/875221228 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f31cc15e960 0x7f31cc0b0bc0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f31cc072fc0 tx=0x7f31bc02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c215593086d2f117 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:39.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.812+0000 7f31c9d9b640 1 -- 172.21.15.55:0/875221228 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31bc037070 con 0x7f31cc15e960 2024-05-27T12:33:39.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.812+0000 7f31c9d9b640 1 -- 172.21.15.55:0/875221228 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31bc032440 con 0x7f31cc15e960 2024-05-27T12:33:39.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.812+0000 7f31c9d9b640 1 -- 172.21.15.55:0/875221228 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31bc032810 con 0x7f31cc15e960 2024-05-27T12:33:39.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.812+0000 7f31d0fe2640 1 -- 172.21.15.55:0/875221228 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f31cc15e960 msgr2=0x7f31cc0b0bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:39.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.812+0000 7f31d0fe2640 1 --2- 172.21.15.55:0/875221228 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f31cc15e960 0x7f31cc0b0bc0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f31cc072fc0 tx=0x7f31bc02a140 comp rx=0 tx=0).stop 2024-05-27T12:33:39.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.813+0000 7f31d0fe2640 1 -- 172.21.15.55:0/875221228 shutdown_connections 2024-05-27T12:33:39.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.813+0000 7f31d0fe2640 1 --2- 172.21.15.55:0/875221228 >> v2:172.21.15.72:3300/0 conn(0x7f31cc070c10 0x7f31cc06b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:39.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.813+0000 7f31d0fe2640 1 --2- 172.21.15.55:0/875221228 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f31cc0707b0 0x7f31cc15ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:39.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.813+0000 7f31d0fe2640 1 --2- 172.21.15.55:0/875221228 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f31cc15e960 0x7f31cc0b0bc0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:39.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.813+0000 7f31d0fe2640 1 -- 172.21.15.55:0/875221228 >> 172.21.15.55:0/875221228 conn(0x7f31cc0b3360 msgr2=0x7f31cc0b3770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:39.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.813+0000 7f31d0fe2640 1 -- 172.21.15.55:0/875221228 shutdown_connections 2024-05-27T12:33:39.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.813+0000 7f31d0fe2640 1 -- 172.21.15.55:0/875221228 wait complete. 2024-05-27T12:33:39.818 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.814+0000 7f31d0fe2640 1 Processor -- start 2024-05-27T12:33:39.818 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.814+0000 7f31d0fe2640 1 -- start start 2024-05-27T12:33:39.818 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.815+0000 7f31d0fe2640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31cc0707b0 0x7f31cc0cb8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:39.818 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.815+0000 7f31d0fe2640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f31cc15e960 0x7f31cc1f4230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:39.818 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.815+0000 7f31d0fe2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f31cc0ca9e0 0x7f31cc1f70e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:39.818 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.815+0000 7f31d0fe2640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f31cc15f400 con 0x7f31cc0ca9e0 2024-05-27T12:33:39.818 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.815+0000 7f31d0fe2640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f31cc15f280 con 0x7f31cc0707b0 2024-05-27T12:33:39.818 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.815+0000 7f31d0fe2640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f31cc06be70 con 0x7f31cc15e960 2024-05-27T12:33:39.818 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.815+0000 7f31cad9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f31cc0ca9e0 0x7f31cc1f70e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:39.818 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.815+0000 7f31cad9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f31cc0ca9e0 0x7f31cc1f70e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51176/0 (socket says 172.21.15.55:51176) 2024-05-27T12:33:39.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.815+0000 7f31cad9d640 1 -- 172.21.15.55:0/947557208 learned_addr learned my addr 172.21.15.55:0/947557208 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:33:39.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.815+0000 7f31c1d9b640 1 --2- 172.21.15.55:0/947557208 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f31cc15e960 0x7f31cc1f4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:39.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.815+0000 7f31ca59c640 1 --2- 172.21.15.55:0/947557208 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31cc0707b0 0x7f31cc0cb8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:39.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.815+0000 7f31cad9d640 1 -- 172.21.15.55:0/947557208 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f31cc15e960 msgr2=0x7f31cc1f4230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:39.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.815+0000 7f31cad9d640 1 --2- 172.21.15.55:0/947557208 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f31cc15e960 0x7f31cc1f4230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:39.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.815+0000 7f31cad9d640 1 -- 172.21.15.55:0/947557208 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31cc0707b0 msgr2=0x7f31cc0cb8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:39.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.815+0000 7f31cad9d640 1 --2- 172.21.15.55:0/947557208 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31cc0707b0 0x7f31cc0cb8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:39.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.815+0000 7f31cad9d640 1 -- 172.21.15.55:0/947557208 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31cc153830 con 0x7f31cc0ca9e0 2024-05-27T12:33:39.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.815+0000 7f31ca59c640 1 --2- 172.21.15.55:0/947557208 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31cc0707b0 0x7f31cc0cb8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T12:33:39.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.815+0000 7f31cad9d640 1 --2- 172.21.15.55:0/947557208 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f31cc0ca9e0 0x7f31cc1f70e0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f31c4007f20 tx=0x7f31c400d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:39.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.816+0000 7f31c37fe640 1 -- 172.21.15.55:0/947557208 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31c401a070 con 0x7f31cc0ca9e0 2024-05-27T12:33:39.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.816+0000 7f31c37fe640 1 -- 172.21.15.55:0/947557208 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31c4003b90 con 0x7f31cc0ca9e0 2024-05-27T12:33:39.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.816+0000 7f31d0fe2640 1 -- 172.21.15.55:0/947557208 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31cc0cbf90 con 0x7f31cc0ca9e0 2024-05-27T12:33:39.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.816+0000 7f31c37fe640 1 -- 172.21.15.55:0/947557208 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31c4004030 con 0x7f31cc0ca9e0 2024-05-27T12:33:39.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.816+0000 7f31d0fe2640 1 -- 172.21.15.55:0/947557208 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31cc160390 con 0x7f31cc0ca9e0 2024-05-27T12:33:39.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.817+0000 7f31d0fe2640 1 -- 172.21.15.55:0/947557208 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31cc075460 con 0x7f31cc0ca9e0 2024-05-27T12:33:39.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.817+0000 7f31c37fe640 1 -- 172.21.15.55:0/947557208 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f31c401d070 con 0x7f31cc0ca9e0 2024-05-27T12:33:39.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.818+0000 7f31c37fe640 1 --2- 172.21.15.55:0/947557208 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f31ac06c920 0x7f31ac06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:39.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.818+0000 7f31c37fe640 1 -- 172.21.15.55:0/947557208 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5709+0+0 (secure 0 0 0) 0x7f31c408bcd0 con 0x7f31cc0ca9e0 2024-05-27T12:33:39.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.818+0000 7f31ca59c640 1 --2- 172.21.15.55:0/947557208 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f31ac06c920 0x7f31ac06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:39.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.818+0000 7f31ca59c640 1 --2- 172.21.15.55:0/947557208 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f31ac06c920 0x7f31ac06ede0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f31bc034000 tx=0x7f31bc02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:39.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:39.822+0000 7f31c37fe640 1 -- 172.21.15.55:0/947557208 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f31c4010070 con 0x7f31cc0ca9e0 2024-05-27T12:33:40.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.011+0000 7f31d0fe2640 1 -- 172.21.15.55:0/947557208 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f31cc06c240 con 0x7f31cc0ca9e0 2024-05-27T12:33:40.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.012+0000 7f31c37fe640 1 -- 172.21.15.55:0/947557208 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) ==== 74+0+16621 (secure 0 0 0) 0x7f31c4059b40 con 0x7f31cc0ca9e0 2024-05-27T12:33:40.013 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-27T12:33:40.013 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":36,"fsid":"c3ff4e3b-8dae-4856-9593-e5cc66c59982","created":"2024-05-27T12:32:17.019097+0000","modified":"2024-05-27T12:33:37.305481+0000","last_up_change":"2024-05-27T12:32:28.109744+0000","last_in_change":"2024-05-27T12:32:19.309872+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-27T12:32:29.277895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-05-27T12:33:34.122092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-05-27T12:33:34.617553+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e607b598-061b-4b6f-92ff-95c20b330599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":807572567},{"type":"v1","addr":"172.21.15.55:6801","nonce":807572567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":807572567},{"type":"v1","addr":"172.21.15.55:6803","nonce":807572567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":807572567},{"type":"v1","addr":"172.21.15.55:6807","nonce":807572567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":807572567},{"type":"v1","addr":"172.21.15.55:6805","nonce":807572567}]},"public_addr":"172.21.15.55:6801/807572567","cluster_addr":"172.21.15.55:6803/807572567","heartbeat_back_addr":"172.21.15.55:6807/807572567","heartbeat_front_addr":"172.21.15.55:6805/807572567","state":["exists","up"]},{"osd":1,"uuid":"ba2b5b1d-71a9-4ecc-9a48-55aa7fe54261","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":3426897300},{"type":"v1","addr":"172.21.15.55:6825","nonce":3426897300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":3426897300},{"type":"v1","addr":"172.21.15.55:6827","nonce":3426897300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":3426897300},{"type":"v1","addr":"172.21.15.55:6831","nonce":3426897300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":3426897300},{"type":"v1","addr":"172.21.15.55:6829","nonce":3426897300}]},"public_addr":"172.21.15.55:6825/3426897300","cluster_addr":"172.21.15.55:6827/3426897300","heartbeat_back_addr":"172.21.15.55:6831/3426897300","heartbeat_front_addr":"172.21.15.55:6829/3426897300","state":["exists","up"]},{"osd":2,"uuid":"e6b81cc6-4ff1-45d0-87eb-9f04ccf986a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3510271725},{"type":"v1","addr":"172.21.15.55:6809","nonce":3510271725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3510271725},{"type":"v1","addr":"172.21.15.55:6811","nonce":3510271725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3510271725},{"type":"v1","addr":"172.21.15.55:6815","nonce":3510271725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3510271725},{"type":"v1","addr":"172.21.15.55:6813","nonce":3510271725}]},"public_addr":"172.21.15.55:6809/3510271725","cluster_addr":"172.21.15.55:6811/3510271725","heartbeat_back_addr":"172.21.15.55:6815/3510271725","heartbeat_front_addr":"172.21.15.55:6813/3510271725","state":["exists","up"]},{"osd":3,"uuid":"b6a34b75-807d-4693-b1c3-903cb4c618d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":1066693520},{"type":"v1","addr":"172.21.15.55:6817","nonce":1066693520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":1066693520},{"type":"v1","addr":"172.21.15.55:6819","nonce":1066693520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":1066693520},{"type":"v1","addr":"172.21.15.55:6823","nonce":1066693520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":1066693520},{"type":"v1","addr":"172.21.15.55:6821","nonce":1066693520}]},"public_addr":"172.21.15.55:6817/1066693520","cluster_addr":"172.21.15.55:6819/1066693520","heartbeat_back_addr":"172.21.15.55:6823/1066693520","heartbeat_front_addr":"172.21.15.55:6821/1066693520","state":["exists","up"]},{"osd":4,"uuid":"272ec937-56b4-4f0a-b2e1-b0bc189c9d79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":4190771237},{"type":"v1","addr":"172.21.15.72:6820","nonce":4190771237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":4190771237},{"type":"v1","addr":"172.21.15.72:6824","nonce":4190771237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":4190771237},{"type":"v1","addr":"172.21.15.72:6831","nonce":4190771237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":4190771237},{"type":"v1","addr":"172.21.15.72:6828","nonce":4190771237}]},"public_addr":"172.21.15.72:6820/4190771237","cluster_addr":"172.21.15.72:6824/4190771237","heartbeat_back_addr":"172.21.15.72:6831/4190771237","heartbeat_front_addr":"172.21.15.72:6828/4190771237","state":["exists","up"]},{"osd":5,"uuid":"56439854-72a0-4ef4-81ff-184a3d924a5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":2421889184},{"type":"v1","addr":"172.21.15.72:6801","nonce":2421889184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6803","nonce":2421889184},{"type":"v1","addr":"172.21.15.72:6805","nonce":2421889184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":2421889184},{"type":"v1","addr":"172.21.15.72:6813","nonce":2421889184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6807","nonce":2421889184},{"type":"v1","addr":"172.21.15.72:6809","nonce":2421889184}]},"public_addr":"172.21.15.72:6801/2421889184","cluster_addr":"172.21.15.72:6805/2421889184","heartbeat_back_addr":"172.21.15.72:6813/2421889184","heartbeat_front_addr":"172.21.15.72:6809/2421889184","state":["exists","up"]},{"osd":6,"uuid":"e248e2be-3b6e-49cf-8c8a-1a4152827582","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3796994599},{"type":"v1","addr":"172.21.15.72:6804","nonce":3796994599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":3796994599},{"type":"v1","addr":"172.21.15.72:6808","nonce":3796994599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":3796994599},{"type":"v1","addr":"172.21.15.72:6815","nonce":3796994599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":3796994599},{"type":"v1","addr":"172.21.15.72:6812","nonce":3796994599}]},"public_addr":"172.21.15.72:6804/3796994599","cluster_addr":"172.21.15.72:6808/3796994599","heartbeat_back_addr":"172.21.15.72:6815/3796994599","heartbeat_front_addr":"172.21.15.72:6812/3796994599","state":["exists","up"]},{"osd":7,"uuid":"505a62d3-322b-4629-b4fd-187a55563709","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":3024877895},{"type":"v1","addr":"172.21.15.72:6817","nonce":3024877895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":3024877895},{"type":"v1","addr":"172.21.15.72:6821","nonce":3024877895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6827","nonce":3024877895},{"type":"v1","addr":"172.21.15.72:6829","nonce":3024877895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6823","nonce":3024877895},{"type":"v1","addr":"172.21.15.72:6825","nonce":3024877895}]},"public_addr":"172.21.15.72:6817/3024877895","cluster_addr":"172.21.15.72:6821/3024877895","heartbeat_back_addr":"172.21.15.72:6829/3024877895","heartbeat_front_addr":"172.21.15.72:6825/3024877895","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.241014+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.450799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.465018+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.507647+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.534763+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.495895+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.427110+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.547466+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-27T12:33:40.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.015+0000 7f31d0fe2640 1 -- 172.21.15.55:0/947557208 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f31ac06c920 msgr2=0x7f31ac06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:40.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.015+0000 7f31d0fe2640 1 --2- 172.21.15.55:0/947557208 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f31ac06c920 0x7f31ac06ede0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f31bc034000 tx=0x7f31bc02e000 comp rx=0 tx=0).stop 2024-05-27T12:33:40.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.015+0000 7f31d0fe2640 1 -- 172.21.15.55:0/947557208 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f31cc0ca9e0 msgr2=0x7f31cc1f70e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:40.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.015+0000 7f31d0fe2640 1 --2- 172.21.15.55:0/947557208 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f31cc0ca9e0 0x7f31cc1f70e0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f31c4007f20 tx=0x7f31c400d560 comp rx=0 tx=0).stop 2024-05-27T12:33:40.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.015+0000 7f31d0fe2640 1 -- 172.21.15.55:0/947557208 shutdown_connections 2024-05-27T12:33:40.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.015+0000 7f31d0fe2640 1 --2- 172.21.15.55:0/947557208 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f31cc0ca9e0 0x7f31cc1f70e0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:40.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.015+0000 7f31d0fe2640 1 --2- 172.21.15.55:0/947557208 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f31cc15e960 0x7f31cc1f4230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:40.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.015+0000 7f31d0fe2640 1 --2- 172.21.15.55:0/947557208 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f31ac06c920 0x7f31ac06ede0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:40.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.015+0000 7f31d0fe2640 1 --2- 172.21.15.55:0/947557208 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31cc0707b0 0x7f31cc0cb8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:40.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.015+0000 7f31d0fe2640 1 -- 172.21.15.55:0/947557208 >> 172.21.15.55:0/947557208 conn(0x7f31cc0b3360 msgr2=0x7f31cc071000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:40.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.015+0000 7f31d0fe2640 1 -- 172.21.15.55:0/947557208 shutdown_connections 2024-05-27T12:33:40.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.015+0000 7f31d0fe2640 1 -- 172.21.15.55:0/947557208 wait complete. 2024-05-27T12:33:40.027 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-05-27T12:33:40.027 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-27T12:33:40.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.131+0000 7f02260a0640 1 Processor -- start 2024-05-27T12:33:40.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.131+0000 7f02260a0640 1 -- start start 2024-05-27T12:33:40.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.131+0000 7f02260a0640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f022015db80 0x7f022009b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:40.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.131+0000 7f02260a0640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f022015e520 0x7f022009aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:40.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.131+0000 7f02260a0640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02200ce660 con 0x7f022009af70 2024-05-27T12:33:40.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.131+0000 7f02260a0640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f022009bcb0 con 0x7f022015e520 2024-05-27T12:33:40.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.131+0000 7f02260a0640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f02200cddc0 con 0x7f022015db80 2024-05-27T12:33:40.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.132+0000 7f021ffff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f022009af70 0x7f02200d0b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:32876/0 (socket says 172.21.15.55:32876) 2024-05-27T12:33:40.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.132+0000 7f021ffff640 1 -- 172.21.15.55:0/2906429929 learned_addr learned my addr 172.21.15.55:0/2906429929 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-27T12:33:40.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.132+0000 7f021effd640 1 --2- 172.21.15.55:0/2906429929 >> v2:172.21.15.72:3300/0 conn(0x7f022015e520 0x7f022009aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:40.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.132+0000 7f021f7fe640 1 --2- 172.21.15.55:0/2906429929 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f022015db80 0x7f022009b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:40.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.132+0000 7f021e7fc640 1 -- 172.21.15.55:0/2906429929 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3026978010 0 0) 0x7f02200ce660 con 0x7f022009af70 2024-05-27T12:33:40.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.132+0000 7f021e7fc640 1 -- 172.21.15.55:0/2906429929 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0208003520 con 0x7f022009af70 2024-05-27T12:33:40.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.132+0000 7f021f7fe640 1 -- 172.21.15.55:0/2906429929 >> v2:172.21.15.72:3300/0 conn(0x7f022015e520 msgr2=0x7f022009aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:40.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.132+0000 7f021f7fe640 1 --2- 172.21.15.55:0/2906429929 >> v2:172.21.15.72:3300/0 conn(0x7f022015e520 0x7f022009aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:40.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.132+0000 7f021f7fe640 1 -- 172.21.15.55:0/2906429929 >> v1:172.21.15.55:6789/0 conn(0x7f022009af70 legacy=0x7f02200d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:40.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.132+0000 7f021f7fe640 1 -- 172.21.15.55:0/2906429929 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02200ce0a0 con 0x7f022015db80 2024-05-27T12:33:40.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.133+0000 7f021f7fe640 1 --2- 172.21.15.55:0/2906429929 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f022015db80 0x7f022009b770 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f02100097a0 tx=0x7f021002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2db99ad931e47fed server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:40.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.133+0000 7f021e7fc640 1 -- 172.21.15.55:0/2906429929 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0210037070 con 0x7f022015db80 2024-05-27T12:33:40.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.133+0000 7f021e7fc640 1 -- 172.21.15.55:0/2906429929 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0210032440 con 0x7f022015db80 2024-05-27T12:33:40.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.133+0000 7f021e7fc640 1 -- 172.21.15.55:0/2906429929 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0210032810 con 0x7f022015db80 2024-05-27T12:33:40.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.134+0000 7f02260a0640 1 -- 172.21.15.55:0/2906429929 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f022015db80 msgr2=0x7f022009b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:40.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.134+0000 7f02260a0640 1 --2- 172.21.15.55:0/2906429929 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f022015db80 0x7f022009b770 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f02100097a0 tx=0x7f021002a180 comp rx=0 tx=0).stop 2024-05-27T12:33:40.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.134+0000 7f02260a0640 1 -- 172.21.15.55:0/2906429929 shutdown_connections 2024-05-27T12:33:40.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.134+0000 7f02260a0640 1 --2- 172.21.15.55:0/2906429929 >> v2:172.21.15.72:3300/0 conn(0x7f022015e520 0x7f022009aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:40.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.134+0000 7f02260a0640 1 --2- 172.21.15.55:0/2906429929 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f022015db80 0x7f022009b770 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:40.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.134+0000 7f02260a0640 1 -- 172.21.15.55:0/2906429929 >> 172.21.15.55:0/2906429929 conn(0x7f02200b4190 msgr2=0x7f02200b45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:40.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.134+0000 7f02260a0640 1 -- 172.21.15.55:0/2906429929 shutdown_connections 2024-05-27T12:33:40.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.134+0000 7f02260a0640 1 -- 172.21.15.55:0/2906429929 wait complete. 2024-05-27T12:33:40.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.135+0000 7f02260a0640 1 Processor -- start 2024-05-27T12:33:40.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.135+0000 7f02260a0640 1 -- start start 2024-05-27T12:33:40.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.136+0000 7f02260a0640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f022009af70 0x7f02200c8580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:40.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.136+0000 7f02260a0640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f022015db80 0x7f02200b7970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:40.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.136+0000 7f02260a0640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f022015e520 0x7f02200b7eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:40.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.136+0000 7f02260a0640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f02200d05f0 con 0x7f022009af70 2024-05-27T12:33:40.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.136+0000 7f02260a0640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f02200d0310 con 0x7f022015db80 2024-05-27T12:33:40.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.136+0000 7f02260a0640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f022015e980 con 0x7f022015e520 2024-05-27T12:33:40.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.136+0000 7f021f7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f022009af70 0x7f02200c8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:40.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.136+0000 7f021f7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f022009af70 0x7f02200c8580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51186/0 (socket says 172.21.15.55:51186) 2024-05-27T12:33:40.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.136+0000 7f021f7fe640 1 -- 172.21.15.55:0/3591702020 learned_addr learned my addr 172.21.15.55:0/3591702020 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:33:40.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.136+0000 7f021ffff640 1 --2- 172.21.15.55:0/3591702020 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f022015e520 0x7f02200b7eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:40.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.136+0000 7f021f7fe640 1 -- 172.21.15.55:0/3591702020 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f022015e520 msgr2=0x7f02200b7eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:40.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.136+0000 7f021f7fe640 1 --2- 172.21.15.55:0/3591702020 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f022015e520 0x7f02200b7eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:40.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.136+0000 7f021f7fe640 1 -- 172.21.15.55:0/3591702020 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f022015db80 msgr2=0x7f02200b7970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:40.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.136+0000 7f021f7fe640 1 --2- 172.21.15.55:0/3591702020 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f022015db80 0x7f02200b7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:40.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.136+0000 7f021f7fe640 1 -- 172.21.15.55:0/3591702020 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02200c6370 con 0x7f022009af70 2024-05-27T12:33:40.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.136+0000 7f021f7fe640 1 --2- 172.21.15.55:0/3591702020 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f022009af70 0x7f02200c8580 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f0210035040 tx=0x7f02100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:40.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.136+0000 7f0207fff640 1 -- 172.21.15.55:0/3591702020 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0210041030 con 0x7f022009af70 2024-05-27T12:33:40.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.137+0000 7f0207fff640 1 -- 172.21.15.55:0/3591702020 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f021003d4e0 con 0x7f022009af70 2024-05-27T12:33:40.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.137+0000 7f02260a0640 1 -- 172.21.15.55:0/3591702020 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02200c6650 con 0x7f022009af70 2024-05-27T12:33:40.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.137+0000 7f0207fff640 1 -- 172.21.15.55:0/3591702020 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0210037040 con 0x7f022009af70 2024-05-27T12:33:40.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.137+0000 7f02260a0640 1 -- 172.21.15.55:0/3591702020 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02200c6c10 con 0x7f022009af70 2024-05-27T12:33:40.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.138+0000 7f02260a0640 1 -- 172.21.15.55:0/3591702020 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0220075460 con 0x7f022009af70 2024-05-27T12:33:40.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.138+0000 7f0207fff640 1 -- 172.21.15.55:0/3591702020 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0210044070 con 0x7f022009af70 2024-05-27T12:33:40.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.139+0000 7f0207fff640 1 --2- 172.21.15.55:0/3591702020 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f020c06c8f0 0x7f020c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:40.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.139+0000 7f0207fff640 1 -- 172.21.15.55:0/3591702020 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5709+0+0 (secure 0 0 0) 0x7f02100ac220 con 0x7f022009af70 2024-05-27T12:33:40.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.139+0000 7f021effd640 1 --2- 172.21.15.55:0/3591702020 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f020c06c8f0 0x7f020c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:40.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.139+0000 7f021effd640 1 --2- 172.21.15.55:0/3591702020 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f020c06c8f0 0x7f020c06edb0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f0214006a90 tx=0x7f0214006a20 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:40.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.143+0000 7f0207fff640 1 -- 172.21.15.55:0/3591702020 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f0210044e40 con 0x7f022009af70 2024-05-27T12:33:40.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.325+0000 7f02260a0640 1 -- 172.21.15.55:0/3591702020 --> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f02200c8ac0 con 0x7f020c06c8f0 2024-05-27T12:33:40.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.332+0000 7f0207fff640 1 -- 172.21.15.55:0/3591702020 <== mgr.4105 v2:172.21.15.72:6832/3152720583 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251922 (secure 0 0 0) 0x7f02200c8ac0 con 0x7f020c06c8f0 2024-05-27T12:33:40.335 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-27T12:33:40.336 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2024-05-27T12:33:40.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.335+0000 7f02260a0640 1 -- 172.21.15.55:0/3591702020 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f020c06c8f0 msgr2=0x7f020c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:40.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.335+0000 7f02260a0640 1 --2- 172.21.15.55:0/3591702020 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f020c06c8f0 0x7f020c06edb0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f0214006a90 tx=0x7f0214006a20 comp rx=0 tx=0).stop 2024-05-27T12:33:40.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.335+0000 7f02260a0640 1 -- 172.21.15.55:0/3591702020 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f022009af70 msgr2=0x7f02200c8580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:40.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.335+0000 7f02260a0640 1 --2- 172.21.15.55:0/3591702020 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f022009af70 0x7f02200c8580 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f0210035040 tx=0x7f02100046c0 comp rx=0 tx=0).stop 2024-05-27T12:33:40.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.335+0000 7f02260a0640 1 -- 172.21.15.55:0/3591702020 shutdown_connections 2024-05-27T12:33:40.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.335+0000 7f02260a0640 1 --2- 172.21.15.55:0/3591702020 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f022015e520 0x7f02200b7eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:40.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.335+0000 7f02260a0640 1 --2- 172.21.15.55:0/3591702020 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f020c06c8f0 0x7f020c06edb0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:40.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.335+0000 7f02260a0640 1 --2- 172.21.15.55:0/3591702020 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f022015db80 0x7f02200b7970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:40.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.335+0000 7f02260a0640 1 --2- 172.21.15.55:0/3591702020 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f022009af70 0x7f02200c8580 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:40.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.335+0000 7f02260a0640 1 -- 172.21.15.55:0/3591702020 >> 172.21.15.55:0/3591702020 conn(0x7f02200b4190 msgr2=0x7f02200cecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:40.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.335+0000 7f02260a0640 1 -- 172.21.15.55:0/3591702020 shutdown_connections 2024-05-27T12:33:40.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.335+0000 7f02260a0640 1 -- 172.21.15.55:0/3591702020 wait complete. 2024-05-27T12:33:40.346 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":65,"stamp":"2024-05-27T12:33:39.275680+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":115,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":237096,"kb_used_data":4288,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737624,"statfs":{"total":773094113280,"available":772851326976,"internally_reserved":0,"allocated":4390912,"data_stored":2400788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.986444"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-27T12:33:36.321717+0000","last_change":"2024-05-27T12:33:36.314451+0000","last_active":"2024-05-27T12:33:36.321717+0000","last_peered":"2024-05-27T12:33:36.321717+0000","last_clean":"2024-05-27T12:33:36.321717+0000","last_became_active":"2024-05-27T12:33:36.314177+0000","last_became_peered":"2024-05-27T12:33:36.314177+0000","last_unstale":"2024-05-27T12:33:36.321717+0000","last_undegraded":"2024-05-27T12:33:36.321717+0000","last_fullsized":"2024-05-27T12:33:36.321717+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_clean_scrub_stamp":"2024-05-27T12:33:35.284230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:38:23.093549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T12:33:37.311949+0000","last_change":"2024-05-27T12:33:36.324212+0000","last_active":"2024-05-27T12:33:37.311949+0000","last_peered":"2024-05-27T12:33:37.311949+0000","last_clean":"2024-05-27T12:33:37.311949+0000","last_became_active":"2024-05-27T12:33:36.323915+0000","last_became_peered":"2024-05-27T12:33:36.323915+0000","last_unstale":"2024-05-27T12:33:37.311949+0000","last_undegraded":"2024-05-27T12:33:37.311949+0000","last_fullsized":"2024-05-27T12:33:37.311949+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_clean_scrub_stamp":"2024-05-27T12:33:35.284230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T23:04:17.935273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T12:33:37.972219+0000","last_change":"2024-05-27T12:33:36.328736+0000","last_active":"2024-05-27T12:33:37.972219+0000","last_peered":"2024-05-27T12:33:37.972219+0000","last_clean":"2024-05-27T12:33:37.972219+0000","last_became_active":"2024-05-27T12:33:36.328455+0000","last_became_peered":"2024-05-27T12:33:36.328455+0000","last_unstale":"2024-05-27T12:33:37.972219+0000","last_undegraded":"2024-05-27T12:33:37.972219+0000","last_fullsized":"2024-05-27T12:33:37.972219+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_clean_scrub_stamp":"2024-05-27T12:33:35.284230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:11:55.992630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-27T12:33:36.329640+0000","last_change":"2024-05-27T12:33:36.322811+0000","last_active":"2024-05-27T12:33:36.329640+0000","last_peered":"2024-05-27T12:33:36.329640+0000","last_clean":"2024-05-27T12:33:36.329640+0000","last_became_active":"2024-05-27T12:33:36.322276+0000","last_became_peered":"2024-05-27T12:33:36.322276+0000","last_unstale":"2024-05-27T12:33:36.329640+0000","last_undegraded":"2024-05-27T12:33:36.329640+0000","last_fullsized":"2024-05-27T12:33:36.329640+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_clean_scrub_stamp":"2024-05-27T12:33:35.284230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:03:37.356621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-27T12:33:36.331699+0000","last_change":"2024-05-27T12:33:36.329115+0000","last_active":"2024-05-27T12:33:36.331699+0000","last_peered":"2024-05-27T12:33:36.331699+0000","last_clean":"2024-05-27T12:33:36.331699+0000","last_became_active":"2024-05-27T12:33:36.328798+0000","last_became_peered":"2024-05-27T12:33:36.328798+0000","last_unstale":"2024-05-27T12:33:36.331699+0000","last_undegraded":"2024-05-27T12:33:36.331699+0000","last_fullsized":"2024-05-27T12:33:36.331699+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_clean_scrub_stamp":"2024-05-27T12:33:35.284230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T00:02:24.934808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T12:33:37.311554+0000","last_change":"2024-05-27T12:33:36.326859+0000","last_active":"2024-05-27T12:33:37.311554+0000","last_peered":"2024-05-27T12:33:37.311554+0000","last_clean":"2024-05-27T12:33:37.311554+0000","last_became_active":"2024-05-27T12:33:36.326513+0000","last_became_peered":"2024-05-27T12:33:36.326513+0000","last_unstale":"2024-05-27T12:33:37.311554+0000","last_undegraded":"2024-05-27T12:33:37.311554+0000","last_fullsized":"2024-05-27T12:33:37.311554+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_clean_scrub_stamp":"2024-05-27T12:33:35.284230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:11:55.992630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T12:33:37.311727+0000","last_change":"2024-05-27T12:33:36.311448+0000","last_active":"2024-05-27T12:33:37.311727+0000","last_peered":"2024-05-27T12:33:37.311727+0000","last_clean":"2024-05-27T12:33:37.311727+0000","last_became_active":"2024-05-27T12:33:36.311138+0000","last_became_peered":"2024-05-27T12:33:36.311138+0000","last_unstale":"2024-05-27T12:33:37.311727+0000","last_undegraded":"2024-05-27T12:33:37.311727+0000","last_fullsized":"2024-05-27T12:33:37.311727+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_clean_scrub_stamp":"2024-05-27T12:33:35.284230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:24:08.125844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T12:33:37.311397+0000","last_change":"2024-05-27T12:33:36.319549+0000","last_active":"2024-05-27T12:33:37.311397+0000","last_peered":"2024-05-27T12:33:37.311397+0000","last_clean":"2024-05-27T12:33:37.311397+0000","last_became_active":"2024-05-27T12:33:36.319090+0000","last_became_peered":"2024-05-27T12:33:36.319090+0000","last_unstale":"2024-05-27T12:33:37.311397+0000","last_undegraded":"2024-05-27T12:33:37.311397+0000","last_fullsized":"2024-05-27T12:33:37.311397+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_clean_scrub_stamp":"2024-05-27T12:33:35.284230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:46:24.593752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T12:33:38.115731+0000","last_change":"2024-05-27T12:33:36.324446+0000","last_active":"2024-05-27T12:33:38.115731+0000","last_peered":"2024-05-27T12:33:38.115731+0000","last_clean":"2024-05-27T12:33:38.115731+0000","last_became_active":"2024-05-27T12:33:36.324200+0000","last_became_peered":"2024-05-27T12:33:36.324200+0000","last_unstale":"2024-05-27T12:33:38.115731+0000","last_undegraded":"2024-05-27T12:33:38.115731+0000","last_fullsized":"2024-05-27T12:33:38.115731+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_clean_scrub_stamp":"2024-05-27T12:33:35.284230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:22:51.744439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-27T12:33:36.331190+0000","last_change":"2024-05-27T12:33:36.327389+0000","last_active":"2024-05-27T12:33:36.331190+0000","last_peered":"2024-05-27T12:33:36.331190+0000","last_clean":"2024-05-27T12:33:36.331190+0000","last_became_active":"2024-05-27T12:33:36.327053+0000","last_became_peered":"2024-05-27T12:33:36.327053+0000","last_unstale":"2024-05-27T12:33:36.331190+0000","last_undegraded":"2024-05-27T12:33:36.331190+0000","last_fullsized":"2024-05-27T12:33:36.331190+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_clean_scrub_stamp":"2024-05-27T12:33:35.284230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:02:08.391560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T12:33:37.312087+0000","last_change":"2024-05-27T12:33:36.332697+0000","last_active":"2024-05-27T12:33:37.312087+0000","last_peered":"2024-05-27T12:33:37.312087+0000","last_clean":"2024-05-27T12:33:37.312087+0000","last_became_active":"2024-05-27T12:33:36.332453+0000","last_became_peered":"2024-05-27T12:33:36.332453+0000","last_unstale":"2024-05-27T12:33:37.312087+0000","last_undegraded":"2024-05-27T12:33:37.312087+0000","last_fullsized":"2024-05-27T12:33:37.312087+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_clean_scrub_stamp":"2024-05-27T12:33:35.284230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:50:34.508404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T12:33:37.972111+0000","last_change":"2024-05-27T12:33:36.325434+0000","last_active":"2024-05-27T12:33:37.972111+0000","last_peered":"2024-05-27T12:33:37.972111+0000","last_clean":"2024-05-27T12:33:37.972111+0000","last_became_active":"2024-05-27T12:33:36.325127+0000","last_became_peered":"2024-05-27T12:33:36.325127+0000","last_unstale":"2024-05-27T12:33:37.972111+0000","last_undegraded":"2024-05-27T12:33:37.972111+0000","last_fullsized":"2024-05-27T12:33:37.972111+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_clean_scrub_stamp":"2024-05-27T12:33:35.284230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:33:51.478610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-27T12:33:36.331721+0000","last_change":"2024-05-27T12:33:36.330391+0000","last_active":"2024-05-27T12:33:36.331721+0000","last_peered":"2024-05-27T12:33:36.331721+0000","last_clean":"2024-05-27T12:33:36.331721+0000","last_became_active":"2024-05-27T12:33:36.330057+0000","last_became_peered":"2024-05-27T12:33:36.330057+0000","last_unstale":"2024-05-27T12:33:36.331721+0000","last_undegraded":"2024-05-27T12:33:36.331721+0000","last_fullsized":"2024-05-27T12:33:36.331721+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_clean_scrub_stamp":"2024-05-27T12:33:35.284230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:12:39.137537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T12:33:37.311755+0000","last_change":"2024-05-27T12:33:36.328825+0000","last_active":"2024-05-27T12:33:37.311755+0000","last_peered":"2024-05-27T12:33:37.311755+0000","last_clean":"2024-05-27T12:33:37.311755+0000","last_became_active":"2024-05-27T12:33:36.328544+0000","last_became_peered":"2024-05-27T12:33:36.328544+0000","last_unstale":"2024-05-27T12:33:37.311755+0000","last_undegraded":"2024-05-27T12:33:37.311755+0000","last_fullsized":"2024-05-27T12:33:37.311755+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_clean_scrub_stamp":"2024-05-27T12:33:35.284230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:04:18.874449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T12:33:37.972000+0000","last_change":"2024-05-27T12:33:36.313315+0000","last_active":"2024-05-27T12:33:37.972000+0000","last_peered":"2024-05-27T12:33:37.972000+0000","last_clean":"2024-05-27T12:33:37.972000+0000","last_became_active":"2024-05-27T12:33:36.312057+0000","last_became_peered":"2024-05-27T12:33:36.312057+0000","last_unstale":"2024-05-27T12:33:37.972000+0000","last_undegraded":"2024-05-27T12:33:37.972000+0000","last_fullsized":"2024-05-27T12:33:37.972000+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_clean_scrub_stamp":"2024-05-27T12:33:35.284230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:59:00.013617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T12:33:37.311928+0000","last_change":"2024-05-27T12:33:36.328082+0000","last_active":"2024-05-27T12:33:37.311928+0000","last_peered":"2024-05-27T12:33:37.311928+0000","last_clean":"2024-05-27T12:33:37.311928+0000","last_became_active":"2024-05-27T12:33:36.327813+0000","last_became_peered":"2024-05-27T12:33:36.327813+0000","last_unstale":"2024-05-27T12:33:37.311928+0000","last_undegraded":"2024-05-27T12:33:37.311928+0000","last_fullsized":"2024-05-27T12:33:37.311928+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_clean_scrub_stamp":"2024-05-27T12:33:35.284230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:11:55.992630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T12:33:37.312069+0000","last_change":"2024-05-27T12:33:36.313580+0000","last_active":"2024-05-27T12:33:37.312069+0000","last_peered":"2024-05-27T12:33:37.312069+0000","last_clean":"2024-05-27T12:33:37.312069+0000","last_became_active":"2024-05-27T12:33:36.313278+0000","last_became_peered":"2024-05-27T12:33:36.313278+0000","last_unstale":"2024-05-27T12:33:37.312069+0000","last_undegraded":"2024-05-27T12:33:37.312069+0000","last_fullsized":"2024-05-27T12:33:37.312069+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_clean_scrub_stamp":"2024-05-27T12:33:35.284230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:20:39.722410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T12:33:37.312017+0000","last_change":"2024-05-27T12:33:36.333650+0000","last_active":"2024-05-27T12:33:37.312017+0000","last_peered":"2024-05-27T12:33:37.312017+0000","last_clean":"2024-05-27T12:33:37.312017+0000","last_became_active":"2024-05-27T12:33:36.333341+0000","last_became_peered":"2024-05-27T12:33:36.333341+0000","last_unstale":"2024-05-27T12:33:37.312017+0000","last_undegraded":"2024-05-27T12:33:37.312017+0000","last_fullsized":"2024-05-27T12:33:37.312017+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_clean_scrub_stamp":"2024-05-27T12:33:35.284230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:44:57.296713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T12:33:37.311624+0000","last_change":"2024-05-27T12:33:36.333189+0000","last_active":"2024-05-27T12:33:37.311624+0000","last_peered":"2024-05-27T12:33:37.311624+0000","last_clean":"2024-05-27T12:33:37.311624+0000","last_became_active":"2024-05-27T12:33:36.332890+0000","last_became_peered":"2024-05-27T12:33:36.332890+0000","last_unstale":"2024-05-27T12:33:37.311624+0000","last_undegraded":"2024-05-27T12:33:37.311624+0000","last_fullsized":"2024-05-27T12:33:37.311624+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_clean_scrub_stamp":"2024-05-27T12:33:35.284230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:20:39.722410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-27T12:33:36.320219+0000","last_change":"2024-05-27T12:33:36.318712+0000","last_active":"2024-05-27T12:33:36.320219+0000","last_peered":"2024-05-27T12:33:36.320219+0000","last_clean":"2024-05-27T12:33:36.320219+0000","last_became_active":"2024-05-27T12:33:36.318408+0000","last_became_peered":"2024-05-27T12:33:36.318408+0000","last_unstale":"2024-05-27T12:33:36.320219+0000","last_undegraded":"2024-05-27T12:33:36.320219+0000","last_fullsized":"2024-05-27T12:33:36.320219+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_clean_scrub_stamp":"2024-05-27T12:33:35.284230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:02:09.081005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T12:33:38.115287+0000","last_change":"2024-05-27T12:33:36.319791+0000","last_active":"2024-05-27T12:33:38.115287+0000","last_peered":"2024-05-27T12:33:38.115287+0000","last_clean":"2024-05-27T12:33:38.115287+0000","last_became_active":"2024-05-27T12:33:36.319283+0000","last_became_peered":"2024-05-27T12:33:36.319283+0000","last_unstale":"2024-05-27T12:33:38.115287+0000","last_undegraded":"2024-05-27T12:33:38.115287+0000","last_fullsized":"2024-05-27T12:33:38.115287+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_clean_scrub_stamp":"2024-05-27T12:33:35.284230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:09:32.352795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T12:33:38.115398+0000","last_change":"2024-05-27T12:33:36.327923+0000","last_active":"2024-05-27T12:33:38.115398+0000","last_peered":"2024-05-27T12:33:38.115398+0000","last_clean":"2024-05-27T12:33:38.115398+0000","last_became_active":"2024-05-27T12:33:36.327586+0000","last_became_peered":"2024-05-27T12:33:36.327586+0000","last_unstale":"2024-05-27T12:33:38.115398+0000","last_undegraded":"2024-05-27T12:33:38.115398+0000","last_fullsized":"2024-05-27T12:33:38.115398+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_clean_scrub_stamp":"2024-05-27T12:33:35.284230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:06:13.907502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-27T12:33:36.314165+0000","last_change":"2024-05-27T12:33:36.306325+0000","last_active":"2024-05-27T12:33:36.314165+0000","last_peered":"2024-05-27T12:33:36.314165+0000","last_clean":"2024-05-27T12:33:36.314165+0000","last_became_active":"2024-05-27T12:33:36.306013+0000","last_became_peered":"2024-05-27T12:33:36.306013+0000","last_unstale":"2024-05-27T12:33:36.314165+0000","last_undegraded":"2024-05-27T12:33:36.314165+0000","last_fullsized":"2024-05-27T12:33:36.314165+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_clean_scrub_stamp":"2024-05-27T12:33:35.284230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:43:40.211652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T12:33:37.971858+0000","last_change":"2024-05-27T12:33:36.320108+0000","last_active":"2024-05-27T12:33:37.971858+0000","last_peered":"2024-05-27T12:33:37.971858+0000","last_clean":"2024-05-27T12:33:37.971858+0000","last_became_active":"2024-05-27T12:33:36.319762+0000","last_became_peered":"2024-05-27T12:33:36.319762+0000","last_unstale":"2024-05-27T12:33:37.971858+0000","last_undegraded":"2024-05-27T12:33:37.971858+0000","last_fullsized":"2024-05-27T12:33:37.971858+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_clean_scrub_stamp":"2024-05-27T12:33:35.284230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:31:43.112287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-27T12:33:36.329668+0000","last_change":"2024-05-27T12:33:36.323576+0000","last_active":"2024-05-27T12:33:36.329668+0000","last_peered":"2024-05-27T12:33:36.329668+0000","last_clean":"2024-05-27T12:33:36.329668+0000","last_became_active":"2024-05-27T12:33:36.322574+0000","last_became_peered":"2024-05-27T12:33:36.322574+0000","last_unstale":"2024-05-27T12:33:36.329668+0000","last_undegraded":"2024-05-27T12:33:36.329668+0000","last_fullsized":"2024-05-27T12:33:36.329668+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_clean_scrub_stamp":"2024-05-27T12:33:35.284230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:22:51.744439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T12:33:37.312067+0000","last_change":"2024-05-27T12:33:36.324845+0000","last_active":"2024-05-27T12:33:37.312067+0000","last_peered":"2024-05-27T12:33:37.312067+0000","last_clean":"2024-05-27T12:33:37.312067+0000","last_became_active":"2024-05-27T12:33:36.324518+0000","last_became_peered":"2024-05-27T12:33:36.324518+0000","last_unstale":"2024-05-27T12:33:37.312067+0000","last_undegraded":"2024-05-27T12:33:37.312067+0000","last_fullsized":"2024-05-27T12:33:37.312067+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_clean_scrub_stamp":"2024-05-27T12:33:35.284230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:29:51.086297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-27T12:33:36.329554+0000","last_change":"2024-05-27T12:33:36.325559+0000","last_active":"2024-05-27T12:33:36.329554+0000","last_peered":"2024-05-27T12:33:36.329554+0000","last_clean":"2024-05-27T12:33:36.329554+0000","last_became_active":"2024-05-27T12:33:36.322470+0000","last_became_peered":"2024-05-27T12:33:36.322470+0000","last_unstale":"2024-05-27T12:33:36.329554+0000","last_undegraded":"2024-05-27T12:33:36.329554+0000","last_fullsized":"2024-05-27T12:33:36.329554+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_clean_scrub_stamp":"2024-05-27T12:33:35.284230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:51:23.021358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T12:33:37.972205+0000","last_change":"2024-05-27T12:33:36.315499+0000","last_active":"2024-05-27T12:33:37.972205+0000","last_peered":"2024-05-27T12:33:37.972205+0000","last_clean":"2024-05-27T12:33:37.972205+0000","last_became_active":"2024-05-27T12:33:36.315224+0000","last_became_peered":"2024-05-27T12:33:36.315224+0000","last_unstale":"2024-05-27T12:33:37.972205+0000","last_undegraded":"2024-05-27T12:33:37.972205+0000","last_fullsized":"2024-05-27T12:33:37.972205+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_clean_scrub_stamp":"2024-05-27T12:33:35.284230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:21:33.852199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T12:33:38.115361+0000","last_change":"2024-05-27T12:33:36.327853+0000","last_active":"2024-05-27T12:33:38.115361+0000","last_peered":"2024-05-27T12:33:38.115361+0000","last_clean":"2024-05-27T12:33:38.115361+0000","last_became_active":"2024-05-27T12:33:36.327568+0000","last_became_peered":"2024-05-27T12:33:36.327568+0000","last_unstale":"2024-05-27T12:33:38.115361+0000","last_undegraded":"2024-05-27T12:33:38.115361+0000","last_fullsized":"2024-05-27T12:33:38.115361+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_clean_scrub_stamp":"2024-05-27T12:33:35.284230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:49:40.768251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T12:33:37.311532+0000","last_change":"2024-05-27T12:33:36.313675+0000","last_active":"2024-05-27T12:33:37.311532+0000","last_peered":"2024-05-27T12:33:37.311532+0000","last_clean":"2024-05-27T12:33:37.311532+0000","last_became_active":"2024-05-27T12:33:36.313361+0000","last_became_peered":"2024-05-27T12:33:36.313361+0000","last_unstale":"2024-05-27T12:33:37.311532+0000","last_undegraded":"2024-05-27T12:33:37.311532+0000","last_fullsized":"2024-05-27T12:33:37.311532+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_clean_scrub_stamp":"2024-05-27T12:33:35.284230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:31:43.112287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-27T12:33:36.329336+0000","last_change":"2024-05-27T12:33:36.325512+0000","last_active":"2024-05-27T12:33:36.329336+0000","last_peered":"2024-05-27T12:33:36.329336+0000","last_clean":"2024-05-27T12:33:36.329336+0000","last_became_active":"2024-05-27T12:33:36.324670+0000","last_became_peered":"2024-05-27T12:33:36.324670+0000","last_unstale":"2024-05-27T12:33:36.329336+0000","last_undegraded":"2024-05-27T12:33:36.329336+0000","last_fullsized":"2024-05-27T12:33:36.329336+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_clean_scrub_stamp":"2024-05-27T12:33:35.284230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:09:32.352795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T12:33:37.311742+0000","last_change":"2024-05-27T12:33:36.314614+0000","last_active":"2024-05-27T12:33:37.311742+0000","last_peered":"2024-05-27T12:33:37.311742+0000","last_clean":"2024-05-27T12:33:37.311742+0000","last_became_active":"2024-05-27T12:33:36.314350+0000","last_became_peered":"2024-05-27T12:33:36.314350+0000","last_unstale":"2024-05-27T12:33:37.311742+0000","last_undegraded":"2024-05-27T12:33:37.311742+0000","last_fullsized":"2024-05-27T12:33:37.311742+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_clean_scrub_stamp":"2024-05-27T12:33:35.284230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:21:33.852199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-27T12:33:36.314202+0000","last_change":"2024-05-27T12:33:36.306672+0000","last_active":"2024-05-27T12:33:36.314202+0000","last_peered":"2024-05-27T12:33:36.314202+0000","last_clean":"2024-05-27T12:33:36.314202+0000","last_became_active":"2024-05-27T12:33:36.306375+0000","last_became_peered":"2024-05-27T12:33:36.306375+0000","last_unstale":"2024-05-27T12:33:36.314202+0000","last_undegraded":"2024-05-27T12:33:36.314202+0000","last_fullsized":"2024-05-27T12:33:36.314202+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_clean_scrub_stamp":"2024-05-27T12:33:35.284230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:15:22.260330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"35'4","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-27T12:33:36.324704+0000","last_change":"2024-05-27T12:33:35.325498+0000","last_active":"2024-05-27T12:33:36.324704+0000","last_peered":"2024-05-27T12:33:36.324704+0000","last_clean":"2024-05-27T12:33:36.324704+0000","last_became_active":"2024-05-27T12:33:35.325214+0000","last_became_peered":"2024-05-27T12:33:35.325214+0000","last_unstale":"2024-05-27T12:33:36.324704+0000","last_undegraded":"2024-05-27T12:33:36.324704+0000","last_fullsized":"2024-05-27T12:33:36.324704+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:34.272777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:34.272777+0000","last_clean_scrub_stamp":"2024-05-27T12:33:34.272777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:38:59.846163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-27T12:33:36.321741+0000","last_change":"2024-05-27T12:33:36.317427+0000","last_active":"2024-05-27T12:33:36.321741+0000","last_peered":"2024-05-27T12:33:36.321741+0000","last_clean":"2024-05-27T12:33:36.321741+0000","last_became_active":"2024-05-27T12:33:36.317144+0000","last_became_peered":"2024-05-27T12:33:36.317144+0000","last_unstale":"2024-05-27T12:33:36.321741+0000","last_undegraded":"2024-05-27T12:33:36.321741+0000","last_fullsized":"2024-05-27T12:33:36.321741+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_clean_scrub_stamp":"2024-05-27T12:33:35.284230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:52:27.285148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"35'1","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-27T12:33:36.321464+0000","last_change":"2024-05-27T12:33:35.314393+0000","last_active":"2024-05-27T12:33:36.321464+0000","last_peered":"2024-05-27T12:33:36.321464+0000","last_clean":"2024-05-27T12:33:36.321464+0000","last_became_active":"2024-05-27T12:33:35.314063+0000","last_became_peered":"2024-05-27T12:33:35.314063+0000","last_unstale":"2024-05-27T12:33:36.321464+0000","last_undegraded":"2024-05-27T12:33:36.321464+0000","last_fullsized":"2024-05-27T12:33:36.321464+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:34.272777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:34.272777+0000","last_clean_scrub_stamp":"2024-05-27T12:33:34.272777+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:47:34.570227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T12:33:38.115504+0000","last_change":"2024-05-27T12:33:36.326414+0000","last_active":"2024-05-27T12:33:38.115504+0000","last_peered":"2024-05-27T12:33:38.115504+0000","last_clean":"2024-05-27T12:33:38.115504+0000","last_became_active":"2024-05-27T12:33:36.326040+0000","last_became_peered":"2024-05-27T12:33:36.326040+0000","last_unstale":"2024-05-27T12:33:38.115504+0000","last_undegraded":"2024-05-27T12:33:38.115504+0000","last_fullsized":"2024-05-27T12:33:38.115504+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_clean_scrub_stamp":"2024-05-27T12:33:35.284230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:22:49.224603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"35'2","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T12:33:37.311766+0000","last_change":"2024-05-27T12:33:35.314814+0000","last_active":"2024-05-27T12:33:37.311766+0000","last_peered":"2024-05-27T12:33:37.311766+0000","last_clean":"2024-05-27T12:33:37.311766+0000","last_became_active":"2024-05-27T12:33:35.314233+0000","last_became_peered":"2024-05-27T12:33:35.314233+0000","last_unstale":"2024-05-27T12:33:37.311766+0000","last_undegraded":"2024-05-27T12:33:37.311766+0000","last_fullsized":"2024-05-27T12:33:37.311766+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:34.272777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:34.272777+0000","last_clean_scrub_stamp":"2024-05-27T12:33:34.272777+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:03:36.345169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-27T12:33:36.329518+0000","last_change":"2024-05-27T12:33:36.318145+0000","last_active":"2024-05-27T12:33:36.329518+0000","last_peered":"2024-05-27T12:33:36.329518+0000","last_clean":"2024-05-27T12:33:36.329518+0000","last_became_active":"2024-05-27T12:33:36.317383+0000","last_became_peered":"2024-05-27T12:33:36.317383+0000","last_unstale":"2024-05-27T12:33:36.329518+0000","last_undegraded":"2024-05-27T12:33:36.329518+0000","last_fullsized":"2024-05-27T12:33:36.329518+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_clean_scrub_stamp":"2024-05-27T12:33:35.284230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:49:40.768251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"35'2","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-27T12:33:36.328317+0000","last_change":"2024-05-27T12:33:35.315563+0000","last_active":"2024-05-27T12:33:36.328317+0000","last_peered":"2024-05-27T12:33:36.328317+0000","last_clean":"2024-05-27T12:33:36.328317+0000","last_became_active":"2024-05-27T12:33:35.314709+0000","last_became_peered":"2024-05-27T12:33:35.314709+0000","last_unstale":"2024-05-27T12:33:36.328317+0000","last_undegraded":"2024-05-27T12:33:36.328317+0000","last_fullsized":"2024-05-27T12:33:36.328317+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:34.272777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:34.272777+0000","last_clean_scrub_stamp":"2024-05-27T12:33:34.272777+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:50:12.109735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T12:33:37.311727+0000","last_change":"2024-05-27T12:33:36.315414+0000","last_active":"2024-05-27T12:33:37.311727+0000","last_peered":"2024-05-27T12:33:37.311727+0000","last_clean":"2024-05-27T12:33:37.311727+0000","last_became_active":"2024-05-27T12:33:36.315114+0000","last_became_peered":"2024-05-27T12:33:36.315114+0000","last_unstale":"2024-05-27T12:33:37.311727+0000","last_undegraded":"2024-05-27T12:33:37.311727+0000","last_fullsized":"2024-05-27T12:33:37.311727+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_clean_scrub_stamp":"2024-05-27T12:33:35.284230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:33:51.478610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"35'1","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T12:33:38.115495+0000","last_change":"2024-05-27T12:33:35.320535+0000","last_active":"2024-05-27T12:33:38.115495+0000","last_peered":"2024-05-27T12:33:38.115495+0000","last_clean":"2024-05-27T12:33:38.115495+0000","last_became_active":"2024-05-27T12:33:35.319915+0000","last_became_peered":"2024-05-27T12:33:35.319915+0000","last_unstale":"2024-05-27T12:33:38.115495+0000","last_undegraded":"2024-05-27T12:33:38.115495+0000","last_fullsized":"2024-05-27T12:33:38.115495+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:34.272777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:34.272777+0000","last_clean_scrub_stamp":"2024-05-27T12:33:34.272777+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:46:09.692663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T12:33:37.972028+0000","last_change":"2024-05-27T12:33:36.318608+0000","last_active":"2024-05-27T12:33:37.972028+0000","last_peered":"2024-05-27T12:33:37.972028+0000","last_clean":"2024-05-27T12:33:37.972028+0000","last_became_active":"2024-05-27T12:33:36.318259+0000","last_became_peered":"2024-05-27T12:33:36.318259+0000","last_unstale":"2024-05-27T12:33:37.972028+0000","last_undegraded":"2024-05-27T12:33:37.972028+0000","last_fullsized":"2024-05-27T12:33:37.972028+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_clean_scrub_stamp":"2024-05-27T12:33:35.284230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:43:50.999505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"35'1","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T12:33:38.115254+0000","last_change":"2024-05-27T12:33:35.320312+0000","last_active":"2024-05-27T12:33:38.115254+0000","last_peered":"2024-05-27T12:33:38.115254+0000","last_clean":"2024-05-27T12:33:38.115254+0000","last_became_active":"2024-05-27T12:33:35.319822+0000","last_became_peered":"2024-05-27T12:33:35.319822+0000","last_unstale":"2024-05-27T12:33:38.115254+0000","last_undegraded":"2024-05-27T12:33:38.115254+0000","last_fullsized":"2024-05-27T12:33:38.115254+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:34.272777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:34.272777+0000","last_clean_scrub_stamp":"2024-05-27T12:33:34.272777+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:08:20.272945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T12:33:38.115209+0000","last_change":"2024-05-27T12:33:36.311305+0000","last_active":"2024-05-27T12:33:38.115209+0000","last_peered":"2024-05-27T12:33:38.115209+0000","last_clean":"2024-05-27T12:33:38.115209+0000","last_became_active":"2024-05-27T12:33:36.310641+0000","last_became_peered":"2024-05-27T12:33:36.310641+0000","last_unstale":"2024-05-27T12:33:38.115209+0000","last_undegraded":"2024-05-27T12:33:38.115209+0000","last_fullsized":"2024-05-27T12:33:38.115209+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_clean_scrub_stamp":"2024-05-27T12:33:35.284230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:59:08.435274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T12:33:37.311551+0000","last_change":"2024-05-27T12:33:35.311498+0000","last_active":"2024-05-27T12:33:37.311551+0000","last_peered":"2024-05-27T12:33:37.311551+0000","last_clean":"2024-05-27T12:33:37.311551+0000","last_became_active":"2024-05-27T12:33:35.311196+0000","last_became_peered":"2024-05-27T12:33:35.311196+0000","last_unstale":"2024-05-27T12:33:37.311551+0000","last_undegraded":"2024-05-27T12:33:37.311551+0000","last_fullsized":"2024-05-27T12:33:37.311551+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:34.272777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:34.272777+0000","last_clean_scrub_stamp":"2024-05-27T12:33:34.272777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:51:22.009905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-27T12:33:36.326610+0000","last_change":"2024-05-27T12:33:36.315292+0000","last_active":"2024-05-27T12:33:36.326610+0000","last_peered":"2024-05-27T12:33:36.326610+0000","last_clean":"2024-05-27T12:33:36.326610+0000","last_became_active":"2024-05-27T12:33:36.315029+0000","last_became_peered":"2024-05-27T12:33:36.315029+0000","last_unstale":"2024-05-27T12:33:36.326610+0000","last_undegraded":"2024-05-27T12:33:36.326610+0000","last_fullsized":"2024-05-27T12:33:36.326610+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_clean_scrub_stamp":"2024-05-27T12:33:35.284230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:09:32.352795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T12:33:38.115104+0000","last_change":"2024-05-27T12:33:35.318492+0000","last_active":"2024-05-27T12:33:38.115104+0000","last_peered":"2024-05-27T12:33:38.115104+0000","last_clean":"2024-05-27T12:33:38.115104+0000","last_became_active":"2024-05-27T12:33:35.318106+0000","last_became_peered":"2024-05-27T12:33:35.318106+0000","last_unstale":"2024-05-27T12:33:38.115104+0000","last_undegraded":"2024-05-27T12:33:38.115104+0000","last_fullsized":"2024-05-27T12:33:38.115104+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:34.272777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:34.272777+0000","last_clean_scrub_stamp":"2024-05-27T12:33:34.272777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:35:42.639120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T12:33:37.972293+0000","last_change":"2024-05-27T12:33:36.325529+0000","last_active":"2024-05-27T12:33:37.972293+0000","last_peered":"2024-05-27T12:33:37.972293+0000","last_clean":"2024-05-27T12:33:37.972293+0000","last_became_active":"2024-05-27T12:33:36.325107+0000","last_became_peered":"2024-05-27T12:33:36.325107+0000","last_unstale":"2024-05-27T12:33:37.972293+0000","last_undegraded":"2024-05-27T12:33:37.972293+0000","last_fullsized":"2024-05-27T12:33:37.972293+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_clean_scrub_stamp":"2024-05-27T12:33:35.284230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:20:39.722410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T12:33:37.311929+0000","last_change":"2024-05-27T12:33:35.312728+0000","last_active":"2024-05-27T12:33:37.311929+0000","last_peered":"2024-05-27T12:33:37.311929+0000","last_clean":"2024-05-27T12:33:37.311929+0000","last_became_active":"2024-05-27T12:33:35.312406+0000","last_became_peered":"2024-05-27T12:33:35.312406+0000","last_unstale":"2024-05-27T12:33:37.311929+0000","last_undegraded":"2024-05-27T12:33:37.311929+0000","last_fullsized":"2024-05-27T12:33:37.311929+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:34.272777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:34.272777+0000","last_clean_scrub_stamp":"2024-05-27T12:33:34.272777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:22:48.213150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T12:33:37.311983+0000","last_change":"2024-05-27T12:33:36.333681+0000","last_active":"2024-05-27T12:33:37.311983+0000","last_peered":"2024-05-27T12:33:37.311983+0000","last_clean":"2024-05-27T12:33:37.311983+0000","last_became_active":"2024-05-27T12:33:36.333313+0000","last_became_peered":"2024-05-27T12:33:36.333313+0000","last_unstale":"2024-05-27T12:33:37.311983+0000","last_undegraded":"2024-05-27T12:33:37.311983+0000","last_fullsized":"2024-05-27T12:33:37.311983+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_clean_scrub_stamp":"2024-05-27T12:33:35.284230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:09:06.683768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-27T12:33:36.302004+0000","last_change":"2024-05-27T12:33:35.320305+0000","last_active":"2024-05-27T12:33:36.302004+0000","last_peered":"2024-05-27T12:33:36.302004+0000","last_clean":"2024-05-27T12:33:36.302004+0000","last_became_active":"2024-05-27T12:33:35.320024+0000","last_became_peered":"2024-05-27T12:33:35.320024+0000","last_unstale":"2024-05-27T12:33:36.302004+0000","last_undegraded":"2024-05-27T12:33:36.302004+0000","last_fullsized":"2024-05-27T12:33:36.302004+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:34.272777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:34.272777+0000","last_clean_scrub_stamp":"2024-05-27T12:33:34.272777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:14:17.404607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T12:33:37.311911+0000","last_change":"2024-05-27T12:33:36.325808+0000","last_active":"2024-05-27T12:33:37.311911+0000","last_peered":"2024-05-27T12:33:37.311911+0000","last_clean":"2024-05-27T12:33:37.311911+0000","last_became_active":"2024-05-27T12:33:36.325178+0000","last_became_peered":"2024-05-27T12:33:36.325178+0000","last_unstale":"2024-05-27T12:33:37.311911+0000","last_undegraded":"2024-05-27T12:33:37.311911+0000","last_fullsized":"2024-05-27T12:33:37.311911+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_clean_scrub_stamp":"2024-05-27T12:33:35.284230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T23:26:05.295795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"35'3","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T12:33:37.972263+0000","last_change":"2024-05-27T12:33:35.313239+0000","last_active":"2024-05-27T12:33:37.972263+0000","last_peered":"2024-05-27T12:33:37.972263+0000","last_clean":"2024-05-27T12:33:37.972263+0000","last_became_active":"2024-05-27T12:33:35.312930+0000","last_became_peered":"2024-05-27T12:33:35.312930+0000","last_unstale":"2024-05-27T12:33:37.972263+0000","last_undegraded":"2024-05-27T12:33:37.972263+0000","last_fullsized":"2024-05-27T12:33:37.972263+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:34.272777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:34.272777+0000","last_clean_scrub_stamp":"2024-05-27T12:33:34.272777+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:03:36.345169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T12:33:37.972096+0000","last_change":"2024-05-27T12:33:36.328533+0000","last_active":"2024-05-27T12:33:37.972096+0000","last_peered":"2024-05-27T12:33:37.972096+0000","last_clean":"2024-05-27T12:33:37.972096+0000","last_became_active":"2024-05-27T12:33:36.328248+0000","last_became_peered":"2024-05-27T12:33:36.328248+0000","last_unstale":"2024-05-27T12:33:37.972096+0000","last_undegraded":"2024-05-27T12:33:37.972096+0000","last_fullsized":"2024-05-27T12:33:37.972096+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_clean_scrub_stamp":"2024-05-27T12:33:35.284230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:24:08.125844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"35'6","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T12:33:37.311793+0000","last_change":"2024-05-27T12:33:35.319748+0000","last_active":"2024-05-27T12:33:37.311793+0000","last_peered":"2024-05-27T12:33:37.311793+0000","last_clean":"2024-05-27T12:33:37.311793+0000","last_became_active":"2024-05-27T12:33:35.319418+0000","last_became_peered":"2024-05-27T12:33:35.319418+0000","last_unstale":"2024-05-27T12:33:37.311793+0000","last_undegraded":"2024-05-27T12:33:37.311793+0000","last_fullsized":"2024-05-27T12:33:37.311793+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:34.272777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:34.272777+0000","last_clean_scrub_stamp":"2024-05-27T12:33:34.272777+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:28:51.377628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-27T12:33:36.329974+0000","last_change":"2024-05-27T12:33:36.319991+0000","last_active":"2024-05-27T12:33:36.329974+0000","last_peered":"2024-05-27T12:33:36.329974+0000","last_clean":"2024-05-27T12:33:36.329974+0000","last_became_active":"2024-05-27T12:33:36.319698+0000","last_became_peered":"2024-05-27T12:33:36.319698+0000","last_unstale":"2024-05-27T12:33:36.329974+0000","last_undegraded":"2024-05-27T12:33:36.329974+0000","last_fullsized":"2024-05-27T12:33:36.329974+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_clean_scrub_stamp":"2024-05-27T12:33:35.284230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:06:13.907502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"35'2","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T12:33:38.115581+0000","last_change":"2024-05-27T12:33:35.320983+0000","last_active":"2024-05-27T12:33:38.115581+0000","last_peered":"2024-05-27T12:33:38.115581+0000","last_clean":"2024-05-27T12:33:38.115581+0000","last_became_active":"2024-05-27T12:33:35.320659+0000","last_became_peered":"2024-05-27T12:33:35.320659+0000","last_unstale":"2024-05-27T12:33:38.115581+0000","last_undegraded":"2024-05-27T12:33:38.115581+0000","last_fullsized":"2024-05-27T12:33:38.115581+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:34.272777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:34.272777+0000","last_clean_scrub_stamp":"2024-05-27T12:33:34.272777+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T23:02:56.767466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T12:33:37.311735+0000","last_change":"2024-05-27T12:33:36.321242+0000","last_active":"2024-05-27T12:33:37.311735+0000","last_peered":"2024-05-27T12:33:37.311735+0000","last_clean":"2024-05-27T12:33:37.311735+0000","last_became_active":"2024-05-27T12:33:36.320354+0000","last_became_peered":"2024-05-27T12:33:36.320354+0000","last_unstale":"2024-05-27T12:33:37.311735+0000","last_undegraded":"2024-05-27T12:33:37.311735+0000","last_fullsized":"2024-05-27T12:33:37.311735+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_clean_scrub_stamp":"2024-05-27T12:33:35.284230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:50:34.508404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-27T12:33:36.306370+0000","last_change":"2024-05-27T12:33:35.321157+0000","last_active":"2024-05-27T12:33:36.306370+0000","last_peered":"2024-05-27T12:33:36.306370+0000","last_clean":"2024-05-27T12:33:36.306370+0000","last_became_active":"2024-05-27T12:33:35.320866+0000","last_became_peered":"2024-05-27T12:33:35.320866+0000","last_unstale":"2024-05-27T12:33:36.306370+0000","last_undegraded":"2024-05-27T12:33:36.306370+0000","last_fullsized":"2024-05-27T12:33:36.306370+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:34.272777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:34.272777+0000","last_clean_scrub_stamp":"2024-05-27T12:33:34.272777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:47:17.699647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T12:33:37.311661+0000","last_change":"2024-05-27T12:33:36.312816+0000","last_active":"2024-05-27T12:33:37.311661+0000","last_peered":"2024-05-27T12:33:37.311661+0000","last_clean":"2024-05-27T12:33:37.311661+0000","last_became_active":"2024-05-27T12:33:36.312563+0000","last_became_peered":"2024-05-27T12:33:36.312563+0000","last_unstale":"2024-05-27T12:33:37.311661+0000","last_undegraded":"2024-05-27T12:33:37.311661+0000","last_fullsized":"2024-05-27T12:33:37.311661+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_clean_scrub_stamp":"2024-05-27T12:33:35.284230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:43:50.999505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T12:33:37.311394+0000","last_change":"2024-05-27T12:33:35.312264+0000","last_active":"2024-05-27T12:33:37.311394+0000","last_peered":"2024-05-27T12:33:37.311394+0000","last_clean":"2024-05-27T12:33:37.311394+0000","last_became_active":"2024-05-27T12:33:35.312009+0000","last_became_peered":"2024-05-27T12:33:35.312009+0000","last_unstale":"2024-05-27T12:33:37.311394+0000","last_undegraded":"2024-05-27T12:33:37.311394+0000","last_fullsized":"2024-05-27T12:33:37.311394+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:34.272777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:34.272777+0000","last_clean_scrub_stamp":"2024-05-27T12:33:34.272777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:36:03.625091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-27T12:33:36.321669+0000","last_change":"2024-05-27T12:33:36.313860+0000","last_active":"2024-05-27T12:33:36.321669+0000","last_peered":"2024-05-27T12:33:36.321669+0000","last_clean":"2024-05-27T12:33:36.321669+0000","last_became_active":"2024-05-27T12:33:36.313599+0000","last_became_peered":"2024-05-27T12:33:36.313599+0000","last_unstale":"2024-05-27T12:33:36.321669+0000","last_undegraded":"2024-05-27T12:33:36.321669+0000","last_fullsized":"2024-05-27T12:33:36.321669+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_clean_scrub_stamp":"2024-05-27T12:33:35.284230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:47:18.711099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"35'8","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T12:33:37.311453+0000","last_change":"2024-05-27T12:33:35.315350+0000","last_active":"2024-05-27T12:33:37.311453+0000","last_peered":"2024-05-27T12:33:37.311453+0000","last_clean":"2024-05-27T12:33:37.311453+0000","last_became_active":"2024-05-27T12:33:35.315062+0000","last_became_peered":"2024-05-27T12:33:35.315062+0000","last_unstale":"2024-05-27T12:33:37.311453+0000","last_undegraded":"2024-05-27T12:33:37.311453+0000","last_fullsized":"2024-05-27T12:33:37.311453+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:34.272777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:34.272777+0000","last_clean_scrub_stamp":"2024-05-27T12:33:34.272777+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:02:07.380108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T12:33:38.115672+0000","last_change":"2024-05-27T12:33:36.314651+0000","last_active":"2024-05-27T12:33:38.115672+0000","last_peered":"2024-05-27T12:33:38.115672+0000","last_clean":"2024-05-27T12:33:38.115672+0000","last_became_active":"2024-05-27T12:33:36.314264+0000","last_became_peered":"2024-05-27T12:33:36.314264+0000","last_unstale":"2024-05-27T12:33:38.115672+0000","last_undegraded":"2024-05-27T12:33:38.115672+0000","last_fullsized":"2024-05-27T12:33:38.115672+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_clean_scrub_stamp":"2024-05-27T12:33:35.284230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:03:37.356621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"35'1","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-27T12:33:36.331632+0000","last_change":"2024-05-27T12:33:35.314462+0000","last_active":"2024-05-27T12:33:36.331632+0000","last_peered":"2024-05-27T12:33:36.331632+0000","last_clean":"2024-05-27T12:33:36.331632+0000","last_became_active":"2024-05-27T12:33:35.314115+0000","last_became_peered":"2024-05-27T12:33:35.314115+0000","last_unstale":"2024-05-27T12:33:36.331632+0000","last_undegraded":"2024-05-27T12:33:36.331632+0000","last_fullsized":"2024-05-27T12:33:36.331632+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:34.272777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:34.272777+0000","last_clean_scrub_stamp":"2024-05-27T12:33:34.272777+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:52:26.273696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T12:33:37.972389+0000","last_change":"2024-05-27T12:33:36.311826+0000","last_active":"2024-05-27T12:33:37.972389+0000","last_peered":"2024-05-27T12:33:37.972389+0000","last_clean":"2024-05-27T12:33:37.972389+0000","last_became_active":"2024-05-27T12:33:36.310935+0000","last_became_peered":"2024-05-27T12:33:36.310935+0000","last_unstale":"2024-05-27T12:33:37.972389+0000","last_undegraded":"2024-05-27T12:33:37.972389+0000","last_fullsized":"2024-05-27T12:33:37.972389+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_clean_scrub_stamp":"2024-05-27T12:33:35.284230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:04:18.874449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"35'2","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T12:33:38.115596+0000","last_change":"2024-05-27T12:33:35.318457+0000","last_active":"2024-05-27T12:33:38.115596+0000","last_peered":"2024-05-27T12:33:38.115596+0000","last_clean":"2024-05-27T12:33:38.115596+0000","last_became_active":"2024-05-27T12:33:35.318111+0000","last_became_peered":"2024-05-27T12:33:35.318111+0000","last_unstale":"2024-05-27T12:33:38.115596+0000","last_undegraded":"2024-05-27T12:33:38.115596+0000","last_fullsized":"2024-05-27T12:33:38.115596+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:34.272777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:34.272777+0000","last_clean_scrub_stamp":"2024-05-27T12:33:34.272777+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T00:02:23.923356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-27T12:33:36.329495+0000","last_change":"2024-05-27T12:33:36.321764+0000","last_active":"2024-05-27T12:33:36.329495+0000","last_peered":"2024-05-27T12:33:36.329495+0000","last_clean":"2024-05-27T12:33:36.329495+0000","last_became_active":"2024-05-27T12:33:36.321510+0000","last_became_peered":"2024-05-27T12:33:36.321510+0000","last_unstale":"2024-05-27T12:33:36.329495+0000","last_undegraded":"2024-05-27T12:33:36.329495+0000","last_fullsized":"2024-05-27T12:33:36.329495+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_clean_scrub_stamp":"2024-05-27T12:33:35.284230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:22:49.224603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"35'1","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T12:33:38.115646+0000","last_change":"2024-05-27T12:33:35.319171+0000","last_active":"2024-05-27T12:33:38.115646+0000","last_peered":"2024-05-27T12:33:38.115646+0000","last_clean":"2024-05-27T12:33:38.115646+0000","last_became_active":"2024-05-27T12:33:35.318890+0000","last_became_peered":"2024-05-27T12:33:35.318890+0000","last_unstale":"2024-05-27T12:33:38.115646+0000","last_undegraded":"2024-05-27T12:33:38.115646+0000","last_fullsized":"2024-05-27T12:33:38.115646+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:34.272777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:34.272777+0000","last_clean_scrub_stamp":"2024-05-27T12:33:34.272777+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:47:19.054571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-27T12:33:36.328367+0000","last_change":"2024-05-27T12:33:36.324428+0000","last_active":"2024-05-27T12:33:36.328367+0000","last_peered":"2024-05-27T12:33:36.328367+0000","last_clean":"2024-05-27T12:33:36.328367+0000","last_became_active":"2024-05-27T12:33:36.324175+0000","last_became_peered":"2024-05-27T12:33:36.324175+0000","last_unstale":"2024-05-27T12:33:36.328367+0000","last_undegraded":"2024-05-27T12:33:36.328367+0000","last_fullsized":"2024-05-27T12:33:36.328367+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_clean_scrub_stamp":"2024-05-27T12:33:35.284230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:10:21.369836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T12:33:38.115429+0000","last_change":"2024-05-27T12:33:35.320626+0000","last_active":"2024-05-27T12:33:38.115429+0000","last_peered":"2024-05-27T12:33:38.115429+0000","last_clean":"2024-05-27T12:33:38.115429+0000","last_became_active":"2024-05-27T12:33:35.320221+0000","last_became_peered":"2024-05-27T12:33:35.320221+0000","last_unstale":"2024-05-27T12:33:38.115429+0000","last_undegraded":"2024-05-27T12:33:38.115429+0000","last_fullsized":"2024-05-27T12:33:38.115429+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:34.272777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:34.272777+0000","last_clean_scrub_stamp":"2024-05-27T12:33:34.272777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:12:38.126085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-27T12:33:36.331082+0000","last_change":"2024-05-27T12:33:36.325799+0000","last_active":"2024-05-27T12:33:36.331082+0000","last_peered":"2024-05-27T12:33:36.331082+0000","last_clean":"2024-05-27T12:33:36.331082+0000","last_became_active":"2024-05-27T12:33:36.325289+0000","last_became_peered":"2024-05-27T12:33:36.325289+0000","last_unstale":"2024-05-27T12:33:36.331082+0000","last_undegraded":"2024-05-27T12:33:36.331082+0000","last_fullsized":"2024-05-27T12:33:36.331082+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_clean_scrub_stamp":"2024-05-27T12:33:35.284230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:09:09.241291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"35'2","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-27T12:33:36.328225+0000","last_change":"2024-05-27T12:33:35.320065+0000","last_active":"2024-05-27T12:33:36.328225+0000","last_peered":"2024-05-27T12:33:36.328225+0000","last_clean":"2024-05-27T12:33:36.328225+0000","last_became_active":"2024-05-27T12:33:35.319781+0000","last_became_peered":"2024-05-27T12:33:35.319781+0000","last_unstale":"2024-05-27T12:33:36.328225+0000","last_undegraded":"2024-05-27T12:33:36.328225+0000","last_fullsized":"2024-05-27T12:33:36.328225+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:34.272777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:34.272777+0000","last_clean_scrub_stamp":"2024-05-27T12:33:34.272777+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T23:15:01.695621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-27T12:33:36.328463+0000","last_change":"2024-05-27T12:33:36.323354+0000","last_active":"2024-05-27T12:33:36.328463+0000","last_peered":"2024-05-27T12:33:36.328463+0000","last_clean":"2024-05-27T12:33:36.328463+0000","last_became_active":"2024-05-27T12:33:36.323088+0000","last_became_peered":"2024-05-27T12:33:36.323088+0000","last_unstale":"2024-05-27T12:33:36.328463+0000","last_undegraded":"2024-05-27T12:33:36.328463+0000","last_fullsized":"2024-05-27T12:33:36.328463+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_clean_scrub_stamp":"2024-05-27T12:33:35.284230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:11:04.651952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-27T12:33:36.309706+0000","last_change":"2024-05-27T12:33:35.325112+0000","last_active":"2024-05-27T12:33:36.309706+0000","last_peered":"2024-05-27T12:33:36.309706+0000","last_clean":"2024-05-27T12:33:36.309706+0000","last_became_active":"2024-05-27T12:33:35.324750+0000","last_became_peered":"2024-05-27T12:33:35.324750+0000","last_unstale":"2024-05-27T12:33:36.309706+0000","last_undegraded":"2024-05-27T12:33:36.309706+0000","last_fullsized":"2024-05-27T12:33:36.309706+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:34.272777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:34.272777+0000","last_clean_scrub_stamp":"2024-05-27T12:33:34.272777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T00:25:57.154617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-27T12:33:36.325256+0000","last_change":"2024-05-27T12:33:36.320799+0000","last_active":"2024-05-27T12:33:36.325256+0000","last_peered":"2024-05-27T12:33:36.325256+0000","last_clean":"2024-05-27T12:33:36.325256+0000","last_became_active":"2024-05-27T12:33:36.320492+0000","last_became_peered":"2024-05-27T12:33:36.320492+0000","last_unstale":"2024-05-27T12:33:36.325256+0000","last_undegraded":"2024-05-27T12:33:36.325256+0000","last_fullsized":"2024-05-27T12:33:36.325256+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_clean_scrub_stamp":"2024-05-27T12:33:35.284230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:32:06.319169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T12:33:38.115171+0000","last_change":"2024-05-27T12:33:35.320409+0000","last_active":"2024-05-27T12:33:38.115171+0000","last_peered":"2024-05-27T12:33:38.115171+0000","last_clean":"2024-05-27T12:33:38.115171+0000","last_became_active":"2024-05-27T12:33:35.320108+0000","last_became_peered":"2024-05-27T12:33:35.320108+0000","last_unstale":"2024-05-27T12:33:38.115171+0000","last_undegraded":"2024-05-27T12:33:38.115171+0000","last_fullsized":"2024-05-27T12:33:38.115171+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:34.272777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:34.272777+0000","last_clean_scrub_stamp":"2024-05-27T12:33:34.272777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:09:08.229839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T12:33:37.311531+0000","last_change":"2024-05-27T12:33:36.311530+0000","last_active":"2024-05-27T12:33:37.311531+0000","last_peered":"2024-05-27T12:33:37.311531+0000","last_clean":"2024-05-27T12:33:37.311531+0000","last_became_active":"2024-05-27T12:33:36.311243+0000","last_became_peered":"2024-05-27T12:33:36.311243+0000","last_unstale":"2024-05-27T12:33:37.311531+0000","last_undegraded":"2024-05-27T12:33:37.311531+0000","last_fullsized":"2024-05-27T12:33:37.311531+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_clean_scrub_stamp":"2024-05-27T12:33:35.284230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T00:27:04.534327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T12:33:37.971794+0000","last_change":"2024-05-27T12:33:35.313757+0000","last_active":"2024-05-27T12:33:37.971794+0000","last_peered":"2024-05-27T12:33:37.971794+0000","last_clean":"2024-05-27T12:33:37.971794+0000","last_became_active":"2024-05-27T12:33:35.313442+0000","last_became_peered":"2024-05-27T12:33:35.313442+0000","last_unstale":"2024-05-27T12:33:37.971794+0000","last_undegraded":"2024-05-27T12:33:37.971794+0000","last_fullsized":"2024-05-27T12:33:37.971794+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:34.272777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:34.272777+0000","last_clean_scrub_stamp":"2024-05-27T12:33:34.272777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:22:48.213150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-27T12:33:36.328129+0000","last_change":"2024-05-27T12:33:36.322939+0000","last_active":"2024-05-27T12:33:36.328129+0000","last_peered":"2024-05-27T12:33:36.328129+0000","last_clean":"2024-05-27T12:33:36.328129+0000","last_became_active":"2024-05-27T12:33:36.322537+0000","last_became_peered":"2024-05-27T12:33:36.322537+0000","last_unstale":"2024-05-27T12:33:36.328129+0000","last_undegraded":"2024-05-27T12:33:36.328129+0000","last_fullsized":"2024-05-27T12:33:36.328129+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_clean_scrub_stamp":"2024-05-27T12:33:35.284230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:46:48.176334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"35'2","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-27T12:33:36.329595+0000","last_change":"2024-05-27T12:33:35.316653+0000","last_active":"2024-05-27T12:33:36.329595+0000","last_peered":"2024-05-27T12:33:36.329595+0000","last_clean":"2024-05-27T12:33:36.329595+0000","last_became_active":"2024-05-27T12:33:35.316340+0000","last_became_peered":"2024-05-27T12:33:35.316340+0000","last_unstale":"2024-05-27T12:33:36.329595+0000","last_undegraded":"2024-05-27T12:33:36.329595+0000","last_fullsized":"2024-05-27T12:33:36.329595+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:34.272777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:34.272777+0000","last_clean_scrub_stamp":"2024-05-27T12:33:34.272777+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:59:07.423822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T12:33:37.972388+0000","last_change":"2024-05-27T12:33:36.323758+0000","last_active":"2024-05-27T12:33:37.972388+0000","last_peered":"2024-05-27T12:33:37.972388+0000","last_clean":"2024-05-27T12:33:37.972388+0000","last_became_active":"2024-05-27T12:33:36.323221+0000","last_became_peered":"2024-05-27T12:33:36.323221+0000","last_unstale":"2024-05-27T12:33:37.972388+0000","last_undegraded":"2024-05-27T12:33:37.972388+0000","last_fullsized":"2024-05-27T12:33:37.972388+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_clean_scrub_stamp":"2024-05-27T12:33:35.284230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:50:34.508404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-27T12:33:36.302150+0000","last_change":"2024-05-27T12:33:35.320123+0000","last_active":"2024-05-27T12:33:36.302150+0000","last_peered":"2024-05-27T12:33:36.302150+0000","last_clean":"2024-05-27T12:33:36.302150+0000","last_became_active":"2024-05-27T12:33:35.319819+0000","last_became_peered":"2024-05-27T12:33:35.319819+0000","last_unstale":"2024-05-27T12:33:36.302150+0000","last_undegraded":"2024-05-27T12:33:36.302150+0000","last_fullsized":"2024-05-27T12:33:36.302150+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:34.272777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:34.272777+0000","last_clean_scrub_stamp":"2024-05-27T12:33:34.272777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T23:14:01.127110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-27T12:33:36.325923+0000","last_change":"2024-05-27T12:33:36.325205+0000","last_active":"2024-05-27T12:33:36.325923+0000","last_peered":"2024-05-27T12:33:36.325923+0000","last_clean":"2024-05-27T12:33:36.325923+0000","last_became_active":"2024-05-27T12:33:36.324924+0000","last_became_peered":"2024-05-27T12:33:36.324924+0000","last_unstale":"2024-05-27T12:33:36.325923+0000","last_undegraded":"2024-05-27T12:33:36.325923+0000","last_fullsized":"2024-05-27T12:33:36.325923+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_clean_scrub_stamp":"2024-05-27T12:33:35.284230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:50:14.197103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-27T12:33:36.306800+0000","last_change":"2024-05-27T12:33:35.313928+0000","last_active":"2024-05-27T12:33:36.306800+0000","last_peered":"2024-05-27T12:33:36.306800+0000","last_clean":"2024-05-27T12:33:36.306800+0000","last_became_active":"2024-05-27T12:33:35.313568+0000","last_became_peered":"2024-05-27T12:33:35.313568+0000","last_unstale":"2024-05-27T12:33:36.306800+0000","last_undegraded":"2024-05-27T12:33:36.306800+0000","last_fullsized":"2024-05-27T12:33:36.306800+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:34.272777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:34.272777+0000","last_clean_scrub_stamp":"2024-05-27T12:33:34.272777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:38:22.082096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-27T12:33:36.323248+0000","last_change":"2024-05-27T12:33:36.321446+0000","last_active":"2024-05-27T12:33:36.323248+0000","last_peered":"2024-05-27T12:33:36.323248+0000","last_clean":"2024-05-27T12:33:36.323248+0000","last_became_active":"2024-05-27T12:33:36.321085+0000","last_became_peered":"2024-05-27T12:33:36.321085+0000","last_unstale":"2024-05-27T12:33:36.323248+0000","last_undegraded":"2024-05-27T12:33:36.323248+0000","last_fullsized":"2024-05-27T12:33:36.323248+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_clean_scrub_stamp":"2024-05-27T12:33:35.284230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:59:08.435274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-27T12:33:36.301944+0000","last_change":"2024-05-27T12:33:35.319206+0000","last_active":"2024-05-27T12:33:36.301944+0000","last_peered":"2024-05-27T12:33:36.301944+0000","last_clean":"2024-05-27T12:33:36.301944+0000","last_became_active":"2024-05-27T12:33:35.318916+0000","last_became_peered":"2024-05-27T12:33:35.318916+0000","last_unstale":"2024-05-27T12:33:36.301944+0000","last_undegraded":"2024-05-27T12:33:36.301944+0000","last_fullsized":"2024-05-27T12:33:36.301944+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:34.272777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:34.272777+0000","last_clean_scrub_stamp":"2024-05-27T12:33:34.272777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:54:35.941785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-27T12:33:36.317702+0000","last_change":"2024-05-27T12:33:36.309083+0000","last_active":"2024-05-27T12:33:36.317702+0000","last_peered":"2024-05-27T12:33:36.317702+0000","last_clean":"2024-05-27T12:33:36.317702+0000","last_became_active":"2024-05-27T12:33:36.308781+0000","last_became_peered":"2024-05-27T12:33:36.308781+0000","last_unstale":"2024-05-27T12:33:36.317702+0000","last_undegraded":"2024-05-27T12:33:36.317702+0000","last_fullsized":"2024-05-27T12:33:36.317702+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_clean_scrub_stamp":"2024-05-27T12:33:35.284230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:49:30.856022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-27T12:33:36.306050+0000","last_change":"2024-05-27T12:33:35.315607+0000","last_active":"2024-05-27T12:33:36.306050+0000","last_peered":"2024-05-27T12:33:36.306050+0000","last_clean":"2024-05-27T12:33:36.306050+0000","last_became_active":"2024-05-27T12:33:35.315331+0000","last_became_peered":"2024-05-27T12:33:35.315331+0000","last_unstale":"2024-05-27T12:33:36.306050+0000","last_undegraded":"2024-05-27T12:33:36.306050+0000","last_fullsized":"2024-05-27T12:33:36.306050+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:34.272777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:34.272777+0000","last_clean_scrub_stamp":"2024-05-27T12:33:34.272777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:38:59.846163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T12:33:37.311363+0000","last_change":"2024-05-27T12:33:36.333252+0000","last_active":"2024-05-27T12:33:37.311363+0000","last_peered":"2024-05-27T12:33:37.311363+0000","last_clean":"2024-05-27T12:33:37.311363+0000","last_became_active":"2024-05-27T12:33:36.332915+0000","last_became_peered":"2024-05-27T12:33:36.332915+0000","last_unstale":"2024-05-27T12:33:37.311363+0000","last_undegraded":"2024-05-27T12:33:37.311363+0000","last_fullsized":"2024-05-27T12:33:37.311363+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_clean_scrub_stamp":"2024-05-27T12:33:35.284230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:21:33.852199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T12:33:38.115289+0000","last_change":"2024-05-27T12:33:35.314218+0000","last_active":"2024-05-27T12:33:38.115289+0000","last_peered":"2024-05-27T12:33:38.115289+0000","last_clean":"2024-05-27T12:33:38.115289+0000","last_became_active":"2024-05-27T12:33:35.313101+0000","last_became_peered":"2024-05-27T12:33:35.313101+0000","last_unstale":"2024-05-27T12:33:38.115289+0000","last_undegraded":"2024-05-27T12:33:38.115289+0000","last_fullsized":"2024-05-27T12:33:38.115289+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:34.272777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:34.272777+0000","last_clean_scrub_stamp":"2024-05-27T12:33:34.272777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:50:20.737955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T12:33:38.115174+0000","last_change":"2024-05-27T12:33:36.325226+0000","last_active":"2024-05-27T12:33:38.115174+0000","last_peered":"2024-05-27T12:33:38.115174+0000","last_clean":"2024-05-27T12:33:38.115174+0000","last_became_active":"2024-05-27T12:33:36.324889+0000","last_became_peered":"2024-05-27T12:33:36.324889+0000","last_unstale":"2024-05-27T12:33:38.115174+0000","last_undegraded":"2024-05-27T12:33:38.115174+0000","last_fullsized":"2024-05-27T12:33:38.115174+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_clean_scrub_stamp":"2024-05-27T12:33:35.284230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:52:27.285148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T12:33:37.311349+0000","last_change":"2024-05-27T12:33:35.313499+0000","last_active":"2024-05-27T12:33:37.311349+0000","last_peered":"2024-05-27T12:33:37.311349+0000","last_clean":"2024-05-27T12:33:37.311349+0000","last_became_active":"2024-05-27T12:33:35.313223+0000","last_became_peered":"2024-05-27T12:33:35.313223+0000","last_unstale":"2024-05-27T12:33:37.311349+0000","last_undegraded":"2024-05-27T12:33:37.311349+0000","last_fullsized":"2024-05-27T12:33:37.311349+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:34.272777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:34.272777+0000","last_clean_scrub_stamp":"2024-05-27T12:33:34.272777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:22:50.732987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T12:33:37.311652+0000","last_change":"2024-05-27T12:33:36.320126+0000","last_active":"2024-05-27T12:33:37.311652+0000","last_peered":"2024-05-27T12:33:37.311652+0000","last_clean":"2024-05-27T12:33:37.311652+0000","last_became_active":"2024-05-27T12:33:36.319073+0000","last_became_peered":"2024-05-27T12:33:36.319073+0000","last_unstale":"2024-05-27T12:33:37.311652+0000","last_undegraded":"2024-05-27T12:33:37.311652+0000","last_fullsized":"2024-05-27T12:33:37.311652+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_clean_scrub_stamp":"2024-05-27T12:33:35.284230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:59:00.013617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-27T12:33:36.309707+0000","last_change":"2024-05-27T12:33:35.329188+0000","last_active":"2024-05-27T12:33:36.309707+0000","last_peered":"2024-05-27T12:33:36.309707+0000","last_clean":"2024-05-27T12:33:36.309707+0000","last_became_active":"2024-05-27T12:33:35.328900+0000","last_became_peered":"2024-05-27T12:33:35.328900+0000","last_unstale":"2024-05-27T12:33:36.309707+0000","last_undegraded":"2024-05-27T12:33:36.309707+0000","last_fullsized":"2024-05-27T12:33:36.309707+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:34.272777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:34.272777+0000","last_clean_scrub_stamp":"2024-05-27T12:33:34.272777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:02:34.928983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":196,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T12:33:37.311809+0000","last_change":"2024-05-27T12:32:31.185664+0000","last_active":"2024-05-27T12:33:37.311809+0000","last_peered":"2024-05-27T12:33:37.311809+0000","last_clean":"2024-05-27T12:33:37.311809+0000","last_became_active":"2024-05-27T12:32:31.184757+0000","last_became_peered":"2024-05-27T12:32:31.184757+0000","last_unstale":"2024-05-27T12:33:37.311809+0000","last_undegraded":"2024-05-27T12:33:37.311809+0000","last_fullsized":"2024-05-27T12:33:37.311809+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:30.136480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:30.136480+0000","last_clean_scrub_stamp":"2024-05-27T12:32:30.136480+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:49:13.241747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509457,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28000,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343840,"statfs":{"total":96636764160,"available":96608092160,"internally_reserved":0,"allocated":999424,"data_stored":747087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509457,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":397312,"data_stored":150945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509457,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":397312,"data_stored":151001,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509457,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":397312,"data_stored":150433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509457,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31592,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340248,"statfs":{"total":96636764160,"available":96604413952,"internally_reserved":0,"allocated":417792,"data_stored":158263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509457,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31564,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340276,"statfs":{"total":96636764160,"available":96604442624,"internally_reserved":0,"allocated":393216,"data_stored":150399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509457,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31576,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340264,"statfs":{"total":96636764160,"available":96604430336,"internally_reserved":0,"allocated":405504,"data_stored":151963,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542162,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32140,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339700,"statfs":{"total":96636764160,"available":96603852800,"internally_reserved":0,"allocated":983040,"data_stored":740697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-27T12:33:40.350 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-27T12:33:40.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.490+0000 7f1660ccf640 1 Processor -- start 2024-05-27T12:33:40.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.490+0000 7f1660ccf640 1 -- start start 2024-05-27T12:33:40.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.491+0000 7f1660ccf640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f165c0cf6b0 0x7f165c15dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:40.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.491+0000 7f1660ccf640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f165c06c340 0x7f165c160680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:40.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.491+0000 7f1660ccf640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f165c06c790 con 0x7f165c146140 2024-05-27T12:33:40.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.491+0000 7f1660ccf640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f165c0c67e0 con 0x7f165c06c340 2024-05-27T12:33:40.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.491+0000 7f1660ccf640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f165c15d190 con 0x7f165c0cf6b0 2024-05-27T12:33:40.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.491+0000 7f165ad9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f165c06c340 0x7f165c160680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:40.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.491+0000 7f165ad9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f165c06c340 0x7f165c160680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51190/0 (socket says 172.21.15.55:51190) 2024-05-27T12:33:40.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.491+0000 7f165ad9d640 1 -- 172.21.15.55:0/3863891024 learned_addr learned my addr 172.21.15.55:0/3863891024 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:33:40.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.491+0000 7f165ad9d640 1 -- 172.21.15.55:0/3863891024 >> v2:172.21.15.72:3300/0 conn(0x7f165c0cf6b0 msgr2=0x7f165c15dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:40.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.491+0000 7f165ad9d640 1 --2- 172.21.15.55:0/3863891024 >> v2:172.21.15.72:3300/0 conn(0x7f165c0cf6b0 0x7f165c15dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:40.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.491+0000 7f165ad9d640 1 -- 172.21.15.55:0/3863891024 >> v1:172.21.15.72:6789/0 conn(0x7f165c146140 legacy=0x7f165c0cfa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:40.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.491+0000 7f165ad9d640 1 -- 172.21.15.55:0/3863891024 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f165c15d470 con 0x7f165c06c340 2024-05-27T12:33:40.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.492+0000 7f165ad9d640 1 --2- 172.21.15.55:0/3863891024 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f165c06c340 0x7f165c160680 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f165c074150 tx=0x7f165402a780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32c535f1979ce3af server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:40.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.492+0000 7f1659d9b640 1 -- 172.21.15.55:0/3863891024 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1654036070 con 0x7f165c06c340 2024-05-27T12:33:40.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.492+0000 7f1659d9b640 1 -- 172.21.15.55:0/3863891024 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1654031600 con 0x7f165c06c340 2024-05-27T12:33:40.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.492+0000 7f1659d9b640 1 -- 172.21.15.55:0/3863891024 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16540319d0 con 0x7f165c06c340 2024-05-27T12:33:40.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.492+0000 7f1660ccf640 1 -- 172.21.15.55:0/3863891024 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f165c06c340 msgr2=0x7f165c160680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:40.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.492+0000 7f1660ccf640 1 --2- 172.21.15.55:0/3863891024 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f165c06c340 0x7f165c160680 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f165c074150 tx=0x7f165402a780 comp rx=0 tx=0).stop 2024-05-27T12:33:40.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.492+0000 7f1660ccf640 1 -- 172.21.15.55:0/3863891024 shutdown_connections 2024-05-27T12:33:40.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.492+0000 7f1660ccf640 1 --2- 172.21.15.55:0/3863891024 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f165c06c340 0x7f165c160680 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:40.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.492+0000 7f1660ccf640 1 --2- 172.21.15.55:0/3863891024 >> v2:172.21.15.72:3300/0 conn(0x7f165c0cf6b0 0x7f165c15dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:40.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.492+0000 7f1660ccf640 1 -- 172.21.15.55:0/3863891024 >> 172.21.15.55:0/3863891024 conn(0x7f165c0b3360 msgr2=0x7f165c0b3770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:40.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.493+0000 7f1660ccf640 1 -- 172.21.15.55:0/3863891024 shutdown_connections 2024-05-27T12:33:40.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.493+0000 7f1660ccf640 1 -- 172.21.15.55:0/3863891024 wait complete. 2024-05-27T12:33:40.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.494+0000 7f1660ccf640 1 Processor -- start 2024-05-27T12:33:40.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.494+0000 7f1660ccf640 1 -- start start 2024-05-27T12:33:40.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.495+0000 7f1660ccf640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f165c06c340 0x7f165c15b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:40.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.495+0000 7f1660ccf640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f165c0cf6b0 0x7f165c13e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:40.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.495+0000 7f1660ccf640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f165c146140 0x7f165c0aa8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:40.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.495+0000 7f1660ccf640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f165c15dd10 con 0x7f165c146140 2024-05-27T12:33:40.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.495+0000 7f1660ccf640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f165c15da30 con 0x7f165c0cf6b0 2024-05-27T12:33:40.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.495+0000 7f1660ccf640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f165c15cdf0 con 0x7f165c06c340 2024-05-27T12:33:40.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.495+0000 7f165ad9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f165c146140 0x7f165c0aa8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:40.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.495+0000 7f165ad9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f165c146140 0x7f165c0aa8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51192/0 (socket says 172.21.15.55:51192) 2024-05-27T12:33:40.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.495+0000 7f165ad9d640 1 -- 172.21.15.55:0/2204030565 learned_addr learned my addr 172.21.15.55:0/2204030565 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:33:40.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.495+0000 7f165a59c640 1 --2- 172.21.15.55:0/2204030565 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f165c06c340 0x7f165c15b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:40.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.495+0000 7f1651d9b640 1 --2- 172.21.15.55:0/2204030565 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f165c0cf6b0 0x7f165c13e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:40.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.495+0000 7f165ad9d640 1 -- 172.21.15.55:0/2204030565 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f165c06c340 msgr2=0x7f165c15b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:40.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.495+0000 7f165ad9d640 1 --2- 172.21.15.55:0/2204030565 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f165c06c340 0x7f165c15b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:40.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.495+0000 7f165ad9d640 1 -- 172.21.15.55:0/2204030565 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f165c0cf6b0 msgr2=0x7f165c13e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:40.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.495+0000 7f165ad9d640 1 --2- 172.21.15.55:0/2204030565 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f165c0cf6b0 0x7f165c13e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:40.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.495+0000 7f165ad9d640 1 -- 172.21.15.55:0/2204030565 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f165c0a9830 con 0x7f165c146140 2024-05-27T12:33:40.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.495+0000 7f165ad9d640 1 --2- 172.21.15.55:0/2204030565 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f165c146140 0x7f165c0aa8d0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f1654034040 tx=0x7f1654004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:40.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.496+0000 7f16537fe640 1 -- 172.21.15.55:0/2204030565 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1654041020 con 0x7f165c146140 2024-05-27T12:33:40.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.496+0000 7f16537fe640 1 -- 172.21.15.55:0/2204030565 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16540077a0 con 0x7f165c146140 2024-05-27T12:33:40.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.496+0000 7f1660ccf640 1 -- 172.21.15.55:0/2204030565 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f165c0a9b10 con 0x7f165c146140 2024-05-27T12:33:40.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.496+0000 7f16537fe640 1 -- 172.21.15.55:0/2204030565 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1654036040 con 0x7f165c146140 2024-05-27T12:33:40.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.496+0000 7f1660ccf640 1 -- 172.21.15.55:0/2204030565 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f165c0aa0d0 con 0x7f165c146140 2024-05-27T12:33:40.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.497+0000 7f1660ccf640 1 -- 172.21.15.55:0/2204030565 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f165c075460 con 0x7f165c146140 2024-05-27T12:33:40.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.497+0000 7f16537fe640 1 -- 172.21.15.55:0/2204030565 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1654044020 con 0x7f165c146140 2024-05-27T12:33:40.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.497+0000 7f16537fe640 1 --2- 172.21.15.55:0/2204030565 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f163c06c920 0x7f163c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:40.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.498+0000 7f16537fe640 1 -- 172.21.15.55:0/2204030565 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5709+0+0 (secure 0 0 0) 0x7f16540aca70 con 0x7f165c146140 2024-05-27T12:33:40.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.498+0000 7f165a59c640 1 --2- 172.21.15.55:0/2204030565 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f163c06c920 0x7f163c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:40.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.498+0000 7f165a59c640 1 --2- 172.21.15.55:0/2204030565 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f163c06c920 0x7f163c06ede0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f164c009890 tx=0x7f164c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:40.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.502+0000 7f16537fe640 1 -- 172.21.15.55:0/2204030565 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f165404b030 con 0x7f165c146140 2024-05-27T12:33:40.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.681+0000 7f1660ccf640 1 -- 172.21.15.55:0/2204030565 --> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f165c13f6f0 con 0x7f163c06c920 2024-05-27T12:33:40.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.688+0000 7f16537fe640 1 -- 172.21.15.55:0/2204030565 <== mgr.4105 v2:172.21.15.72:6832/3152720583 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251922 (secure 0 0 0) 0x7f165c13f6f0 con 0x7f163c06c920 2024-05-27T12:33:40.691 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-27T12:33:40.692 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2024-05-27T12:33:40.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.691+0000 7f1660ccf640 1 -- 172.21.15.55:0/2204030565 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f163c06c920 msgr2=0x7f163c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:40.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.691+0000 7f1660ccf640 1 --2- 172.21.15.55:0/2204030565 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f163c06c920 0x7f163c06ede0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f164c009890 tx=0x7f164c008040 comp rx=0 tx=0).stop 2024-05-27T12:33:40.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.691+0000 7f1660ccf640 1 -- 172.21.15.55:0/2204030565 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f165c146140 msgr2=0x7f165c0aa8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:40.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.691+0000 7f1660ccf640 1 --2- 172.21.15.55:0/2204030565 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f165c146140 0x7f165c0aa8d0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f1654034040 tx=0x7f1654004a40 comp rx=0 tx=0).stop 2024-05-27T12:33:40.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.691+0000 7f1660ccf640 1 -- 172.21.15.55:0/2204030565 shutdown_connections 2024-05-27T12:33:40.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.691+0000 7f1660ccf640 1 --2- 172.21.15.55:0/2204030565 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f165c146140 0x7f165c0aa8d0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:40.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.691+0000 7f1660ccf640 1 --2- 172.21.15.55:0/2204030565 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f163c06c920 0x7f163c06ede0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:40.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.691+0000 7f1660ccf640 1 --2- 172.21.15.55:0/2204030565 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f165c0cf6b0 0x7f165c13e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:40.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.691+0000 7f1660ccf640 1 --2- 172.21.15.55:0/2204030565 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f165c06c340 0x7f165c15b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:40.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.691+0000 7f1660ccf640 1 -- 172.21.15.55:0/2204030565 >> 172.21.15.55:0/2204030565 conn(0x7f165c0b3360 msgr2=0x7f165c0d0060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:40.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.691+0000 7f1660ccf640 1 -- 172.21.15.55:0/2204030565 shutdown_connections 2024-05-27T12:33:40.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.691+0000 7f1660ccf640 1 -- 172.21.15.55:0/2204030565 wait complete. 2024-05-27T12:33:40.702 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":65,"stamp":"2024-05-27T12:33:39.275680+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":115,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":237096,"kb_used_data":4288,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737624,"statfs":{"total":773094113280,"available":772851326976,"internally_reserved":0,"allocated":4390912,"data_stored":2400788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.986444"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-27T12:33:36.321717+0000","last_change":"2024-05-27T12:33:36.314451+0000","last_active":"2024-05-27T12:33:36.321717+0000","last_peered":"2024-05-27T12:33:36.321717+0000","last_clean":"2024-05-27T12:33:36.321717+0000","last_became_active":"2024-05-27T12:33:36.314177+0000","last_became_peered":"2024-05-27T12:33:36.314177+0000","last_unstale":"2024-05-27T12:33:36.321717+0000","last_undegraded":"2024-05-27T12:33:36.321717+0000","last_fullsized":"2024-05-27T12:33:36.321717+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_clean_scrub_stamp":"2024-05-27T12:33:35.284230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:38:23.093549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T12:33:37.311949+0000","last_change":"2024-05-27T12:33:36.324212+0000","last_active":"2024-05-27T12:33:37.311949+0000","last_peered":"2024-05-27T12:33:37.311949+0000","last_clean":"2024-05-27T12:33:37.311949+0000","last_became_active":"2024-05-27T12:33:36.323915+0000","last_became_peered":"2024-05-27T12:33:36.323915+0000","last_unstale":"2024-05-27T12:33:37.311949+0000","last_undegraded":"2024-05-27T12:33:37.311949+0000","last_fullsized":"2024-05-27T12:33:37.311949+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_clean_scrub_stamp":"2024-05-27T12:33:35.284230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T23:04:17.935273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T12:33:37.972219+0000","last_change":"2024-05-27T12:33:36.328736+0000","last_active":"2024-05-27T12:33:37.972219+0000","last_peered":"2024-05-27T12:33:37.972219+0000","last_clean":"2024-05-27T12:33:37.972219+0000","last_became_active":"2024-05-27T12:33:36.328455+0000","last_became_peered":"2024-05-27T12:33:36.328455+0000","last_unstale":"2024-05-27T12:33:37.972219+0000","last_undegraded":"2024-05-27T12:33:37.972219+0000","last_fullsized":"2024-05-27T12:33:37.972219+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_clean_scrub_stamp":"2024-05-27T12:33:35.284230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:11:55.992630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-27T12:33:36.329640+0000","last_change":"2024-05-27T12:33:36.322811+0000","last_active":"2024-05-27T12:33:36.329640+0000","last_peered":"2024-05-27T12:33:36.329640+0000","last_clean":"2024-05-27T12:33:36.329640+0000","last_became_active":"2024-05-27T12:33:36.322276+0000","last_became_peered":"2024-05-27T12:33:36.322276+0000","last_unstale":"2024-05-27T12:33:36.329640+0000","last_undegraded":"2024-05-27T12:33:36.329640+0000","last_fullsized":"2024-05-27T12:33:36.329640+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_clean_scrub_stamp":"2024-05-27T12:33:35.284230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:03:37.356621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-27T12:33:36.331699+0000","last_change":"2024-05-27T12:33:36.329115+0000","last_active":"2024-05-27T12:33:36.331699+0000","last_peered":"2024-05-27T12:33:36.331699+0000","last_clean":"2024-05-27T12:33:36.331699+0000","last_became_active":"2024-05-27T12:33:36.328798+0000","last_became_peered":"2024-05-27T12:33:36.328798+0000","last_unstale":"2024-05-27T12:33:36.331699+0000","last_undegraded":"2024-05-27T12:33:36.331699+0000","last_fullsized":"2024-05-27T12:33:36.331699+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_clean_scrub_stamp":"2024-05-27T12:33:35.284230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T00:02:24.934808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T12:33:37.311554+0000","last_change":"2024-05-27T12:33:36.326859+0000","last_active":"2024-05-27T12:33:37.311554+0000","last_peered":"2024-05-27T12:33:37.311554+0000","last_clean":"2024-05-27T12:33:37.311554+0000","last_became_active":"2024-05-27T12:33:36.326513+0000","last_became_peered":"2024-05-27T12:33:36.326513+0000","last_unstale":"2024-05-27T12:33:37.311554+0000","last_undegraded":"2024-05-27T12:33:37.311554+0000","last_fullsized":"2024-05-27T12:33:37.311554+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_clean_scrub_stamp":"2024-05-27T12:33:35.284230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:11:55.992630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T12:33:37.311727+0000","last_change":"2024-05-27T12:33:36.311448+0000","last_active":"2024-05-27T12:33:37.311727+0000","last_peered":"2024-05-27T12:33:37.311727+0000","last_clean":"2024-05-27T12:33:37.311727+0000","last_became_active":"2024-05-27T12:33:36.311138+0000","last_became_peered":"2024-05-27T12:33:36.311138+0000","last_unstale":"2024-05-27T12:33:37.311727+0000","last_undegraded":"2024-05-27T12:33:37.311727+0000","last_fullsized":"2024-05-27T12:33:37.311727+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_clean_scrub_stamp":"2024-05-27T12:33:35.284230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:24:08.125844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T12:33:37.311397+0000","last_change":"2024-05-27T12:33:36.319549+0000","last_active":"2024-05-27T12:33:37.311397+0000","last_peered":"2024-05-27T12:33:37.311397+0000","last_clean":"2024-05-27T12:33:37.311397+0000","last_became_active":"2024-05-27T12:33:36.319090+0000","last_became_peered":"2024-05-27T12:33:36.319090+0000","last_unstale":"2024-05-27T12:33:37.311397+0000","last_undegraded":"2024-05-27T12:33:37.311397+0000","last_fullsized":"2024-05-27T12:33:37.311397+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_clean_scrub_stamp":"2024-05-27T12:33:35.284230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:46:24.593752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T12:33:38.115731+0000","last_change":"2024-05-27T12:33:36.324446+0000","last_active":"2024-05-27T12:33:38.115731+0000","last_peered":"2024-05-27T12:33:38.115731+0000","last_clean":"2024-05-27T12:33:38.115731+0000","last_became_active":"2024-05-27T12:33:36.324200+0000","last_became_peered":"2024-05-27T12:33:36.324200+0000","last_unstale":"2024-05-27T12:33:38.115731+0000","last_undegraded":"2024-05-27T12:33:38.115731+0000","last_fullsized":"2024-05-27T12:33:38.115731+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_clean_scrub_stamp":"2024-05-27T12:33:35.284230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:22:51.744439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-27T12:33:36.331190+0000","last_change":"2024-05-27T12:33:36.327389+0000","last_active":"2024-05-27T12:33:36.331190+0000","last_peered":"2024-05-27T12:33:36.331190+0000","last_clean":"2024-05-27T12:33:36.331190+0000","last_became_active":"2024-05-27T12:33:36.327053+0000","last_became_peered":"2024-05-27T12:33:36.327053+0000","last_unstale":"2024-05-27T12:33:36.331190+0000","last_undegraded":"2024-05-27T12:33:36.331190+0000","last_fullsized":"2024-05-27T12:33:36.331190+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_clean_scrub_stamp":"2024-05-27T12:33:35.284230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:02:08.391560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T12:33:37.312087+0000","last_change":"2024-05-27T12:33:36.332697+0000","last_active":"2024-05-27T12:33:37.312087+0000","last_peered":"2024-05-27T12:33:37.312087+0000","last_clean":"2024-05-27T12:33:37.312087+0000","last_became_active":"2024-05-27T12:33:36.332453+0000","last_became_peered":"2024-05-27T12:33:36.332453+0000","last_unstale":"2024-05-27T12:33:37.312087+0000","last_undegraded":"2024-05-27T12:33:37.312087+0000","last_fullsized":"2024-05-27T12:33:37.312087+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_clean_scrub_stamp":"2024-05-27T12:33:35.284230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:50:34.508404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T12:33:37.972111+0000","last_change":"2024-05-27T12:33:36.325434+0000","last_active":"2024-05-27T12:33:37.972111+0000","last_peered":"2024-05-27T12:33:37.972111+0000","last_clean":"2024-05-27T12:33:37.972111+0000","last_became_active":"2024-05-27T12:33:36.325127+0000","last_became_peered":"2024-05-27T12:33:36.325127+0000","last_unstale":"2024-05-27T12:33:37.972111+0000","last_undegraded":"2024-05-27T12:33:37.972111+0000","last_fullsized":"2024-05-27T12:33:37.972111+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_clean_scrub_stamp":"2024-05-27T12:33:35.284230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:33:51.478610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-27T12:33:36.331721+0000","last_change":"2024-05-27T12:33:36.330391+0000","last_active":"2024-05-27T12:33:36.331721+0000","last_peered":"2024-05-27T12:33:36.331721+0000","last_clean":"2024-05-27T12:33:36.331721+0000","last_became_active":"2024-05-27T12:33:36.330057+0000","last_became_peered":"2024-05-27T12:33:36.330057+0000","last_unstale":"2024-05-27T12:33:36.331721+0000","last_undegraded":"2024-05-27T12:33:36.331721+0000","last_fullsized":"2024-05-27T12:33:36.331721+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_clean_scrub_stamp":"2024-05-27T12:33:35.284230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:12:39.137537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T12:33:37.311755+0000","last_change":"2024-05-27T12:33:36.328825+0000","last_active":"2024-05-27T12:33:37.311755+0000","last_peered":"2024-05-27T12:33:37.311755+0000","last_clean":"2024-05-27T12:33:37.311755+0000","last_became_active":"2024-05-27T12:33:36.328544+0000","last_became_peered":"2024-05-27T12:33:36.328544+0000","last_unstale":"2024-05-27T12:33:37.311755+0000","last_undegraded":"2024-05-27T12:33:37.311755+0000","last_fullsized":"2024-05-27T12:33:37.311755+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_clean_scrub_stamp":"2024-05-27T12:33:35.284230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:04:18.874449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T12:33:37.972000+0000","last_change":"2024-05-27T12:33:36.313315+0000","last_active":"2024-05-27T12:33:37.972000+0000","last_peered":"2024-05-27T12:33:37.972000+0000","last_clean":"2024-05-27T12:33:37.972000+0000","last_became_active":"2024-05-27T12:33:36.312057+0000","last_became_peered":"2024-05-27T12:33:36.312057+0000","last_unstale":"2024-05-27T12:33:37.972000+0000","last_undegraded":"2024-05-27T12:33:37.972000+0000","last_fullsized":"2024-05-27T12:33:37.972000+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_clean_scrub_stamp":"2024-05-27T12:33:35.284230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:59:00.013617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T12:33:37.311928+0000","last_change":"2024-05-27T12:33:36.328082+0000","last_active":"2024-05-27T12:33:37.311928+0000","last_peered":"2024-05-27T12:33:37.311928+0000","last_clean":"2024-05-27T12:33:37.311928+0000","last_became_active":"2024-05-27T12:33:36.327813+0000","last_became_peered":"2024-05-27T12:33:36.327813+0000","last_unstale":"2024-05-27T12:33:37.311928+0000","last_undegraded":"2024-05-27T12:33:37.311928+0000","last_fullsized":"2024-05-27T12:33:37.311928+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_clean_scrub_stamp":"2024-05-27T12:33:35.284230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:11:55.992630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T12:33:37.312069+0000","last_change":"2024-05-27T12:33:36.313580+0000","last_active":"2024-05-27T12:33:37.312069+0000","last_peered":"2024-05-27T12:33:37.312069+0000","last_clean":"2024-05-27T12:33:37.312069+0000","last_became_active":"2024-05-27T12:33:36.313278+0000","last_became_peered":"2024-05-27T12:33:36.313278+0000","last_unstale":"2024-05-27T12:33:37.312069+0000","last_undegraded":"2024-05-27T12:33:37.312069+0000","last_fullsized":"2024-05-27T12:33:37.312069+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_clean_scrub_stamp":"2024-05-27T12:33:35.284230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:20:39.722410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T12:33:37.312017+0000","last_change":"2024-05-27T12:33:36.333650+0000","last_active":"2024-05-27T12:33:37.312017+0000","last_peered":"2024-05-27T12:33:37.312017+0000","last_clean":"2024-05-27T12:33:37.312017+0000","last_became_active":"2024-05-27T12:33:36.333341+0000","last_became_peered":"2024-05-27T12:33:36.333341+0000","last_unstale":"2024-05-27T12:33:37.312017+0000","last_undegraded":"2024-05-27T12:33:37.312017+0000","last_fullsized":"2024-05-27T12:33:37.312017+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_clean_scrub_stamp":"2024-05-27T12:33:35.284230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:44:57.296713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T12:33:37.311624+0000","last_change":"2024-05-27T12:33:36.333189+0000","last_active":"2024-05-27T12:33:37.311624+0000","last_peered":"2024-05-27T12:33:37.311624+0000","last_clean":"2024-05-27T12:33:37.311624+0000","last_became_active":"2024-05-27T12:33:36.332890+0000","last_became_peered":"2024-05-27T12:33:36.332890+0000","last_unstale":"2024-05-27T12:33:37.311624+0000","last_undegraded":"2024-05-27T12:33:37.311624+0000","last_fullsized":"2024-05-27T12:33:37.311624+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_clean_scrub_stamp":"2024-05-27T12:33:35.284230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:20:39.722410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-27T12:33:36.320219+0000","last_change":"2024-05-27T12:33:36.318712+0000","last_active":"2024-05-27T12:33:36.320219+0000","last_peered":"2024-05-27T12:33:36.320219+0000","last_clean":"2024-05-27T12:33:36.320219+0000","last_became_active":"2024-05-27T12:33:36.318408+0000","last_became_peered":"2024-05-27T12:33:36.318408+0000","last_unstale":"2024-05-27T12:33:36.320219+0000","last_undegraded":"2024-05-27T12:33:36.320219+0000","last_fullsized":"2024-05-27T12:33:36.320219+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_clean_scrub_stamp":"2024-05-27T12:33:35.284230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:02:09.081005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T12:33:38.115287+0000","last_change":"2024-05-27T12:33:36.319791+0000","last_active":"2024-05-27T12:33:38.115287+0000","last_peered":"2024-05-27T12:33:38.115287+0000","last_clean":"2024-05-27T12:33:38.115287+0000","last_became_active":"2024-05-27T12:33:36.319283+0000","last_became_peered":"2024-05-27T12:33:36.319283+0000","last_unstale":"2024-05-27T12:33:38.115287+0000","last_undegraded":"2024-05-27T12:33:38.115287+0000","last_fullsized":"2024-05-27T12:33:38.115287+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_clean_scrub_stamp":"2024-05-27T12:33:35.284230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:09:32.352795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T12:33:38.115398+0000","last_change":"2024-05-27T12:33:36.327923+0000","last_active":"2024-05-27T12:33:38.115398+0000","last_peered":"2024-05-27T12:33:38.115398+0000","last_clean":"2024-05-27T12:33:38.115398+0000","last_became_active":"2024-05-27T12:33:36.327586+0000","last_became_peered":"2024-05-27T12:33:36.327586+0000","last_unstale":"2024-05-27T12:33:38.115398+0000","last_undegraded":"2024-05-27T12:33:38.115398+0000","last_fullsized":"2024-05-27T12:33:38.115398+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_clean_scrub_stamp":"2024-05-27T12:33:35.284230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:06:13.907502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-27T12:33:36.314165+0000","last_change":"2024-05-27T12:33:36.306325+0000","last_active":"2024-05-27T12:33:36.314165+0000","last_peered":"2024-05-27T12:33:36.314165+0000","last_clean":"2024-05-27T12:33:36.314165+0000","last_became_active":"2024-05-27T12:33:36.306013+0000","last_became_peered":"2024-05-27T12:33:36.306013+0000","last_unstale":"2024-05-27T12:33:36.314165+0000","last_undegraded":"2024-05-27T12:33:36.314165+0000","last_fullsized":"2024-05-27T12:33:36.314165+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_clean_scrub_stamp":"2024-05-27T12:33:35.284230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:43:40.211652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T12:33:37.971858+0000","last_change":"2024-05-27T12:33:36.320108+0000","last_active":"2024-05-27T12:33:37.971858+0000","last_peered":"2024-05-27T12:33:37.971858+0000","last_clean":"2024-05-27T12:33:37.971858+0000","last_became_active":"2024-05-27T12:33:36.319762+0000","last_became_peered":"2024-05-27T12:33:36.319762+0000","last_unstale":"2024-05-27T12:33:37.971858+0000","last_undegraded":"2024-05-27T12:33:37.971858+0000","last_fullsized":"2024-05-27T12:33:37.971858+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_clean_scrub_stamp":"2024-05-27T12:33:35.284230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:31:43.112287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-27T12:33:36.329668+0000","last_change":"2024-05-27T12:33:36.323576+0000","last_active":"2024-05-27T12:33:36.329668+0000","last_peered":"2024-05-27T12:33:36.329668+0000","last_clean":"2024-05-27T12:33:36.329668+0000","last_became_active":"2024-05-27T12:33:36.322574+0000","last_became_peered":"2024-05-27T12:33:36.322574+0000","last_unstale":"2024-05-27T12:33:36.329668+0000","last_undegraded":"2024-05-27T12:33:36.329668+0000","last_fullsized":"2024-05-27T12:33:36.329668+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_clean_scrub_stamp":"2024-05-27T12:33:35.284230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:22:51.744439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T12:33:37.312067+0000","last_change":"2024-05-27T12:33:36.324845+0000","last_active":"2024-05-27T12:33:37.312067+0000","last_peered":"2024-05-27T12:33:37.312067+0000","last_clean":"2024-05-27T12:33:37.312067+0000","last_became_active":"2024-05-27T12:33:36.324518+0000","last_became_peered":"2024-05-27T12:33:36.324518+0000","last_unstale":"2024-05-27T12:33:37.312067+0000","last_undegraded":"2024-05-27T12:33:37.312067+0000","last_fullsized":"2024-05-27T12:33:37.312067+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_clean_scrub_stamp":"2024-05-27T12:33:35.284230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:29:51.086297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-27T12:33:36.329554+0000","last_change":"2024-05-27T12:33:36.325559+0000","last_active":"2024-05-27T12:33:36.329554+0000","last_peered":"2024-05-27T12:33:36.329554+0000","last_clean":"2024-05-27T12:33:36.329554+0000","last_became_active":"2024-05-27T12:33:36.322470+0000","last_became_peered":"2024-05-27T12:33:36.322470+0000","last_unstale":"2024-05-27T12:33:36.329554+0000","last_undegraded":"2024-05-27T12:33:36.329554+0000","last_fullsized":"2024-05-27T12:33:36.329554+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_clean_scrub_stamp":"2024-05-27T12:33:35.284230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:51:23.021358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T12:33:37.972205+0000","last_change":"2024-05-27T12:33:36.315499+0000","last_active":"2024-05-27T12:33:37.972205+0000","last_peered":"2024-05-27T12:33:37.972205+0000","last_clean":"2024-05-27T12:33:37.972205+0000","last_became_active":"2024-05-27T12:33:36.315224+0000","last_became_peered":"2024-05-27T12:33:36.315224+0000","last_unstale":"2024-05-27T12:33:37.972205+0000","last_undegraded":"2024-05-27T12:33:37.972205+0000","last_fullsized":"2024-05-27T12:33:37.972205+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_clean_scrub_stamp":"2024-05-27T12:33:35.284230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:21:33.852199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T12:33:38.115361+0000","last_change":"2024-05-27T12:33:36.327853+0000","last_active":"2024-05-27T12:33:38.115361+0000","last_peered":"2024-05-27T12:33:38.115361+0000","last_clean":"2024-05-27T12:33:38.115361+0000","last_became_active":"2024-05-27T12:33:36.327568+0000","last_became_peered":"2024-05-27T12:33:36.327568+0000","last_unstale":"2024-05-27T12:33:38.115361+0000","last_undegraded":"2024-05-27T12:33:38.115361+0000","last_fullsized":"2024-05-27T12:33:38.115361+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_clean_scrub_stamp":"2024-05-27T12:33:35.284230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:49:40.768251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T12:33:37.311532+0000","last_change":"2024-05-27T12:33:36.313675+0000","last_active":"2024-05-27T12:33:37.311532+0000","last_peered":"2024-05-27T12:33:37.311532+0000","last_clean":"2024-05-27T12:33:37.311532+0000","last_became_active":"2024-05-27T12:33:36.313361+0000","last_became_peered":"2024-05-27T12:33:36.313361+0000","last_unstale":"2024-05-27T12:33:37.311532+0000","last_undegraded":"2024-05-27T12:33:37.311532+0000","last_fullsized":"2024-05-27T12:33:37.311532+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_clean_scrub_stamp":"2024-05-27T12:33:35.284230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:31:43.112287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-27T12:33:36.329336+0000","last_change":"2024-05-27T12:33:36.325512+0000","last_active":"2024-05-27T12:33:36.329336+0000","last_peered":"2024-05-27T12:33:36.329336+0000","last_clean":"2024-05-27T12:33:36.329336+0000","last_became_active":"2024-05-27T12:33:36.324670+0000","last_became_peered":"2024-05-27T12:33:36.324670+0000","last_unstale":"2024-05-27T12:33:36.329336+0000","last_undegraded":"2024-05-27T12:33:36.329336+0000","last_fullsized":"2024-05-27T12:33:36.329336+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_clean_scrub_stamp":"2024-05-27T12:33:35.284230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:09:32.352795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T12:33:37.311742+0000","last_change":"2024-05-27T12:33:36.314614+0000","last_active":"2024-05-27T12:33:37.311742+0000","last_peered":"2024-05-27T12:33:37.311742+0000","last_clean":"2024-05-27T12:33:37.311742+0000","last_became_active":"2024-05-27T12:33:36.314350+0000","last_became_peered":"2024-05-27T12:33:36.314350+0000","last_unstale":"2024-05-27T12:33:37.311742+0000","last_undegraded":"2024-05-27T12:33:37.311742+0000","last_fullsized":"2024-05-27T12:33:37.311742+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_clean_scrub_stamp":"2024-05-27T12:33:35.284230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:21:33.852199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-27T12:33:36.314202+0000","last_change":"2024-05-27T12:33:36.306672+0000","last_active":"2024-05-27T12:33:36.314202+0000","last_peered":"2024-05-27T12:33:36.314202+0000","last_clean":"2024-05-27T12:33:36.314202+0000","last_became_active":"2024-05-27T12:33:36.306375+0000","last_became_peered":"2024-05-27T12:33:36.306375+0000","last_unstale":"2024-05-27T12:33:36.314202+0000","last_undegraded":"2024-05-27T12:33:36.314202+0000","last_fullsized":"2024-05-27T12:33:36.314202+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_clean_scrub_stamp":"2024-05-27T12:33:35.284230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:15:22.260330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"35'4","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-27T12:33:36.324704+0000","last_change":"2024-05-27T12:33:35.325498+0000","last_active":"2024-05-27T12:33:36.324704+0000","last_peered":"2024-05-27T12:33:36.324704+0000","last_clean":"2024-05-27T12:33:36.324704+0000","last_became_active":"2024-05-27T12:33:35.325214+0000","last_became_peered":"2024-05-27T12:33:35.325214+0000","last_unstale":"2024-05-27T12:33:36.324704+0000","last_undegraded":"2024-05-27T12:33:36.324704+0000","last_fullsized":"2024-05-27T12:33:36.324704+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:34.272777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:34.272777+0000","last_clean_scrub_stamp":"2024-05-27T12:33:34.272777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:38:59.846163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-27T12:33:36.321741+0000","last_change":"2024-05-27T12:33:36.317427+0000","last_active":"2024-05-27T12:33:36.321741+0000","last_peered":"2024-05-27T12:33:36.321741+0000","last_clean":"2024-05-27T12:33:36.321741+0000","last_became_active":"2024-05-27T12:33:36.317144+0000","last_became_peered":"2024-05-27T12:33:36.317144+0000","last_unstale":"2024-05-27T12:33:36.321741+0000","last_undegraded":"2024-05-27T12:33:36.321741+0000","last_fullsized":"2024-05-27T12:33:36.321741+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_clean_scrub_stamp":"2024-05-27T12:33:35.284230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:52:27.285148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"35'1","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-27T12:33:36.321464+0000","last_change":"2024-05-27T12:33:35.314393+0000","last_active":"2024-05-27T12:33:36.321464+0000","last_peered":"2024-05-27T12:33:36.321464+0000","last_clean":"2024-05-27T12:33:36.321464+0000","last_became_active":"2024-05-27T12:33:35.314063+0000","last_became_peered":"2024-05-27T12:33:35.314063+0000","last_unstale":"2024-05-27T12:33:36.321464+0000","last_undegraded":"2024-05-27T12:33:36.321464+0000","last_fullsized":"2024-05-27T12:33:36.321464+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:34.272777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:34.272777+0000","last_clean_scrub_stamp":"2024-05-27T12:33:34.272777+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:47:34.570227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T12:33:38.115504+0000","last_change":"2024-05-27T12:33:36.326414+0000","last_active":"2024-05-27T12:33:38.115504+0000","last_peered":"2024-05-27T12:33:38.115504+0000","last_clean":"2024-05-27T12:33:38.115504+0000","last_became_active":"2024-05-27T12:33:36.326040+0000","last_became_peered":"2024-05-27T12:33:36.326040+0000","last_unstale":"2024-05-27T12:33:38.115504+0000","last_undegraded":"2024-05-27T12:33:38.115504+0000","last_fullsized":"2024-05-27T12:33:38.115504+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_clean_scrub_stamp":"2024-05-27T12:33:35.284230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:22:49.224603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"35'2","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T12:33:37.311766+0000","last_change":"2024-05-27T12:33:35.314814+0000","last_active":"2024-05-27T12:33:37.311766+0000","last_peered":"2024-05-27T12:33:37.311766+0000","last_clean":"2024-05-27T12:33:37.311766+0000","last_became_active":"2024-05-27T12:33:35.314233+0000","last_became_peered":"2024-05-27T12:33:35.314233+0000","last_unstale":"2024-05-27T12:33:37.311766+0000","last_undegraded":"2024-05-27T12:33:37.311766+0000","last_fullsized":"2024-05-27T12:33:37.311766+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:34.272777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:34.272777+0000","last_clean_scrub_stamp":"2024-05-27T12:33:34.272777+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:03:36.345169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-27T12:33:36.329518+0000","last_change":"2024-05-27T12:33:36.318145+0000","last_active":"2024-05-27T12:33:36.329518+0000","last_peered":"2024-05-27T12:33:36.329518+0000","last_clean":"2024-05-27T12:33:36.329518+0000","last_became_active":"2024-05-27T12:33:36.317383+0000","last_became_peered":"2024-05-27T12:33:36.317383+0000","last_unstale":"2024-05-27T12:33:36.329518+0000","last_undegraded":"2024-05-27T12:33:36.329518+0000","last_fullsized":"2024-05-27T12:33:36.329518+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_clean_scrub_stamp":"2024-05-27T12:33:35.284230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:49:40.768251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"35'2","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-27T12:33:36.328317+0000","last_change":"2024-05-27T12:33:35.315563+0000","last_active":"2024-05-27T12:33:36.328317+0000","last_peered":"2024-05-27T12:33:36.328317+0000","last_clean":"2024-05-27T12:33:36.328317+0000","last_became_active":"2024-05-27T12:33:35.314709+0000","last_became_peered":"2024-05-27T12:33:35.314709+0000","last_unstale":"2024-05-27T12:33:36.328317+0000","last_undegraded":"2024-05-27T12:33:36.328317+0000","last_fullsized":"2024-05-27T12:33:36.328317+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:34.272777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:34.272777+0000","last_clean_scrub_stamp":"2024-05-27T12:33:34.272777+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:50:12.109735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T12:33:37.311727+0000","last_change":"2024-05-27T12:33:36.315414+0000","last_active":"2024-05-27T12:33:37.311727+0000","last_peered":"2024-05-27T12:33:37.311727+0000","last_clean":"2024-05-27T12:33:37.311727+0000","last_became_active":"2024-05-27T12:33:36.315114+0000","last_became_peered":"2024-05-27T12:33:36.315114+0000","last_unstale":"2024-05-27T12:33:37.311727+0000","last_undegraded":"2024-05-27T12:33:37.311727+0000","last_fullsized":"2024-05-27T12:33:37.311727+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_clean_scrub_stamp":"2024-05-27T12:33:35.284230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T12:33:51.478610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"35'1","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T12:33:38.115495+0000","last_change":"2024-05-27T12:33:35.320535+0000","last_active":"2024-05-27T12:33:38.115495+0000","last_peered":"2024-05-27T12:33:38.115495+0000","last_clean":"2024-05-27T12:33:38.115495+0000","last_became_active":"2024-05-27T12:33:35.319915+0000","last_became_peered":"2024-05-27T12:33:35.319915+0000","last_unstale":"2024-05-27T12:33:38.115495+0000","last_undegraded":"2024-05-27T12:33:38.115495+0000","last_fullsized":"2024-05-27T12:33:38.115495+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:34.272777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:34.272777+0000","last_clean_scrub_stamp":"2024-05-27T12:33:34.272777+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:46:09.692663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T12:33:37.972028+0000","last_change":"2024-05-27T12:33:36.318608+0000","last_active":"2024-05-27T12:33:37.972028+0000","last_peered":"2024-05-27T12:33:37.972028+0000","last_clean":"2024-05-27T12:33:37.972028+0000","last_became_active":"2024-05-27T12:33:36.318259+0000","last_became_peered":"2024-05-27T12:33:36.318259+0000","last_unstale":"2024-05-27T12:33:37.972028+0000","last_undegraded":"2024-05-27T12:33:37.972028+0000","last_fullsized":"2024-05-27T12:33:37.972028+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_clean_scrub_stamp":"2024-05-27T12:33:35.284230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:43:50.999505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"35'1","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T12:33:38.115254+0000","last_change":"2024-05-27T12:33:35.320312+0000","last_active":"2024-05-27T12:33:38.115254+0000","last_peered":"2024-05-27T12:33:38.115254+0000","last_clean":"2024-05-27T12:33:38.115254+0000","last_became_active":"2024-05-27T12:33:35.319822+0000","last_became_peered":"2024-05-27T12:33:35.319822+0000","last_unstale":"2024-05-27T12:33:38.115254+0000","last_undegraded":"2024-05-27T12:33:38.115254+0000","last_fullsized":"2024-05-27T12:33:38.115254+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:34.272777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:34.272777+0000","last_clean_scrub_stamp":"2024-05-27T12:33:34.272777+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T22:08:20.272945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T12:33:38.115209+0000","last_change":"2024-05-27T12:33:36.311305+0000","last_active":"2024-05-27T12:33:38.115209+0000","last_peered":"2024-05-27T12:33:38.115209+0000","last_clean":"2024-05-27T12:33:38.115209+0000","last_became_active":"2024-05-27T12:33:36.310641+0000","last_became_peered":"2024-05-27T12:33:36.310641+0000","last_unstale":"2024-05-27T12:33:38.115209+0000","last_undegraded":"2024-05-27T12:33:38.115209+0000","last_fullsized":"2024-05-27T12:33:38.115209+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_clean_scrub_stamp":"2024-05-27T12:33:35.284230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:59:08.435274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T12:33:37.311551+0000","last_change":"2024-05-27T12:33:35.311498+0000","last_active":"2024-05-27T12:33:37.311551+0000","last_peered":"2024-05-27T12:33:37.311551+0000","last_clean":"2024-05-27T12:33:37.311551+0000","last_became_active":"2024-05-27T12:33:35.311196+0000","last_became_peered":"2024-05-27T12:33:35.311196+0000","last_unstale":"2024-05-27T12:33:37.311551+0000","last_undegraded":"2024-05-27T12:33:37.311551+0000","last_fullsized":"2024-05-27T12:33:37.311551+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:34.272777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:34.272777+0000","last_clean_scrub_stamp":"2024-05-27T12:33:34.272777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:51:22.009905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-27T12:33:36.326610+0000","last_change":"2024-05-27T12:33:36.315292+0000","last_active":"2024-05-27T12:33:36.326610+0000","last_peered":"2024-05-27T12:33:36.326610+0000","last_clean":"2024-05-27T12:33:36.326610+0000","last_became_active":"2024-05-27T12:33:36.315029+0000","last_became_peered":"2024-05-27T12:33:36.315029+0000","last_unstale":"2024-05-27T12:33:36.326610+0000","last_undegraded":"2024-05-27T12:33:36.326610+0000","last_fullsized":"2024-05-27T12:33:36.326610+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_clean_scrub_stamp":"2024-05-27T12:33:35.284230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:09:32.352795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T12:33:38.115104+0000","last_change":"2024-05-27T12:33:35.318492+0000","last_active":"2024-05-27T12:33:38.115104+0000","last_peered":"2024-05-27T12:33:38.115104+0000","last_clean":"2024-05-27T12:33:38.115104+0000","last_became_active":"2024-05-27T12:33:35.318106+0000","last_became_peered":"2024-05-27T12:33:35.318106+0000","last_unstale":"2024-05-27T12:33:38.115104+0000","last_undegraded":"2024-05-27T12:33:38.115104+0000","last_fullsized":"2024-05-27T12:33:38.115104+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:34.272777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:34.272777+0000","last_clean_scrub_stamp":"2024-05-27T12:33:34.272777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:35:42.639120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T12:33:37.972293+0000","last_change":"2024-05-27T12:33:36.325529+0000","last_active":"2024-05-27T12:33:37.972293+0000","last_peered":"2024-05-27T12:33:37.972293+0000","last_clean":"2024-05-27T12:33:37.972293+0000","last_became_active":"2024-05-27T12:33:36.325107+0000","last_became_peered":"2024-05-27T12:33:36.325107+0000","last_unstale":"2024-05-27T12:33:37.972293+0000","last_undegraded":"2024-05-27T12:33:37.972293+0000","last_fullsized":"2024-05-27T12:33:37.972293+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_clean_scrub_stamp":"2024-05-27T12:33:35.284230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:20:39.722410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T12:33:37.311929+0000","last_change":"2024-05-27T12:33:35.312728+0000","last_active":"2024-05-27T12:33:37.311929+0000","last_peered":"2024-05-27T12:33:37.311929+0000","last_clean":"2024-05-27T12:33:37.311929+0000","last_became_active":"2024-05-27T12:33:35.312406+0000","last_became_peered":"2024-05-27T12:33:35.312406+0000","last_unstale":"2024-05-27T12:33:37.311929+0000","last_undegraded":"2024-05-27T12:33:37.311929+0000","last_fullsized":"2024-05-27T12:33:37.311929+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:34.272777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:34.272777+0000","last_clean_scrub_stamp":"2024-05-27T12:33:34.272777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:22:48.213150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T12:33:37.311983+0000","last_change":"2024-05-27T12:33:36.333681+0000","last_active":"2024-05-27T12:33:37.311983+0000","last_peered":"2024-05-27T12:33:37.311983+0000","last_clean":"2024-05-27T12:33:37.311983+0000","last_became_active":"2024-05-27T12:33:36.333313+0000","last_became_peered":"2024-05-27T12:33:36.333313+0000","last_unstale":"2024-05-27T12:33:37.311983+0000","last_undegraded":"2024-05-27T12:33:37.311983+0000","last_fullsized":"2024-05-27T12:33:37.311983+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_clean_scrub_stamp":"2024-05-27T12:33:35.284230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T17:09:06.683768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-27T12:33:36.302004+0000","last_change":"2024-05-27T12:33:35.320305+0000","last_active":"2024-05-27T12:33:36.302004+0000","last_peered":"2024-05-27T12:33:36.302004+0000","last_clean":"2024-05-27T12:33:36.302004+0000","last_became_active":"2024-05-27T12:33:35.320024+0000","last_became_peered":"2024-05-27T12:33:35.320024+0000","last_unstale":"2024-05-27T12:33:36.302004+0000","last_undegraded":"2024-05-27T12:33:36.302004+0000","last_fullsized":"2024-05-27T12:33:36.302004+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:34.272777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:34.272777+0000","last_clean_scrub_stamp":"2024-05-27T12:33:34.272777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:14:17.404607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T12:33:37.311911+0000","last_change":"2024-05-27T12:33:36.325808+0000","last_active":"2024-05-27T12:33:37.311911+0000","last_peered":"2024-05-27T12:33:37.311911+0000","last_clean":"2024-05-27T12:33:37.311911+0000","last_became_active":"2024-05-27T12:33:36.325178+0000","last_became_peered":"2024-05-27T12:33:36.325178+0000","last_unstale":"2024-05-27T12:33:37.311911+0000","last_undegraded":"2024-05-27T12:33:37.311911+0000","last_fullsized":"2024-05-27T12:33:37.311911+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_clean_scrub_stamp":"2024-05-27T12:33:35.284230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T23:26:05.295795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"35'3","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T12:33:37.972263+0000","last_change":"2024-05-27T12:33:35.313239+0000","last_active":"2024-05-27T12:33:37.972263+0000","last_peered":"2024-05-27T12:33:37.972263+0000","last_clean":"2024-05-27T12:33:37.972263+0000","last_became_active":"2024-05-27T12:33:35.312930+0000","last_became_peered":"2024-05-27T12:33:35.312930+0000","last_unstale":"2024-05-27T12:33:37.972263+0000","last_undegraded":"2024-05-27T12:33:37.972263+0000","last_fullsized":"2024-05-27T12:33:37.972263+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:34.272777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:34.272777+0000","last_clean_scrub_stamp":"2024-05-27T12:33:34.272777+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:03:36.345169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T12:33:37.972096+0000","last_change":"2024-05-27T12:33:36.328533+0000","last_active":"2024-05-27T12:33:37.972096+0000","last_peered":"2024-05-27T12:33:37.972096+0000","last_clean":"2024-05-27T12:33:37.972096+0000","last_became_active":"2024-05-27T12:33:36.328248+0000","last_became_peered":"2024-05-27T12:33:36.328248+0000","last_unstale":"2024-05-27T12:33:37.972096+0000","last_undegraded":"2024-05-27T12:33:37.972096+0000","last_fullsized":"2024-05-27T12:33:37.972096+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_clean_scrub_stamp":"2024-05-27T12:33:35.284230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:24:08.125844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"35'6","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T12:33:37.311793+0000","last_change":"2024-05-27T12:33:35.319748+0000","last_active":"2024-05-27T12:33:37.311793+0000","last_peered":"2024-05-27T12:33:37.311793+0000","last_clean":"2024-05-27T12:33:37.311793+0000","last_became_active":"2024-05-27T12:33:35.319418+0000","last_became_peered":"2024-05-27T12:33:35.319418+0000","last_unstale":"2024-05-27T12:33:37.311793+0000","last_undegraded":"2024-05-27T12:33:37.311793+0000","last_fullsized":"2024-05-27T12:33:37.311793+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:34.272777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:34.272777+0000","last_clean_scrub_stamp":"2024-05-27T12:33:34.272777+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:28:51.377628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-27T12:33:36.329974+0000","last_change":"2024-05-27T12:33:36.319991+0000","last_active":"2024-05-27T12:33:36.329974+0000","last_peered":"2024-05-27T12:33:36.329974+0000","last_clean":"2024-05-27T12:33:36.329974+0000","last_became_active":"2024-05-27T12:33:36.319698+0000","last_became_peered":"2024-05-27T12:33:36.319698+0000","last_unstale":"2024-05-27T12:33:36.329974+0000","last_undegraded":"2024-05-27T12:33:36.329974+0000","last_fullsized":"2024-05-27T12:33:36.329974+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_clean_scrub_stamp":"2024-05-27T12:33:35.284230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:06:13.907502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"35'2","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T12:33:38.115581+0000","last_change":"2024-05-27T12:33:35.320983+0000","last_active":"2024-05-27T12:33:38.115581+0000","last_peered":"2024-05-27T12:33:38.115581+0000","last_clean":"2024-05-27T12:33:38.115581+0000","last_became_active":"2024-05-27T12:33:35.320659+0000","last_became_peered":"2024-05-27T12:33:35.320659+0000","last_unstale":"2024-05-27T12:33:38.115581+0000","last_undegraded":"2024-05-27T12:33:38.115581+0000","last_fullsized":"2024-05-27T12:33:38.115581+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:34.272777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:34.272777+0000","last_clean_scrub_stamp":"2024-05-27T12:33:34.272777+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T23:02:56.767466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T12:33:37.311735+0000","last_change":"2024-05-27T12:33:36.321242+0000","last_active":"2024-05-27T12:33:37.311735+0000","last_peered":"2024-05-27T12:33:37.311735+0000","last_clean":"2024-05-27T12:33:37.311735+0000","last_became_active":"2024-05-27T12:33:36.320354+0000","last_became_peered":"2024-05-27T12:33:36.320354+0000","last_unstale":"2024-05-27T12:33:37.311735+0000","last_undegraded":"2024-05-27T12:33:37.311735+0000","last_fullsized":"2024-05-27T12:33:37.311735+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_clean_scrub_stamp":"2024-05-27T12:33:35.284230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:50:34.508404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-27T12:33:36.306370+0000","last_change":"2024-05-27T12:33:35.321157+0000","last_active":"2024-05-27T12:33:36.306370+0000","last_peered":"2024-05-27T12:33:36.306370+0000","last_clean":"2024-05-27T12:33:36.306370+0000","last_became_active":"2024-05-27T12:33:35.320866+0000","last_became_peered":"2024-05-27T12:33:35.320866+0000","last_unstale":"2024-05-27T12:33:36.306370+0000","last_undegraded":"2024-05-27T12:33:36.306370+0000","last_fullsized":"2024-05-27T12:33:36.306370+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:34.272777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:34.272777+0000","last_clean_scrub_stamp":"2024-05-27T12:33:34.272777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:47:17.699647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T12:33:37.311661+0000","last_change":"2024-05-27T12:33:36.312816+0000","last_active":"2024-05-27T12:33:37.311661+0000","last_peered":"2024-05-27T12:33:37.311661+0000","last_clean":"2024-05-27T12:33:37.311661+0000","last_became_active":"2024-05-27T12:33:36.312563+0000","last_became_peered":"2024-05-27T12:33:36.312563+0000","last_unstale":"2024-05-27T12:33:37.311661+0000","last_undegraded":"2024-05-27T12:33:37.311661+0000","last_fullsized":"2024-05-27T12:33:37.311661+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_clean_scrub_stamp":"2024-05-27T12:33:35.284230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:43:50.999505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T12:33:37.311394+0000","last_change":"2024-05-27T12:33:35.312264+0000","last_active":"2024-05-27T12:33:37.311394+0000","last_peered":"2024-05-27T12:33:37.311394+0000","last_clean":"2024-05-27T12:33:37.311394+0000","last_became_active":"2024-05-27T12:33:35.312009+0000","last_became_peered":"2024-05-27T12:33:35.312009+0000","last_unstale":"2024-05-27T12:33:37.311394+0000","last_undegraded":"2024-05-27T12:33:37.311394+0000","last_fullsized":"2024-05-27T12:33:37.311394+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:34.272777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:34.272777+0000","last_clean_scrub_stamp":"2024-05-27T12:33:34.272777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:36:03.625091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-27T12:33:36.321669+0000","last_change":"2024-05-27T12:33:36.313860+0000","last_active":"2024-05-27T12:33:36.321669+0000","last_peered":"2024-05-27T12:33:36.321669+0000","last_clean":"2024-05-27T12:33:36.321669+0000","last_became_active":"2024-05-27T12:33:36.313599+0000","last_became_peered":"2024-05-27T12:33:36.313599+0000","last_unstale":"2024-05-27T12:33:36.321669+0000","last_undegraded":"2024-05-27T12:33:36.321669+0000","last_fullsized":"2024-05-27T12:33:36.321669+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_clean_scrub_stamp":"2024-05-27T12:33:35.284230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:47:18.711099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"35'8","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T12:33:37.311453+0000","last_change":"2024-05-27T12:33:35.315350+0000","last_active":"2024-05-27T12:33:37.311453+0000","last_peered":"2024-05-27T12:33:37.311453+0000","last_clean":"2024-05-27T12:33:37.311453+0000","last_became_active":"2024-05-27T12:33:35.315062+0000","last_became_peered":"2024-05-27T12:33:35.315062+0000","last_unstale":"2024-05-27T12:33:37.311453+0000","last_undegraded":"2024-05-27T12:33:37.311453+0000","last_fullsized":"2024-05-27T12:33:37.311453+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:34.272777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:34.272777+0000","last_clean_scrub_stamp":"2024-05-27T12:33:34.272777+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:02:07.380108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T12:33:38.115672+0000","last_change":"2024-05-27T12:33:36.314651+0000","last_active":"2024-05-27T12:33:38.115672+0000","last_peered":"2024-05-27T12:33:38.115672+0000","last_clean":"2024-05-27T12:33:38.115672+0000","last_became_active":"2024-05-27T12:33:36.314264+0000","last_became_peered":"2024-05-27T12:33:36.314264+0000","last_unstale":"2024-05-27T12:33:38.115672+0000","last_undegraded":"2024-05-27T12:33:38.115672+0000","last_fullsized":"2024-05-27T12:33:38.115672+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_clean_scrub_stamp":"2024-05-27T12:33:35.284230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:03:37.356621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"35'1","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-27T12:33:36.331632+0000","last_change":"2024-05-27T12:33:35.314462+0000","last_active":"2024-05-27T12:33:36.331632+0000","last_peered":"2024-05-27T12:33:36.331632+0000","last_clean":"2024-05-27T12:33:36.331632+0000","last_became_active":"2024-05-27T12:33:35.314115+0000","last_became_peered":"2024-05-27T12:33:35.314115+0000","last_unstale":"2024-05-27T12:33:36.331632+0000","last_undegraded":"2024-05-27T12:33:36.331632+0000","last_fullsized":"2024-05-27T12:33:36.331632+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:34.272777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:34.272777+0000","last_clean_scrub_stamp":"2024-05-27T12:33:34.272777+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:52:26.273696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T12:33:37.972389+0000","last_change":"2024-05-27T12:33:36.311826+0000","last_active":"2024-05-27T12:33:37.972389+0000","last_peered":"2024-05-27T12:33:37.972389+0000","last_clean":"2024-05-27T12:33:37.972389+0000","last_became_active":"2024-05-27T12:33:36.310935+0000","last_became_peered":"2024-05-27T12:33:36.310935+0000","last_unstale":"2024-05-27T12:33:37.972389+0000","last_undegraded":"2024-05-27T12:33:37.972389+0000","last_fullsized":"2024-05-27T12:33:37.972389+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_clean_scrub_stamp":"2024-05-27T12:33:35.284230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:04:18.874449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"35'2","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T12:33:38.115596+0000","last_change":"2024-05-27T12:33:35.318457+0000","last_active":"2024-05-27T12:33:38.115596+0000","last_peered":"2024-05-27T12:33:38.115596+0000","last_clean":"2024-05-27T12:33:38.115596+0000","last_became_active":"2024-05-27T12:33:35.318111+0000","last_became_peered":"2024-05-27T12:33:35.318111+0000","last_unstale":"2024-05-27T12:33:38.115596+0000","last_undegraded":"2024-05-27T12:33:38.115596+0000","last_fullsized":"2024-05-27T12:33:38.115596+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:34.272777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:34.272777+0000","last_clean_scrub_stamp":"2024-05-27T12:33:34.272777+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T00:02:23.923356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-27T12:33:36.329495+0000","last_change":"2024-05-27T12:33:36.321764+0000","last_active":"2024-05-27T12:33:36.329495+0000","last_peered":"2024-05-27T12:33:36.329495+0000","last_clean":"2024-05-27T12:33:36.329495+0000","last_became_active":"2024-05-27T12:33:36.321510+0000","last_became_peered":"2024-05-27T12:33:36.321510+0000","last_unstale":"2024-05-27T12:33:36.329495+0000","last_undegraded":"2024-05-27T12:33:36.329495+0000","last_fullsized":"2024-05-27T12:33:36.329495+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_clean_scrub_stamp":"2024-05-27T12:33:35.284230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:22:49.224603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"35'1","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T12:33:38.115646+0000","last_change":"2024-05-27T12:33:35.319171+0000","last_active":"2024-05-27T12:33:38.115646+0000","last_peered":"2024-05-27T12:33:38.115646+0000","last_clean":"2024-05-27T12:33:38.115646+0000","last_became_active":"2024-05-27T12:33:35.318890+0000","last_became_peered":"2024-05-27T12:33:35.318890+0000","last_unstale":"2024-05-27T12:33:38.115646+0000","last_undegraded":"2024-05-27T12:33:38.115646+0000","last_fullsized":"2024-05-27T12:33:38.115646+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:34.272777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:34.272777+0000","last_clean_scrub_stamp":"2024-05-27T12:33:34.272777+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:47:19.054571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-27T12:33:36.328367+0000","last_change":"2024-05-27T12:33:36.324428+0000","last_active":"2024-05-27T12:33:36.328367+0000","last_peered":"2024-05-27T12:33:36.328367+0000","last_clean":"2024-05-27T12:33:36.328367+0000","last_became_active":"2024-05-27T12:33:36.324175+0000","last_became_peered":"2024-05-27T12:33:36.324175+0000","last_unstale":"2024-05-27T12:33:36.328367+0000","last_undegraded":"2024-05-27T12:33:36.328367+0000","last_fullsized":"2024-05-27T12:33:36.328367+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_clean_scrub_stamp":"2024-05-27T12:33:35.284230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:10:21.369836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T12:33:38.115429+0000","last_change":"2024-05-27T12:33:35.320626+0000","last_active":"2024-05-27T12:33:38.115429+0000","last_peered":"2024-05-27T12:33:38.115429+0000","last_clean":"2024-05-27T12:33:38.115429+0000","last_became_active":"2024-05-27T12:33:35.320221+0000","last_became_peered":"2024-05-27T12:33:35.320221+0000","last_unstale":"2024-05-27T12:33:38.115429+0000","last_undegraded":"2024-05-27T12:33:38.115429+0000","last_fullsized":"2024-05-27T12:33:38.115429+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:34.272777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:34.272777+0000","last_clean_scrub_stamp":"2024-05-27T12:33:34.272777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:12:38.126085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-27T12:33:36.331082+0000","last_change":"2024-05-27T12:33:36.325799+0000","last_active":"2024-05-27T12:33:36.331082+0000","last_peered":"2024-05-27T12:33:36.331082+0000","last_clean":"2024-05-27T12:33:36.331082+0000","last_became_active":"2024-05-27T12:33:36.325289+0000","last_became_peered":"2024-05-27T12:33:36.325289+0000","last_unstale":"2024-05-27T12:33:36.331082+0000","last_undegraded":"2024-05-27T12:33:36.331082+0000","last_fullsized":"2024-05-27T12:33:36.331082+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_clean_scrub_stamp":"2024-05-27T12:33:35.284230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:09:09.241291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"35'2","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-27T12:33:36.328225+0000","last_change":"2024-05-27T12:33:35.320065+0000","last_active":"2024-05-27T12:33:36.328225+0000","last_peered":"2024-05-27T12:33:36.328225+0000","last_clean":"2024-05-27T12:33:36.328225+0000","last_became_active":"2024-05-27T12:33:35.319781+0000","last_became_peered":"2024-05-27T12:33:35.319781+0000","last_unstale":"2024-05-27T12:33:36.328225+0000","last_undegraded":"2024-05-27T12:33:36.328225+0000","last_fullsized":"2024-05-27T12:33:36.328225+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:34.272777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:34.272777+0000","last_clean_scrub_stamp":"2024-05-27T12:33:34.272777+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T23:15:01.695621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-27T12:33:36.328463+0000","last_change":"2024-05-27T12:33:36.323354+0000","last_active":"2024-05-27T12:33:36.328463+0000","last_peered":"2024-05-27T12:33:36.328463+0000","last_clean":"2024-05-27T12:33:36.328463+0000","last_became_active":"2024-05-27T12:33:36.323088+0000","last_became_peered":"2024-05-27T12:33:36.323088+0000","last_unstale":"2024-05-27T12:33:36.328463+0000","last_undegraded":"2024-05-27T12:33:36.328463+0000","last_fullsized":"2024-05-27T12:33:36.328463+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_clean_scrub_stamp":"2024-05-27T12:33:35.284230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:11:04.651952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-27T12:33:36.309706+0000","last_change":"2024-05-27T12:33:35.325112+0000","last_active":"2024-05-27T12:33:36.309706+0000","last_peered":"2024-05-27T12:33:36.309706+0000","last_clean":"2024-05-27T12:33:36.309706+0000","last_became_active":"2024-05-27T12:33:35.324750+0000","last_became_peered":"2024-05-27T12:33:35.324750+0000","last_unstale":"2024-05-27T12:33:36.309706+0000","last_undegraded":"2024-05-27T12:33:36.309706+0000","last_fullsized":"2024-05-27T12:33:36.309706+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:34.272777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:34.272777+0000","last_clean_scrub_stamp":"2024-05-27T12:33:34.272777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T00:25:57.154617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-27T12:33:36.325256+0000","last_change":"2024-05-27T12:33:36.320799+0000","last_active":"2024-05-27T12:33:36.325256+0000","last_peered":"2024-05-27T12:33:36.325256+0000","last_clean":"2024-05-27T12:33:36.325256+0000","last_became_active":"2024-05-27T12:33:36.320492+0000","last_became_peered":"2024-05-27T12:33:36.320492+0000","last_unstale":"2024-05-27T12:33:36.325256+0000","last_undegraded":"2024-05-27T12:33:36.325256+0000","last_fullsized":"2024-05-27T12:33:36.325256+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_clean_scrub_stamp":"2024-05-27T12:33:35.284230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:32:06.319169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T12:33:38.115171+0000","last_change":"2024-05-27T12:33:35.320409+0000","last_active":"2024-05-27T12:33:38.115171+0000","last_peered":"2024-05-27T12:33:38.115171+0000","last_clean":"2024-05-27T12:33:38.115171+0000","last_became_active":"2024-05-27T12:33:35.320108+0000","last_became_peered":"2024-05-27T12:33:35.320108+0000","last_unstale":"2024-05-27T12:33:38.115171+0000","last_undegraded":"2024-05-27T12:33:38.115171+0000","last_fullsized":"2024-05-27T12:33:38.115171+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:34.272777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:34.272777+0000","last_clean_scrub_stamp":"2024-05-27T12:33:34.272777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:09:08.229839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T12:33:37.311531+0000","last_change":"2024-05-27T12:33:36.311530+0000","last_active":"2024-05-27T12:33:37.311531+0000","last_peered":"2024-05-27T12:33:37.311531+0000","last_clean":"2024-05-27T12:33:37.311531+0000","last_became_active":"2024-05-27T12:33:36.311243+0000","last_became_peered":"2024-05-27T12:33:36.311243+0000","last_unstale":"2024-05-27T12:33:37.311531+0000","last_undegraded":"2024-05-27T12:33:37.311531+0000","last_fullsized":"2024-05-27T12:33:37.311531+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_clean_scrub_stamp":"2024-05-27T12:33:35.284230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-29T00:27:04.534327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T12:33:37.971794+0000","last_change":"2024-05-27T12:33:35.313757+0000","last_active":"2024-05-27T12:33:37.971794+0000","last_peered":"2024-05-27T12:33:37.971794+0000","last_clean":"2024-05-27T12:33:37.971794+0000","last_became_active":"2024-05-27T12:33:35.313442+0000","last_became_peered":"2024-05-27T12:33:35.313442+0000","last_unstale":"2024-05-27T12:33:37.971794+0000","last_undegraded":"2024-05-27T12:33:37.971794+0000","last_fullsized":"2024-05-27T12:33:37.971794+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:34.272777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:34.272777+0000","last_clean_scrub_stamp":"2024-05-27T12:33:34.272777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:22:48.213150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-27T12:33:36.328129+0000","last_change":"2024-05-27T12:33:36.322939+0000","last_active":"2024-05-27T12:33:36.328129+0000","last_peered":"2024-05-27T12:33:36.328129+0000","last_clean":"2024-05-27T12:33:36.328129+0000","last_became_active":"2024-05-27T12:33:36.322537+0000","last_became_peered":"2024-05-27T12:33:36.322537+0000","last_unstale":"2024-05-27T12:33:36.328129+0000","last_undegraded":"2024-05-27T12:33:36.328129+0000","last_fullsized":"2024-05-27T12:33:36.328129+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_clean_scrub_stamp":"2024-05-27T12:33:35.284230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:46:48.176334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"35'2","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-27T12:33:36.329595+0000","last_change":"2024-05-27T12:33:35.316653+0000","last_active":"2024-05-27T12:33:36.329595+0000","last_peered":"2024-05-27T12:33:36.329595+0000","last_clean":"2024-05-27T12:33:36.329595+0000","last_became_active":"2024-05-27T12:33:35.316340+0000","last_became_peered":"2024-05-27T12:33:35.316340+0000","last_unstale":"2024-05-27T12:33:36.329595+0000","last_undegraded":"2024-05-27T12:33:36.329595+0000","last_fullsized":"2024-05-27T12:33:36.329595+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:34.272777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:34.272777+0000","last_clean_scrub_stamp":"2024-05-27T12:33:34.272777+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:59:07.423822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T12:33:37.972388+0000","last_change":"2024-05-27T12:33:36.323758+0000","last_active":"2024-05-27T12:33:37.972388+0000","last_peered":"2024-05-27T12:33:37.972388+0000","last_clean":"2024-05-27T12:33:37.972388+0000","last_became_active":"2024-05-27T12:33:36.323221+0000","last_became_peered":"2024-05-27T12:33:36.323221+0000","last_unstale":"2024-05-27T12:33:37.972388+0000","last_undegraded":"2024-05-27T12:33:37.972388+0000","last_fullsized":"2024-05-27T12:33:37.972388+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_clean_scrub_stamp":"2024-05-27T12:33:35.284230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:50:34.508404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-27T12:33:36.302150+0000","last_change":"2024-05-27T12:33:35.320123+0000","last_active":"2024-05-27T12:33:36.302150+0000","last_peered":"2024-05-27T12:33:36.302150+0000","last_clean":"2024-05-27T12:33:36.302150+0000","last_became_active":"2024-05-27T12:33:35.319819+0000","last_became_peered":"2024-05-27T12:33:35.319819+0000","last_unstale":"2024-05-27T12:33:36.302150+0000","last_undegraded":"2024-05-27T12:33:36.302150+0000","last_fullsized":"2024-05-27T12:33:36.302150+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:34.272777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:34.272777+0000","last_clean_scrub_stamp":"2024-05-27T12:33:34.272777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T23:14:01.127110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-27T12:33:36.325923+0000","last_change":"2024-05-27T12:33:36.325205+0000","last_active":"2024-05-27T12:33:36.325923+0000","last_peered":"2024-05-27T12:33:36.325923+0000","last_clean":"2024-05-27T12:33:36.325923+0000","last_became_active":"2024-05-27T12:33:36.324924+0000","last_became_peered":"2024-05-27T12:33:36.324924+0000","last_unstale":"2024-05-27T12:33:36.325923+0000","last_undegraded":"2024-05-27T12:33:36.325923+0000","last_fullsized":"2024-05-27T12:33:36.325923+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_clean_scrub_stamp":"2024-05-27T12:33:35.284230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:50:14.197103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-27T12:33:36.306800+0000","last_change":"2024-05-27T12:33:35.313928+0000","last_active":"2024-05-27T12:33:36.306800+0000","last_peered":"2024-05-27T12:33:36.306800+0000","last_clean":"2024-05-27T12:33:36.306800+0000","last_became_active":"2024-05-27T12:33:35.313568+0000","last_became_peered":"2024-05-27T12:33:35.313568+0000","last_unstale":"2024-05-27T12:33:36.306800+0000","last_undegraded":"2024-05-27T12:33:36.306800+0000","last_fullsized":"2024-05-27T12:33:36.306800+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:34.272777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:34.272777+0000","last_clean_scrub_stamp":"2024-05-27T12:33:34.272777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:38:22.082096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-27T12:33:36.323248+0000","last_change":"2024-05-27T12:33:36.321446+0000","last_active":"2024-05-27T12:33:36.323248+0000","last_peered":"2024-05-27T12:33:36.323248+0000","last_clean":"2024-05-27T12:33:36.323248+0000","last_became_active":"2024-05-27T12:33:36.321085+0000","last_became_peered":"2024-05-27T12:33:36.321085+0000","last_unstale":"2024-05-27T12:33:36.323248+0000","last_undegraded":"2024-05-27T12:33:36.323248+0000","last_fullsized":"2024-05-27T12:33:36.323248+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_clean_scrub_stamp":"2024-05-27T12:33:35.284230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:59:08.435274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-27T12:33:36.301944+0000","last_change":"2024-05-27T12:33:35.319206+0000","last_active":"2024-05-27T12:33:36.301944+0000","last_peered":"2024-05-27T12:33:36.301944+0000","last_clean":"2024-05-27T12:33:36.301944+0000","last_became_active":"2024-05-27T12:33:35.318916+0000","last_became_peered":"2024-05-27T12:33:35.318916+0000","last_unstale":"2024-05-27T12:33:36.301944+0000","last_undegraded":"2024-05-27T12:33:36.301944+0000","last_fullsized":"2024-05-27T12:33:36.301944+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:34.272777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:34.272777+0000","last_clean_scrub_stamp":"2024-05-27T12:33:34.272777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:54:35.941785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-27T12:33:36.317702+0000","last_change":"2024-05-27T12:33:36.309083+0000","last_active":"2024-05-27T12:33:36.317702+0000","last_peered":"2024-05-27T12:33:36.317702+0000","last_clean":"2024-05-27T12:33:36.317702+0000","last_became_active":"2024-05-27T12:33:36.308781+0000","last_became_peered":"2024-05-27T12:33:36.308781+0000","last_unstale":"2024-05-27T12:33:36.317702+0000","last_undegraded":"2024-05-27T12:33:36.317702+0000","last_fullsized":"2024-05-27T12:33:36.317702+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_clean_scrub_stamp":"2024-05-27T12:33:35.284230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T13:49:30.856022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-27T12:33:36.306050+0000","last_change":"2024-05-27T12:33:35.315607+0000","last_active":"2024-05-27T12:33:36.306050+0000","last_peered":"2024-05-27T12:33:36.306050+0000","last_clean":"2024-05-27T12:33:36.306050+0000","last_became_active":"2024-05-27T12:33:35.315331+0000","last_became_peered":"2024-05-27T12:33:35.315331+0000","last_unstale":"2024-05-27T12:33:36.306050+0000","last_undegraded":"2024-05-27T12:33:36.306050+0000","last_fullsized":"2024-05-27T12:33:36.306050+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:34.272777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:34.272777+0000","last_clean_scrub_stamp":"2024-05-27T12:33:34.272777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T21:38:59.846163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T12:33:37.311363+0000","last_change":"2024-05-27T12:33:36.333252+0000","last_active":"2024-05-27T12:33:37.311363+0000","last_peered":"2024-05-27T12:33:37.311363+0000","last_clean":"2024-05-27T12:33:37.311363+0000","last_became_active":"2024-05-27T12:33:36.332915+0000","last_became_peered":"2024-05-27T12:33:36.332915+0000","last_unstale":"2024-05-27T12:33:37.311363+0000","last_undegraded":"2024-05-27T12:33:37.311363+0000","last_fullsized":"2024-05-27T12:33:37.311363+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_clean_scrub_stamp":"2024-05-27T12:33:35.284230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:21:33.852199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T12:33:38.115289+0000","last_change":"2024-05-27T12:33:35.314218+0000","last_active":"2024-05-27T12:33:38.115289+0000","last_peered":"2024-05-27T12:33:38.115289+0000","last_clean":"2024-05-27T12:33:38.115289+0000","last_became_active":"2024-05-27T12:33:35.313101+0000","last_became_peered":"2024-05-27T12:33:35.313101+0000","last_unstale":"2024-05-27T12:33:38.115289+0000","last_undegraded":"2024-05-27T12:33:38.115289+0000","last_fullsized":"2024-05-27T12:33:38.115289+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:34.272777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:34.272777+0000","last_clean_scrub_stamp":"2024-05-27T12:33:34.272777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T20:50:20.737955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T12:33:38.115174+0000","last_change":"2024-05-27T12:33:36.325226+0000","last_active":"2024-05-27T12:33:38.115174+0000","last_peered":"2024-05-27T12:33:38.115174+0000","last_clean":"2024-05-27T12:33:38.115174+0000","last_became_active":"2024-05-27T12:33:36.324889+0000","last_became_peered":"2024-05-27T12:33:36.324889+0000","last_unstale":"2024-05-27T12:33:38.115174+0000","last_undegraded":"2024-05-27T12:33:38.115174+0000","last_fullsized":"2024-05-27T12:33:38.115174+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_clean_scrub_stamp":"2024-05-27T12:33:35.284230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T14:52:27.285148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T12:33:37.311349+0000","last_change":"2024-05-27T12:33:35.313499+0000","last_active":"2024-05-27T12:33:37.311349+0000","last_peered":"2024-05-27T12:33:37.311349+0000","last_clean":"2024-05-27T12:33:37.311349+0000","last_became_active":"2024-05-27T12:33:35.313223+0000","last_became_peered":"2024-05-27T12:33:35.313223+0000","last_unstale":"2024-05-27T12:33:37.311349+0000","last_undegraded":"2024-05-27T12:33:37.311349+0000","last_fullsized":"2024-05-27T12:33:37.311349+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:34.272777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:34.272777+0000","last_clean_scrub_stamp":"2024-05-27T12:33:34.272777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T18:22:50.732987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T12:33:37.311652+0000","last_change":"2024-05-27T12:33:36.320126+0000","last_active":"2024-05-27T12:33:37.311652+0000","last_peered":"2024-05-27T12:33:37.311652+0000","last_clean":"2024-05-27T12:33:37.311652+0000","last_became_active":"2024-05-27T12:33:36.319073+0000","last_became_peered":"2024-05-27T12:33:36.319073+0000","last_unstale":"2024-05-27T12:33:37.311652+0000","last_undegraded":"2024-05-27T12:33:37.311652+0000","last_fullsized":"2024-05-27T12:33:37.311652+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:35.284230+0000","last_clean_scrub_stamp":"2024-05-27T12:33:35.284230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T19:59:00.013617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-27T12:33:36.309707+0000","last_change":"2024-05-27T12:33:35.329188+0000","last_active":"2024-05-27T12:33:36.309707+0000","last_peered":"2024-05-27T12:33:36.309707+0000","last_clean":"2024-05-27T12:33:36.309707+0000","last_became_active":"2024-05-27T12:33:35.328900+0000","last_became_peered":"2024-05-27T12:33:35.328900+0000","last_unstale":"2024-05-27T12:33:36.309707+0000","last_undegraded":"2024-05-27T12:33:36.309707+0000","last_fullsized":"2024-05-27T12:33:36.309707+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:33:34.272777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:33:34.272777+0000","last_clean_scrub_stamp":"2024-05-27T12:33:34.272777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T16:02:34.928983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":196,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-27T12:33:37.311809+0000","last_change":"2024-05-27T12:32:31.185664+0000","last_active":"2024-05-27T12:33:37.311809+0000","last_peered":"2024-05-27T12:33:37.311809+0000","last_clean":"2024-05-27T12:33:37.311809+0000","last_became_active":"2024-05-27T12:32:31.184757+0000","last_became_peered":"2024-05-27T12:32:31.184757+0000","last_unstale":"2024-05-27T12:33:37.311809+0000","last_undegraded":"2024-05-27T12:33:37.311809+0000","last_fullsized":"2024-05-27T12:33:37.311809+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-27T12:32:30.136480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-27T12:32:30.136480+0000","last_clean_scrub_stamp":"2024-05-27T12:32:30.136480+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T15:49:13.241747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509457,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28000,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343840,"statfs":{"total":96636764160,"available":96608092160,"internally_reserved":0,"allocated":999424,"data_stored":747087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509457,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":397312,"data_stored":150945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509457,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":397312,"data_stored":151001,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509457,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":397312,"data_stored":150433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509457,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31592,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340248,"statfs":{"total":96636764160,"available":96604413952,"internally_reserved":0,"allocated":417792,"data_stored":158263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509457,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31564,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340276,"statfs":{"total":96636764160,"available":96604442624,"internally_reserved":0,"allocated":393216,"data_stored":150399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509457,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31576,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340264,"statfs":{"total":96636764160,"available":96604430336,"internally_reserved":0,"allocated":405504,"data_stored":151963,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542162,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32140,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339700,"statfs":{"total":96636764160,"available":96603852800,"internally_reserved":0,"allocated":983040,"data_stored":740697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-27T12:33:40.706 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-05-27T12:33:40.706 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-05-27T12:33:40.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.852+0000 7fe9b3f76640 1 Processor -- start 2024-05-27T12:33:40.853 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.852+0000 7fe9b3f76640 1 -- start start 2024-05-27T12:33:40.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.853+0000 7fe9b3f76640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe9ac162460 0x7fe9ac0b7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:40.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.853+0000 7fe9b3f76640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9ac0cff20 con 0x7fe9ac0cb5f0 2024-05-27T12:33:40.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.853+0000 7fe9b3f76640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9ac0d41e0 con 0x7fe9ac06d000 2024-05-27T12:33:40.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.853+0000 7fe9b3f76640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fe9ac0d44c0 con 0x7fe9ac162460 2024-05-27T12:33:40.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.853+0000 7fe9b2513640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fe9ac0cb5f0 0x7fe9ac0b8430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:32886/0 (socket says 172.21.15.55:32886) 2024-05-27T12:33:40.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.853+0000 7fe9b2513640 1 -- 172.21.15.55:0/1637073049 learned_addr learned my addr 172.21.15.55:0/1637073049 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-27T12:33:40.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.854+0000 7fe9b1511640 1 --2- 172.21.15.55:0/1637073049 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe9ac162460 0x7fe9ac0b7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:40.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.854+0000 7fe9b0d10640 1 -- 172.21.15.55:0/1637073049 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 255727083 0 0) 0x7fe9ac0cff20 con 0x7fe9ac0cb5f0 2024-05-27T12:33:40.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.854+0000 7fe9b0d10640 1 -- 172.21.15.55:0/1637073049 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe998003520 con 0x7fe9ac0cb5f0 2024-05-27T12:33:40.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.854+0000 7fe9b0d10640 1 -- 172.21.15.55:0/1637073049 <== mon.1 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 914058520 0 0) 0x7fe9ac0d41e0 con 0x7fe9ac06d000 2024-05-27T12:33:40.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.854+0000 7fe9b0d10640 1 -- 172.21.15.55:0/1637073049 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe9ac0cff20 con 0x7fe9ac06d000 2024-05-27T12:33:40.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.854+0000 7fe9b0d10640 1 -- 172.21.15.55:0/1637073049 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4037310112 0 0) 0x7fe998003520 con 0x7fe9ac0cb5f0 2024-05-27T12:33:40.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.854+0000 7fe9b0d10640 1 -- 172.21.15.55:0/1637073049 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe9ac162460 msgr2=0x7fe9ac0b7ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:40.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.854+0000 7fe9b0d10640 1 --2- 172.21.15.55:0/1637073049 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe9ac162460 0x7fe9ac0b7ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:40.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.854+0000 7fe9b0d10640 1 -- 172.21.15.55:0/1637073049 >> v1:172.21.15.72:6789/0 conn(0x7fe9ac06d000 legacy=0x7fe9ac161d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:40.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.854+0000 7fe9b0d10640 1 -- 172.21.15.55:0/1637073049 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9ac0d47a0 con 0x7fe9ac0cb5f0 2024-05-27T12:33:40.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.854+0000 7fe9b0d10640 1 -- 172.21.15.55:0/1637073049 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 793017739 0 0) 0x7fe9a40019f0 con 0x7fe9ac0cb5f0 2024-05-27T12:33:40.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.854+0000 7fe9b1511640 1 --2- 172.21.15.55:0/1637073049 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe9ac162460 0x7fe9ac0b7ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T12:33:40.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.854+0000 7fe9b0d10640 1 -- 172.21.15.55:0/1637073049 >> v1:172.21.15.55:6789/0 conn(0x7fe9ac0cb5f0 legacy=0x7fe9ac0b8430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:40.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.854+0000 7fe9b0d10640 1 --2- 172.21.15.55:0/1637073049 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe998003b70 0x7fe998003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:40.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.854+0000 7fe9b0d10640 1 --2- 172.21.15.55:0/1637073049 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe998004800 0x7fe998004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:40.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.854+0000 7fe9b0d10640 1 --2- 172.21.15.55:0/1637073049 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe9ac162460 0x7fe9980051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:40.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.854+0000 7fe9b0d10640 1 -- 172.21.15.55:0/1637073049 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7fe9ac0d44c0 con 0x7fe998004800 2024-05-27T12:33:40.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.854+0000 7fe9b0d10640 1 -- 172.21.15.55:0/1637073049 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fe99800ba70 con 0x7fe998003b70 2024-05-27T12:33:40.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.854+0000 7fe9b0d10640 1 -- 172.21.15.55:0/1637073049 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fe99800bc20 con 0x7fe9ac162460 2024-05-27T12:33:40.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.854+0000 7fe9b1511640 1 --2- 172.21.15.55:0/1637073049 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe998004800 0x7fe998004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:40.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.854+0000 7fe9b1d12640 1 --2- 172.21.15.55:0/1637073049 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe998003b70 0x7fe998003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:40.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.854+0000 7fe9b2513640 1 --2- 172.21.15.55:0/1637073049 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe9ac162460 0x7fe9980051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:40.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.854+0000 7fe9b1511640 1 -- 172.21.15.55:0/1637073049 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe9ac162460 msgr2=0x7fe9980051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:40.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.854+0000 7fe9b1511640 1 --2- 172.21.15.55:0/1637073049 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe9ac162460 0x7fe9980051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:40.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.854+0000 7fe9b1511640 1 -- 172.21.15.55:0/1637073049 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe998003b70 msgr2=0x7fe998003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:40.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.854+0000 7fe9b1511640 1 --2- 172.21.15.55:0/1637073049 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe998003b70 0x7fe998003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:40.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.854+0000 7fe9b1511640 1 -- 172.21.15.55:0/1637073049 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe998003520 con 0x7fe998004800 2024-05-27T12:33:40.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.855+0000 7fe9b1511640 1 --2- 172.21.15.55:0/1637073049 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe998004800 0x7fe998004c80 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fe99c009c60 tx=0x7fe998005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b8be92c6ec5870c server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:40.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.855+0000 7fe9b0d10640 1 -- 172.21.15.55:0/1637073049 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe99c036070 con 0x7fe998004800 2024-05-27T12:33:40.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.855+0000 7fe9b0d10640 1 -- 172.21.15.55:0/1637073049 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe99c031400 con 0x7fe998004800 2024-05-27T12:33:40.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.855+0000 7fe9b0d10640 1 -- 172.21.15.55:0/1637073049 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe99c009860 con 0x7fe998004800 2024-05-27T12:33:40.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.856+0000 7fe9b3f76640 1 -- 172.21.15.55:0/1637073049 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe998004800 msgr2=0x7fe998004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:40.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.856+0000 7fe9b3f76640 1 --2- 172.21.15.55:0/1637073049 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe998004800 0x7fe998004c80 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fe99c009c60 tx=0x7fe998005830 comp rx=0 tx=0).stop 2024-05-27T12:33:40.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.856+0000 7fe9b2513640 1 -- 172.21.15.55:0/1637073049 reap_dead start 2024-05-27T12:33:40.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.856+0000 7fe9b3f76640 1 -- 172.21.15.55:0/1637073049 shutdown_connections 2024-05-27T12:33:40.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.856+0000 7fe9b3f76640 1 -- 172.21.15.55:0/1637073049 >> 172.21.15.55:0/1637073049 conn(0x7fe9ac0d1a90 msgr2=0x7fe9ac0d49e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:40.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.856+0000 7fe9b3f76640 1 -- 172.21.15.55:0/1637073049 shutdown_connections 2024-05-27T12:33:40.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.856+0000 7fe9b3f76640 1 -- 172.21.15.55:0/1637073049 wait complete. 2024-05-27T12:33:40.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.857+0000 7fe9b3f76640 1 Processor -- start 2024-05-27T12:33:40.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.857+0000 7fe9b3f76640 1 -- start start 2024-05-27T12:33:40.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.858+0000 7fe9b3f76640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe998004800 0x7fe9ac14f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:40.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.858+0000 7fe9b3f76640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9ac160c60 0x7fe9ac14fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:40.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.858+0000 7fe9b3f76640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe9ac0ca0f0 0x7fe9ac0ca5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:40.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.858+0000 7fe9b3f76640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7fe9ac0cf9b0 con 0x7fe9ac160c60 2024-05-27T12:33:40.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.858+0000 7fe9b3f76640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fe9ac0d5950 con 0x7fe998004800 2024-05-27T12:33:40.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.858+0000 7fe9b3f76640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fe9ac0cfb30 con 0x7fe9ac0ca0f0 2024-05-27T12:33:40.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.858+0000 7fe9b1511640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9ac160c60 0x7fe9ac14fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:40.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.858+0000 7fe9b1511640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9ac160c60 0x7fe9ac14fa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51212/0 (socket says 172.21.15.55:51212) 2024-05-27T12:33:40.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.858+0000 7fe9b1511640 1 -- 172.21.15.55:0/2389759500 learned_addr learned my addr 172.21.15.55:0/2389759500 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:33:40.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.858+0000 7fe9b1d12640 1 --2- 172.21.15.55:0/2389759500 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe998004800 0x7fe9ac14f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:40.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.858+0000 7fe9b2513640 1 --2- 172.21.15.55:0/2389759500 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe9ac0ca0f0 0x7fe9ac0ca5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:40.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.858+0000 7fe9b1511640 1 -- 172.21.15.55:0/2389759500 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe9ac0ca0f0 msgr2=0x7fe9ac0ca5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:40.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.858+0000 7fe9b1511640 1 --2- 172.21.15.55:0/2389759500 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe9ac0ca0f0 0x7fe9ac0ca5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:40.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.858+0000 7fe9b1511640 1 -- 172.21.15.55:0/2389759500 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe998004800 msgr2=0x7fe9ac14f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:40.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.858+0000 7fe9b1511640 1 --2- 172.21.15.55:0/2389759500 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe998004800 0x7fe9ac14f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:40.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.858+0000 7fe9b1511640 1 -- 172.21.15.55:0/2389759500 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9ac150af0 con 0x7fe9ac160c60 2024-05-27T12:33:40.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.859+0000 7fe9b1511640 1 --2- 172.21.15.55:0/2389759500 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9ac160c60 0x7fe9ac14fa00 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fe99c009c60 tx=0x7fe99c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:40.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.859+0000 7fe9a27fc640 1 -- 172.21.15.55:0/2389759500 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe99c041020 con 0x7fe9ac160c60 2024-05-27T12:33:40.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.859+0000 7fe9a27fc640 1 -- 172.21.15.55:0/2389759500 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe99c0093e0 con 0x7fe9ac160c60 2024-05-27T12:33:40.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.859+0000 7fe9b3f76640 1 -- 172.21.15.55:0/2389759500 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9ac150250 con 0x7fe9ac160c60 2024-05-27T12:33:40.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.859+0000 7fe9a27fc640 1 -- 172.21.15.55:0/2389759500 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe99c036040 con 0x7fe9ac160c60 2024-05-27T12:33:40.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.859+0000 7fe9b3f76640 1 -- 172.21.15.55:0/2389759500 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9ac150810 con 0x7fe9ac160c60 2024-05-27T12:33:40.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.860+0000 7fe9b3f76640 1 -- 172.21.15.55:0/2389759500 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9ac068b50 con 0x7fe9ac160c60 2024-05-27T12:33:40.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.860+0000 7fe9a27fc640 1 -- 172.21.15.55:0/2389759500 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe99c044020 con 0x7fe9ac160c60 2024-05-27T12:33:40.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.861+0000 7fe9a27fc640 1 --2- 172.21.15.55:0/2389759500 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fe99006c920 0x7fe99006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:40.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.861+0000 7fe9a27fc640 1 -- 172.21.15.55:0/2389759500 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5709+0+0 (secure 0 0 0) 0x7fe99c0abe00 con 0x7fe9ac160c60 2024-05-27T12:33:40.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.861+0000 7fe9b1d12640 1 --2- 172.21.15.55:0/2389759500 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fe99006c920 0x7fe99006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:40.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.862+0000 7fe9b1d12640 1 --2- 172.21.15.55:0/2389759500 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fe99006c920 0x7fe99006ede0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fe9a80055b0 tx=0x7fe9a8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:40.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:40.865+0000 7fe9a27fc640 1 -- 172.21.15.55:0/2389759500 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe99c04b070 con 0x7fe9ac160c60 2024-05-27T12:33:41.078 INFO:tasks.ceph.mds.a.smithi055.stderr:2024-05-27T12:33:41.078+0000 7f9ad37d4640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-27T12:33:41.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:41.121+0000 7fe9b3f76640 1 -- 172.21.15.55:0/2389759500 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fe9ac1e7e90 con 0x7fe9ac160c60 2024-05-27T12:33:41.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:41.125+0000 7fe9a27fc640 1 -- 172.21.15.55:0/2389759500 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) ==== 190+0+147 (secure 0 0 0) 0x7fe99c07a2c0 con 0x7fe9ac160c60 2024-05-27T12:33:41.125 INFO:teuthology.orchestra.run.smithi055.stdout:[client.0] 2024-05-27T12:33:41.125 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQAsfVRmIz9dGRAAjAf3liTmQK1aXNskyzdRyQ== 2024-05-27T12:33:41.125 INFO:teuthology.orchestra.run.smithi055.stdout: caps mds = "allow" 2024-05-27T12:33:41.125 INFO:teuthology.orchestra.run.smithi055.stdout: caps mon = "allow r" 2024-05-27T12:33:41.125 INFO:teuthology.orchestra.run.smithi055.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-05-27T12:33:41.125 INFO:teuthology.orchestra.run.smithi055.stderr:updated caps for client.0 2024-05-27T12:33:41.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:41.126+0000 7fe9b3f76640 1 -- 172.21.15.55:0/2389759500 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fe99006c920 msgr2=0x7fe99006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:41.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:41.126+0000 7fe9b3f76640 1 --2- 172.21.15.55:0/2389759500 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fe99006c920 0x7fe99006ede0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fe9a80055b0 tx=0x7fe9a8009040 comp rx=0 tx=0).stop 2024-05-27T12:33:41.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:41.126+0000 7fe9b3f76640 1 -- 172.21.15.55:0/2389759500 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9ac160c60 msgr2=0x7fe9ac14fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:41.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:41.126+0000 7fe9b3f76640 1 --2- 172.21.15.55:0/2389759500 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9ac160c60 0x7fe9ac14fa00 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fe99c009c60 tx=0x7fe99c004730 comp rx=0 tx=0).stop 2024-05-27T12:33:41.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:41.127+0000 7fe9b3f76640 1 -- 172.21.15.55:0/2389759500 shutdown_connections 2024-05-27T12:33:41.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:41.127+0000 7fe9b3f76640 1 --2- 172.21.15.55:0/2389759500 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe9ac0ca0f0 0x7fe9ac0ca5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:41.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:41.127+0000 7fe9b3f76640 1 --2- 172.21.15.55:0/2389759500 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9ac160c60 0x7fe9ac14fa00 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:41.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:41.127+0000 7fe9b3f76640 1 --2- 172.21.15.55:0/2389759500 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fe99006c920 0x7fe99006ede0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:41.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:41.127+0000 7fe9b3f76640 1 --2- 172.21.15.55:0/2389759500 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe998004800 0x7fe9ac14f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:41.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:41.127+0000 7fe9b3f76640 1 -- 172.21.15.55:0/2389759500 >> 172.21.15.55:0/2389759500 conn(0x7fe9ac0d1a90 msgr2=0x7fe9ac074f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:41.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:41.127+0000 7fe9b3f76640 1 -- 172.21.15.55:0/2389759500 shutdown_connections 2024-05-27T12:33:41.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:41.127+0000 7fe9b3f76640 1 -- 172.21.15.55:0/2389759500 wait complete. 2024-05-27T12:33:41.138 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-27T12:33:41.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:41.241+0000 7f1393a60640 1 Processor -- start 2024-05-27T12:33:41.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:41.242+0000 7f1393a60640 1 -- start start 2024-05-27T12:33:41.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:41.242+0000 7f1393a60640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f138c0b3860 0x7f138c0b3db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:41.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:41.242+0000 7f1393a60640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f138c0b6370 0x7f138c0b6800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:41.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:41.242+0000 7f1393a60640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f138c1632f0 con 0x7f138c15ec00 2024-05-27T12:33:41.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:41.242+0000 7f1393a60640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f138c0cf2e0 con 0x7f138c0b3860 2024-05-27T12:33:41.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:41.242+0000 7f1393a60640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f138c1635d0 con 0x7f138c0b6370 2024-05-27T12:33:41.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:41.243+0000 7f1391ffd640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f138c0b6370 0x7f138c0b6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:41.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:41.243+0000 7f1390ffb640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f138c0b3860 0x7f138c0b3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:41.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:41.243+0000 7f13917fc640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f138c15ec00 0x7f138c0cfd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.55:35920/0 (socket says 172.21.15.55:35920) 2024-05-27T12:33:41.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:41.243+0000 7f13917fc640 1 -- 172.21.15.55:0/2778579772 learned_addr learned my addr 172.21.15.55:0/2778579772 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-27T12:33:41.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:41.243+0000 7f1383fff640 1 -- 172.21.15.55:0/2778579772 <== mon.1 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 181811045 0 0) 0x7f138c1632f0 con 0x7f138c15ec00 2024-05-27T12:33:41.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:41.243+0000 7f1383fff640 1 -- 172.21.15.55:0/2778579772 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1378003520 con 0x7f138c15ec00 2024-05-27T12:33:41.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:41.243+0000 7f1390ffb640 1 -- 172.21.15.55:0/2778579772 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f138c0b6370 msgr2=0x7f138c0b6800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:41.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:41.243+0000 7f1390ffb640 1 --2- 172.21.15.55:0/2778579772 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f138c0b6370 0x7f138c0b6800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:41.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:41.243+0000 7f1390ffb640 1 -- 172.21.15.55:0/2778579772 >> v1:172.21.15.72:6789/0 conn(0x7f138c15ec00 legacy=0x7f138c0cfd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:41.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:41.243+0000 7f1390ffb640 1 -- 172.21.15.55:0/2778579772 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f138c0cf530 con 0x7f138c0b3860 2024-05-27T12:33:41.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:41.243+0000 7f1391ffd640 1 --2- 172.21.15.55:0/2778579772 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f138c0b6370 0x7f138c0b6800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T12:33:41.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:41.244+0000 7f1390ffb640 1 --2- 172.21.15.55:0/2778579772 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f138c0b3860 0x7f138c0b3db0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f137c0097a0 tx=0x7f137c02a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ca7ff3a382ac77f7 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:41.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:41.244+0000 7f1383fff640 1 -- 172.21.15.55:0/2778579772 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f137c037070 con 0x7f138c0b3860 2024-05-27T12:33:41.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:41.244+0000 7f1383fff640 1 -- 172.21.15.55:0/2778579772 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f137c032440 con 0x7f138c0b3860 2024-05-27T12:33:41.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:41.244+0000 7f1383fff640 1 -- 172.21.15.55:0/2778579772 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f137c0327f0 con 0x7f138c0b3860 2024-05-27T12:33:41.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:41.245+0000 7f1393a60640 1 -- 172.21.15.55:0/2778579772 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f138c0b3860 msgr2=0x7f138c0b3db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:41.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:41.245+0000 7f1393a60640 1 --2- 172.21.15.55:0/2778579772 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f138c0b3860 0x7f138c0b3db0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f137c0097a0 tx=0x7f137c02a180 comp rx=0 tx=0).stop 2024-05-27T12:33:41.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:41.245+0000 7f1393a60640 1 -- 172.21.15.55:0/2778579772 shutdown_connections 2024-05-27T12:33:41.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:41.245+0000 7f1393a60640 1 --2- 172.21.15.55:0/2778579772 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f138c0b6370 0x7f138c0b6800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:41.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:41.245+0000 7f1393a60640 1 --2- 172.21.15.55:0/2778579772 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f138c0b3860 0x7f138c0b3db0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:41.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:41.245+0000 7f1393a60640 1 -- 172.21.15.55:0/2778579772 >> 172.21.15.55:0/2778579772 conn(0x7f138c0d1370 msgr2=0x7f138c0d1780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:41.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:41.245+0000 7f1393a60640 1 -- 172.21.15.55:0/2778579772 shutdown_connections 2024-05-27T12:33:41.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:41.245+0000 7f1393a60640 1 -- 172.21.15.55:0/2778579772 wait complete. 2024-05-27T12:33:41.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:41.246+0000 7f1393a60640 1 Processor -- start 2024-05-27T12:33:41.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:41.246+0000 7f1393a60640 1 -- start start 2024-05-27T12:33:41.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:41.247+0000 7f1393a60640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f138c0b3860 0x7f138c160390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:41.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:41.247+0000 7f1393a60640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f138c0b6370 0x7f138c0d3180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:41.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:41.247+0000 7f1393a60640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f138c15ec00 0x7f138c15bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:41.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:41.247+0000 7f1393a60640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f138c15efe0 con 0x7f138c15ec00 2024-05-27T12:33:41.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:41.247+0000 7f1393a60640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f138c0b3530 con 0x7f138c0b6370 2024-05-27T12:33:41.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:41.247+0000 7f1393a60640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f138c15f160 con 0x7f138c0b3860 2024-05-27T12:33:41.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:41.247+0000 7f1391ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f138c15ec00 0x7f138c15bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:41.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:41.247+0000 7f1391ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f138c15ec00 0x7f138c15bc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51214/0 (socket says 172.21.15.55:51214) 2024-05-27T12:33:41.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:41.247+0000 7f1391ffd640 1 -- 172.21.15.55:0/3715367157 learned_addr learned my addr 172.21.15.55:0/3715367157 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:33:41.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:41.247+0000 7f1390ffb640 1 --2- 172.21.15.55:0/3715367157 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f138c0b6370 0x7f138c0d3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:41.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:41.247+0000 7f13917fc640 1 --2- 172.21.15.55:0/3715367157 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f138c0b3860 0x7f138c160390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:41.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:41.247+0000 7f1391ffd640 1 -- 172.21.15.55:0/3715367157 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f138c0b3860 msgr2=0x7f138c160390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:41.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:41.247+0000 7f1391ffd640 1 --2- 172.21.15.55:0/3715367157 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f138c0b3860 0x7f138c160390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:41.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:41.247+0000 7f1391ffd640 1 -- 172.21.15.55:0/3715367157 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f138c0b6370 msgr2=0x7f138c0d3180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:41.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:41.247+0000 7f1391ffd640 1 --2- 172.21.15.55:0/3715367157 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f138c0b6370 0x7f138c0d3180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:41.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:41.247+0000 7f1391ffd640 1 -- 172.21.15.55:0/3715367157 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f138c160a90 con 0x7f138c15ec00 2024-05-27T12:33:41.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:41.247+0000 7f13917fc640 1 --2- 172.21.15.55:0/3715367157 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f138c0b3860 0x7f138c160390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T12:33:41.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:41.248+0000 7f1391ffd640 1 --2- 172.21.15.55:0/3715367157 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f138c15ec00 0x7f138c15bc90 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f1384009f00 tx=0x7f138400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:41.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:41.248+0000 7f1381ffb640 1 -- 172.21.15.55:0/3715367157 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1384018030 con 0x7f138c15ec00 2024-05-27T12:33:41.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:41.248+0000 7f1381ffb640 1 -- 172.21.15.55:0/3715367157 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f138400ce50 con 0x7f138c15ec00 2024-05-27T12:33:41.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:41.248+0000 7f1393a60640 1 -- 172.21.15.55:0/3715367157 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f138c160d70 con 0x7f138c15ec00 2024-05-27T12:33:41.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:41.248+0000 7f1381ffb640 1 -- 172.21.15.55:0/3715367157 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1384003bb0 con 0x7f138c15ec00 2024-05-27T12:33:41.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:41.248+0000 7f1393a60640 1 -- 172.21.15.55:0/3715367157 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f138c161330 con 0x7f138c15ec00 2024-05-27T12:33:41.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:41.249+0000 7f1393a60640 1 -- 172.21.15.55:0/3715367157 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f138c06db20 con 0x7f138c15ec00 2024-05-27T12:33:41.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:41.249+0000 7f1381ffb640 1 -- 172.21.15.55:0/3715367157 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f138401b070 con 0x7f138c15ec00 2024-05-27T12:33:41.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:41.250+0000 7f1381ffb640 1 --2- 172.21.15.55:0/3715367157 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f137006c8f0 0x7f137006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:41.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:41.250+0000 7f1381ffb640 1 -- 172.21.15.55:0/3715367157 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5709+0+0 (secure 0 0 0) 0x7f138408c4a0 con 0x7f138c15ec00 2024-05-27T12:33:41.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:41.250+0000 7f13917fc640 1 --2- 172.21.15.55:0/3715367157 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f137006c8f0 0x7f137006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:41.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:41.251+0000 7f13917fc640 1 --2- 172.21.15.55:0/3715367157 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f137006c8f0 0x7f137006edb0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f1388007fd0 tx=0x7f1388009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:41.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:41.254+0000 7f1381ffb640 1 -- 172.21.15.55:0/3715367157 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f138c06db20 con 0x7f138c15ec00 2024-05-27T12:33:41.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:41.480+0000 7f1393a60640 1 -- 172.21.15.55:0/3715367157 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f138c075460 con 0x7f138c15ec00 2024-05-27T12:33:41.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:41.480+0000 7f1381ffb640 1 -- 172.21.15.55:0/3715367157 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+5180 (secure 0 0 0) 0x7f1384010040 con 0x7f138c15ec00 2024-05-27T12:33:41.481 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-27T12:33:41.481 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4760,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6836/1520859199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":1520859199},{"type":"v1","addr":"172.21.15.72:6836","nonce":1520859199}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":4769,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/4005455241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":4005455241},{"type":"v1","addr":"172.21.15.55:6835","nonce":4005455241}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":5002,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/3014759941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6835","nonce":3014759941},{"type":"v1","addr":"172.21.15.72:6837","nonce":3014759941}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-27T12:33:35.670308+0000","modified":"2024-05-27T12:33:38.696129+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5151},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5151":{"gid":5151,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6833/1971815735","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":1971815735},{"type":"v1","addr":"172.21.15.55:6833","nonce":1971815735}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5151,"qdb_cluster":[5151]},"id":2}]} 2024-05-27T12:33:41.481 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 14 2024-05-27T12:33:41.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:41.482+0000 7f1393a60640 1 -- 172.21.15.55:0/3715367157 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f137006c8f0 msgr2=0x7f137006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:41.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:41.482+0000 7f1393a60640 1 --2- 172.21.15.55:0/3715367157 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f137006c8f0 0x7f137006edb0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f1388007fd0 tx=0x7f1388009040 comp rx=0 tx=0).stop 2024-05-27T12:33:41.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:41.482+0000 7f1393a60640 1 -- 172.21.15.55:0/3715367157 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f138c15ec00 msgr2=0x7f138c15bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:41.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:41.482+0000 7f1393a60640 1 --2- 172.21.15.55:0/3715367157 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f138c15ec00 0x7f138c15bc90 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f1384009f00 tx=0x7f138400c490 comp rx=0 tx=0).stop 2024-05-27T12:33:41.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:41.482+0000 7f1393a60640 1 -- 172.21.15.55:0/3715367157 shutdown_connections 2024-05-27T12:33:41.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:41.482+0000 7f1393a60640 1 --2- 172.21.15.55:0/3715367157 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f138c15ec00 0x7f138c15bc90 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:41.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:41.482+0000 7f1393a60640 1 --2- 172.21.15.55:0/3715367157 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f137006c8f0 0x7f137006edb0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:41.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:41.482+0000 7f1393a60640 1 --2- 172.21.15.55:0/3715367157 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f138c0b6370 0x7f138c0d3180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:41.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:41.482+0000 7f1393a60640 1 --2- 172.21.15.55:0/3715367157 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f138c0b3860 0x7f138c160390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:41.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:41.482+0000 7f1393a60640 1 -- 172.21.15.55:0/3715367157 >> 172.21.15.55:0/3715367157 conn(0x7f138c0d1370 msgr2=0x7f138c0b4760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:41.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:41.482+0000 7f1393a60640 1 -- 172.21.15.55:0/3715367157 shutdown_connections 2024-05-27T12:33:41.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:41.482+0000 7f1393a60640 1 -- 172.21.15.55:0/3715367157 wait complete. 2024-05-27T12:33:41.896 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 14, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-27T12:33:35.670308+0000', 'modified': '2024-05-27T12:33:38.696129+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5151}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5151': {'gid': 5151, 'name': 'a', 'rank': 0, 'incarnation': 11, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.55:6833/1971815735', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.55:6832', 'nonce': 1971815735}, {'type': 'v1', 'addr': '172.21.15.55:6833', 'nonce': 1971815735}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5151, 'qdb_cluster': [5151]} 2024-05-27T12:33:41.897 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-27T12:33:41.897 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-05-27T12:33:42.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.007+0000 7f012d1e1640 1 Processor -- start 2024-05-27T12:33:42.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.007+0000 7f012d1e1640 1 -- start start 2024-05-27T12:33:42.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.008+0000 7f012d1e1640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0128140090 0x7f0128140470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:42.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.008+0000 7f012d1e1640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f01280b3540 0x7f0128140e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:42.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.008+0000 7f012d1e1640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f012815b520 con 0x7f0128071e40 2024-05-27T12:33:42.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.008+0000 7f012d1e1640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f012815c130 con 0x7f0128140090 2024-05-27T12:33:42.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.008+0000 7f012d1e1640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f012815b800 con 0x7f01280b3540 2024-05-27T12:33:42.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.008+0000 7f0126d9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0128140090 0x7f0128140470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:42.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.008+0000 7f012759e640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f0128071e40 0x7f012806f320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:32896/0 (socket says 172.21.15.55:32896) 2024-05-27T12:33:42.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.008+0000 7f012759e640 1 -- 172.21.15.55:0/1753620272 learned_addr learned my addr 172.21.15.55:0/1753620272 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-27T12:33:42.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.008+0000 7f0126d9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0128140090 0x7f0128140470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51216/0 (socket says 172.21.15.55:51216) 2024-05-27T12:33:42.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.008+0000 7f011e59c640 1 --2- 172.21.15.55:0/1753620272 >> v2:172.21.15.72:3300/0 conn(0x7f01280b3540 0x7f0128140e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:42.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.008+0000 7f0126d9d640 1 -- 172.21.15.55:0/1753620272 >> v2:172.21.15.72:3300/0 conn(0x7f01280b3540 msgr2=0x7f0128140e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:42.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.008+0000 7f0126d9d640 1 --2- 172.21.15.55:0/1753620272 >> v2:172.21.15.72:3300/0 conn(0x7f01280b3540 0x7f0128140e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:42.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.008+0000 7f0126d9d640 1 -- 172.21.15.55:0/1753620272 >> v1:172.21.15.55:6789/0 conn(0x7f0128071e40 legacy=0x7f012806f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:42.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.008+0000 7f012659c640 1 -- 172.21.15.55:0/1753620272 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3726122391 0 0) 0x7f012815b520 con 0x7f0128071e40 2024-05-27T12:33:42.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.008+0000 7f0126d9d640 1 -- 172.21.15.55:0/1753620272 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f012815bae0 con 0x7f0128140090 2024-05-27T12:33:42.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.009+0000 7f0126d9d640 1 --2- 172.21.15.55:0/1753620272 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0128140090 0x7f0128140470 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f012815c0a0 tx=0x7f011802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8189c38c70e57ae2 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:42.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.009+0000 7f012659c640 1 -- 172.21.15.55:0/1753620272 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0118037070 con 0x7f0128140090 2024-05-27T12:33:42.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.009+0000 7f012659c640 1 -- 172.21.15.55:0/1753620272 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0118032440 con 0x7f0128140090 2024-05-27T12:33:42.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.009+0000 7f012659c640 1 -- 172.21.15.55:0/1753620272 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0118032810 con 0x7f0128140090 2024-05-27T12:33:42.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.010+0000 7f012d1e1640 1 -- 172.21.15.55:0/1753620272 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0128140090 msgr2=0x7f0128140470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:42.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.010+0000 7f012d1e1640 1 --2- 172.21.15.55:0/1753620272 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0128140090 0x7f0128140470 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f012815c0a0 tx=0x7f011802a1a0 comp rx=0 tx=0).stop 2024-05-27T12:33:42.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.010+0000 7f012d1e1640 1 -- 172.21.15.55:0/1753620272 shutdown_connections 2024-05-27T12:33:42.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.010+0000 7f012d1e1640 1 --2- 172.21.15.55:0/1753620272 >> v2:172.21.15.72:3300/0 conn(0x7f01280b3540 0x7f0128140e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:42.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.010+0000 7f012d1e1640 1 --2- 172.21.15.55:0/1753620272 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0128140090 0x7f0128140470 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:42.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.010+0000 7f012d1e1640 1 -- 172.21.15.55:0/1753620272 >> 172.21.15.55:0/1753620272 conn(0x7f0128067d70 msgr2=0x7f01280b2270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:42.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.010+0000 7f012d1e1640 1 -- 172.21.15.55:0/1753620272 shutdown_connections 2024-05-27T12:33:42.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.010+0000 7f012d1e1640 1 -- 172.21.15.55:0/1753620272 wait complete. 2024-05-27T12:33:42.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.011+0000 7f012d1e1640 1 Processor -- start 2024-05-27T12:33:42.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.011+0000 7f012d1e1640 1 -- start start 2024-05-27T12:33:42.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.012+0000 7f012d1e1640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f01280b3540 0x7f012813efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:42.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.012+0000 7f012d1e1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0128140090 0x7f01280ce8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:42.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.012+0000 7f012d1e1640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0128159970 0x7f01280d0880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:42.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.012+0000 7f012d1e1640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f01281414c0 con 0x7f0128140090 2024-05-27T12:33:42.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.012+0000 7f012d1e1640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f0128141340 con 0x7f0128159970 2024-05-27T12:33:42.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.012+0000 7f012d1e1640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f01280722f0 con 0x7f01280b3540 2024-05-27T12:33:42.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.012+0000 7f011e59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0128140090 0x7f01280ce8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:42.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.012+0000 7f011e59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0128140090 0x7f01280ce8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51226/0 (socket says 172.21.15.55:51226) 2024-05-27T12:33:42.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.012+0000 7f011e59c640 1 -- 172.21.15.55:0/163742590 learned_addr learned my addr 172.21.15.55:0/163742590 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:33:42.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.012+0000 7f012759e640 1 --2- 172.21.15.55:0/163742590 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0128159970 0x7f01280d0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:42.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.012+0000 7f0126d9d640 1 --2- 172.21.15.55:0/163742590 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f01280b3540 0x7f012813efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:42.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.013+0000 7f011e59c640 1 -- 172.21.15.55:0/163742590 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f01280b3540 msgr2=0x7f012813efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:42.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.013+0000 7f011e59c640 1 --2- 172.21.15.55:0/163742590 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f01280b3540 0x7f012813efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:42.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.013+0000 7f011e59c640 1 -- 172.21.15.55:0/163742590 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0128159970 msgr2=0x7f01280d0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:42.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.013+0000 7f011e59c640 1 --2- 172.21.15.55:0/163742590 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0128159970 0x7f01280d0880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:42.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.013+0000 7f011e59c640 1 -- 172.21.15.55:0/163742590 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0128159ea0 con 0x7f0128140090 2024-05-27T12:33:42.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.013+0000 7f011e59c640 1 --2- 172.21.15.55:0/163742590 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0128140090 0x7f01280ce8e0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f011000d800 tx=0x7f011000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:42.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.013+0000 7f011ffff640 1 -- 172.21.15.55:0/163742590 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f011000b660 con 0x7f0128140090 2024-05-27T12:33:42.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.013+0000 7f011ffff640 1 -- 172.21.15.55:0/163742590 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0110019070 con 0x7f0128140090 2024-05-27T12:33:42.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.013+0000 7f012d1e1640 1 -- 172.21.15.55:0/163742590 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f012815a180 con 0x7f0128140090 2024-05-27T12:33:42.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.013+0000 7f011ffff640 1 -- 172.21.15.55:0/163742590 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f011000ba40 con 0x7f0128140090 2024-05-27T12:33:42.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.013+0000 7f012d1e1640 1 -- 172.21.15.55:0/163742590 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f012815a740 con 0x7f0128140090 2024-05-27T12:33:42.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.015+0000 7f011ffff640 1 -- 172.21.15.55:0/163742590 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f011000bbe0 con 0x7f0128140090 2024-05-27T12:33:42.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.015+0000 7f011ffff640 1 --2- 172.21.15.55:0/163742590 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f010806c8f0 0x7f010806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:42.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.015+0000 7f011ffff640 1 -- 172.21.15.55:0/163742590 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5709+0+0 (secure 0 0 0) 0x7f011008be80 con 0x7f0128140090 2024-05-27T12:33:42.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.015+0000 7f0126d9d640 1 --2- 172.21.15.55:0/163742590 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f010806c8f0 0x7f010806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:42.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.016+0000 7f0126d9d640 1 --2- 172.21.15.55:0/163742590 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f010806c8f0 0x7f010806edb0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f0118034000 tx=0x7f011802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:42.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.016+0000 7f012ffcc740 1 Processor -- start 2024-05-27T12:33:42.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.016+0000 7f012ffcc740 1 -- start start 2024-05-27T12:33:42.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.017+0000 7f012ffcc740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56128b85ec20 0x56128b85f000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:42.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.017+0000 7f012ffcc740 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x56128b859ab0 0x56128b85d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:42.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.017+0000 7f012ffcc740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56128b85dd60 0x56128b85e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:42.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.017+0000 7f012ffcc740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x56128b7c3c50 con 0x56128b85ec20 2024-05-27T12:33:42.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.017+0000 7f012ffcc740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x56128b760830 con 0x56128b85dd60 2024-05-27T12:33:42.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.017+0000 7f012ffcc740 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x56128b7bfc10 con 0x56128b859ab0 2024-05-27T12:33:42.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.017+0000 7f0126d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56128b85ec20 0x56128b85f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:42.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.017+0000 7f0126d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56128b85ec20 0x56128b85f000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51234/0 (socket says 172.21.15.55:51234) 2024-05-27T12:33:42.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.017+0000 7f0126d9d640 1 -- 172.21.15.55:0/2935546629 learned_addr learned my addr 172.21.15.55:0/2935546629 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:33:42.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.017+0000 7f011e59c640 1 --2- 172.21.15.55:0/2935546629 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x56128b859ab0 0x56128b85d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:42.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.017+0000 7f012759e640 1 --2- 172.21.15.55:0/2935546629 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56128b85dd60 0x56128b85e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:42.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.017+0000 7f0126d9d640 1 -- 172.21.15.55:0/2935546629 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x56128b859ab0 msgr2=0x56128b85d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:42.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.017+0000 7f0126d9d640 1 --2- 172.21.15.55:0/2935546629 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x56128b859ab0 0x56128b85d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:42.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.017+0000 7f0126d9d640 1 -- 172.21.15.55:0/2935546629 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56128b85dd60 msgr2=0x56128b85e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:42.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.017+0000 7f0126d9d640 1 --2- 172.21.15.55:0/2935546629 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56128b85dd60 0x56128b85e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:42.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.017+0000 7f0126d9d640 1 -- 172.21.15.55:0/2935546629 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56128b4d62d0 con 0x56128b85ec20 2024-05-27T12:33:42.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.017+0000 7f0126d9d640 1 --2- 172.21.15.55:0/2935546629 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56128b85ec20 0x56128b85f000 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f0118009860 tx=0x7f011802c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a02ab1cc25557a73 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:42.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.017+0000 7f011cd99640 1 -- 172.21.15.55:0/2935546629 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f011804e070 con 0x56128b85ec20 2024-05-27T12:33:42.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.018+0000 7f011cd99640 1 -- 172.21.15.55:0/2935546629 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0118032d10 con 0x56128b85ec20 2024-05-27T12:33:42.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.018+0000 7f011cd99640 1 -- 172.21.15.55:0/2935546629 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0118037040 con 0x56128b85ec20 2024-05-27T12:33:42.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.018+0000 7f012ffcc740 1 -- 172.21.15.55:0/2935546629 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56128b85ec20 msgr2=0x56128b85f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:42.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.018+0000 7f012ffcc740 1 --2- 172.21.15.55:0/2935546629 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56128b85ec20 0x56128b85f000 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f0118009860 tx=0x7f011802c000 comp rx=0 tx=0).stop 2024-05-27T12:33:42.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.018+0000 7f012ffcc740 1 -- 172.21.15.55:0/2935546629 shutdown_connections 2024-05-27T12:33:42.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.018+0000 7f012ffcc740 1 --2- 172.21.15.55:0/2935546629 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56128b85dd60 0x56128b85e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:42.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.018+0000 7f012ffcc740 1 --2- 172.21.15.55:0/2935546629 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x56128b859ab0 0x56128b85d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:42.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.018+0000 7f012ffcc740 1 --2- 172.21.15.55:0/2935546629 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56128b85ec20 0x56128b85f000 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:42.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.018+0000 7f012ffcc740 1 -- 172.21.15.55:0/2935546629 >> 172.21.15.55:0/2935546629 conn(0x56128b85bd20 msgr2=0x56128b8a47e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:42.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.018+0000 7f012ffcc740 1 -- 172.21.15.55:0/2935546629 shutdown_connections 2024-05-27T12:33:42.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.018+0000 7f012ffcc740 1 -- 172.21.15.55:0/2935546629 wait complete. 2024-05-27T12:33:42.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.019+0000 7f012ffcc740 1 -- start start 2024-05-27T12:33:42.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.019+0000 7f012ffcc740 1 Processor -- start 2024-05-27T12:33:42.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.020+0000 7f012ffcc740 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x56128b85dd60 0x56128b87ed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:42.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.020+0000 7f012ffcc740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56128b85ec20 0x56128b8a1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:42.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.020+0000 7f012ffcc740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56128b8a7f00 0x56128b8aa890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:42.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.020+0000 7f012ffcc740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x56128b88a7b0 con 0x56128b85ec20 2024-05-27T12:33:42.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.020+0000 7f012ffcc740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x56128b75e470 con 0x56128b8a7f00 2024-05-27T12:33:42.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.020+0000 7f012ffcc740 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x56128b889c30 con 0x56128b85dd60 2024-05-27T12:33:42.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.020+0000 7f012ffcc740 10 client.0 _ll_register_callbacks cb 0x56128b783f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T12:33:42.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.020+0000 7f011e59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56128b85ec20 0x56128b8a1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:42.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.020+0000 7f011e59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56128b85ec20 0x56128b8a1ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51240/0 (socket says 172.21.15.55:51240) 2024-05-27T12:33:42.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.020+0000 7f011e59c640 1 -- 172.21.15.55:0/289591219 learned_addr learned my addr 172.21.15.55:0/289591219 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:33:42.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.020+0000 7f0126d9d640 1 --2- 172.21.15.55:0/289591219 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x56128b85dd60 0x56128b87ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:42.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.020+0000 7f012759e640 1 --2- 172.21.15.55:0/289591219 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56128b8a7f00 0x56128b8aa890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:42.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.020+0000 7f011e59c640 1 -- 172.21.15.55:0/289591219 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x56128b85dd60 msgr2=0x56128b87ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:42.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.020+0000 7f011e59c640 1 --2- 172.21.15.55:0/289591219 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x56128b85dd60 0x56128b87ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:42.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.020+0000 7f011e59c640 1 -- 172.21.15.55:0/289591219 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56128b8a7f00 msgr2=0x56128b8aa890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:42.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.020+0000 7f011e59c640 1 --2- 172.21.15.55:0/289591219 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56128b8a7f00 0x56128b8aa890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:42.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.020+0000 7f011e59c640 1 -- 172.21.15.55:0/289591219 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56128b5a06b0 con 0x56128b85ec20 2024-05-27T12:33:42.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.020+0000 7f011e59c640 1 --2- 172.21.15.55:0/289591219 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56128b85ec20 0x56128b8a1ba0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f011000d7d0 tx=0x7f011005e0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d7c8e5c02dafcf6 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:42.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.020+0000 7f0105ffb640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-05-27T12:33:42.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.020+0000 7f0105ffb640 1 -- 172.21.15.55:0/289591219 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01100590b0 con 0x56128b85ec20 2024-05-27T12:33:42.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.021+0000 7f012ffcc740 1 -- 172.21.15.55:0/289591219 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0118032d10 con 0x56128b85ec20 2024-05-27T12:33:42.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.021+0000 7f0105ffb640 1 -- 172.21.15.55:0/289591219 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(36..36 src has 1..36) ==== 5709+0+0 (secure 0 0 0) 0x7f0110059250 con 0x56128b85ec20 2024-05-27T12:33:42.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.021+0000 7f0105ffb640 1 -- 172.21.15.55:0/289591219 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7f0110060160 con 0x56128b85ec20 2024-05-27T12:33:42.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.021+0000 7f012ffcc740 10 client.5325 fetch_fsmap learned FSMap version 14 2024-05-27T12:33:42.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.021+0000 7f012ffcc740 1 -- 172.21.15.55:0/289591219 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x56128b8a99c0 con 0x56128b85ec20 2024-05-27T12:33:42.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.021+0000 7f0105ffb640 1 -- 172.21.15.55:0/289591219 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0118032d10 con 0x56128b85ec20 2024-05-27T12:33:42.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.021+0000 7f0105ffb640 1 -- 172.21.15.55:0/289591219 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 14) ==== 3494+0+0 (secure 0 0 0) 0x7f0110013070 con 0x56128b85ec20 2024-05-27T12:33:42.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.021+0000 7f012ffcc740 10 client.5325 fetch_fsmap finished waiting for FSMap version 14 2024-05-27T12:33:42.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.021+0000 7f012ffcc740 10 client.5325 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-27T12:33:42.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.021+0000 7f012ffcc740 20 client.5325 populate_metadata read hostname 'smithi055' 2024-05-27T12:33:42.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.021+0000 7f012ffcc740 1 --2- 172.21.15.55:0/289591219 >> [v2:172.21.15.55:6832/1971815735,v1:172.21.15.55:6833/1971815735] conn(0x56128b8a5f60 0x56128b8a1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:42.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.021+0000 7f012ffcc740 4 client.5325 mds_command: new command op to 5151 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-27T12:33:42.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.021+0000 7f012ffcc740 1 -- 172.21.15.55:0/289591219 --> [v2:172.21.15.55:6832/1971815735,v1:172.21.15.55:6833/1971815735] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56128b7d1670 con 0x56128b8a5f60 2024-05-27T12:33:42.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.021+0000 7f0126d9d640 1 --2- 172.21.15.55:0/289591219 >> [v2:172.21.15.55:6832/1971815735,v1:172.21.15.55:6833/1971815735] conn(0x56128b8a5f60 0x56128b8a1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:42.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.021+0000 7f0105ffb640 10 client.5325 ms_handle_connect on v2:172.21.15.55:6832/1971815735 2024-05-27T12:33:42.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.021+0000 7f0126d9d640 1 --2- 172.21.15.55:0/289591219 >> [v2:172.21.15.55:6832/1971815735,v1:172.21.15.55:6833/1971815735] conn(0x56128b8a5f60 0x56128b8a1170 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4693a8f37624bfe1 server_cookie=166a05e93bac8aa4 in_seq=0 out_seq=0 2024-05-27T12:33:42.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.022+0000 7f0105ffb640 1 -- 172.21.15.55:0/289591219 <== mds.0 v2:172.21.15.55:6832/1971815735 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x56128b7d1670 con 0x56128b8a5f60 2024-05-27T12:33:42.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.022+0000 7f0105ffb640 10 client.5325 handle_command_reply: tid=0 2024-05-27T12:33:42.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.022+0000 7f012ffcc740 1 client.5325 shutdown 2024-05-27T12:33:42.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.022+0000 7f012ffcc740 1 -- 172.21.15.55:0/289591219 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56128b85ec20 msgr2=0x56128b8a1ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:42.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.022+0000 7f012ffcc740 1 --2- 172.21.15.55:0/289591219 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56128b85ec20 0x56128b8a1ba0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f011000d7d0 tx=0x7f011005e0e0 comp rx=0 tx=0).stop 2024-05-27T12:33:42.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.022+0000 7f012ffcc740 1 -- 172.21.15.55:0/289591219 shutdown_connections 2024-05-27T12:33:42.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.022+0000 7f012ffcc740 1 --2- 172.21.15.55:0/289591219 >> [v2:172.21.15.55:6832/1971815735,v1:172.21.15.55:6833/1971815735] conn(0x56128b8a5f60 0x56128b8a1170 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:42.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.022+0000 7f012ffcc740 1 --2- 172.21.15.55:0/289591219 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56128b8a7f00 0x56128b8aa890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:42.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.022+0000 7f012ffcc740 1 --2- 172.21.15.55:0/289591219 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56128b85ec20 0x56128b8a1ba0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:42.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.022+0000 7f012ffcc740 1 --2- 172.21.15.55:0/289591219 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x56128b85dd60 0x56128b87ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:42.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.022+0000 7f0105ffb640 0 client.5325 ms_handle_reset on v2:172.21.15.55:6832/1971815735 2024-05-27T12:33:42.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.022+0000 7f012ffcc740 1 -- 172.21.15.55:0/289591219 >> 172.21.15.55:0/289591219 conn(0x56128b859ab0 msgr2=0x56128b85f710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:42.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.022+0000 7f012ffcc740 1 -- 172.21.15.55:0/289591219 shutdown_connections 2024-05-27T12:33:42.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.022+0000 7f012ffcc740 1 -- 172.21.15.55:0/289591219 wait complete. 2024-05-27T12:33:42.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.023+0000 7f012ffcc740 20 client.5325 trim_cache size 0 max 16384 2024-05-27T12:33:42.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.041+0000 7f012ffcc740 1 Processor -- start 2024-05-27T12:33:42.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.041+0000 7f012ffcc740 1 -- start start 2024-05-27T12:33:42.044 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.042+0000 7f012ffcc740 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x56128b85dd60 0x56128b889c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:42.044 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.042+0000 7f012ffcc740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56128b85ec20 0x56128b88a170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:42.044 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.042+0000 7f012ffcc740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56128b8a7f00 0x56128b8a1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:42.044 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.042+0000 7f012ffcc740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f01281ffb70 con 0x56128b85ec20 2024-05-27T12:33:42.044 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.042+0000 7f012ffcc740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f01281feed0 con 0x56128b8a7f00 2024-05-27T12:33:42.044 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.042+0000 7f012ffcc740 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f01281ff520 con 0x56128b85dd60 2024-05-27T12:33:42.044 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.042+0000 7f011e59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56128b85ec20 0x56128b88a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:42.044 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.042+0000 7f011e59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56128b85ec20 0x56128b88a170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51248/0 (socket says 172.21.15.55:51248) 2024-05-27T12:33:42.044 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.042+0000 7f011e59c640 1 -- 172.21.15.55:0/1677816537 learned_addr learned my addr 172.21.15.55:0/1677816537 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:33:42.044 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.042+0000 7f0126d9d640 1 --2- 172.21.15.55:0/1677816537 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x56128b85dd60 0x56128b889c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:42.044 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.042+0000 7f012759e640 1 --2- 172.21.15.55:0/1677816537 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56128b8a7f00 0x56128b8a1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:42.044 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.042+0000 7f011e59c640 1 -- 172.21.15.55:0/1677816537 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x56128b85dd60 msgr2=0x56128b889c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:42.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.042+0000 7f011e59c640 1 --2- 172.21.15.55:0/1677816537 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x56128b85dd60 0x56128b889c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:42.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.042+0000 7f011e59c640 1 -- 172.21.15.55:0/1677816537 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56128b8a7f00 msgr2=0x56128b8a1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:42.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.042+0000 7f011e59c640 1 --2- 172.21.15.55:0/1677816537 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56128b8a7f00 0x56128b8a1170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:42.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.042+0000 7f011e59c640 1 -- 172.21.15.55:0/1677816537 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56128b8a3ea0 con 0x56128b85ec20 2024-05-27T12:33:42.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.042+0000 7f0126d9d640 1 --2- 172.21.15.55:0/1677816537 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x56128b85dd60 0x56128b889c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T12:33:42.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.042+0000 7f012759e640 1 --2- 172.21.15.55:0/1677816537 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56128b8a7f00 0x56128b8a1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T12:33:42.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.042+0000 7f011e59c640 1 --2- 172.21.15.55:0/1677816537 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56128b85ec20 0x56128b88a170 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f011008c1a0 tx=0x7f011005d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3853a89717ac21d server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:42.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.042+0000 7f0107fff640 1 -- 172.21.15.55:0/1677816537 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f011008a2f0 con 0x56128b85ec20 2024-05-27T12:33:42.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.042+0000 7f0107fff640 1 -- 172.21.15.55:0/1677816537 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0110088070 con 0x56128b85ec20 2024-05-27T12:33:42.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.042+0000 7f0107fff640 1 -- 172.21.15.55:0/1677816537 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01100590b0 con 0x56128b85ec20 2024-05-27T12:33:42.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.043+0000 7f012ffcc740 1 -- 172.21.15.55:0/1677816537 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56128b85ec20 msgr2=0x56128b88a170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:42.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.043+0000 7f012ffcc740 1 --2- 172.21.15.55:0/1677816537 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56128b85ec20 0x56128b88a170 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f011008c1a0 tx=0x7f011005d000 comp rx=0 tx=0).stop 2024-05-27T12:33:42.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.043+0000 7f012ffcc740 1 -- 172.21.15.55:0/1677816537 shutdown_connections 2024-05-27T12:33:42.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.043+0000 7f012ffcc740 1 --2- 172.21.15.55:0/1677816537 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56128b8a7f00 0x56128b8a1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:42.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.043+0000 7f012ffcc740 1 --2- 172.21.15.55:0/1677816537 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56128b85ec20 0x56128b88a170 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:42.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.043+0000 7f012ffcc740 1 --2- 172.21.15.55:0/1677816537 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x56128b85dd60 0x56128b889c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:42.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.043+0000 7f012ffcc740 1 -- 172.21.15.55:0/1677816537 >> 172.21.15.55:0/1677816537 conn(0x56128b859ab0 msgr2=0x56128b8c9790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:42.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.043+0000 7f012ffcc740 1 -- 172.21.15.55:0/1677816537 shutdown_connections 2024-05-27T12:33:42.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.043+0000 7f012ffcc740 1 -- 172.21.15.55:0/1677816537 wait complete. 2024-05-27T12:33:42.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.043+0000 7f012ffcc740 1 -- start start 2024-05-27T12:33:42.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.044+0000 7f012ffcc740 1 Processor -- start 2024-05-27T12:33:42.049 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.044+0000 7f012ffcc740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56128b85dd60 0x56128b8a02c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:42.049 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.044+0000 7f012ffcc740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56128b85ec20 0x56128b91f380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:42.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.044+0000 7f012ffcc740 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x56128b8a7f00 0x56128b889c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:42.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.044+0000 7f012ffcc740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x56128b8a5de0 con 0x56128b85dd60 2024-05-27T12:33:42.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.044+0000 7f012ffcc740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x56128b8a9f20 con 0x56128b85ec20 2024-05-27T12:33:42.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.044+0000 7f012ffcc740 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x56128b8a6400 con 0x56128b8a7f00 2024-05-27T12:33:42.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.044+0000 7f012ffcc740 10 client.0 _ll_register_callbacks cb 0x7f0110059850 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-27T12:33:42.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.044+0000 7f0126d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56128b85dd60 0x56128b8a02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:42.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.044+0000 7f0126d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56128b85dd60 0x56128b8a02c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51260/0 (socket says 172.21.15.55:51260) 2024-05-27T12:33:42.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.044+0000 7f0126d9d640 1 -- 172.21.15.55:0/1053143078 learned_addr learned my addr 172.21.15.55:0/1053143078 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:33:42.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.044+0000 7f011e59c640 1 --2- 172.21.15.55:0/1053143078 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56128b85ec20 0x56128b91f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:42.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.044+0000 7f012759e640 1 --2- 172.21.15.55:0/1053143078 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x56128b8a7f00 0x56128b889c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:42.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.045+0000 7f0126d9d640 1 -- 172.21.15.55:0/1053143078 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x56128b8a7f00 msgr2=0x56128b889c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:42.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.045+0000 7f0126d9d640 1 --2- 172.21.15.55:0/1053143078 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x56128b8a7f00 0x56128b889c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:42.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.045+0000 7f0126d9d640 1 -- 172.21.15.55:0/1053143078 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56128b85ec20 msgr2=0x56128b91f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:42.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.045+0000 7f0126d9d640 1 --2- 172.21.15.55:0/1053143078 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56128b85ec20 0x56128b91f380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:42.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.045+0000 7f0126d9d640 1 -- 172.21.15.55:0/1053143078 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56128b91f8c0 con 0x56128b85dd60 2024-05-27T12:33:42.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.045+0000 7f012759e640 1 --2- 172.21.15.55:0/1053143078 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x56128b8a7f00 0x56128b889c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T12:33:42.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.045+0000 7f0126d9d640 1 --2- 172.21.15.55:0/1053143078 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56128b85dd60 0x56128b8a02c0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f0118032860 tx=0x7f0118004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4072234d090fe3f6 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:42.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.045+0000 7f0105ffb640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-05-27T12:33:42.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.045+0000 7f0105ffb640 1 -- 172.21.15.55:0/1053143078 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0118057070 con 0x56128b85dd60 2024-05-27T12:33:42.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.045+0000 7f0105ffb640 1 -- 172.21.15.55:0/1053143078 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(36..36 src has 1..36) ==== 5709+0+0 (secure 0 0 0) 0x7f0118053380 con 0x56128b85dd60 2024-05-27T12:33:42.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.045+0000 7f012ffcc740 1 -- 172.21.15.55:0/1053143078 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0110088070 con 0x56128b85dd60 2024-05-27T12:33:42.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.045+0000 7f0105ffb640 1 -- 172.21.15.55:0/1053143078 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7f011805f050 con 0x56128b85dd60 2024-05-27T12:33:42.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.045+0000 7f012ffcc740 10 client.5331 fetch_fsmap learned FSMap version 14 2024-05-27T12:33:42.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.045+0000 7f012ffcc740 1 -- 172.21.15.55:0/1053143078 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x56128b858c20 con 0x56128b85dd60 2024-05-27T12:33:42.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.045+0000 7f0105ffb640 1 -- 172.21.15.55:0/1053143078 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0110088070 con 0x56128b85dd60 2024-05-27T12:33:42.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.045+0000 7f0105ffb640 1 -- 172.21.15.55:0/1053143078 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 14) ==== 3494+0+0 (secure 0 0 0) 0x7f0118062020 con 0x56128b85dd60 2024-05-27T12:33:42.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.045+0000 7f012ffcc740 10 client.5331 fetch_fsmap finished waiting for FSMap version 14 2024-05-27T12:33:42.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.046+0000 7f012ffcc740 10 client.5331 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-27T12:33:42.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.046+0000 7f012ffcc740 20 client.5331 populate_metadata read hostname 'smithi055' 2024-05-27T12:33:42.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.046+0000 7f012ffcc740 1 --2- 172.21.15.55:0/1053143078 >> [v2:172.21.15.55:6832/1971815735,v1:172.21.15.55:6833/1971815735] conn(0x56128b922410 0x56128b8a10d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:42.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.046+0000 7f012ffcc740 4 client.5331 mds_command: new command op to 5151 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-27T12:33:42.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.046+0000 7f012ffcc740 1 -- 172.21.15.55:0/1053143078 --> [v2:172.21.15.55:6832/1971815735,v1:172.21.15.55:6833/1971815735] -- command(tid 0: {"prefix": "status"}) -- 0x56128b7cb4e0 con 0x56128b922410 2024-05-27T12:33:42.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.046+0000 7f011e59c640 1 --2- 172.21.15.55:0/1053143078 >> [v2:172.21.15.55:6832/1971815735,v1:172.21.15.55:6833/1971815735] conn(0x56128b922410 0x56128b8a10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:42.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.046+0000 7f0105ffb640 10 client.5331 ms_handle_connect on v2:172.21.15.55:6832/1971815735 2024-05-27T12:33:42.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.046+0000 7f011e59c640 1 --2- 172.21.15.55:0/1053143078 >> [v2:172.21.15.55:6832/1971815735,v1:172.21.15.55:6833/1971815735] conn(0x56128b922410 0x56128b8a10d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5b1b6c41de547521 server_cookie=81cc4eac9153540c in_seq=0 out_seq=0 2024-05-27T12:33:42.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.046+0000 7f0105ffb640 1 -- 172.21.15.55:0/1053143078 <== mds.0 v2:172.21.15.55:6832/1971815735 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x56128b7cb4e0 con 0x56128b922410 2024-05-27T12:33:42.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.046+0000 7f0105ffb640 10 client.5331 handle_command_reply: tid=0 2024-05-27T12:33:42.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.046+0000 7f012ffcc740 1 client.5331 shutdown 2024-05-27T12:33:42.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.046+0000 7f012ffcc740 1 -- 172.21.15.55:0/1053143078 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56128b85dd60 msgr2=0x56128b8a02c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:42.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.046+0000 7f012ffcc740 1 --2- 172.21.15.55:0/1053143078 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56128b85dd60 0x56128b8a02c0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f0118032860 tx=0x7f0118004730 comp rx=0 tx=0).stop 2024-05-27T12:33:42.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.046+0000 7f012ffcc740 1 -- 172.21.15.55:0/1053143078 shutdown_connections 2024-05-27T12:33:42.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.046+0000 7f012ffcc740 1 --2- 172.21.15.55:0/1053143078 >> [v2:172.21.15.55:6832/1971815735,v1:172.21.15.55:6833/1971815735] conn(0x56128b922410 0x56128b8a10d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:42.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.046+0000 7f012ffcc740 1 --2- 172.21.15.55:0/1053143078 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x56128b8a7f00 0x56128b889c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:42.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.046+0000 7f012ffcc740 1 --2- 172.21.15.55:0/1053143078 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56128b85ec20 0x56128b91f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:42.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.046+0000 7f0105ffb640 0 client.5331 ms_handle_reset on v2:172.21.15.55:6832/1971815735 2024-05-27T12:33:42.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.046+0000 7f012ffcc740 1 --2- 172.21.15.55:0/1053143078 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56128b85dd60 0x56128b8a02c0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:42.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.046+0000 7f012ffcc740 1 -- 172.21.15.55:0/1053143078 >> 172.21.15.55:0/1053143078 conn(0x56128b859ab0 msgr2=0x56128b8c97a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:42.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.046+0000 7f012ffcc740 1 -- 172.21.15.55:0/1053143078 shutdown_connections 2024-05-27T12:33:42.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.046+0000 7f012ffcc740 1 -- 172.21.15.55:0/1053143078 wait complete. 2024-05-27T12:33:42.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.046+0000 7f012ffcc740 20 client.5331 trim_cache size 0 max 16384 2024-05-27T12:33:42.053 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-05-27T12:33:42.054 INFO:teuthology.orchestra.run.smithi055.stdout: "cluster_fsid": "c3ff4e3b-8dae-4856-9593-e5cc66c59982", 2024-05-27T12:33:42.054 INFO:teuthology.orchestra.run.smithi055.stdout: "whoami": 0, 2024-05-27T12:33:42.054 INFO:teuthology.orchestra.run.smithi055.stdout: "id": 5151, 2024-05-27T12:33:42.054 INFO:teuthology.orchestra.run.smithi055.stdout: "want_state": "up:active", 2024-05-27T12:33:42.054 INFO:teuthology.orchestra.run.smithi055.stdout: "state": "up:active", 2024-05-27T12:33:42.054 INFO:teuthology.orchestra.run.smithi055.stdout: "fs_name": "cephfs", 2024-05-27T12:33:42.054 INFO:teuthology.orchestra.run.smithi055.stdout: "rank_uptime": 5.7507462240000002, 2024-05-27T12:33:42.054 INFO:teuthology.orchestra.run.smithi055.stdout: "mdsmap_epoch": 14, 2024-05-27T12:33:42.054 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch": 36, 2024-05-27T12:33:42.054 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch_barrier": 36, 2024-05-27T12:33:42.054 INFO:teuthology.orchestra.run.smithi055.stdout: "uptime": 12.826330113999999 2024-05-27T12:33:42.054 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-05-27T12:33:42.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.047+0000 7f012d1e1640 1 -- 172.21.15.55:0/163742590 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f010806c8f0 msgr2=0x7f010806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:42.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.047+0000 7f012d1e1640 1 --2- 172.21.15.55:0/163742590 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f010806c8f0 0x7f010806edb0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f0118034000 tx=0x7f011802e000 comp rx=0 tx=0).stop 2024-05-27T12:33:42.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.047+0000 7f012d1e1640 1 -- 172.21.15.55:0/163742590 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0128140090 msgr2=0x7f01280ce8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:42.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.047+0000 7f012d1e1640 1 --2- 172.21.15.55:0/163742590 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0128140090 0x7f01280ce8e0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f011000d800 tx=0x7f011000dcc0 comp rx=0 tx=0).stop 2024-05-27T12:33:42.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.047+0000 7f012d1e1640 1 -- 172.21.15.55:0/163742590 shutdown_connections 2024-05-27T12:33:42.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.047+0000 7f012d1e1640 1 --2- 172.21.15.55:0/163742590 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f010806c8f0 0x7f010806edb0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:42.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.047+0000 7f012d1e1640 1 --2- 172.21.15.55:0/163742590 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0128159970 0x7f01280d0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:42.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.047+0000 7f012d1e1640 1 --2- 172.21.15.55:0/163742590 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0128140090 0x7f01280ce8e0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:42.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.047+0000 7f012d1e1640 1 --2- 172.21.15.55:0/163742590 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f01280b3540 0x7f012813efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:42.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.047+0000 7f012d1e1640 1 -- 172.21.15.55:0/163742590 >> 172.21.15.55:0/163742590 conn(0x7f0128071e40 msgr2=0x7f01280b0240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:42.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.047+0000 7f012d1e1640 1 -- 172.21.15.55:0/163742590 shutdown_connections 2024-05-27T12:33:42.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.047+0000 7f012d1e1640 1 -- 172.21.15.55:0/163742590 wait complete. 2024-05-27T12:33:42.058 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-27T12:33:42.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.162+0000 7fab20768640 1 Processor -- start 2024-05-27T12:33:42.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.162+0000 7fab20768640 1 -- start start 2024-05-27T12:33:42.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.163+0000 7fab20768640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fab1815eaf0 0x7fab180d2910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:42.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.163+0000 7fab20768640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fab180ba5e0 0x7fab180d1280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:42.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.163+0000 7fab20768640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab180d3280 con 0x7fab180d4320 2024-05-27T12:33:42.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.163+0000 7fab20768640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fab180b89d0 con 0x7fab1815eaf0 2024-05-27T12:33:42.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.163+0000 7fab20768640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fab180d3e90 con 0x7fab180ba5e0 2024-05-27T12:33:42.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.163+0000 7fab1ed05640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fab180d4320 0x7fab180b6310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:32906/0 (socket says 172.21.15.55:32906) 2024-05-27T12:33:42.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.163+0000 7fab1ed05640 1 -- 172.21.15.55:0/3716842499 learned_addr learned my addr 172.21.15.55:0/3716842499 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-27T12:33:42.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.163+0000 7fab1dd03640 1 --2- 172.21.15.55:0/3716842499 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fab180ba5e0 0x7fab180d1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:42.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.163+0000 7fab1e504640 1 --2- 172.21.15.55:0/3716842499 >> v2:172.21.15.72:3300/0 conn(0x7fab1815eaf0 0x7fab180d2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:42.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.163+0000 7fab1d502640 1 -- 172.21.15.55:0/3716842499 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 438490139 0 0) 0x7fab180d3280 con 0x7fab180d4320 2024-05-27T12:33:42.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.163+0000 7fab1d502640 1 -- 172.21.15.55:0/3716842499 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fab04003520 con 0x7fab180d4320 2024-05-27T12:33:42.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.163+0000 7fab1e504640 1 -- 172.21.15.55:0/3716842499 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fab180ba5e0 msgr2=0x7fab180d1280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:42.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.163+0000 7fab1e504640 1 --2- 172.21.15.55:0/3716842499 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fab180ba5e0 0x7fab180d1280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:42.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.163+0000 7fab1e504640 1 -- 172.21.15.55:0/3716842499 >> v1:172.21.15.55:6789/0 conn(0x7fab180d4320 legacy=0x7fab180b6310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:42.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.163+0000 7fab1e504640 1 -- 172.21.15.55:0/3716842499 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab180d3560 con 0x7fab1815eaf0 2024-05-27T12:33:42.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.163+0000 7fab1dd03640 1 --2- 172.21.15.55:0/3716842499 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fab180ba5e0 0x7fab180d1280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T12:33:42.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.164+0000 7fab1e504640 1 --2- 172.21.15.55:0/3716842499 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fab1815eaf0 0x7fab180d2910 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fab140097a0 tx=0x7fab1402a210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ec30e95e4d925394 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:42.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.164+0000 7fab1d502640 1 -- 172.21.15.55:0/3716842499 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab14037070 con 0x7fab1815eaf0 2024-05-27T12:33:42.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.164+0000 7fab1d502640 1 -- 172.21.15.55:0/3716842499 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab14032440 con 0x7fab1815eaf0 2024-05-27T12:33:42.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.164+0000 7fab1d502640 1 -- 172.21.15.55:0/3716842499 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab140327f0 con 0x7fab1815eaf0 2024-05-27T12:33:42.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.165+0000 7fab20768640 1 -- 172.21.15.55:0/3716842499 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fab1815eaf0 msgr2=0x7fab180d2910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:42.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.165+0000 7fab20768640 1 --2- 172.21.15.55:0/3716842499 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fab1815eaf0 0x7fab180d2910 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fab140097a0 tx=0x7fab1402a210 comp rx=0 tx=0).stop 2024-05-27T12:33:42.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.165+0000 7fab20768640 1 -- 172.21.15.55:0/3716842499 shutdown_connections 2024-05-27T12:33:42.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.165+0000 7fab20768640 1 --2- 172.21.15.55:0/3716842499 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fab180ba5e0 0x7fab180d1280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:42.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.165+0000 7fab20768640 1 --2- 172.21.15.55:0/3716842499 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fab1815eaf0 0x7fab180d2910 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:42.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.165+0000 7fab20768640 1 -- 172.21.15.55:0/3716842499 >> 172.21.15.55:0/3716842499 conn(0x7fab1806cdb0 msgr2=0x7fab1806d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:42.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.165+0000 7fab20768640 1 -- 172.21.15.55:0/3716842499 shutdown_connections 2024-05-27T12:33:42.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.165+0000 7fab20768640 1 -- 172.21.15.55:0/3716842499 wait complete. 2024-05-27T12:33:42.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.166+0000 7fab20768640 1 Processor -- start 2024-05-27T12:33:42.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.166+0000 7fab20768640 1 -- start start 2024-05-27T12:33:42.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.167+0000 7fab20768640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fab180ba5e0 0x7fab18152e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:42.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.167+0000 7fab20768640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fab180d4320 0x7fab18161af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:42.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.167+0000 7fab20768640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab1815eaf0 0x7fab180ccbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:42.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.167+0000 7fab20768640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7fab1815eed0 con 0x7fab1815eaf0 2024-05-27T12:33:42.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.167+0000 7fab20768640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fab180d3b20 con 0x7fab180d4320 2024-05-27T12:33:42.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.167+0000 7fab20768640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fab1815f050 con 0x7fab180ba5e0 2024-05-27T12:33:42.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.167+0000 7fab1ed05640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab1815eaf0 0x7fab180ccbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:42.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.167+0000 7fab1ed05640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab1815eaf0 0x7fab180ccbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51264/0 (socket says 172.21.15.55:51264) 2024-05-27T12:33:42.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.167+0000 7fab1ed05640 1 -- 172.21.15.55:0/3208076046 learned_addr learned my addr 172.21.15.55:0/3208076046 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:33:42.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.167+0000 7fab1e504640 1 --2- 172.21.15.55:0/3208076046 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fab180ba5e0 0x7fab18152e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:42.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.167+0000 7fab1dd03640 1 --2- 172.21.15.55:0/3208076046 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fab180d4320 0x7fab18161af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:42.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.167+0000 7fab1ed05640 1 -- 172.21.15.55:0/3208076046 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fab180ba5e0 msgr2=0x7fab18152e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:42.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.167+0000 7fab1ed05640 1 --2- 172.21.15.55:0/3208076046 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fab180ba5e0 0x7fab18152e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:42.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.167+0000 7fab1ed05640 1 -- 172.21.15.55:0/3208076046 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fab180d4320 msgr2=0x7fab18161af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:42.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.167+0000 7fab1ed05640 1 --2- 172.21.15.55:0/3208076046 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fab180d4320 0x7fab18161af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:42.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.167+0000 7fab1ed05640 1 -- 172.21.15.55:0/3208076046 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab180c8420 con 0x7fab1815eaf0 2024-05-27T12:33:42.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.168+0000 7fab1ed05640 1 --2- 172.21.15.55:0/3208076046 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab1815eaf0 0x7fab180ccbe0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fab1000cae0 tx=0x7fab1000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:42.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.168+0000 7fab0effd640 1 -- 172.21.15.55:0/3208076046 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab10017070 con 0x7fab1815eaf0 2024-05-27T12:33:42.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.168+0000 7fab0effd640 1 -- 172.21.15.55:0/3208076046 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab1000ac40 con 0x7fab1815eaf0 2024-05-27T12:33:42.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.168+0000 7fab0effd640 1 -- 172.21.15.55:0/3208076046 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab10012640 con 0x7fab1815eaf0 2024-05-27T12:33:42.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.168+0000 7fab20768640 1 -- 172.21.15.55:0/3208076046 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab180c8700 con 0x7fab1815eaf0 2024-05-27T12:33:42.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.168+0000 7fab20768640 1 -- 172.21.15.55:0/3208076046 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab180c8fa0 con 0x7fab1815eaf0 2024-05-27T12:33:42.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.169+0000 7fab20768640 1 -- 172.21.15.55:0/3208076046 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab180c88d0 con 0x7fab1815eaf0 2024-05-27T12:33:42.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.169+0000 7fab0effd640 1 -- 172.21.15.55:0/3208076046 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fab1001a070 con 0x7fab1815eaf0 2024-05-27T12:33:42.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.170+0000 7fab0effd640 1 --2- 172.21.15.55:0/3208076046 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7faafc06c8f0 0x7faafc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:42.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.170+0000 7fab0effd640 1 -- 172.21.15.55:0/3208076046 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5709+0+0 (secure 0 0 0) 0x7fab1008b840 con 0x7fab1815eaf0 2024-05-27T12:33:42.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.170+0000 7fab1e504640 1 --2- 172.21.15.55:0/3208076046 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7faafc06c8f0 0x7faafc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:42.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.171+0000 7fab1e504640 1 --2- 172.21.15.55:0/3208076046 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7faafc06c8f0 0x7faafc06edb0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fab14034000 tx=0x7fab1402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:42.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.175+0000 7fab0effd640 1 -- 172.21.15.55:0/3208076046 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fab10059620 con 0x7fab1815eaf0 2024-05-27T12:33:42.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.401+0000 7fab20768640 1 -- 172.21.15.55:0/3208076046 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fab180c9170 con 0x7fab1815eaf0 2024-05-27T12:33:42.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.401+0000 7fab0effd640 1 -- 172.21.15.55:0/3208076046 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v14) ==== 53+0+73 (secure 0 0 0) 0x7fab1005d920 con 0x7fab1815eaf0 2024-05-27T12:33:42.401 INFO:teuthology.orchestra.run.smithi055.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-27T12:33:42.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.403+0000 7fab20768640 1 -- 172.21.15.55:0/3208076046 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7faafc06c8f0 msgr2=0x7faafc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:42.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.403+0000 7fab20768640 1 --2- 172.21.15.55:0/3208076046 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7faafc06c8f0 0x7faafc06edb0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fab14034000 tx=0x7fab1402e000 comp rx=0 tx=0).stop 2024-05-27T12:33:42.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.403+0000 7fab20768640 1 -- 172.21.15.55:0/3208076046 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab1815eaf0 msgr2=0x7fab180ccbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:42.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.403+0000 7fab20768640 1 --2- 172.21.15.55:0/3208076046 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab1815eaf0 0x7fab180ccbe0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fab1000cae0 tx=0x7fab1000a060 comp rx=0 tx=0).stop 2024-05-27T12:33:42.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.403+0000 7fab20768640 1 -- 172.21.15.55:0/3208076046 shutdown_connections 2024-05-27T12:33:42.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.403+0000 7fab20768640 1 --2- 172.21.15.55:0/3208076046 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab1815eaf0 0x7fab180ccbe0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:42.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.403+0000 7fab20768640 1 --2- 172.21.15.55:0/3208076046 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7faafc06c8f0 0x7faafc06edb0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:42.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.403+0000 7fab20768640 1 --2- 172.21.15.55:0/3208076046 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fab180d4320 0x7fab18161af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:42.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.403+0000 7fab20768640 1 --2- 172.21.15.55:0/3208076046 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fab180ba5e0 0x7fab18152e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:42.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.403+0000 7fab20768640 1 -- 172.21.15.55:0/3208076046 >> 172.21.15.55:0/3208076046 conn(0x7fab1806cdb0 msgr2=0x7fab180d1280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:42.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.403+0000 7fab20768640 1 -- 172.21.15.55:0/3208076046 shutdown_connections 2024-05-27T12:33:42.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42.403+0000 7fab20768640 1 -- 172.21.15.55:0/3208076046 wait complete. 2024-05-27T12:33:42.414 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-05-27T12:33:42.415 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-27T12:33:42.415 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi055.front.sepia.ceph.com 2024-05-27T12:33:42.415 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-27T12:33:42.415 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-27T12:33:42.415 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-05-27T12:33:42.415 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-05-27T12:33:42.415 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-27T12:33:42.415 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-27T12:33:42.415 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T12:33:42.416 DEBUG:teuthology.orchestra.run.smithi055:> ip addr 2024-05-27T12:33:42.432 INFO:teuthology.orchestra.run.smithi055.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-27T12:33:42.433 INFO:teuthology.orchestra.run.smithi055.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-27T12:33:42.433 INFO:teuthology.orchestra.run.smithi055.stdout: inet 127.0.0.1/8 scope host lo 2024-05-27T12:33:42.433 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-05-27T12:33:42.433 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 ::1/128 scope host 2024-05-27T12:33:42.433 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-05-27T12:33:42.433 INFO:teuthology.orchestra.run.smithi055.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-27T12:33:42.434 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d6 brd ff:ff:ff:ff:ff:ff 2024-05-27T12:33:42.434 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f0 2024-05-27T12:33:42.434 INFO:teuthology.orchestra.run.smithi055.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-27T12:33:42.434 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d7 brd ff:ff:ff:ff:ff:ff 2024-05-27T12:33:42.434 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f1 2024-05-27T12:33:42.434 INFO:teuthology.orchestra.run.smithi055.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-27T12:33:42.434 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:06 brd ff:ff:ff:ff:ff:ff 2024-05-27T12:33:42.435 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f0 2024-05-27T12:33:42.435 INFO:teuthology.orchestra.run.smithi055.stdout: inet 172.21.15.55/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-05-27T12:33:42.435 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft 42657sec preferred_lft 42657sec 2024-05-27T12:33:42.435 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::ae1f:6bff:fef8:2606/64 scope link noprefixroute 2024-05-27T12:33:42.435 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-05-27T12:33:42.435 INFO:teuthology.orchestra.run.smithi055.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-27T12:33:42.435 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:07 brd ff:ff:ff:ff:ff:ff 2024-05-27T12:33:42.435 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f1 2024-05-27T12:33:42.435 INFO:teuthology.orchestra.run.smithi055.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-27T12:33:42.436 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 2a:9a:d9:69:c0:09 brd ff:ff:ff:ff:ff:ff 2024-05-27T12:33:42.436 INFO:teuthology.orchestra.run.smithi055.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-27T12:33:42.436 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-05-27T12:33:42.436 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::64fc:d3ff:fef6:6ed9/64 scope link 2024-05-27T12:33:42.436 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-05-27T12:33:42.436 INFO:teuthology.orchestra.run.smithi055.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-27T12:33:42.436 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 2e:af:a5:b4:68:cc brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-27T12:33:42.436 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::2caf:a5ff:feb4:68cc/64 scope link 2024-05-27T12:33:42.436 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-05-27T12:33:42.436 INFO:teuthology.orchestra.run.smithi055.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-27T12:33:42.436 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 2a:9a:d9:69:c0:09 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-27T12:33:42.436 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::289a:d9ff:fe69:c009/64 scope link 2024-05-27T12:33:42.436 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-05-27T12:33:42.437 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T12:33:42.437 DEBUG:teuthology.orchestra.run.smithi055:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-27T12:33:42.497 INFO:teuthology.orchestra.run.smithi055.stdout:1 2024-05-27T12:33:42.499 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T12:33:42.499 DEBUG:teuthology.orchestra.run.smithi055:> route 2024-05-27T12:33:42.556 INFO:teuthology.orchestra.run.smithi055.stdout:Kernel IP routing table 2024-05-27T12:33:42.556 INFO:teuthology.orchestra.run.smithi055.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-27T12:33:42.557 INFO:teuthology.orchestra.run.smithi055.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-05-27T12:33:42.557 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-05-27T12:33:42.557 INFO:teuthology.orchestra.run.smithi055.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-27T12:33:42.557 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-27T12:33:42.557 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2024-05-27T12:33:42.557 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-05-27T12:33:42.557 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-05-27T12:33:42.557 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-05-27T12:33:42.557 DEBUG:teuthology.orchestra.run.smithi055:> ') 2024-05-27T12:33:42.647 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-27T12:33:42.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-27T12:33:42.686 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T12:33:42.687 DEBUG:teuthology.orchestra.run.smithi055:> ip netns list 2024-05-27T12:33:42.703 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-05-27T12:33:42.703 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-27T12:33:42.703 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-27T12:33:42.703 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T12:33:42.703 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link set brx.0 up 2024-05-27T12:33:42.769 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-27T12:33:42.769 DEBUG:teuthology.orchestra.run.smithi055:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-27T12:33:42.825 INFO:teuthology.orchestra.run.smithi055.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-27T12:33:42.825 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-27T12:33:42.825 DEBUG:teuthology.orchestra.run.smithi055:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-27T12:33:42.880 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-05-27T12:33:42.881 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T12:33:42.881 DEBUG:teuthology.orchestra.run.smithi055:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-27T12:33:42.965 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-27T12:33:42.966 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-27T12:33:42.966 INFO:teuthology.orchestra.run.smithi055.stdout:invalid new device string format 2024-05-27T12:33:42.974 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-27T12:33:42.975 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-27T12:33:42.975 INFO:teuthology.orchestra.run.smithi055.stdout:invalid new device string format 2024-05-27T12:33:42.975 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: resolved to: "172.21.15.55:3300,172.21.15.72:3300,172.21.15.72:3301" 2024-05-27T12:33:42.975 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-27T12:33:42.980 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-27T12:33:42.980 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-27T12:33:42.980 INFO:teuthology.orchestra.run.smithi055.stdout:invalid new device string format 2024-05-27T12:33:42.980 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: resolved to: "172.21.15.55:3300,172.21.15.72:3300,172.21.15.72:3301" 2024-05-27T12:33:42.981 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-27T12:33:42.981 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: resolved to: "172.21.15.55:6789,172.21.15.72:6789,172.21.15.72:6790" 2024-05-27T12:33:42.981 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.55:6789,172.21.15.72:6789,172.21.15.72:6790:/ 2024-05-27T12:33:42.981 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=c3ff4e3b-8dae-4856-9593-e5cc66c59982" will pass to kernel 2024-05-27T12:33:42.981 INFO:teuthology.orchestra.run.smithi055.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-05-27T12:33:42.981 INFO:teuthology.orchestra.run.smithi055.stdout: You just mounted a file system that supports labels which does not 2024-05-27T12:33:42.981 INFO:teuthology.orchestra.run.smithi055.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-27T12:33:42.981 INFO:teuthology.orchestra.run.smithi055.stdout: applications will generate AVC messages and not be allowed access to 2024-05-27T12:33:42.982 INFO:teuthology.orchestra.run.smithi055.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-27T12:33:42.983 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-27T12:33:42.983 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T12:33:42.983 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-27T12:33:43.009 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-27T12:33:43.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:43 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-27T12:33:43.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-27T12:33:43.113 INFO:teuthology.orchestra.run.smithi055.stdout:client5340 2024-05-27T12:33:43.114 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-05-27T12:33:43.114 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-27T12:33:43.130 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-05-27T12:33:43.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:43.280+0000 7f839f595640 1 Processor -- start 2024-05-27T12:33:43.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:43.280+0000 7f839f595640 1 -- start start 2024-05-27T12:33:43.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:43.281+0000 7f839f595640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f839815eb00 0x7f83980cfb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:43.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:43.281+0000 7f839f595640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f83980d3e50 0x7f83980d1830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:43.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:43.281+0000 7f839f595640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83980d2180 con 0x7f83980d1d70 2024-05-27T12:33:43.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:43.281+0000 7f839f595640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f83980d5700 con 0x7f839815eb00 2024-05-27T12:33:43.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:43.281+0000 7f839f595640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f839815eee0 con 0x7f83980d3e50 2024-05-27T12:33:43.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:43.281+0000 7f839d331640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f839815eb00 0x7f83980cfb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:43.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:43.281+0000 7f839d331640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f839815eb00 0x7f83980cfb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44190/0 (socket says 172.21.15.55:44190) 2024-05-27T12:33:43.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:43.281+0000 7f839d331640 1 -- 172.21.15.55:0/3111297954 learned_addr learned my addr 172.21.15.55:0/3111297954 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:33:43.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:43.281+0000 7f839cb30640 1 --2- 172.21.15.55:0/3111297954 >> v2:172.21.15.72:3300/0 conn(0x7f83980d3e50 0x7f83980d1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:43.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:43.282+0000 7f839d331640 1 -- 172.21.15.55:0/3111297954 >> v2:172.21.15.72:3300/0 conn(0x7f83980d3e50 msgr2=0x7f83980d1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:43.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:43.282+0000 7f839d331640 1 --2- 172.21.15.55:0/3111297954 >> v2:172.21.15.72:3300/0 conn(0x7f83980d3e50 0x7f83980d1830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:43.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:43.282+0000 7f839d331640 1 -- 172.21.15.55:0/3111297954 >> v1:172.21.15.72:6789/0 conn(0x7f83980d1d70 legacy=0x7f83980d2910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:43.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:43.282+0000 7f839d331640 1 -- 172.21.15.55:0/3111297954 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83980d4660 con 0x7f839815eb00 2024-05-27T12:33:43.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:43.282+0000 7f839d331640 1 --2- 172.21.15.55:0/3111297954 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f839815eb00 0x7f83980cfb40 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f83980b7760 tx=0x7f839402a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99c66534f925c999 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:43.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:43.282+0000 7f838ffff640 1 -- 172.21.15.55:0/3111297954 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8394037070 con 0x7f839815eb00 2024-05-27T12:33:43.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:43.283+0000 7f838ffff640 1 -- 172.21.15.55:0/3111297954 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f839402ae50 con 0x7f839815eb00 2024-05-27T12:33:43.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:43.283+0000 7f838ffff640 1 -- 172.21.15.55:0/3111297954 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8394032860 con 0x7f839815eb00 2024-05-27T12:33:43.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:43.283+0000 7f839f595640 1 -- 172.21.15.55:0/3111297954 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f839815eb00 msgr2=0x7f83980cfb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:43.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:43.283+0000 7f839f595640 1 --2- 172.21.15.55:0/3111297954 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f839815eb00 0x7f83980cfb40 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f83980b7760 tx=0x7f839402a300 comp rx=0 tx=0).stop 2024-05-27T12:33:43.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:43.283+0000 7f839f595640 1 -- 172.21.15.55:0/3111297954 shutdown_connections 2024-05-27T12:33:43.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:43.283+0000 7f839f595640 1 --2- 172.21.15.55:0/3111297954 >> v2:172.21.15.72:3300/0 conn(0x7f83980d3e50 0x7f83980d1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:43.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:43.283+0000 7f839f595640 1 --2- 172.21.15.55:0/3111297954 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f839815eb00 0x7f83980cfb40 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:43.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:43.283+0000 7f839f595640 1 -- 172.21.15.55:0/3111297954 >> 172.21.15.55:0/3111297954 conn(0x7f8398067a50 msgr2=0x7f8398067e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:43.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:43.283+0000 7f839f595640 1 -- 172.21.15.55:0/3111297954 shutdown_connections 2024-05-27T12:33:43.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:43.283+0000 7f839f595640 1 -- 172.21.15.55:0/3111297954 wait complete. 2024-05-27T12:33:43.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:43.284+0000 7f839f595640 1 Processor -- start 2024-05-27T12:33:43.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:43.284+0000 7f839f595640 1 -- start start 2024-05-27T12:33:43.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:43.285+0000 7f839f595640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83980d1d70 0x7f839815f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:43.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:43.285+0000 7f839f595640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f83980d3e50 0x7f83980cc6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:43.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:43.285+0000 7f839f595640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f839815eb00 0x7f83980ca190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:43.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:43.285+0000 7f839f595640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f83980d4f00 con 0x7f839815eb00 2024-05-27T12:33:43.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:43.285+0000 7f839f595640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f83980d4c20 con 0x7f83980d1d70 2024-05-27T12:33:43.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:43.285+0000 7f839f595640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f83980d51e0 con 0x7f83980d3e50 2024-05-27T12:33:43.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:43.285+0000 7f839db32640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f839815eb00 0x7f83980ca190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:43.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:43.285+0000 7f839db32640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f839815eb00 0x7f83980ca190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44192/0 (socket says 172.21.15.55:44192) 2024-05-27T12:33:43.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:43.285+0000 7f839db32640 1 -- 172.21.15.55:0/1380483749 learned_addr learned my addr 172.21.15.55:0/1380483749 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:33:43.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:43.285+0000 7f839d331640 1 --2- 172.21.15.55:0/1380483749 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83980d1d70 0x7f839815f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:43.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:43.285+0000 7f839cb30640 1 --2- 172.21.15.55:0/1380483749 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f83980d3e50 0x7f83980cc6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:43.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:43.286+0000 7f839db32640 1 -- 172.21.15.55:0/1380483749 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f83980d3e50 msgr2=0x7f83980cc6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:43.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:43.286+0000 7f839db32640 1 --2- 172.21.15.55:0/1380483749 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f83980d3e50 0x7f83980cc6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:43.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:43.286+0000 7f839db32640 1 -- 172.21.15.55:0/1380483749 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83980d1d70 msgr2=0x7f839815f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:43.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:43.286+0000 7f839db32640 1 --2- 172.21.15.55:0/1380483749 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83980d1d70 0x7f839815f950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:43.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:43.286+0000 7f839db32640 1 -- 172.21.15.55:0/1380483749 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83980c93d0 con 0x7f839815eb00 2024-05-27T12:33:43.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:43.286+0000 7f839db32640 1 --2- 172.21.15.55:0/1380483749 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f839815eb00 0x7f83980ca190 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f839000c7a0 tx=0x7f839000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:43.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:43.286+0000 7f838dffb640 1 -- 172.21.15.55:0/1380483749 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8390003b70 con 0x7f839815eb00 2024-05-27T12:33:43.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:43.286+0000 7f838dffb640 1 -- 172.21.15.55:0/1380483749 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8390003d30 con 0x7f839815eb00 2024-05-27T12:33:43.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:43.286+0000 7f839f595640 1 -- 172.21.15.55:0/1380483749 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83980c96b0 con 0x7f839815eb00 2024-05-27T12:33:43.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:43.286+0000 7f838dffb640 1 -- 172.21.15.55:0/1380483749 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f839000aa90 con 0x7f839815eb00 2024-05-27T12:33:43.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:43.286+0000 7f839f595640 1 -- 172.21.15.55:0/1380483749 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83980c9c70 con 0x7f839815eb00 2024-05-27T12:33:43.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:43.287+0000 7f839f595640 1 -- 172.21.15.55:0/1380483749 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8398068a70 con 0x7f839815eb00 2024-05-27T12:33:43.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:43.288+0000 7f838dffb640 1 -- 172.21.15.55:0/1380483749 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f839000ac30 con 0x7f839815eb00 2024-05-27T12:33:43.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:43.288+0000 7f838dffb640 1 --2- 172.21.15.55:0/1380483749 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f837c06c8f0 0x7f837c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:43.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:43.288+0000 7f838dffb640 1 -- 172.21.15.55:0/1380483749 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5709+0+0 (secure 0 0 0) 0x7f839008b960 con 0x7f839815eb00 2024-05-27T12:33:43.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:43.289+0000 7f839d331640 1 --2- 172.21.15.55:0/1380483749 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f837c06c8f0 0x7f837c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:43.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:43.289+0000 7f839d331640 1 --2- 172.21.15.55:0/1380483749 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f837c06c8f0 0x7f837c06edb0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f8394034000 tx=0x7f839402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:43.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:43.293+0000 7f838dffb640 1 -- 172.21.15.55:0/1380483749 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f83980d2180 con 0x7f839815eb00 2024-05-27T12:33:43.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:43.526+0000 7f839f595640 1 -- 172.21.15.55:0/1380483749 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) -- 0x7f83980cfe60 con 0x7f839815eb00 2024-05-27T12:33:44.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.351+0000 7f838dffb640 1 -- 172.21.15.55:0/1380483749 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v15) ==== 136+0+0 (secure 0 0 0) 0x7f8390059740 con 0x7f839815eb00 2024-05-27T12:33:44.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.354+0000 7f839f595640 1 -- 172.21.15.55:0/1380483749 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f837c06c8f0 msgr2=0x7f837c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:44.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.354+0000 7f839f595640 1 --2- 172.21.15.55:0/1380483749 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f837c06c8f0 0x7f837c06edb0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f8394034000 tx=0x7f839402e000 comp rx=0 tx=0).stop 2024-05-27T12:33:44.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.354+0000 7f839f595640 1 -- 172.21.15.55:0/1380483749 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f839815eb00 msgr2=0x7f83980ca190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:44.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.354+0000 7f839f595640 1 --2- 172.21.15.55:0/1380483749 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f839815eb00 0x7f83980ca190 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f839000c7a0 tx=0x7f839000cc60 comp rx=0 tx=0).stop 2024-05-27T12:33:44.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.354+0000 7f839f595640 1 -- 172.21.15.55:0/1380483749 shutdown_connections 2024-05-27T12:33:44.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.354+0000 7f839f595640 1 --2- 172.21.15.55:0/1380483749 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f839815eb00 0x7f83980ca190 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:44.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.354+0000 7f839f595640 1 --2- 172.21.15.55:0/1380483749 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f83980d3e50 0x7f83980cc6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:44.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.354+0000 7f839f595640 1 --2- 172.21.15.55:0/1380483749 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f837c06c8f0 0x7f837c06edb0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:44.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.354+0000 7f839f595640 1 --2- 172.21.15.55:0/1380483749 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83980d1d70 0x7f839815f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:44.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.354+0000 7f839f595640 1 -- 172.21.15.55:0/1380483749 >> 172.21.15.55:0/1380483749 conn(0x7f8398067a50 msgr2=0x7f83980b5570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:44.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.354+0000 7f839f595640 1 -- 172.21.15.55:0/1380483749 shutdown_connections 2024-05-27T12:33:44.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.354+0000 7f839f595640 1 -- 172.21.15.55:0/1380483749 wait complete. 2024-05-27T12:33:44.367 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-05-27T12:33:44.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.480+0000 7f2e62a1e640 1 Processor -- start 2024-05-27T12:33:44.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.480+0000 7f2e62a1e640 1 -- start start 2024-05-27T12:33:44.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.480+0000 7f2e62a1e640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2e5c0b7bb0 0x7f2e5c0b6350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:44.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.480+0000 7f2e62a1e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2e5c0b6890 0x7f2e5c0d3790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:44.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.481+0000 7f2e62a1e640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e5c162f40 con 0x7f2e5c15e9a0 2024-05-27T12:33:44.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.481+0000 7f2e62a1e640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f2e5c163220 con 0x7f2e5c0b6890 2024-05-27T12:33:44.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.481+0000 7f2e62a1e640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f2e5c0d2f90 con 0x7f2e5c0b7bb0 2024-05-27T12:33:44.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.481+0000 7f2e60fbb640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2e5c0b6890 0x7f2e5c0d3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:44.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.481+0000 7f2e60fbb640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2e5c0b6890 0x7f2e5c0d3790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44204/0 (socket says 172.21.15.55:44204) 2024-05-27T12:33:44.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.481+0000 7f2e60fbb640 1 -- 172.21.15.55:0/4285320332 learned_addr learned my addr 172.21.15.55:0/4285320332 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:33:44.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.481+0000 7f2e5b7fe640 1 --2- 172.21.15.55:0/4285320332 >> v2:172.21.15.72:3300/0 conn(0x7f2e5c0b7bb0 0x7f2e5c0b6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:44.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.481+0000 7f2e60fbb640 1 -- 172.21.15.55:0/4285320332 >> v2:172.21.15.72:3300/0 conn(0x7f2e5c0b7bb0 msgr2=0x7f2e5c0b6350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:44.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.481+0000 7f2e60fbb640 1 --2- 172.21.15.55:0/4285320332 >> v2:172.21.15.72:3300/0 conn(0x7f2e5c0b7bb0 0x7f2e5c0b6350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:44.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.481+0000 7f2e60fbb640 1 -- 172.21.15.55:0/4285320332 >> v1:172.21.15.72:6789/0 conn(0x7f2e5c15e9a0 legacy=0x7f2e5c162510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:44.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.481+0000 7f2e60fbb640 1 -- 172.21.15.55:0/4285320332 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e5c0d3270 con 0x7f2e5c0b6890 2024-05-27T12:33:44.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.481+0000 7f2e5b7fe640 1 --2- 172.21.15.55:0/4285320332 >> v2:172.21.15.72:3300/0 conn(0x7f2e5c0b7bb0 0x7f2e5c0b6350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T12:33:44.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.482+0000 7f2e60fbb640 1 --2- 172.21.15.55:0/4285320332 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e5c0b6890 0x7f2e5c0d3790 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f2e5c0b7050 tx=0x7f2e5402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=800c07702b4ac543 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:44.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.482+0000 7f2e5affd640 1 -- 172.21.15.55:0/4285320332 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e54036070 con 0x7f2e5c0b6890 2024-05-27T12:33:44.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.482+0000 7f2e5affd640 1 -- 172.21.15.55:0/4285320332 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e54031600 con 0x7f2e5c0b6890 2024-05-27T12:33:44.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.482+0000 7f2e5affd640 1 -- 172.21.15.55:0/4285320332 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e540319d0 con 0x7f2e5c0b6890 2024-05-27T12:33:44.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.482+0000 7f2e62a1e640 1 -- 172.21.15.55:0/4285320332 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e5c0b6890 msgr2=0x7f2e5c0d3790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:44.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.482+0000 7f2e62a1e640 1 --2- 172.21.15.55:0/4285320332 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e5c0b6890 0x7f2e5c0d3790 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f2e5c0b7050 tx=0x7f2e5402a6a0 comp rx=0 tx=0).stop 2024-05-27T12:33:44.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.482+0000 7f2e62a1e640 1 -- 172.21.15.55:0/4285320332 shutdown_connections 2024-05-27T12:33:44.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.482+0000 7f2e62a1e640 1 --2- 172.21.15.55:0/4285320332 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e5c0b6890 0x7f2e5c0d3790 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:44.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.482+0000 7f2e62a1e640 1 --2- 172.21.15.55:0/4285320332 >> v2:172.21.15.72:3300/0 conn(0x7f2e5c0b7bb0 0x7f2e5c0b6350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:44.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.483+0000 7f2e62a1e640 1 -- 172.21.15.55:0/4285320332 >> 172.21.15.55:0/4285320332 conn(0x7f2e5c0d1350 msgr2=0x7f2e5c0d1760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:44.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.483+0000 7f2e62a1e640 1 -- 172.21.15.55:0/4285320332 shutdown_connections 2024-05-27T12:33:44.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.483+0000 7f2e62a1e640 1 -- 172.21.15.55:0/4285320332 wait complete. 2024-05-27T12:33:44.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.484+0000 7f2e62a1e640 1 Processor -- start 2024-05-27T12:33:44.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.484+0000 7f2e62a1e640 1 -- start start 2024-05-27T12:33:44.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.485+0000 7f2e62a1e640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2e5c0b6890 0x7f2e5c159270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:44.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.485+0000 7f2e62a1e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e5c0b7bb0 0x7f2e5c0b55d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:44.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.485+0000 7f2e62a1e640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e5c15e9a0 0x7f2e5c0b5b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:44.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.485+0000 7f2e62a1e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f2e5c0cf2c0 con 0x7f2e5c0b7bb0 2024-05-27T12:33:44.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.485+0000 7f2e62a1e640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f2e5c15ed80 con 0x7f2e5c15e9a0 2024-05-27T12:33:44.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.485+0000 7f2e62a1e640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f2e5c0cf440 con 0x7f2e5c0b6890 2024-05-27T12:33:44.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.485+0000 7f2e5b7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e5c0b7bb0 0x7f2e5c0b55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:44.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.485+0000 7f2e5b7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e5c0b7bb0 0x7f2e5c0b55d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44218/0 (socket says 172.21.15.55:44218) 2024-05-27T12:33:44.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.485+0000 7f2e5b7fe640 1 -- 172.21.15.55:0/172016885 learned_addr learned my addr 172.21.15.55:0/172016885 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:33:44.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.485+0000 7f2e60fbb640 1 --2- 172.21.15.55:0/172016885 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e5c15e9a0 0x7f2e5c0b5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:44.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.485+0000 7f2e5bfff640 1 --2- 172.21.15.55:0/172016885 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2e5c0b6890 0x7f2e5c159270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:44.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.485+0000 7f2e5b7fe640 1 -- 172.21.15.55:0/172016885 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2e5c0b6890 msgr2=0x7f2e5c159270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:44.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.485+0000 7f2e5b7fe640 1 --2- 172.21.15.55:0/172016885 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2e5c0b6890 0x7f2e5c159270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:44.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.485+0000 7f2e5b7fe640 1 -- 172.21.15.55:0/172016885 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e5c15e9a0 msgr2=0x7f2e5c0b5b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:44.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.485+0000 7f2e5b7fe640 1 --2- 172.21.15.55:0/172016885 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e5c15e9a0 0x7f2e5c0b5b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:44.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.485+0000 7f2e5b7fe640 1 -- 172.21.15.55:0/172016885 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e5c0acce0 con 0x7f2e5c0b7bb0 2024-05-27T12:33:44.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.485+0000 7f2e60fbb640 1 --2- 172.21.15.55:0/172016885 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e5c15e9a0 0x7f2e5c0b5b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T12:33:44.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.485+0000 7f2e5bfff640 1 --2- 172.21.15.55:0/172016885 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2e5c0b6890 0x7f2e5c159270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T12:33:44.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.485+0000 7f2e5b7fe640 1 --2- 172.21.15.55:0/172016885 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e5c0b7bb0 0x7f2e5c0b55d0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f2e5000e810 tx=0x7f2e5000ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:44.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.486+0000 7f2e58ff9640 1 -- 172.21.15.55:0/172016885 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e5000f040 con 0x7f2e5c0b7bb0 2024-05-27T12:33:44.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.486+0000 7f2e58ff9640 1 -- 172.21.15.55:0/172016885 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e50004030 con 0x7f2e5c0b7bb0 2024-05-27T12:33:44.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.486+0000 7f2e62a1e640 1 -- 172.21.15.55:0/172016885 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e5c0acf80 con 0x7f2e5c0b7bb0 2024-05-27T12:33:44.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.486+0000 7f2e58ff9640 1 -- 172.21.15.55:0/172016885 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e50004400 con 0x7f2e5c0b7bb0 2024-05-27T12:33:44.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.486+0000 7f2e62a1e640 1 -- 172.21.15.55:0/172016885 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e5c0ad540 con 0x7f2e5c0b7bb0 2024-05-27T12:33:44.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.487+0000 7f2e62a1e640 1 -- 172.21.15.55:0/172016885 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e5c075460 con 0x7f2e5c0b7bb0 2024-05-27T12:33:44.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.487+0000 7f2e58ff9640 1 -- 172.21.15.55:0/172016885 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2e5000c6d0 con 0x7f2e5c0b7bb0 2024-05-27T12:33:44.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.488+0000 7f2e58ff9640 1 --2- 172.21.15.55:0/172016885 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f2e4806c8f0 0x7f2e4806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:44.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.488+0000 7f2e58ff9640 1 -- 172.21.15.55:0/172016885 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5709+0+0 (secure 0 0 0) 0x7f2e5008b9a0 con 0x7f2e5c0b7bb0 2024-05-27T12:33:44.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.488+0000 7f2e5bfff640 1 --2- 172.21.15.55:0/172016885 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f2e4806c8f0 0x7f2e4806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:44.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.489+0000 7f2e5bfff640 1 --2- 172.21.15.55:0/172016885 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f2e4806c8f0 0x7f2e4806edb0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f2e4c0015e0 tx=0x7f2e4c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:44.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.492+0000 7f2e58ff9640 1 -- 172.21.15.55:0/172016885 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2e50017020 con 0x7f2e5c0b7bb0 2024-05-27T12:33:44.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.701+0000 7f2e62a1e640 1 -- 172.21.15.55:0/172016885 --> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7f2e5c1597b0 con 0x7f2e4806c8f0 2024-05-27T12:33:44.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.703+0000 7f2e58ff9640 1 -- 172.21.15.55:0/172016885 <== mgr.4105 v2:172.21.15.72:6832/3152720583 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7f2e4c0067d0 con 0x7f2e4806c8f0 2024-05-27T12:33:44.702 INFO:teuthology.orchestra.run.smithi055.stdout:[ 2024-05-27T12:33:44.702 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-05-27T12:33:44.702 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "cephfs" 2024-05-27T12:33:44.702 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-05-27T12:33:44.702 INFO:teuthology.orchestra.run.smithi055.stdout:] 2024-05-27T12:33:44.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.705+0000 7f2e62a1e640 1 -- 172.21.15.55:0/172016885 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f2e4806c8f0 msgr2=0x7f2e4806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:44.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.705+0000 7f2e62a1e640 1 --2- 172.21.15.55:0/172016885 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f2e4806c8f0 0x7f2e4806edb0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f2e4c0015e0 tx=0x7f2e4c009040 comp rx=0 tx=0).stop 2024-05-27T12:33:44.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.705+0000 7f2e62a1e640 1 -- 172.21.15.55:0/172016885 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e5c0b7bb0 msgr2=0x7f2e5c0b55d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:44.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.705+0000 7f2e62a1e640 1 --2- 172.21.15.55:0/172016885 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e5c0b7bb0 0x7f2e5c0b55d0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f2e5000e810 tx=0x7f2e5000ecd0 comp rx=0 tx=0).stop 2024-05-27T12:33:44.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.705+0000 7f2e62a1e640 1 -- 172.21.15.55:0/172016885 shutdown_connections 2024-05-27T12:33:44.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.705+0000 7f2e62a1e640 1 --2- 172.21.15.55:0/172016885 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f2e4806c8f0 0x7f2e4806edb0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:44.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.705+0000 7f2e62a1e640 1 --2- 172.21.15.55:0/172016885 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e5c15e9a0 0x7f2e5c0b5b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:44.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.705+0000 7f2e62a1e640 1 --2- 172.21.15.55:0/172016885 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e5c0b7bb0 0x7f2e5c0b55d0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:44.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.705+0000 7f2e62a1e640 1 --2- 172.21.15.55:0/172016885 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2e5c0b6890 0x7f2e5c159270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:44.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.705+0000 7f2e62a1e640 1 -- 172.21.15.55:0/172016885 >> 172.21.15.55:0/172016885 conn(0x7f2e5c0d1350 msgr2=0x7f2e5c0b9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:44.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.705+0000 7f2e62a1e640 1 -- 172.21.15.55:0/172016885 shutdown_connections 2024-05-27T12:33:44.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.705+0000 7f2e62a1e640 1 -- 172.21.15.55:0/172016885 wait complete. 2024-05-27T12:33:44.715 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-05-27T12:33:44.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.823+0000 7fb22e872640 1 Processor -- start 2024-05-27T12:33:44.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.823+0000 7fb22e872640 1 -- start start 2024-05-27T12:33:44.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.823+0000 7fb22e872640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb2280b8900 0x7fb228169610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:44.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.824+0000 7fb22e872640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb22815eee0 con 0x7fb2280cfb40 2024-05-27T12:33:44.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.824+0000 7fb22e872640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2280d4660 con 0x7fb22815eb00 2024-05-27T12:33:44.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.824+0000 7fb22e872640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7fb2280d5700 con 0x7fb2280b8900 2024-05-27T12:33:44.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.824+0000 7fb21ffff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fb2280cfb40 0x7fb2280d1830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:54008/0 (socket says 172.21.15.55:54008) 2024-05-27T12:33:44.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.824+0000 7fb21ffff640 1 -- 172.21.15.55:0/1224362581 learned_addr learned my addr 172.21.15.55:0/1224362581 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-27T12:33:44.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.824+0000 7fb22ce0f640 1 --2- 172.21.15.55:0/1224362581 >> v2:172.21.15.55:3300/0 conn(0x7fb2280b8900 0x7fb228169610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:44.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.824+0000 7fb22ce0f640 1 -- 172.21.15.55:0/1224362581 >> v1:172.21.15.72:6789/0 conn(0x7fb22815eb00 legacy=0x7fb2280d3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:44.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.824+0000 7fb22ce0f640 1 -- 172.21.15.55:0/1224362581 >> v1:172.21.15.55:6789/0 conn(0x7fb2280cfb40 legacy=0x7fb2280d1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:44.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.824+0000 7fb22ce0f640 1 -- 172.21.15.55:0/1224362581 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2280d4940 con 0x7fb2280b8900 2024-05-27T12:33:44.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.824+0000 7fb2277fe640 1 -- 172.21.15.55:0/1224362581 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3154580777 0 0) 0x7fb22815eee0 con 0x7fb2280cfb40 2024-05-27T12:33:44.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.825+0000 7fb22ce0f640 1 --2- 172.21.15.55:0/1224362581 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2280b8900 0x7fb228169610 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fb220009d90 tx=0x7fb22002a780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b2d1b35aff73f9c server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:44.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.825+0000 7fb2277fe640 1 -- 172.21.15.55:0/1224362581 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb220037070 con 0x7fb2280b8900 2024-05-27T12:33:44.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.825+0000 7fb2277fe640 1 -- 172.21.15.55:0/1224362581 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb220007740 con 0x7fb2280b8900 2024-05-27T12:33:44.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.825+0000 7fb2277fe640 1 -- 172.21.15.55:0/1224362581 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb220007b10 con 0x7fb2280b8900 2024-05-27T12:33:44.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.825+0000 7fb22e872640 1 -- 172.21.15.55:0/1224362581 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2280b8900 msgr2=0x7fb228169610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:44.826 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.825+0000 7fb22e872640 1 --2- 172.21.15.55:0/1224362581 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2280b8900 0x7fb228169610 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fb220009d90 tx=0x7fb22002a780 comp rx=0 tx=0).stop 2024-05-27T12:33:44.826 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.825+0000 7fb22e872640 1 -- 172.21.15.55:0/1224362581 shutdown_connections 2024-05-27T12:33:44.826 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.826+0000 7fb22e872640 1 --2- 172.21.15.55:0/1224362581 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2280b8900 0x7fb228169610 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:44.826 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.826+0000 7fb22e872640 1 -- 172.21.15.55:0/1224362581 >> 172.21.15.55:0/1224362581 conn(0x7fb228067a50 msgr2=0x7fb228067e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:44.826 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.826+0000 7fb22e872640 1 -- 172.21.15.55:0/1224362581 shutdown_connections 2024-05-27T12:33:44.826 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.826+0000 7fb22e872640 1 -- 172.21.15.55:0/1224362581 wait complete. 2024-05-27T12:33:44.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.827+0000 7fb22e872640 1 Processor -- start 2024-05-27T12:33:44.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.827+0000 7fb22e872640 1 -- start start 2024-05-27T12:33:44.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.827+0000 7fb22e872640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb2280b8900 0x7fb228153670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:44.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.827+0000 7fb22e872640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb2280cfb40 0x7fb2280cc980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:44.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.827+0000 7fb22e872640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb22815eb00 0x7fb2280ccec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:44.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.827+0000 7fb22e872640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7fb2280d51e0 con 0x7fb22815eb00 2024-05-27T12:33:44.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.827+0000 7fb22e872640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fb2280d4f00 con 0x7fb2280cfb40 2024-05-27T12:33:44.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.827+0000 7fb22e872640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fb2280d1f40 con 0x7fb2280b8900 2024-05-27T12:33:44.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.828+0000 7fb22ce0f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb22815eb00 0x7fb2280ccec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:44.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.828+0000 7fb22ce0f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb22815eb00 0x7fb2280ccec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44242/0 (socket says 172.21.15.55:44242) 2024-05-27T12:33:44.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.828+0000 7fb22ce0f640 1 -- 172.21.15.55:0/2648344491 learned_addr learned my addr 172.21.15.55:0/2648344491 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:33:44.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.828+0000 7fb21ffff640 1 --2- 172.21.15.55:0/2648344491 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb2280cfb40 0x7fb2280cc980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:44.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.828+0000 7fb227fff640 1 --2- 172.21.15.55:0/2648344491 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb2280b8900 0x7fb228153670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:44.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.828+0000 7fb22ce0f640 1 -- 172.21.15.55:0/2648344491 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb2280b8900 msgr2=0x7fb228153670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:44.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.828+0000 7fb22ce0f640 1 --2- 172.21.15.55:0/2648344491 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb2280b8900 0x7fb228153670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:44.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.828+0000 7fb22ce0f640 1 -- 172.21.15.55:0/2648344491 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb2280cfb40 msgr2=0x7fb2280cc980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:44.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.828+0000 7fb22ce0f640 1 --2- 172.21.15.55:0/2648344491 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb2280cfb40 0x7fb2280cc980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:44.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.828+0000 7fb22ce0f640 1 -- 172.21.15.55:0/2648344491 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2280cb190 con 0x7fb22815eb00 2024-05-27T12:33:44.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.828+0000 7fb227fff640 1 --2- 172.21.15.55:0/2648344491 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb2280b8900 0x7fb228153670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T12:33:44.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.828+0000 7fb22ce0f640 1 --2- 172.21.15.55:0/2648344491 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb22815eb00 0x7fb2280ccec0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fb220035040 tx=0x7fb220004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:44.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.828+0000 7fb2257fa640 1 -- 172.21.15.55:0/2648344491 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb220042020 con 0x7fb22815eb00 2024-05-27T12:33:44.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.828+0000 7fb2257fa640 1 -- 172.21.15.55:0/2648344491 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb220032990 con 0x7fb22815eb00 2024-05-27T12:33:44.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.828+0000 7fb2257fa640 1 -- 172.21.15.55:0/2648344491 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb220037040 con 0x7fb22815eb00 2024-05-27T12:33:44.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.828+0000 7fb22e872640 1 -- 172.21.15.55:0/2648344491 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2280cabd0 con 0x7fb22815eb00 2024-05-27T12:33:44.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.828+0000 7fb22e872640 1 -- 172.21.15.55:0/2648344491 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb22815fd90 con 0x7fb22815eb00 2024-05-27T12:33:44.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.829+0000 7fb22e872640 1 -- 172.21.15.55:0/2648344491 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb228068a70 con 0x7fb22815eb00 2024-05-27T12:33:44.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.830+0000 7fb2257fa640 1 -- 172.21.15.55:0/2648344491 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb220045020 con 0x7fb22815eb00 2024-05-27T12:33:44.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.830+0000 7fb2257fa640 1 --2- 172.21.15.55:0/2648344491 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fb20806c920 0x7fb20806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:44.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.831+0000 7fb2257fa640 1 -- 172.21.15.55:0/2648344491 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5709+0+0 (secure 0 0 0) 0x7fb2200ac9f0 con 0x7fb22815eb00 2024-05-27T12:33:44.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.831+0000 7fb227fff640 1 --2- 172.21.15.55:0/2648344491 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fb20806c920 0x7fb20806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:44.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.831+0000 7fb227fff640 1 --2- 172.21.15.55:0/2648344491 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fb20806c920 0x7fb20806ede0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fb218000f60 tx=0x7fb218009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:44.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:44.835+0000 7fb2257fa640 1 -- 172.21.15.55:0/2648344491 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb22004c070 con 0x7fb22815eb00 2024-05-27T12:33:45.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.020+0000 7fb22e872640 1 -- 172.21.15.55:0/2648344491 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fb22815ff60 con 0x7fb22815eb00 2024-05-27T12:33:45.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.021+0000 7fb2257fa640 1 -- 172.21.15.55:0/2648344491 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7fb220030e20 con 0x7fb22815eb00 2024-05-27T12:33:45.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.023+0000 7fb22e872640 1 -- 172.21.15.55:0/2648344491 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fb20806c920 msgr2=0x7fb20806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:45.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.023+0000 7fb22e872640 1 --2- 172.21.15.55:0/2648344491 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fb20806c920 0x7fb20806ede0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fb218000f60 tx=0x7fb218009040 comp rx=0 tx=0).stop 2024-05-27T12:33:45.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.023+0000 7fb22e872640 1 -- 172.21.15.55:0/2648344491 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb22815eb00 msgr2=0x7fb2280ccec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:45.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.023+0000 7fb22e872640 1 --2- 172.21.15.55:0/2648344491 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb22815eb00 0x7fb2280ccec0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fb220035040 tx=0x7fb220004a40 comp rx=0 tx=0).stop 2024-05-27T12:33:45.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.023+0000 7fb22e872640 1 -- 172.21.15.55:0/2648344491 shutdown_connections 2024-05-27T12:33:45.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.023+0000 7fb22e872640 1 --2- 172.21.15.55:0/2648344491 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb22815eb00 0x7fb2280ccec0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:45.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.023+0000 7fb22e872640 1 --2- 172.21.15.55:0/2648344491 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fb20806c920 0x7fb20806ede0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:45.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.023+0000 7fb22e872640 1 --2- 172.21.15.55:0/2648344491 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb2280cfb40 0x7fb2280cc980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:45.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.023+0000 7fb22e872640 1 --2- 172.21.15.55:0/2648344491 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb2280b8900 0x7fb228153670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:45.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.023+0000 7fb22e872640 1 -- 172.21.15.55:0/2648344491 >> 172.21.15.55:0/2648344491 conn(0x7fb228067a50 msgr2=0x7fb2280d3220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:45.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.023+0000 7fb22e872640 1 -- 172.21.15.55:0/2648344491 shutdown_connections 2024-05-27T12:33:45.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.023+0000 7fb22e872640 1 -- 172.21.15.55:0/2648344491 wait complete. 2024-05-27T12:33:45.034 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv1 --mode=777 2024-05-27T12:33:45.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.143+0000 7f99ecccb640 1 Processor -- start 2024-05-27T12:33:45.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.143+0000 7f99ecccb640 1 -- start start 2024-05-27T12:33:45.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.144+0000 7f99ecccb640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f99e809b980 0x7f99e80d1390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:45.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.144+0000 7f99ecccb640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99e806cb70 con 0x7f99e809aa30 2024-05-27T12:33:45.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.144+0000 7f99ecccb640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99e806ce50 con 0x7f99e815eb60 2024-05-27T12:33:45.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.144+0000 7f99ecccb640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f99e80d1cc0 con 0x7f99e809b980 2024-05-27T12:33:45.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.144+0000 7f99e5d9b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f99e809b980 0x7f99e80d1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:45.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.144+0000 7f99e5d9b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f99e809b980 0x7f99e80d1390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44248/0 (socket says 172.21.15.55:44248) 2024-05-27T12:33:45.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.144+0000 7f99e6d9d640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f99e809aa30 0x7f99e80cccc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:54020/0 (socket says 172.21.15.55:54020) 2024-05-27T12:33:45.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.144+0000 7f99e5d9b640 1 -- 172.21.15.55:0/716475976 learned_addr learned my addr 172.21.15.55:0/716475976 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:33:45.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.144+0000 7f99e5d9b640 1 -- 172.21.15.55:0/716475976 >> v1:172.21.15.72:6789/0 conn(0x7f99e815eb60 legacy=0x7f99e806d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:45.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.144+0000 7f99e5d9b640 1 -- 172.21.15.55:0/716475976 >> v1:172.21.15.55:6789/0 conn(0x7f99e809aa30 legacy=0x7f99e80cccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:45.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.144+0000 7f99e5d9b640 1 -- 172.21.15.55:0/716475976 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99e806d130 con 0x7f99e809b980 2024-05-27T12:33:45.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.144+0000 7f99e559a640 1 -- 172.21.15.55:0/716475976 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 704943427 0 0) 0x7f99e806cb70 con 0x7f99e809aa30 2024-05-27T12:33:45.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.145+0000 7f99e5d9b640 1 --2- 172.21.15.55:0/716475976 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99e809b980 0x7f99e80d1390 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f99d0009870 tx=0x7f99d002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33f79aef39dc1056 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:45.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.145+0000 7f99e559a640 1 -- 172.21.15.55:0/716475976 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99d0037070 con 0x7f99e809b980 2024-05-27T12:33:45.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.145+0000 7f99e559a640 1 -- 172.21.15.55:0/716475976 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99d0032440 con 0x7f99e809b980 2024-05-27T12:33:45.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.145+0000 7f99e559a640 1 -- 172.21.15.55:0/716475976 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99d0032810 con 0x7f99e809b980 2024-05-27T12:33:45.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.145+0000 7f99ecccb640 1 -- 172.21.15.55:0/716475976 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99e809b980 msgr2=0x7f99e80d1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:45.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.145+0000 7f99ecccb640 1 --2- 172.21.15.55:0/716475976 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99e809b980 0x7f99e80d1390 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f99d0009870 tx=0x7f99d002a1e0 comp rx=0 tx=0).stop 2024-05-27T12:33:45.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.146+0000 7f99ecccb640 1 -- 172.21.15.55:0/716475976 shutdown_connections 2024-05-27T12:33:45.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.146+0000 7f99ecccb640 1 --2- 172.21.15.55:0/716475976 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99e809b980 0x7f99e80d1390 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:45.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.146+0000 7f99ecccb640 1 -- 172.21.15.55:0/716475976 >> 172.21.15.55:0/716475976 conn(0x7f99e80b4160 msgr2=0x7f99e80b4570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:45.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.146+0000 7f99ecccb640 1 -- 172.21.15.55:0/716475976 shutdown_connections 2024-05-27T12:33:45.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.146+0000 7f99ecccb640 1 -- 172.21.15.55:0/716475976 wait complete. 2024-05-27T12:33:45.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.147+0000 7f99ecccb640 1 Processor -- start 2024-05-27T12:33:45.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.147+0000 7f99ecccb640 1 -- start start 2024-05-27T12:33:45.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.148+0000 7f99ecccb640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99e809aa30 0x7f99e809c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:45.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.148+0000 7f99ecccb640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f99e809b980 0x7f99e80cc1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:45.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.148+0000 7f99ecccb640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f99e815eb60 0x7f99e81f7b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:45.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.148+0000 7f99ecccb640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f99e80d1a50 con 0x7f99e809aa30 2024-05-27T12:33:45.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.148+0000 7f99ecccb640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f99e80d18d0 con 0x7f99e815eb60 2024-05-27T12:33:45.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.148+0000 7f99ecccb640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f99e80cd3d0 con 0x7f99e809b980 2024-05-27T12:33:45.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.148+0000 7f99e659c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99e809aa30 0x7f99e809c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:45.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.148+0000 7f99e659c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99e809aa30 0x7f99e809c410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44252/0 (socket says 172.21.15.55:44252) 2024-05-27T12:33:45.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.148+0000 7f99e659c640 1 -- 172.21.15.55:0/4181078365 learned_addr learned my addr 172.21.15.55:0/4181078365 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:33:45.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.148+0000 7f99e5d9b640 1 --2- 172.21.15.55:0/4181078365 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f99e809b980 0x7f99e80cc1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:45.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.148+0000 7f99e6d9d640 1 --2- 172.21.15.55:0/4181078365 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f99e815eb60 0x7f99e81f7b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:45.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.148+0000 7f99e659c640 1 -- 172.21.15.55:0/4181078365 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f99e809b980 msgr2=0x7f99e80cc1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:45.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.148+0000 7f99e659c640 1 --2- 172.21.15.55:0/4181078365 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f99e809b980 0x7f99e80cc1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:45.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.148+0000 7f99e659c640 1 -- 172.21.15.55:0/4181078365 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f99e815eb60 msgr2=0x7f99e81f7b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:45.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.148+0000 7f99e659c640 1 --2- 172.21.15.55:0/4181078365 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f99e815eb60 0x7f99e81f7b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:45.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.148+0000 7f99e659c640 1 -- 172.21.15.55:0/4181078365 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99e809fd90 con 0x7f99e809aa30 2024-05-27T12:33:45.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.148+0000 7f99e6d9d640 1 --2- 172.21.15.55:0/4181078365 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f99e815eb60 0x7f99e81f7b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T12:33:45.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.149+0000 7f99e659c640 1 --2- 172.21.15.55:0/4181078365 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99e809aa30 0x7f99e809c410 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f99d800c430 tx=0x7f99d800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:45.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.149+0000 7f99deffd640 1 -- 172.21.15.55:0/4181078365 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99d8017070 con 0x7f99e809aa30 2024-05-27T12:33:45.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.149+0000 7f99deffd640 1 -- 172.21.15.55:0/4181078365 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99d80052d0 con 0x7f99e809aa30 2024-05-27T12:33:45.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.149+0000 7f99deffd640 1 -- 172.21.15.55:0/4181078365 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99d8003830 con 0x7f99e809aa30 2024-05-27T12:33:45.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.149+0000 7f99ecccb640 1 -- 172.21.15.55:0/4181078365 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99e80a0070 con 0x7f99e809aa30 2024-05-27T12:33:45.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.149+0000 7f99ecccb640 1 -- 172.21.15.55:0/4181078365 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99e809d280 con 0x7f99e809aa30 2024-05-27T12:33:45.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.150+0000 7f99ecccb640 1 -- 172.21.15.55:0/4181078365 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99e8068a70 con 0x7f99e809aa30 2024-05-27T12:33:45.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.150+0000 7f99deffd640 1 -- 172.21.15.55:0/4181078365 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f99d801a070 con 0x7f99e809aa30 2024-05-27T12:33:45.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.151+0000 7f99deffd640 1 --2- 172.21.15.55:0/4181078365 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f99c806c8f0 0x7f99c806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:45.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.151+0000 7f99deffd640 1 -- 172.21.15.55:0/4181078365 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5709+0+0 (secure 0 0 0) 0x7f99d808ad50 con 0x7f99e809aa30 2024-05-27T12:33:45.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.151+0000 7f99e5d9b640 1 --2- 172.21.15.55:0/4181078365 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f99c806c8f0 0x7f99c806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:45.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.152+0000 7f99e5d9b640 1 --2- 172.21.15.55:0/4181078365 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f99c806c8f0 0x7f99c806edb0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f99d0034000 tx=0x7f99d002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:45.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.155+0000 7f99deffd640 1 -- 172.21.15.55:0/4181078365 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f99d808e030 con 0x7f99e809aa30 2024-05-27T12:33:45.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.367+0000 7f99ecccb640 1 -- 172.21.15.55:0/4181078365 --> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv1", "mode": "777", "target": ["mon-mgr", ""]}) -- 0x7f99e80a0240 con 0x7f99c806c8f0 2024-05-27T12:33:45.372 INFO:tasks.ceph.mgr.x.smithi072.stderr:2024-05-27T12:33:45.372+0000 7f91e8238640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-27T12:33:45.372 INFO:tasks.ceph.mgr.x.smithi072.stderr:2024-05-27T12:33:45.372+0000 7f91e8238640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-27T12:33:45.372 INFO:tasks.ceph.mgr.x.smithi072.stderr:2024-05-27T12:33:45.372+0000 7f91e8238640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-27T12:33:45.372 INFO:tasks.ceph.mgr.x.smithi072.stderr:2024-05-27T12:33:45.372+0000 7f91e8238640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-27T12:33:45.372 INFO:tasks.ceph.mgr.x.smithi072.stderr:2024-05-27T12:33:45.372+0000 7f91e8238640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-27T12:33:45.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.403+0000 7f99deffd640 1 -- 172.21.15.55:0/4181078365 <== mgr.4105 v2:172.21.15.72:6832/3152720583 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f99e80a0240 con 0x7f99c806c8f0 2024-05-27T12:33:45.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.405+0000 7f99ecccb640 1 -- 172.21.15.55:0/4181078365 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f99c806c8f0 msgr2=0x7f99c806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:45.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.405+0000 7f99ecccb640 1 --2- 172.21.15.55:0/4181078365 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f99c806c8f0 0x7f99c806edb0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f99d0034000 tx=0x7f99d002e000 comp rx=0 tx=0).stop 2024-05-27T12:33:45.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.405+0000 7f99ecccb640 1 -- 172.21.15.55:0/4181078365 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99e809aa30 msgr2=0x7f99e809c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:45.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.405+0000 7f99ecccb640 1 --2- 172.21.15.55:0/4181078365 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99e809aa30 0x7f99e809c410 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f99d800c430 tx=0x7f99d800c8f0 comp rx=0 tx=0).stop 2024-05-27T12:33:45.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.405+0000 7f99ecccb640 1 -- 172.21.15.55:0/4181078365 shutdown_connections 2024-05-27T12:33:45.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.405+0000 7f99ecccb640 1 --2- 172.21.15.55:0/4181078365 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f99c806c8f0 0x7f99c806edb0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:45.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.405+0000 7f99ecccb640 1 --2- 172.21.15.55:0/4181078365 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f99e815eb60 0x7f99e81f7b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:45.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.405+0000 7f99ecccb640 1 --2- 172.21.15.55:0/4181078365 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f99e809b980 0x7f99e80cc1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:45.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.405+0000 7f99ecccb640 1 --2- 172.21.15.55:0/4181078365 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99e809aa30 0x7f99e809c410 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:45.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.405+0000 7f99ecccb640 1 -- 172.21.15.55:0/4181078365 >> 172.21.15.55:0/4181078365 conn(0x7f99e80b4160 msgr2=0x7f99e8074bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:45.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.405+0000 7f99ecccb640 1 -- 172.21.15.55:0/4181078365 shutdown_connections 2024-05-27T12:33:45.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.406+0000 7f99ecccb640 1 -- 172.21.15.55:0/4181078365 wait complete. 2024-05-27T12:33:45.416 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv1 2024-05-27T12:33:45.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.524+0000 7f5993320640 1 Processor -- start 2024-05-27T12:33:45.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.524+0000 7f5993320640 1 -- start start 2024-05-27T12:33:45.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.525+0000 7f5993320640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f598c09b980 0x7f598c0d1390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:45.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.525+0000 7f5993320640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f598c06cb70 con 0x7f598c09aa30 2024-05-27T12:33:45.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.525+0000 7f5993320640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f598c06ce50 con 0x7f598c15eb60 2024-05-27T12:33:45.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.525+0000 7f5993320640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f598c0d1cc0 con 0x7f598c09b980 2024-05-27T12:33:45.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.525+0000 7f59918bd640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f598c09aa30 0x7f598c0cccc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:54030/0 (socket says 172.21.15.55:54030) 2024-05-27T12:33:45.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.525+0000 7f59918bd640 1 -- 172.21.15.55:0/3665168503 learned_addr learned my addr 172.21.15.55:0/3665168503 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-27T12:33:45.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.525+0000 7f59908bb640 1 --2- 172.21.15.55:0/3665168503 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f598c09b980 0x7f598c0d1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:45.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.525+0000 7f5983fff640 1 -- 172.21.15.55:0/3665168503 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3293394701 0 0) 0x7f598c06cb70 con 0x7f598c09aa30 2024-05-27T12:33:45.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.525+0000 7f5983fff640 1 -- 172.21.15.55:0/3665168503 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5978003520 con 0x7f598c09aa30 2024-05-27T12:33:45.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.526+0000 7f5983fff640 1 -- 172.21.15.55:0/3665168503 <== mon.1 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1266080501 0 0) 0x7f598c06ce50 con 0x7f598c15eb60 2024-05-27T12:33:45.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.526+0000 7f5983fff640 1 -- 172.21.15.55:0/3665168503 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f598c06cb70 con 0x7f598c15eb60 2024-05-27T12:33:45.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.526+0000 7f5983fff640 1 -- 172.21.15.55:0/3665168503 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2132824776 0 0) 0x7f5978003520 con 0x7f598c09aa30 2024-05-27T12:33:45.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.526+0000 7f5983fff640 1 -- 172.21.15.55:0/3665168503 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f598c09b980 msgr2=0x7f598c0d1390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:45.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.526+0000 7f5983fff640 1 --2- 172.21.15.55:0/3665168503 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f598c09b980 0x7f598c0d1390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:45.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.526+0000 7f5983fff640 1 -- 172.21.15.55:0/3665168503 >> v1:172.21.15.72:6789/0 conn(0x7f598c15eb60 legacy=0x7f598c06d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:45.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.526+0000 7f5983fff640 1 -- 172.21.15.55:0/3665168503 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f598c06d130 con 0x7f598c09aa30 2024-05-27T12:33:45.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.526+0000 7f5983fff640 1 -- 172.21.15.55:0/3665168503 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 793017739 0 0) 0x7f59840019f0 con 0x7f598c09aa30 2024-05-27T12:33:45.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.526+0000 7f59908bb640 1 --2- 172.21.15.55:0/3665168503 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f598c09b980 0x7f598c0d1390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T12:33:45.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.526+0000 7f5983fff640 1 -- 172.21.15.55:0/3665168503 >> v1:172.21.15.55:6789/0 conn(0x7f598c09aa30 legacy=0x7f598c0cccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:45.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.526+0000 7f5983fff640 1 --2- 172.21.15.55:0/3665168503 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f598c09b980 0x7f5978003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:45.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.526+0000 7f5983fff640 1 --2- 172.21.15.55:0/3665168503 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5978004100 0x7f5978004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:45.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.526+0000 7f5983fff640 1 --2- 172.21.15.55:0/3665168503 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5978004d40 0x7f59780051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:45.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.526+0000 7f5983fff640 1 -- 172.21.15.55:0/3665168503 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f598c0d1cc0 con 0x7f5978004100 2024-05-27T12:33:45.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.526+0000 7f5983fff640 1 -- 172.21.15.55:0/3665168503 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f597800bc00 con 0x7f5978004d40 2024-05-27T12:33:45.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.526+0000 7f5983fff640 1 -- 172.21.15.55:0/3665168503 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f597800be00 con 0x7f598c09b980 2024-05-27T12:33:45.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.526+0000 7f59908bb640 1 --2- 172.21.15.55:0/3665168503 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5978004100 0x7f5978004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:45.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.526+0000 7f59918bd640 1 --2- 172.21.15.55:0/3665168503 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5978004d40 0x7f59780051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:45.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.526+0000 7f59910bc640 1 --2- 172.21.15.55:0/3665168503 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f598c09b980 0x7f5978003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:45.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.526+0000 7f59908bb640 1 -- 172.21.15.55:0/3665168503 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f598c09b980 msgr2=0x7f5978003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:45.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.526+0000 7f59908bb640 1 --2- 172.21.15.55:0/3665168503 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f598c09b980 0x7f5978003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:45.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.526+0000 7f59908bb640 1 -- 172.21.15.55:0/3665168503 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5978004d40 msgr2=0x7f59780051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:33:45.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.526+0000 7f59908bb640 1 --2- 172.21.15.55:0/3665168503 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5978004d40 0x7f59780051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:45.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.526+0000 7f59908bb640 1 -- 172.21.15.55:0/3665168503 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5978003520 con 0x7f5978004100 2024-05-27T12:33:45.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.527+0000 7f59908bb640 1 --2- 172.21.15.55:0/3665168503 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5978004100 0x7f5978004800 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f597c009c40 tx=0x7f5978005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=700cb42663dd81cf server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:45.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.527+0000 7f5983fff640 1 -- 172.21.15.55:0/3665168503 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f597c036070 con 0x7f5978004100 2024-05-27T12:33:45.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.527+0000 7f5983fff640 1 -- 172.21.15.55:0/3665168503 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f597c031400 con 0x7f5978004100 2024-05-27T12:33:45.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.527+0000 7f5983fff640 1 -- 172.21.15.55:0/3665168503 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f597c009840 con 0x7f5978004100 2024-05-27T12:33:45.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.528+0000 7f5993320640 1 -- 172.21.15.55:0/3665168503 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5978004100 msgr2=0x7f5978004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:45.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.528+0000 7f5993320640 1 --2- 172.21.15.55:0/3665168503 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5978004100 0x7f5978004800 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f597c009c40 tx=0x7f5978005830 comp rx=0 tx=0).stop 2024-05-27T12:33:45.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.528+0000 7f59918bd640 1 -- 172.21.15.55:0/3665168503 reap_dead start 2024-05-27T12:33:45.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.528+0000 7f5993320640 1 -- 172.21.15.55:0/3665168503 shutdown_connections 2024-05-27T12:33:45.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.528+0000 7f5993320640 1 -- 172.21.15.55:0/3665168503 >> 172.21.15.55:0/3665168503 conn(0x7f598c0b4160 msgr2=0x7f598c0b4570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:45.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.528+0000 7f5993320640 1 -- 172.21.15.55:0/3665168503 shutdown_connections 2024-05-27T12:33:45.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.528+0000 7f5993320640 1 -- 172.21.15.55:0/3665168503 wait complete. 2024-05-27T12:33:45.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.529+0000 7f5993320640 1 Processor -- start 2024-05-27T12:33:45.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.529+0000 7f5993320640 1 -- start start 2024-05-27T12:33:45.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.530+0000 7f5993320640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5978004100 0x7f598c15c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:45.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.530+0000 7f5993320640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f598c15ca30 0x7f598c0cca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:45.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.530+0000 7f5993320640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f598c0ca0e0 0x7f598c0ca560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:45.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.530+0000 7f5993320640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f598c0cd550 con 0x7f5978004100 2024-05-27T12:33:45.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.530+0000 7f5993320640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f598c0cd3d0 con 0x7f598c15ca30 2024-05-27T12:33:45.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.530+0000 7f5993320640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f598c0cd6d0 con 0x7f598c0ca0e0 2024-05-27T12:33:45.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.530+0000 7f59910bc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5978004100 0x7f598c15c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:45.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.530+0000 7f59910bc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5978004100 0x7f598c15c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44260/0 (socket says 172.21.15.55:44260) 2024-05-27T12:33:45.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.530+0000 7f59910bc640 1 -- 172.21.15.55:0/3577135420 learned_addr learned my addr 172.21.15.55:0/3577135420 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:33:45.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.530+0000 7f59918bd640 1 --2- 172.21.15.55:0/3577135420 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f598c0ca0e0 0x7f598c0ca560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:45.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.530+0000 7f59908bb640 1 --2- 172.21.15.55:0/3577135420 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f598c15ca30 0x7f598c0cca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:45.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.530+0000 7f59910bc640 1 -- 172.21.15.55:0/3577135420 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f598c0ca0e0 msgr2=0x7f598c0ca560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:45.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.530+0000 7f59910bc640 1 --2- 172.21.15.55:0/3577135420 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f598c0ca0e0 0x7f598c0ca560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:45.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.530+0000 7f59910bc640 1 -- 172.21.15.55:0/3577135420 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f598c15ca30 msgr2=0x7f598c0cca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:45.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.530+0000 7f59910bc640 1 --2- 172.21.15.55:0/3577135420 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f598c15ca30 0x7f598c0cca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:45.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.530+0000 7f59910bc640 1 -- 172.21.15.55:0/3577135420 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f598c0c9ea0 con 0x7f5978004100 2024-05-27T12:33:45.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.530+0000 7f59908bb640 1 --2- 172.21.15.55:0/3577135420 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f598c15ca30 0x7f598c0cca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T12:33:45.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.530+0000 7f59918bd640 1 --2- 172.21.15.55:0/3577135420 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f598c0ca0e0 0x7f598c0ca560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T12:33:45.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.530+0000 7f59910bc640 1 --2- 172.21.15.55:0/3577135420 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5978004100 0x7f598c15c480 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f598800f770 tx=0x7f598800fc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:45.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.530+0000 7f5981ffb640 1 -- 172.21.15.55:0/3577135420 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59880050d0 con 0x7f5978004100 2024-05-27T12:33:45.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.531+0000 7f5981ffb640 1 -- 172.21.15.55:0/3577135420 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5988018070 con 0x7f5978004100 2024-05-27T12:33:45.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.531+0000 7f5993320640 1 -- 172.21.15.55:0/3577135420 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f598c0ccfc0 con 0x7f5978004100 2024-05-27T12:33:45.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.531+0000 7f5981ffb640 1 -- 172.21.15.55:0/3577135420 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f598800d730 con 0x7f5978004100 2024-05-27T12:33:45.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.531+0000 7f5993320640 1 -- 172.21.15.55:0/3577135420 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f598c0c9bc0 con 0x7f5978004100 2024-05-27T12:33:45.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.532+0000 7f5993320640 1 -- 172.21.15.55:0/3577135420 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f598c0b3ca0 con 0x7f5978004100 2024-05-27T12:33:45.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.532+0000 7f5981ffb640 1 -- 172.21.15.55:0/3577135420 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f598800dae0 con 0x7f5978004100 2024-05-27T12:33:45.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.533+0000 7f5981ffb640 1 --2- 172.21.15.55:0/3577135420 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f597006c8f0 0x7f597006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:33:45.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.533+0000 7f5981ffb640 1 -- 172.21.15.55:0/3577135420 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5709+0+0 (secure 0 0 0) 0x7f598808bdb0 con 0x7f5978004100 2024-05-27T12:33:45.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.533+0000 7f59908bb640 1 --2- 172.21.15.55:0/3577135420 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f597006c8f0 0x7f597006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:33:45.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.533+0000 7f59908bb640 1 --2- 172.21.15.55:0/3577135420 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f597006c8f0 0x7f597006edb0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f597c033000 tx=0x7f597c008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:33:45.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.537+0000 7f5981ffb640 1 -- 172.21.15.55:0/3577135420 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f598c0b3ca0 con 0x7f5978004100 2024-05-27T12:33:45.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.750+0000 7f5993320640 1 -- 172.21.15.55:0/3577135420 --> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""]}) -- 0x7f598c068a70 con 0x7f597006c8f0 2024-05-27T12:33:45.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.755+0000 7f5981ffb640 1 -- 172.21.15.55:0/3577135420 <== mgr.4105 v2:172.21.15.72:6832/3152720583 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+59 (secure 0 0 0) 0x7f598c068a70 con 0x7f597006c8f0 2024-05-27T12:33:45.755 INFO:teuthology.orchestra.run.smithi055.stdout:/volumes/_nogroup/sv1/a5bb5787-9607-4a0e-97f4-6809bc1b9bff 2024-05-27T12:33:45.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.757+0000 7f5993320640 1 -- 172.21.15.55:0/3577135420 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f597006c8f0 msgr2=0x7f597006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:45.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.757+0000 7f5993320640 1 --2- 172.21.15.55:0/3577135420 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f597006c8f0 0x7f597006edb0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f597c033000 tx=0x7f597c008030 comp rx=0 tx=0).stop 2024-05-27T12:33:45.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.757+0000 7f5993320640 1 -- 172.21.15.55:0/3577135420 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5978004100 msgr2=0x7f598c15c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:33:45.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.757+0000 7f5993320640 1 --2- 172.21.15.55:0/3577135420 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5978004100 0x7f598c15c480 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f598800f770 tx=0x7f598800fc30 comp rx=0 tx=0).stop 2024-05-27T12:33:45.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.757+0000 7f5993320640 1 -- 172.21.15.55:0/3577135420 shutdown_connections 2024-05-27T12:33:45.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.757+0000 7f5993320640 1 --2- 172.21.15.55:0/3577135420 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f598c0ca0e0 0x7f598c0ca560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:45.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.757+0000 7f5993320640 1 --2- 172.21.15.55:0/3577135420 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f597006c8f0 0x7f597006edb0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:45.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.757+0000 7f5993320640 1 --2- 172.21.15.55:0/3577135420 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f598c15ca30 0x7f598c0cca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:45.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.757+0000 7f5993320640 1 --2- 172.21.15.55:0/3577135420 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5978004100 0x7f598c15c480 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:33:45.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.757+0000 7f5993320640 1 -- 172.21.15.55:0/3577135420 >> 172.21.15.55:0/3577135420 conn(0x7f598c0b4160 msgr2=0x7f598c071950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:33:45.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.757+0000 7f5993320640 1 -- 172.21.15.55:0/3577135420 shutdown_connections 2024-05-27T12:33:45.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:33:45.757+0000 7f5993320640 1 -- 172.21.15.55:0/3577135420 wait complete. 2024-05-27T12:33:45.767 DEBUG:tasks.cephfs.test_volumes:filling subvolume sv1 with 10 files each 1024MB size under directory volumes/_nogroup/sv1/a5bb5787-9607-4a0e-97f4-6809bc1b9bff 2024-05-27T12:33:45.768 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-05-27T12:33:45.768 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-27T12:33:45.784 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T12:33:45.784 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/a5bb5787-9607-4a0e-97f4-6809bc1b9bff/subvolume_file.0 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-27T12:33:49.464 INFO:teuthology.orchestra.run.smithi055.stderr:1024+0 records in 2024-05-27T12:33:49.464 INFO:teuthology.orchestra.run.smithi055.stderr:1024+0 records out 2024-05-27T12:33:49.465 INFO:teuthology.orchestra.run.smithi055.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 3.61681 s, 297 MB/s 2024-05-27T12:33:49.465 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-05-27T12:33:49.465 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-27T12:33:49.481 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T12:33:49.481 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/a5bb5787-9607-4a0e-97f4-6809bc1b9bff/subvolume_file.1 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-27T12:33:53.167 INFO:teuthology.orchestra.run.smithi055.stderr:1024+0 records in 2024-05-27T12:33:53.167 INFO:teuthology.orchestra.run.smithi055.stderr:1024+0 records out 2024-05-27T12:33:53.167 INFO:teuthology.orchestra.run.smithi055.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 3.62761 s, 296 MB/s 2024-05-27T12:33:53.167 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-05-27T12:33:53.167 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-27T12:33:53.184 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T12:33:53.184 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/a5bb5787-9607-4a0e-97f4-6809bc1b9bff/subvolume_file.2 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-27T12:33:56.856 INFO:teuthology.orchestra.run.smithi055.stderr:1024+0 records in 2024-05-27T12:33:56.856 INFO:teuthology.orchestra.run.smithi055.stderr:1024+0 records out 2024-05-27T12:33:56.857 INFO:teuthology.orchestra.run.smithi055.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 3.61567 s, 297 MB/s 2024-05-27T12:33:56.857 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-05-27T12:33:56.857 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-27T12:33:56.873 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T12:33:56.873 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/a5bb5787-9607-4a0e-97f4-6809bc1b9bff/subvolume_file.3 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-27T12:34:00.675 INFO:teuthology.orchestra.run.smithi055.stderr:1024+0 records in 2024-05-27T12:34:00.675 INFO:teuthology.orchestra.run.smithi055.stderr:1024+0 records out 2024-05-27T12:34:00.675 INFO:teuthology.orchestra.run.smithi055.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 3.74497 s, 287 MB/s 2024-05-27T12:34:00.675 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-05-27T12:34:00.675 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-27T12:34:00.692 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T12:34:00.692 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/a5bb5787-9607-4a0e-97f4-6809bc1b9bff/subvolume_file.4 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-27T12:34:04.411 INFO:teuthology.orchestra.run.smithi055.stderr:1024+0 records in 2024-05-27T12:34:04.411 INFO:teuthology.orchestra.run.smithi055.stderr:1024+0 records out 2024-05-27T12:34:04.411 INFO:teuthology.orchestra.run.smithi055.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 3.66105 s, 293 MB/s 2024-05-27T12:34:04.411 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-05-27T12:34:04.412 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-27T12:34:04.428 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T12:34:04.428 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/a5bb5787-9607-4a0e-97f4-6809bc1b9bff/subvolume_file.5 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-27T12:34:07.872 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T12:34:07.874 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T12:34:08.117 INFO:teuthology.orchestra.run.smithi055.stderr:1024+0 records in 2024-05-27T12:34:08.117 INFO:teuthology.orchestra.run.smithi055.stderr:1024+0 records out 2024-05-27T12:34:08.117 INFO:teuthology.orchestra.run.smithi055.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 3.63207 s, 296 MB/s 2024-05-27T12:34:08.118 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-05-27T12:34:08.118 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-27T12:34:08.134 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T12:34:08.135 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/a5bb5787-9607-4a0e-97f4-6809bc1b9bff/subvolume_file.6 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-27T12:34:11.824 INFO:teuthology.orchestra.run.smithi055.stderr:1024+0 records in 2024-05-27T12:34:11.824 INFO:teuthology.orchestra.run.smithi055.stderr:1024+0 records out 2024-05-27T12:34:11.825 INFO:teuthology.orchestra.run.smithi055.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 3.63194 s, 296 MB/s 2024-05-27T12:34:11.825 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-05-27T12:34:11.825 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-27T12:34:11.841 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T12:34:11.842 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/a5bb5787-9607-4a0e-97f4-6809bc1b9bff/subvolume_file.7 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-27T12:34:15.618 INFO:teuthology.orchestra.run.smithi055.stderr:1024+0 records in 2024-05-27T12:34:15.618 INFO:teuthology.orchestra.run.smithi055.stderr:1024+0 records out 2024-05-27T12:34:15.618 INFO:teuthology.orchestra.run.smithi055.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 3.71807 s, 289 MB/s 2024-05-27T12:34:15.618 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-05-27T12:34:15.618 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-27T12:34:15.634 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T12:34:15.635 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/a5bb5787-9607-4a0e-97f4-6809bc1b9bff/subvolume_file.8 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-27T12:34:19.338 INFO:teuthology.orchestra.run.smithi055.stderr:1024+0 records in 2024-05-27T12:34:19.339 INFO:teuthology.orchestra.run.smithi055.stderr:1024+0 records out 2024-05-27T12:34:19.339 INFO:teuthology.orchestra.run.smithi055.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 3.64564 s, 295 MB/s 2024-05-27T12:34:19.339 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-05-27T12:34:19.339 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-27T12:34:19.356 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T12:34:19.356 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/a5bb5787-9607-4a0e-97f4-6809bc1b9bff/subvolume_file.9 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-27T12:34:23.059 INFO:teuthology.orchestra.run.smithi055.stderr:1024+0 records in 2024-05-27T12:34:23.060 INFO:teuthology.orchestra.run.smithi055.stderr:1024+0 records out 2024-05-27T12:34:23.060 INFO:teuthology.orchestra.run.smithi055.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 3.64579 s, 295 MB/s 2024-05-27T12:34:23.060 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot create cephfs sv1 ss1 2024-05-27T12:34:23.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.169+0000 7f0b0bf7d640 1 Processor -- start 2024-05-27T12:34:23.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.170+0000 7f0b0bf7d640 1 -- start start 2024-05-27T12:34:23.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.170+0000 7f0b0bf7d640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0b0415eb00 0x7f0b040cfb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:34:23.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.170+0000 7f0b0bf7d640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0b040d1f40 0x7f0b040b78f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:34:23.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.170+0000 7f0b0bf7d640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b0415eee0 con 0x7f0b040d3e50 2024-05-27T12:34:23.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.170+0000 7f0b0bf7d640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f0b040d5700 con 0x7f0b040d1f40 2024-05-27T12:34:23.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.170+0000 7f0b0bf7d640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f0b040d4660 con 0x7f0b0415eb00 2024-05-27T12:34:23.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.170+0000 7f0b09518640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f0b040d3e50 0x7f0b040d1830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:33164/0 (socket says 172.21.15.55:33164) 2024-05-27T12:34:23.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.171+0000 7f0b09518640 1 -- 172.21.15.55:0/25929889 learned_addr learned my addr 172.21.15.55:0/25929889 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-27T12:34:23.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.171+0000 7f0b09d19640 1 --2- 172.21.15.55:0/25929889 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0b0415eb00 0x7f0b040cfb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:34:23.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.171+0000 7f0b0a51a640 1 --2- 172.21.15.55:0/25929889 >> v2:172.21.15.72:3300/0 conn(0x7f0b040d1f40 0x7f0b040b78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:34:23.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.171+0000 7f0b08d17640 1 -- 172.21.15.55:0/25929889 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1626803476 0 0) 0x7f0b0415eee0 con 0x7f0b040d3e50 2024-05-27T12:34:23.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.171+0000 7f0b08d17640 1 -- 172.21.15.55:0/25929889 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0aec003520 con 0x7f0b040d3e50 2024-05-27T12:34:23.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.171+0000 7f0b09d19640 1 -- 172.21.15.55:0/25929889 >> v2:172.21.15.72:3300/0 conn(0x7f0b040d1f40 msgr2=0x7f0b040b78f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:34:23.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.171+0000 7f0b09d19640 1 --2- 172.21.15.55:0/25929889 >> v2:172.21.15.72:3300/0 conn(0x7f0b040d1f40 0x7f0b040b78f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:34:23.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.171+0000 7f0b09d19640 1 -- 172.21.15.55:0/25929889 >> v1:172.21.15.55:6789/0 conn(0x7f0b040d3e50 legacy=0x7f0b040d1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:34:23.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.171+0000 7f0b09d19640 1 -- 172.21.15.55:0/25929889 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b040d4940 con 0x7f0b0415eb00 2024-05-27T12:34:23.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.171+0000 7f0b0a51a640 1 --2- 172.21.15.55:0/25929889 >> v2:172.21.15.72:3300/0 conn(0x7f0b040d1f40 0x7f0b040b78f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T12:34:23.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.172+0000 7f0b09d19640 1 --2- 172.21.15.55:0/25929889 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0b0415eb00 0x7f0b040cfb40 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0afc0097a0 tx=0x7f0afc02a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=468f38edaf894c20 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:34:23.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.172+0000 7f0b08d17640 1 -- 172.21.15.55:0/25929889 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0afc037070 con 0x7f0b0415eb00 2024-05-27T12:34:23.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.172+0000 7f0b08d17640 1 -- 172.21.15.55:0/25929889 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0afc032440 con 0x7f0b0415eb00 2024-05-27T12:34:23.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.172+0000 7f0b08d17640 1 -- 172.21.15.55:0/25929889 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0afc0327f0 con 0x7f0b0415eb00 2024-05-27T12:34:23.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.172+0000 7f0b0bf7d640 1 -- 172.21.15.55:0/25929889 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0b0415eb00 msgr2=0x7f0b040cfb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:34:23.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.172+0000 7f0b0bf7d640 1 --2- 172.21.15.55:0/25929889 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0b0415eb00 0x7f0b040cfb40 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0afc0097a0 tx=0x7f0afc02a210 comp rx=0 tx=0).stop 2024-05-27T12:34:23.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.172+0000 7f0b0bf7d640 1 -- 172.21.15.55:0/25929889 shutdown_connections 2024-05-27T12:34:23.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.172+0000 7f0b0bf7d640 1 --2- 172.21.15.55:0/25929889 >> v2:172.21.15.72:3300/0 conn(0x7f0b040d1f40 0x7f0b040b78f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:34:23.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.172+0000 7f0b0bf7d640 1 --2- 172.21.15.55:0/25929889 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0b0415eb00 0x7f0b040cfb40 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:34:23.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.172+0000 7f0b0bf7d640 1 -- 172.21.15.55:0/25929889 >> 172.21.15.55:0/25929889 conn(0x7f0b04067a50 msgr2=0x7f0b04067e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:34:23.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.173+0000 7f0b0bf7d640 1 -- 172.21.15.55:0/25929889 shutdown_connections 2024-05-27T12:34:23.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.173+0000 7f0b0bf7d640 1 -- 172.21.15.55:0/25929889 wait complete. 2024-05-27T12:34:23.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.174+0000 7f0b0bf7d640 1 Processor -- start 2024-05-27T12:34:23.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.174+0000 7f0b0bf7d640 1 -- start start 2024-05-27T12:34:23.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.175+0000 7f0b0bf7d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0b040d1f40 0x7f0b04157dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:34:23.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.175+0000 7f0b0bf7d640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b040d3e50 0x7f0b041f5030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:34:23.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.175+0000 7f0b0bf7d640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0b0415eb00 0x7f0b0415fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:34:23.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.175+0000 7f0b0bf7d640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f0b040d51e0 con 0x7f0b040d1f40 2024-05-27T12:34:23.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.175+0000 7f0b0bf7d640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f0b040d4f00 con 0x7f0b040d3e50 2024-05-27T12:34:23.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.175+0000 7f0b0bf7d640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f0b040d4290 con 0x7f0b0415eb00 2024-05-27T12:34:23.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.175+0000 7f0b09d19640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0b040d1f40 0x7f0b04157dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:34:23.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.175+0000 7f0b09d19640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0b040d1f40 0x7f0b04157dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51184/0 (socket says 172.21.15.55:51184) 2024-05-27T12:34:23.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.175+0000 7f0b09d19640 1 -- 172.21.15.55:0/712703769 learned_addr learned my addr 172.21.15.55:0/712703769 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:34:23.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.175+0000 7f0b09518640 1 --2- 172.21.15.55:0/712703769 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b040d3e50 0x7f0b041f5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:34:23.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.175+0000 7f0b09d19640 1 -- 172.21.15.55:0/712703769 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0b0415eb00 msgr2=0x7f0b0415fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:34:23.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.175+0000 7f0b0a51a640 1 --2- 172.21.15.55:0/712703769 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0b0415eb00 0x7f0b0415fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:34:23.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.175+0000 7f0b09d19640 1 --2- 172.21.15.55:0/712703769 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0b0415eb00 0x7f0b0415fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:34:23.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.175+0000 7f0b09d19640 1 -- 172.21.15.55:0/712703769 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b040d3e50 msgr2=0x7f0b041f5030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:34:23.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.175+0000 7f0b09d19640 1 --2- 172.21.15.55:0/712703769 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b040d3e50 0x7f0b041f5030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:34:23.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.175+0000 7f0b09d19640 1 -- 172.21.15.55:0/712703769 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b041f5570 con 0x7f0b040d1f40 2024-05-27T12:34:23.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.175+0000 7f0b0a51a640 1 --2- 172.21.15.55:0/712703769 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0b0415eb00 0x7f0b0415fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T12:34:23.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.175+0000 7f0b09518640 1 --2- 172.21.15.55:0/712703769 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b040d3e50 0x7f0b041f5030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T12:34:23.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.175+0000 7f0b09d19640 1 --2- 172.21.15.55:0/712703769 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0b040d1f40 0x7f0b04157dc0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f0afc035040 tx=0x7f0afc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:34:23.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.175+0000 7f0b027fc640 1 -- 172.21.15.55:0/712703769 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0afc037040 con 0x7f0b040d1f40 2024-05-27T12:34:23.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.175+0000 7f0b027fc640 1 -- 172.21.15.55:0/712703769 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0afc042070 con 0x7f0b040d1f40 2024-05-27T12:34:23.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.175+0000 7f0b0bf7d640 1 -- 172.21.15.55:0/712703769 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b040b6060 con 0x7f0b040d1f40 2024-05-27T12:34:23.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.175+0000 7f0b027fc640 1 -- 172.21.15.55:0/712703769 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0afc03b930 con 0x7f0b040d1f40 2024-05-27T12:34:23.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.175+0000 7f0b0bf7d640 1 -- 172.21.15.55:0/712703769 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b041f5af0 con 0x7f0b040d1f40 2024-05-27T12:34:23.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.176+0000 7f0b0bf7d640 1 -- 172.21.15.55:0/712703769 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b04068a70 con 0x7f0b040d1f40 2024-05-27T12:34:23.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.177+0000 7f0b027fc640 1 -- 172.21.15.55:0/712703769 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 6) ==== 91091+0+0 (secure 0 0 0) 0x7f0afc03bad0 con 0x7f0b040d1f40 2024-05-27T12:34:23.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.177+0000 7f0b027fc640 1 --2- 172.21.15.55:0/712703769 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f0af006c9b0 0x7f0af006ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:34:23.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.178+0000 7f0b027fc640 1 -- 172.21.15.55:0/712703769 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5709+0+0 (secure 0 0 0) 0x7f0afc0ac3a0 con 0x7f0b040d1f40 2024-05-27T12:34:23.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.178+0000 7f0b09518640 1 --2- 172.21.15.55:0/712703769 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f0af006c9b0 0x7f0af006ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:34:23.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.178+0000 7f0b09518640 1 --2- 172.21.15.55:0/712703769 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f0af006c9b0 0x7f0af006ee70 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f0b040b5a60 tx=0x7f0af8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:34:23.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.182+0000 7f0b027fc640 1 -- 172.21.15.55:0/712703769 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f0b041f5570 con 0x7f0b040d1f40 2024-05-27T12:34:23.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.400+0000 7f0b0bf7d640 1 -- 172.21.15.55:0/712703769 --> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot create", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target": ["mon-mgr", ""]}) -- 0x7f0b040b70b0 con 0x7f0af006c9b0 2024-05-27T12:34:23.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.421+0000 7f0b027fc640 1 -- 172.21.15.55:0/712703769 <== mgr.4105 v2:172.21.15.72:6832/3152720583 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f0b040b70b0 con 0x7f0af006c9b0 2024-05-27T12:34:23.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.423+0000 7f0b0bf7d640 1 -- 172.21.15.55:0/712703769 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f0af006c9b0 msgr2=0x7f0af006ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:34:23.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.423+0000 7f0b0bf7d640 1 --2- 172.21.15.55:0/712703769 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f0af006c9b0 0x7f0af006ee70 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f0b040b5a60 tx=0x7f0af8009040 comp rx=0 tx=0).stop 2024-05-27T12:34:23.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.423+0000 7f0b0bf7d640 1 -- 172.21.15.55:0/712703769 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0b040d1f40 msgr2=0x7f0b04157dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:34:23.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.423+0000 7f0b0bf7d640 1 --2- 172.21.15.55:0/712703769 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0b040d1f40 0x7f0b04157dc0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f0afc035040 tx=0x7f0afc0046c0 comp rx=0 tx=0).stop 2024-05-27T12:34:23.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.423+0000 7f0b0bf7d640 1 -- 172.21.15.55:0/712703769 shutdown_connections 2024-05-27T12:34:23.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.423+0000 7f0b0bf7d640 1 --2- 172.21.15.55:0/712703769 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0b0415eb00 0x7f0b0415fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:34:23.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.423+0000 7f0b0bf7d640 1 --2- 172.21.15.55:0/712703769 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f0af006c9b0 0x7f0af006ee70 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:34:23.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.423+0000 7f0b0bf7d640 1 --2- 172.21.15.55:0/712703769 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b040d3e50 0x7f0b041f5030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:34:23.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.423+0000 7f0b0bf7d640 1 --2- 172.21.15.55:0/712703769 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0b040d1f40 0x7f0b04157dc0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:34:23.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.423+0000 7f0b0bf7d640 1 -- 172.21.15.55:0/712703769 >> 172.21.15.55:0/712703769 conn(0x7f0b04067a50 msgr2=0x7f0b040ceb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:34:23.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.423+0000 7f0b0bf7d640 1 -- 172.21.15.55:0/712703769 shutdown_connections 2024-05-27T12:34:23.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.423+0000 7f0b0bf7d640 1 -- 172.21.15.55:0/712703769 wait complete. 2024-05-27T12:34:23.434 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv1 2024-05-27T12:34:23.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.541+0000 7f81bbea9640 1 Processor -- start 2024-05-27T12:34:23.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.541+0000 7f81bbea9640 1 -- start start 2024-05-27T12:34:23.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.542+0000 7f81bbea9640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f81b415eb60 0x7f81b406d930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:34:23.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.542+0000 7f81bbea9640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f81b409aa30 0x7f81b409aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:34:23.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.542+0000 7f81bbea9640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81b406cb70 con 0x7f81b409b980 2024-05-27T12:34:23.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.542+0000 7f81bbea9640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f81b40d1aa0 con 0x7f81b415eb60 2024-05-27T12:34:23.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.542+0000 7f81bbea9640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f81b409b3e0 con 0x7f81b409aa30 2024-05-27T12:34:23.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.542+0000 7f81b9c45640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f81b415eb60 0x7f81b406d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:34:23.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.542+0000 7f81b9c45640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f81b415eb60 0x7f81b406d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51194/0 (socket says 172.21.15.55:51194) 2024-05-27T12:34:23.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.542+0000 7f81b9c45640 1 -- 172.21.15.55:0/3576244932 learned_addr learned my addr 172.21.15.55:0/3576244932 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:34:23.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.542+0000 7f81ba446640 1 --2- 172.21.15.55:0/3576244932 >> v2:172.21.15.72:3300/0 conn(0x7f81b409aa30 0x7f81b409aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:34:23.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.542+0000 7f81b9c45640 1 -- 172.21.15.55:0/3576244932 >> v2:172.21.15.72:3300/0 conn(0x7f81b409aa30 msgr2=0x7f81b409aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:34:23.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.542+0000 7f81b9c45640 1 --2- 172.21.15.55:0/3576244932 >> v2:172.21.15.72:3300/0 conn(0x7f81b409aa30 0x7f81b409aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:34:23.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.542+0000 7f81b9c45640 1 -- 172.21.15.55:0/3576244932 >> v1:172.21.15.72:6789/0 conn(0x7f81b409b980 legacy=0x7f81b40d1390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:34:23.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.542+0000 7f81b9c45640 1 -- 172.21.15.55:0/3576244932 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81b406ce50 con 0x7f81b415eb60 2024-05-27T12:34:23.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.543+0000 7f81b9c45640 1 --2- 172.21.15.55:0/3576244932 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81b415eb60 0x7f81b406d930 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f81b40b4dc0 tx=0x7f81b002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25887865af0f67a3 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:34:23.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.543+0000 7f81b8c43640 1 -- 172.21.15.55:0/3576244932 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81b0036070 con 0x7f81b415eb60 2024-05-27T12:34:23.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.543+0000 7f81b8c43640 1 -- 172.21.15.55:0/3576244932 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81b0031600 con 0x7f81b415eb60 2024-05-27T12:34:23.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.543+0000 7f81b8c43640 1 -- 172.21.15.55:0/3576244932 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81b00319d0 con 0x7f81b415eb60 2024-05-27T12:34:23.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.544+0000 7f81bbea9640 1 -- 172.21.15.55:0/3576244932 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81b415eb60 msgr2=0x7f81b406d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:34:23.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.544+0000 7f81bbea9640 1 --2- 172.21.15.55:0/3576244932 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81b415eb60 0x7f81b406d930 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f81b40b4dc0 tx=0x7f81b002a6a0 comp rx=0 tx=0).stop 2024-05-27T12:34:23.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.544+0000 7f81bbea9640 1 -- 172.21.15.55:0/3576244932 shutdown_connections 2024-05-27T12:34:23.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.544+0000 7f81bbea9640 1 --2- 172.21.15.55:0/3576244932 >> v2:172.21.15.72:3300/0 conn(0x7f81b409aa30 0x7f81b409aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:34:23.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.544+0000 7f81bbea9640 1 --2- 172.21.15.55:0/3576244932 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81b415eb60 0x7f81b406d930 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:34:23.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.544+0000 7f81bbea9640 1 -- 172.21.15.55:0/3576244932 >> 172.21.15.55:0/3576244932 conn(0x7f81b40b4160 msgr2=0x7f81b40b4570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:34:23.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.544+0000 7f81bbea9640 1 -- 172.21.15.55:0/3576244932 shutdown_connections 2024-05-27T12:34:23.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.544+0000 7f81bbea9640 1 -- 172.21.15.55:0/3576244932 wait complete. 2024-05-27T12:34:23.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.545+0000 7f81bbea9640 1 Processor -- start 2024-05-27T12:34:23.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.545+0000 7f81bbea9640 1 -- start start 2024-05-27T12:34:23.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.546+0000 7f81bbea9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81b409aa30 0x7f81b415c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:34:23.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.546+0000 7f81bbea9640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81b409b980 0x7f81b415a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:34:23.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.546+0000 7f81bbea9640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f81b415eb60 0x7f81b415a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:34:23.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.546+0000 7f81bbea9640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f81b406d410 con 0x7f81b409aa30 2024-05-27T12:34:23.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.546+0000 7f81bbea9640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f81b40d1cc0 con 0x7f81b409b980 2024-05-27T12:34:23.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.546+0000 7f81bbea9640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f81b406de70 con 0x7f81b415eb60 2024-05-27T12:34:23.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.546+0000 7f81b9c45640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81b409aa30 0x7f81b415c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:34:23.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.546+0000 7f81b9c45640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81b409aa30 0x7f81b415c3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51198/0 (socket says 172.21.15.55:51198) 2024-05-27T12:34:23.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.546+0000 7f81b9c45640 1 -- 172.21.15.55:0/3823715230 learned_addr learned my addr 172.21.15.55:0/3823715230 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:34:23.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.546+0000 7f81b9444640 1 --2- 172.21.15.55:0/3823715230 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81b409b980 0x7f81b415a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:34:23.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.546+0000 7f81ba446640 1 --2- 172.21.15.55:0/3823715230 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f81b415eb60 0x7f81b415a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:34:23.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.546+0000 7f81b9c45640 1 -- 172.21.15.55:0/3823715230 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f81b415eb60 msgr2=0x7f81b415a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:34:23.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.546+0000 7f81b9c45640 1 --2- 172.21.15.55:0/3823715230 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f81b415eb60 0x7f81b415a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:34:23.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.546+0000 7f81b9c45640 1 -- 172.21.15.55:0/3823715230 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81b409b980 msgr2=0x7f81b415a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:34:23.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.546+0000 7f81b9c45640 1 --2- 172.21.15.55:0/3823715230 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81b409b980 0x7f81b415a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:34:23.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.546+0000 7f81b9c45640 1 -- 172.21.15.55:0/3823715230 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81b41f7cf0 con 0x7f81b409aa30 2024-05-27T12:34:23.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.546+0000 7f81b9c45640 1 --2- 172.21.15.55:0/3823715230 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81b409aa30 0x7f81b415c3e0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f81b0034040 tx=0x7f81b0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:34:23.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.546+0000 7f81aa7fc640 1 -- 172.21.15.55:0/3823715230 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81b003f020 con 0x7f81b409aa30 2024-05-27T12:34:23.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.546+0000 7f81aa7fc640 1 -- 172.21.15.55:0/3823715230 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81b0037040 con 0x7f81b409aa30 2024-05-27T12:34:23.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.546+0000 7f81bbea9640 1 -- 172.21.15.55:0/3823715230 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81b41f7fd0 con 0x7f81b409aa30 2024-05-27T12:34:23.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.546+0000 7f81aa7fc640 1 -- 172.21.15.55:0/3823715230 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81b0036070 con 0x7f81b409aa30 2024-05-27T12:34:23.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.546+0000 7f81bbea9640 1 -- 172.21.15.55:0/3823715230 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81b41f8590 con 0x7f81b409aa30 2024-05-27T12:34:23.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.548+0000 7f81bbea9640 1 -- 172.21.15.55:0/3823715230 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81b4068a70 con 0x7f81b409aa30 2024-05-27T12:34:23.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.548+0000 7f81aa7fc640 1 -- 172.21.15.55:0/3823715230 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 6) ==== 91091+0+0 (secure 0 0 0) 0x7f81b0042020 con 0x7f81b409aa30 2024-05-27T12:34:23.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.548+0000 7f81aa7fc640 1 --2- 172.21.15.55:0/3823715230 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f819806c980 0x7f819806ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:34:23.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.549+0000 7f81aa7fc640 1 -- 172.21.15.55:0/3823715230 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5709+0+0 (secure 0 0 0) 0x7f81b00ac1c0 con 0x7f81b409aa30 2024-05-27T12:34:23.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.549+0000 7f81b9444640 1 --2- 172.21.15.55:0/3823715230 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f819806c980 0x7f819806ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:34:23.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.549+0000 7f81b9444640 1 --2- 172.21.15.55:0/3823715230 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f819806c980 0x7f819806ee40 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f81a4007fd0 tx=0x7f81a4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:34:23.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.553+0000 7f81aa7fc640 1 -- 172.21.15.55:0/3823715230 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f81b0049030 con 0x7f81b409aa30 2024-05-27T12:34:23.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.769+0000 7f81bbea9640 1 -- 172.21.15.55:0/3823715230 --> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""]}) -- 0x7f81b406e1a0 con 0x7f819806c980 2024-05-27T12:34:23.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.774+0000 7f81aa7fc640 1 -- 172.21.15.55:0/3823715230 <== mgr.4105 v2:172.21.15.72:6832/3152720583 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+59 (secure 0 0 0) 0x7f81b406e1a0 con 0x7f819806c980 2024-05-27T12:34:23.773 INFO:teuthology.orchestra.run.smithi055.stdout:/volumes/_nogroup/sv1/a5bb5787-9607-4a0e-97f4-6809bc1b9bff 2024-05-27T12:34:23.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.776+0000 7f81bbea9640 1 -- 172.21.15.55:0/3823715230 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f819806c980 msgr2=0x7f819806ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:34:23.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.776+0000 7f81bbea9640 1 --2- 172.21.15.55:0/3823715230 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f819806c980 0x7f819806ee40 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f81a4007fd0 tx=0x7f81a4009040 comp rx=0 tx=0).stop 2024-05-27T12:34:23.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.776+0000 7f81bbea9640 1 -- 172.21.15.55:0/3823715230 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81b409aa30 msgr2=0x7f81b415c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:34:23.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.776+0000 7f81bbea9640 1 --2- 172.21.15.55:0/3823715230 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81b409aa30 0x7f81b415c3e0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f81b0034040 tx=0x7f81b0004a40 comp rx=0 tx=0).stop 2024-05-27T12:34:23.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.776+0000 7f81bbea9640 1 -- 172.21.15.55:0/3823715230 shutdown_connections 2024-05-27T12:34:23.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.776+0000 7f81bbea9640 1 --2- 172.21.15.55:0/3823715230 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f81b415eb60 0x7f81b415a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:34:23.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.776+0000 7f81bbea9640 1 --2- 172.21.15.55:0/3823715230 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f819806c980 0x7f819806ee40 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:34:23.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.776+0000 7f81bbea9640 1 --2- 172.21.15.55:0/3823715230 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81b409b980 0x7f81b415a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:34:23.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.776+0000 7f81bbea9640 1 --2- 172.21.15.55:0/3823715230 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81b409aa30 0x7f81b415c3e0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:34:23.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.776+0000 7f81bbea9640 1 -- 172.21.15.55:0/3823715230 >> 172.21.15.55:0/3823715230 conn(0x7f81b40b4160 msgr2=0x7f81b40712a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:34:23.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.776+0000 7f81bbea9640 1 -- 172.21.15.55:0/3823715230 shutdown_connections 2024-05-27T12:34:23.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:23.776+0000 7f81bbea9640 1 -- 172.21.15.55:0/3823715230 wait complete. 2024-05-27T12:34:23.787 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T12:34:23.787 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr -n ceph.dir.rbytes volumes/_nogroup/sv1/a5bb5787-9607-4a0e-97f4-6809bc1b9bff 2024-05-27T12:34:23.787 DEBUG:teuthology.orchestra.run.smithi055:> ) 2024-05-27T12:34:23.803 INFO:teuthology.orchestra.run.smithi055.stdout:# file: volumes/_nogroup/sv1/a5bb5787-9607-4a0e-97f4-6809bc1b9bff 2024-05-27T12:34:23.803 INFO:teuthology.orchestra.run.smithi055.stdout:ceph.dir.rbytes="9990258688" 2024-05-27T12:34:23.803 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-27T12:34:23.803 INFO:tasks.cephfs.test_volumes:r_size = 9990258688 exp_size = 10737418240 2024-05-27T12:34:25.805 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T12:34:25.805 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr -n ceph.dir.rbytes volumes/_nogroup/sv1/a5bb5787-9607-4a0e-97f4-6809bc1b9bff 2024-05-27T12:34:25.805 DEBUG:teuthology.orchestra.run.smithi055:> ) 2024-05-27T12:34:25.826 INFO:teuthology.orchestra.run.smithi055.stdout:# file: volumes/_nogroup/sv1/a5bb5787-9607-4a0e-97f4-6809bc1b9bff 2024-05-27T12:34:25.826 INFO:teuthology.orchestra.run.smithi055.stdout:ceph.dir.rbytes="10737418240" 2024-05-27T12:34:25.827 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-27T12:34:25.827 INFO:tasks.cephfs.test_volumes:r_size = 10737418240 exp_size = 10737418240 2024-05-27T12:34:25.827 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 ss1clone1 2024-05-27T12:34:25.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:25.990+0000 7fe20587c640 1 Processor -- start 2024-05-27T12:34:25.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:25.991+0000 7fe20587c640 1 -- start start 2024-05-27T12:34:25.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:25.991+0000 7fe20587c640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe20015eb00 0x7fe2000cfb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:34:25.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:25.991+0000 7fe20587c640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe2000d3e50 0x7fe2000d1830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:34:25.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:25.992+0000 7fe20587c640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe20015eee0 con 0x7fe2000d1d70 2024-05-27T12:34:25.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:25.992+0000 7fe20587c640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fe2000d5700 con 0x7fe20015eb00 2024-05-27T12:34:25.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:25.992+0000 7fe20587c640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fe2000d21a0 con 0x7fe2000d3e50 2024-05-27T12:34:25.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:25.992+0000 7fe1ff7fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fe2000d1d70 0x7fe2000d2910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:33168/0 (socket says 172.21.15.55:33168) 2024-05-27T12:34:25.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:25.992+0000 7fe1ff7fe640 1 -- 172.21.15.55:0/3190761709 learned_addr learned my addr 172.21.15.55:0/3190761709 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-27T12:34:25.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:25.992+0000 7fe1feffd640 1 --2- 172.21.15.55:0/3190761709 >> v2:172.21.15.72:3300/0 conn(0x7fe20015eb00 0x7fe2000cfb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:34:25.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:25.992+0000 7fe1fe7fc640 1 --2- 172.21.15.55:0/3190761709 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe2000d3e50 0x7fe2000d1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:34:25.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:25.992+0000 7fe1fdffb640 1 -- 172.21.15.55:0/3190761709 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 682718858 0 0) 0x7fe20015eee0 con 0x7fe2000d1d70 2024-05-27T12:34:25.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:25.992+0000 7fe1fdffb640 1 -- 172.21.15.55:0/3190761709 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe1e8003520 con 0x7fe2000d1d70 2024-05-27T12:34:25.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:25.992+0000 7fe1feffd640 1 -- 172.21.15.55:0/3190761709 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe2000d3e50 msgr2=0x7fe2000d1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:34:25.993 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:25.992+0000 7fe1feffd640 1 --2- 172.21.15.55:0/3190761709 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe2000d3e50 0x7fe2000d1830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:34:25.993 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:25.992+0000 7fe1feffd640 1 -- 172.21.15.55:0/3190761709 >> v1:172.21.15.55:6789/0 conn(0x7fe2000d1d70 legacy=0x7fe2000d2910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:34:25.993 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:25.992+0000 7fe1fdffb640 1 -- 172.21.15.55:0/3190761709 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 461281122 0 0) 0x7fe1e8003520 con 0x7fe2000d1d70 2024-05-27T12:34:25.993 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:25.992+0000 7fe1feffd640 1 -- 172.21.15.55:0/3190761709 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2000d4660 con 0x7fe20015eb00 2024-05-27T12:34:25.993 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:25.992+0000 7fe1fe7fc640 1 --2- 172.21.15.55:0/3190761709 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe2000d3e50 0x7fe2000d1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T12:34:25.994 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:25.993+0000 7fe1feffd640 1 --2- 172.21.15.55:0/3190761709 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe20015eb00 0x7fe2000cfb40 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fe1f00097d0 tx=0x7fe1f002a1e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7334492f0e91f300 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:34:25.994 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:25.993+0000 7fe1fdffb640 1 -- 172.21.15.55:0/3190761709 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1f0037070 con 0x7fe20015eb00 2024-05-27T12:34:25.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:25.993+0000 7fe1fdffb640 1 -- 172.21.15.55:0/3190761709 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1f002ac70 con 0x7fe20015eb00 2024-05-27T12:34:25.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:25.993+0000 7fe1fdffb640 1 -- 172.21.15.55:0/3190761709 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1f80019f0 con 0x7fe20015eb00 2024-05-27T12:34:25.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:25.994+0000 7fe20587c640 1 -- 172.21.15.55:0/3190761709 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe20015eb00 msgr2=0x7fe2000cfb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:34:25.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:25.994+0000 7fe20587c640 1 --2- 172.21.15.55:0/3190761709 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe20015eb00 0x7fe2000cfb40 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fe1f00097d0 tx=0x7fe1f002a1e0 comp rx=0 tx=0).stop 2024-05-27T12:34:25.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:25.994+0000 7fe20587c640 1 -- 172.21.15.55:0/3190761709 shutdown_connections 2024-05-27T12:34:25.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:25.994+0000 7fe20587c640 1 --2- 172.21.15.55:0/3190761709 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe2000d3e50 0x7fe2000d1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:34:25.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:25.994+0000 7fe20587c640 1 --2- 172.21.15.55:0/3190761709 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe20015eb00 0x7fe2000cfb40 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:34:25.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:25.994+0000 7fe20587c640 1 -- 172.21.15.55:0/3190761709 >> 172.21.15.55:0/3190761709 conn(0x7fe200067a50 msgr2=0x7fe200067e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:34:25.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:25.994+0000 7fe20587c640 1 -- 172.21.15.55:0/3190761709 shutdown_connections 2024-05-27T12:34:25.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:25.994+0000 7fe20587c640 1 -- 172.21.15.55:0/3190761709 wait complete. 2024-05-27T12:34:25.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:25.995+0000 7fe20587c640 1 Processor -- start 2024-05-27T12:34:25.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:25.995+0000 7fe20587c640 1 -- start start 2024-05-27T12:34:25.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:25.996+0000 7fe20587c640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe2000d1d70 0x7fe200161c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:34:25.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:25.996+0000 7fe20587c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2000d3e50 0x7fe2001535e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:34:25.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:25.996+0000 7fe20587c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe20015eb00 0x7fe2000cabf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:34:25.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:25.996+0000 7fe20587c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7fe2000d4f00 con 0x7fe20015eb00 2024-05-27T12:34:25.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:25.996+0000 7fe20587c640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fe2000d4c20 con 0x7fe2000d3e50 2024-05-27T12:34:25.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:25.996+0000 7fe20587c640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fe2000d51e0 con 0x7fe2000d1d70 2024-05-27T12:34:25.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:25.996+0000 7fe1ff7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe20015eb00 0x7fe2000cabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:34:25.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:25.996+0000 7fe1ff7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe20015eb00 0x7fe2000cabf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51208/0 (socket says 172.21.15.55:51208) 2024-05-27T12:34:25.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:25.996+0000 7fe1ff7fe640 1 -- 172.21.15.55:0/2382109095 learned_addr learned my addr 172.21.15.55:0/2382109095 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:34:25.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:25.996+0000 7fe1feffd640 1 --2- 172.21.15.55:0/2382109095 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe2000d1d70 0x7fe200161c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:34:25.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:25.997+0000 7fe1fe7fc640 1 --2- 172.21.15.55:0/2382109095 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2000d3e50 0x7fe2001535e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:34:25.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:25.997+0000 7fe1ff7fe640 1 -- 172.21.15.55:0/2382109095 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe2000d1d70 msgr2=0x7fe200161c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:34:25.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:25.997+0000 7fe1ff7fe640 1 --2- 172.21.15.55:0/2382109095 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe2000d1d70 0x7fe200161c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:34:25.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:25.997+0000 7fe1ff7fe640 1 -- 172.21.15.55:0/2382109095 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2000d3e50 msgr2=0x7fe2001535e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:34:25.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:25.997+0000 7fe1ff7fe640 1 --2- 172.21.15.55:0/2382109095 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2000d3e50 0x7fe2001535e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:34:25.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:25.997+0000 7fe1ff7fe640 1 -- 172.21.15.55:0/2382109095 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2000c9b50 con 0x7fe20015eb00 2024-05-27T12:34:25.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:25.997+0000 7fe1feffd640 1 --2- 172.21.15.55:0/2382109095 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe2000d1d70 0x7fe200161c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T12:34:26.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:25.997+0000 7fe1ff7fe640 1 --2- 172.21.15.55:0/2382109095 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe20015eb00 0x7fe2000cabf0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fe1f800cc70 tx=0x7fe1f800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:34:26.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:25.997+0000 7fe1e7fff640 1 -- 172.21.15.55:0/2382109095 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1f8017070 con 0x7fe20015eb00 2024-05-27T12:34:26.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:25.997+0000 7fe1e7fff640 1 -- 172.21.15.55:0/2382109095 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1f8012400 con 0x7fe20015eb00 2024-05-27T12:34:26.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:25.997+0000 7fe20587c640 1 -- 172.21.15.55:0/2382109095 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2000c9e30 con 0x7fe20015eb00 2024-05-27T12:34:26.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:25.997+0000 7fe1e7fff640 1 -- 172.21.15.55:0/2382109095 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1f8012830 con 0x7fe20015eb00 2024-05-27T12:34:26.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:25.997+0000 7fe20587c640 1 -- 172.21.15.55:0/2382109095 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2000ca6d0 con 0x7fe20015eb00 2024-05-27T12:34:26.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:25.998+0000 7fe20587c640 1 -- 172.21.15.55:0/2382109095 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2000ca8d0 con 0x7fe20015eb00 2024-05-27T12:34:26.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:25.999+0000 7fe1e7fff640 1 -- 172.21.15.55:0/2382109095 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 6) ==== 91091+0+0 (secure 0 0 0) 0x7fe1f801a070 con 0x7fe20015eb00 2024-05-27T12:34:26.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:25.999+0000 7fe1e7fff640 1 --2- 172.21.15.55:0/2382109095 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fe1ec06c980 0x7fe1ec06ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:34:26.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:25.999+0000 7fe1e7fff640 1 -- 172.21.15.55:0/2382109095 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5709+0+0 (secure 0 0 0) 0x7fe1f808bb80 con 0x7fe20015eb00 2024-05-27T12:34:26.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:26.000+0000 7fe1feffd640 1 --2- 172.21.15.55:0/2382109095 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fe1ec06c980 0x7fe1ec06ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:34:26.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:26.000+0000 7fe1feffd640 1 --2- 172.21.15.55:0/2382109095 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fe1ec06c980 0x7fe1ec06ee40 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fe1f0034000 tx=0x7fe1f002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:34:26.002 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:26.004+0000 7fe1e7fff640 1 -- 172.21.15.55:0/2382109095 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe1f8059fc0 con 0x7fe20015eb00 2024-05-27T12:34:26.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:26.232+0000 7fe20587c640 1 -- 172.21.15.55:0/2382109095 --> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "ss1clone1", "target": ["mon-mgr", ""]}) -- 0x7fe200068a70 con 0x7fe1ec06c980 2024-05-27T12:34:26.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:26.300+0000 7fe1e7fff640 1 -- 172.21.15.55:0/2382109095 <== mgr.4105 v2:172.21.15.72:6832/3152720583 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fe200068a70 con 0x7fe1ec06c980 2024-05-27T12:34:26.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:26.303+0000 7fe20587c640 1 -- 172.21.15.55:0/2382109095 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fe1ec06c980 msgr2=0x7fe1ec06ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:34:26.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:26.303+0000 7fe20587c640 1 --2- 172.21.15.55:0/2382109095 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fe1ec06c980 0x7fe1ec06ee40 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fe1f0034000 tx=0x7fe1f002e000 comp rx=0 tx=0).stop 2024-05-27T12:34:26.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:26.303+0000 7fe20587c640 1 -- 172.21.15.55:0/2382109095 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe20015eb00 msgr2=0x7fe2000cabf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:34:26.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:26.303+0000 7fe20587c640 1 --2- 172.21.15.55:0/2382109095 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe20015eb00 0x7fe2000cabf0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fe1f800cc70 tx=0x7fe1f800a430 comp rx=0 tx=0).stop 2024-05-27T12:34:26.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:26.303+0000 7fe20587c640 1 -- 172.21.15.55:0/2382109095 shutdown_connections 2024-05-27T12:34:26.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:26.303+0000 7fe20587c640 1 --2- 172.21.15.55:0/2382109095 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe20015eb00 0x7fe2000cabf0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:34:26.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:26.303+0000 7fe20587c640 1 --2- 172.21.15.55:0/2382109095 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fe1ec06c980 0x7fe1ec06ee40 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:34:26.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:26.303+0000 7fe20587c640 1 --2- 172.21.15.55:0/2382109095 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2000d3e50 0x7fe2001535e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:34:26.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:26.303+0000 7fe20587c640 1 --2- 172.21.15.55:0/2382109095 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe2000d1d70 0x7fe200161c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:34:26.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:26.303+0000 7fe20587c640 1 -- 172.21.15.55:0/2382109095 >> 172.21.15.55:0/2382109095 conn(0x7fe200067a50 msgr2=0x7fe2000d2df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:34:26.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:26.303+0000 7fe20587c640 1 -- 172.21.15.55:0/2382109095 shutdown_connections 2024-05-27T12:34:26.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:26.303+0000 7fe20587c640 1 -- 172.21.15.55:0/2382109095 wait complete. 2024-05-27T12:34:26.303 INFO:tasks.ceph.mgr.x.smithi072.stderr:2024-05-27T12:34:26.302+0000 7f91ed242640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-27T12:34:26.304 INFO:tasks.ceph.mgr.x.smithi072.stderr:2024-05-27T12:34:26.302+0000 7f91ed242640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-27T12:34:26.304 INFO:tasks.ceph.mgr.x.smithi072.stderr:2024-05-27T12:34:26.302+0000 7f91ed242640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-27T12:34:26.304 INFO:tasks.ceph.mgr.x.smithi072.stderr:2024-05-27T12:34:26.302+0000 7f91ed242640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-27T12:34:26.304 INFO:tasks.ceph.mgr.x.smithi072.stderr:2024-05-27T12:34:26.302+0000 7f91ed242640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-27T12:34:26.316 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-27T12:34:26.317 INFO:tasks.ceph.mgr.x.smithi072.stderr:2024-05-27T12:34:26.316+0000 7f91ee244640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-27T12:34:26.317 INFO:tasks.ceph.mgr.x.smithi072.stderr:2024-05-27T12:34:26.316+0000 7f91ee244640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-27T12:34:26.317 INFO:tasks.ceph.mgr.x.smithi072.stderr:2024-05-27T12:34:26.316+0000 7f91ee244640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-27T12:34:26.317 INFO:tasks.ceph.mgr.x.smithi072.stderr:2024-05-27T12:34:26.316+0000 7f91ee244640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-27T12:34:26.317 INFO:tasks.ceph.mgr.x.smithi072.stderr:2024-05-27T12:34:26.316+0000 7f91ee244640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-27T12:34:26.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:26.425+0000 7fea8d14b640 1 Processor -- start 2024-05-27T12:34:26.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:26.425+0000 7fea8d14b640 1 -- start start 2024-05-27T12:34:26.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:26.426+0000 7fea8d14b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fea8815eb00 0x7fea8815f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:34:26.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:26.426+0000 7fea8d14b640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fea880d1630 0x7fea8809aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:34:26.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:26.426+0000 7fea8d14b640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea880d08b0 con 0x7fea8809af70 2024-05-27T12:34:26.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:26.426+0000 7fea8d14b640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7fea880d1a50 con 0x7fea8815eb00 2024-05-27T12:34:26.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:26.426+0000 7fea8d14b640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fea880d0b50 con 0x7fea880d1630 2024-05-27T12:34:26.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:26.426+0000 7fea86d9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fea8815eb00 0x7fea8815f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:34:26.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:26.426+0000 7fea86d9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fea8815eb00 0x7fea8815f9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51218/0 (socket says 172.21.15.55:51218) 2024-05-27T12:34:26.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:26.426+0000 7fea86d9d640 1 -- 172.21.15.55:0/3471464150 learned_addr learned my addr 172.21.15.55:0/3471464150 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:34:26.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:26.426+0000 7fea7ffff640 1 --2- 172.21.15.55:0/3471464150 >> v2:172.21.15.72:3300/0 conn(0x7fea880d1630 0x7fea8809aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:34:26.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:26.426+0000 7fea86d9d640 1 -- 172.21.15.55:0/3471464150 >> v2:172.21.15.72:3300/0 conn(0x7fea880d1630 msgr2=0x7fea8809aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:34:26.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:26.426+0000 7fea86d9d640 1 --2- 172.21.15.55:0/3471464150 >> v2:172.21.15.72:3300/0 conn(0x7fea880d1630 0x7fea8809aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:34:26.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:26.426+0000 7fea86d9d640 1 -- 172.21.15.55:0/3471464150 >> v1:172.21.15.72:6789/0 conn(0x7fea8809af70 legacy=0x7fea8806cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:34:26.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:26.426+0000 7fea86d9d640 1 -- 172.21.15.55:0/3471464150 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea880d0e30 con 0x7fea8815eb00 2024-05-27T12:34:26.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:26.427+0000 7fea86d9d640 1 --2- 172.21.15.55:0/3471464150 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea8815eb00 0x7fea8815f9b0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fea880b5200 tx=0x7fea7802a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efaa34c160368fc server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:34:26.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:26.427+0000 7fea8659c640 1 -- 172.21.15.55:0/3471464150 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea78037070 con 0x7fea8815eb00 2024-05-27T12:34:26.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:26.427+0000 7fea8659c640 1 -- 172.21.15.55:0/3471464150 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea7802ae50 con 0x7fea8815eb00 2024-05-27T12:34:26.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:26.427+0000 7fea8659c640 1 -- 172.21.15.55:0/3471464150 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea78032860 con 0x7fea8815eb00 2024-05-27T12:34:26.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:26.427+0000 7fea8d14b640 1 -- 172.21.15.55:0/3471464150 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea8815eb00 msgr2=0x7fea8815f9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:34:26.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:26.427+0000 7fea8d14b640 1 --2- 172.21.15.55:0/3471464150 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea8815eb00 0x7fea8815f9b0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fea880b5200 tx=0x7fea7802a300 comp rx=0 tx=0).stop 2024-05-27T12:34:26.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:26.428+0000 7fea8d14b640 1 -- 172.21.15.55:0/3471464150 shutdown_connections 2024-05-27T12:34:26.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:26.428+0000 7fea8d14b640 1 --2- 172.21.15.55:0/3471464150 >> v2:172.21.15.72:3300/0 conn(0x7fea880d1630 0x7fea8809aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:34:26.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:26.428+0000 7fea8d14b640 1 --2- 172.21.15.55:0/3471464150 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea8815eb00 0x7fea8815f9b0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:34:26.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:26.428+0000 7fea8d14b640 1 -- 172.21.15.55:0/3471464150 >> 172.21.15.55:0/3471464150 conn(0x7fea880b4100 msgr2=0x7fea880b4510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:34:26.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:26.428+0000 7fea8d14b640 1 -- 172.21.15.55:0/3471464150 shutdown_connections 2024-05-27T12:34:26.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:26.428+0000 7fea8d14b640 1 -- 172.21.15.55:0/3471464150 wait complete. 2024-05-27T12:34:26.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:26.429+0000 7fea8d14b640 1 Processor -- start 2024-05-27T12:34:26.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:26.429+0000 7fea8d14b640 1 -- start start 2024-05-27T12:34:26.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:26.430+0000 7fea8d14b640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fea8809af70 0x7fea88156da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:34:26.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:26.430+0000 7fea8d14b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea880d1630 0x7fea880c6e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:34:26.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:26.430+0000 7fea8d14b640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fea8815eb00 0x7fea880cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:34:26.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:26.430+0000 7fea8d14b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7fea8809b3c0 con 0x7fea880d1630 2024-05-27T12:34:26.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:26.430+0000 7fea8d14b640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fea88160040 con 0x7fea8815eb00 2024-05-27T12:34:26.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:26.430+0000 7fea8d14b640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fea8809b540 con 0x7fea8809af70 2024-05-27T12:34:26.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:26.430+0000 7fea7ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea880d1630 0x7fea880c6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:34:26.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:26.430+0000 7fea7ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea880d1630 0x7fea880c6e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51222/0 (socket says 172.21.15.55:51222) 2024-05-27T12:34:26.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:26.430+0000 7fea7ffff640 1 -- 172.21.15.55:0/1083222070 learned_addr learned my addr 172.21.15.55:0/1083222070 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:34:26.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:26.430+0000 7fea86d9d640 1 --2- 172.21.15.55:0/1083222070 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fea8809af70 0x7fea88156da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:34:26.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:26.430+0000 7fea8759e640 1 --2- 172.21.15.55:0/1083222070 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fea8815eb00 0x7fea880cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:34:26.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:26.430+0000 7fea7ffff640 1 -- 172.21.15.55:0/1083222070 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fea8809af70 msgr2=0x7fea88156da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:34:26.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:26.430+0000 7fea7ffff640 1 --2- 172.21.15.55:0/1083222070 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fea8809af70 0x7fea88156da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:34:26.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:26.430+0000 7fea7ffff640 1 -- 172.21.15.55:0/1083222070 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fea8815eb00 msgr2=0x7fea880cefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:34:26.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:26.430+0000 7fea7ffff640 1 --2- 172.21.15.55:0/1083222070 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fea8815eb00 0x7fea880cefa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:34:26.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:26.430+0000 7fea7ffff640 1 -- 172.21.15.55:0/1083222070 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea880ccc40 con 0x7fea880d1630 2024-05-27T12:34:26.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:26.430+0000 7fea7ffff640 1 --2- 172.21.15.55:0/1083222070 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea880d1630 0x7fea880c6e30 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fea7000d830 tx=0x7fea7000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:34:26.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:26.430+0000 7fea7f7fe640 1 -- 172.21.15.55:0/1083222070 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea7000b6c0 con 0x7fea880d1630 2024-05-27T12:34:26.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:26.430+0000 7fea7f7fe640 1 -- 172.21.15.55:0/1083222070 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea70019070 con 0x7fea880d1630 2024-05-27T12:34:26.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:26.431+0000 7fea8d14b640 1 -- 172.21.15.55:0/1083222070 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea880c78a0 con 0x7fea880d1630 2024-05-27T12:34:26.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:26.431+0000 7fea7f7fe640 1 -- 172.21.15.55:0/1083222070 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea7000ba80 con 0x7fea880d1630 2024-05-27T12:34:26.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:26.431+0000 7fea8d14b640 1 -- 172.21.15.55:0/1083222070 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea880c7e60 con 0x7fea880d1630 2024-05-27T12:34:26.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:26.431+0000 7fea8d14b640 1 -- 172.21.15.55:0/1083222070 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea88075460 con 0x7fea880d1630 2024-05-27T12:34:26.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:26.432+0000 7fea7f7fe640 1 -- 172.21.15.55:0/1083222070 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 6) ==== 91091+0+0 (secure 0 0 0) 0x7fea7001e460 con 0x7fea880d1630 2024-05-27T12:34:26.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:26.432+0000 7fea7f7fe640 1 --2- 172.21.15.55:0/1083222070 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fea6806c9b0 0x7fea6806ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:34:26.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:26.433+0000 7fea7f7fe640 1 -- 172.21.15.55:0/1083222070 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5709+0+0 (secure 0 0 0) 0x7fea7008c2c0 con 0x7fea880d1630 2024-05-27T12:34:26.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:26.433+0000 7fea86d9d640 1 --2- 172.21.15.55:0/1083222070 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fea6806c9b0 0x7fea6806ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:34:26.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:26.433+0000 7fea86d9d640 1 --2- 172.21.15.55:0/1083222070 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fea6806c9b0 0x7fea6806ee70 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fea78034000 tx=0x7fea7802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:34:26.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:26.437+0000 7fea7f7fe640 1 -- 172.21.15.55:0/1083222070 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fea7005a690 con 0x7fea880d1630 2024-05-27T12:34:26.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:26.694+0000 7fea8d14b640 1 -- 172.21.15.55:0/1083222070 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fea880d0030 con 0x7fea880d1630 2024-05-27T12:34:26.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:26.694+0000 7fea7f7fe640 1 -- 172.21.15.55:0/1083222070 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+3267 (secure 0 0 0) 0x7fea70059f90 con 0x7fea880d1630 2024-05-27T12:34:26.693 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-27T12:34:26.694 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-05-27T12:34:26.694 INFO:teuthology.orchestra.run.smithi055.stdout: "fsid": "c3ff4e3b-8dae-4856-9593-e5cc66c59982", 2024-05-27T12:34:26.694 INFO:teuthology.orchestra.run.smithi055.stdout: "health": { 2024-05-27T12:34:26.694 INFO:teuthology.orchestra.run.smithi055.stdout: "status": "HEALTH_OK", 2024-05-27T12:34:26.694 INFO:teuthology.orchestra.run.smithi055.stdout: "checks": {}, 2024-05-27T12:34:26.694 INFO:teuthology.orchestra.run.smithi055.stdout: "mutes": [] 2024-05-27T12:34:26.694 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-05-27T12:34:26.694 INFO:teuthology.orchestra.run.smithi055.stdout: "election_epoch": 4, 2024-05-27T12:34:26.694 INFO:teuthology.orchestra.run.smithi055.stdout: "quorum": [ 2024-05-27T12:34:26.694 INFO:teuthology.orchestra.run.smithi055.stdout: 0, 2024-05-27T12:34:26.694 INFO:teuthology.orchestra.run.smithi055.stdout: 1, 2024-05-27T12:34:26.694 INFO:teuthology.orchestra.run.smithi055.stdout: 2 2024-05-27T12:34:26.694 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-05-27T12:34:26.695 INFO:teuthology.orchestra.run.smithi055.stdout: "quorum_names": [ 2024-05-27T12:34:26.695 INFO:teuthology.orchestra.run.smithi055.stdout: "a", 2024-05-27T12:34:26.695 INFO:teuthology.orchestra.run.smithi055.stdout: "b", 2024-05-27T12:34:26.695 INFO:teuthology.orchestra.run.smithi055.stdout: "c" 2024-05-27T12:34:26.695 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-05-27T12:34:26.695 INFO:teuthology.orchestra.run.smithi055.stdout: "quorum_age": 129, 2024-05-27T12:34:26.695 INFO:teuthology.orchestra.run.smithi055.stdout: "monmap": { 2024-05-27T12:34:26.695 INFO:teuthology.orchestra.run.smithi055.stdout: "epoch": 1, 2024-05-27T12:34:26.695 INFO:teuthology.orchestra.run.smithi055.stdout: "min_mon_release_name": "squid", 2024-05-27T12:34:26.695 INFO:teuthology.orchestra.run.smithi055.stdout: "num_mons": 3 2024-05-27T12:34:26.695 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-05-27T12:34:26.695 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap": { 2024-05-27T12:34:26.695 INFO:teuthology.orchestra.run.smithi055.stdout: "epoch": 36, 2024-05-27T12:34:26.695 INFO:teuthology.orchestra.run.smithi055.stdout: "num_osds": 8, 2024-05-27T12:34:26.696 INFO:teuthology.orchestra.run.smithi055.stdout: "num_up_osds": 8, 2024-05-27T12:34:26.696 INFO:teuthology.orchestra.run.smithi055.stdout: "osd_up_since": 1716813148, 2024-05-27T12:34:26.696 INFO:teuthology.orchestra.run.smithi055.stdout: "num_in_osds": 8, 2024-05-27T12:34:26.696 INFO:teuthology.orchestra.run.smithi055.stdout: "osd_in_since": 1716813139, 2024-05-27T12:34:26.696 INFO:teuthology.orchestra.run.smithi055.stdout: "num_remapped_pgs": 0 2024-05-27T12:34:26.696 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-05-27T12:34:26.696 INFO:teuthology.orchestra.run.smithi055.stdout: "pgmap": { 2024-05-27T12:34:26.696 INFO:teuthology.orchestra.run.smithi055.stdout: "pgs_by_state": [ 2024-05-27T12:34:26.696 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-05-27T12:34:26.696 INFO:teuthology.orchestra.run.smithi055.stdout: "state_name": "active+clean", 2024-05-27T12:34:26.696 INFO:teuthology.orchestra.run.smithi055.stdout: "count": 97 2024-05-27T12:34:26.696 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-05-27T12:34:26.696 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-05-27T12:34:26.696 INFO:teuthology.orchestra.run.smithi055.stdout: "num_pgs": 97, 2024-05-27T12:34:26.697 INFO:teuthology.orchestra.run.smithi055.stdout: "num_pools": 3, 2024-05-27T12:34:26.697 INFO:teuthology.orchestra.run.smithi055.stdout: "num_objects": 2572, 2024-05-27T12:34:26.697 INFO:teuthology.orchestra.run.smithi055.stdout: "data_bytes": 10683935380, 2024-05-27T12:34:26.697 INFO:teuthology.orchestra.run.smithi055.stdout: "bytes_used": 20967981056, 2024-05-27T12:34:26.697 INFO:teuthology.orchestra.run.smithi055.stdout: "bytes_avail": 752126132224, 2024-05-27T12:34:26.697 INFO:teuthology.orchestra.run.smithi055.stdout: "bytes_total": 773094113280, 2024-05-27T12:34:26.697 INFO:teuthology.orchestra.run.smithi055.stdout: "write_bytes_sec": 311020345, 2024-05-27T12:34:26.697 INFO:teuthology.orchestra.run.smithi055.stdout: "read_op_per_sec": 0, 2024-05-27T12:34:26.697 INFO:teuthology.orchestra.run.smithi055.stdout: "write_op_per_sec": 77 2024-05-27T12:34:26.697 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-05-27T12:34:26.697 INFO:teuthology.orchestra.run.smithi055.stdout: "fsmap": { 2024-05-27T12:34:26.697 INFO:teuthology.orchestra.run.smithi055.stdout: "epoch": 15, 2024-05-27T12:34:26.697 INFO:teuthology.orchestra.run.smithi055.stdout: "id": 2, 2024-05-27T12:34:26.697 INFO:teuthology.orchestra.run.smithi055.stdout: "up": 1, 2024-05-27T12:34:26.698 INFO:teuthology.orchestra.run.smithi055.stdout: "in": 1, 2024-05-27T12:34:26.698 INFO:teuthology.orchestra.run.smithi055.stdout: "max": 1, 2024-05-27T12:34:26.698 INFO:teuthology.orchestra.run.smithi055.stdout: "by_rank": [ 2024-05-27T12:34:26.698 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-05-27T12:34:26.698 INFO:teuthology.orchestra.run.smithi055.stdout: "filesystem_id": 2, 2024-05-27T12:34:26.698 INFO:teuthology.orchestra.run.smithi055.stdout: "rank": 0, 2024-05-27T12:34:26.698 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "a", 2024-05-27T12:34:26.698 INFO:teuthology.orchestra.run.smithi055.stdout: "status": "up:active", 2024-05-27T12:34:26.698 INFO:teuthology.orchestra.run.smithi055.stdout: "gid": 5151 2024-05-27T12:34:26.698 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-05-27T12:34:26.698 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-05-27T12:34:26.698 INFO:teuthology.orchestra.run.smithi055.stdout: "up:standby": 3 2024-05-27T12:34:26.698 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-05-27T12:34:26.698 INFO:teuthology.orchestra.run.smithi055.stdout: "mgrmap": { 2024-05-27T12:34:26.699 INFO:teuthology.orchestra.run.smithi055.stdout: "available": true, 2024-05-27T12:34:26.699 INFO:teuthology.orchestra.run.smithi055.stdout: "num_standbys": 1, 2024-05-27T12:34:26.699 INFO:teuthology.orchestra.run.smithi055.stdout: "modules": [ 2024-05-27T12:34:26.699 INFO:teuthology.orchestra.run.smithi055.stdout: "iostat", 2024-05-27T12:34:26.699 INFO:teuthology.orchestra.run.smithi055.stdout: "nfs", 2024-05-27T12:34:26.699 INFO:teuthology.orchestra.run.smithi055.stdout: "restful" 2024-05-27T12:34:26.699 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-05-27T12:34:26.699 INFO:teuthology.orchestra.run.smithi055.stdout: "services": {} 2024-05-27T12:34:26.699 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-05-27T12:34:26.699 INFO:teuthology.orchestra.run.smithi055.stdout: "servicemap": { 2024-05-27T12:34:26.700 INFO:teuthology.orchestra.run.smithi055.stdout: "epoch": 3, 2024-05-27T12:34:26.700 INFO:teuthology.orchestra.run.smithi055.stdout: "modified": "2024-05-27T12:33:29.273941+0000", 2024-05-27T12:34:26.700 INFO:teuthology.orchestra.run.smithi055.stdout: "services": { 2024-05-27T12:34:26.700 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": { 2024-05-27T12:34:26.700 INFO:teuthology.orchestra.run.smithi055.stdout: "daemons": { 2024-05-27T12:34:26.700 INFO:teuthology.orchestra.run.smithi055.stdout: "summary": "", 2024-05-27T12:34:26.700 INFO:teuthology.orchestra.run.smithi055.stdout: "a": { 2024-05-27T12:34:26.700 INFO:teuthology.orchestra.run.smithi055.stdout: "start_epoch": 0, 2024-05-27T12:34:26.700 INFO:teuthology.orchestra.run.smithi055.stdout: "start_stamp": "0.000000", 2024-05-27T12:34:26.700 INFO:teuthology.orchestra.run.smithi055.stdout: "gid": 0, 2024-05-27T12:34:26.700 INFO:teuthology.orchestra.run.smithi055.stdout: "addr": "(unrecognized address family 0)/0", 2024-05-27T12:34:26.700 INFO:teuthology.orchestra.run.smithi055.stdout: "metadata": {}, 2024-05-27T12:34:26.700 INFO:teuthology.orchestra.run.smithi055.stdout: "task_status": {} 2024-05-27T12:34:26.700 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-05-27T12:34:26.701 INFO:teuthology.orchestra.run.smithi055.stdout: "b": { 2024-05-27T12:34:26.701 INFO:teuthology.orchestra.run.smithi055.stdout: "start_epoch": 0, 2024-05-27T12:34:26.701 INFO:teuthology.orchestra.run.smithi055.stdout: "start_stamp": "0.000000", 2024-05-27T12:34:26.701 INFO:teuthology.orchestra.run.smithi055.stdout: "gid": 0, 2024-05-27T12:34:26.701 INFO:teuthology.orchestra.run.smithi055.stdout: "addr": "(unrecognized address family 0)/0", 2024-05-27T12:34:26.701 INFO:teuthology.orchestra.run.smithi055.stdout: "metadata": {}, 2024-05-27T12:34:26.701 INFO:teuthology.orchestra.run.smithi055.stdout: "task_status": {} 2024-05-27T12:34:26.701 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-05-27T12:34:26.701 INFO:teuthology.orchestra.run.smithi055.stdout: "c": { 2024-05-27T12:34:26.701 INFO:teuthology.orchestra.run.smithi055.stdout: "start_epoch": 0, 2024-05-27T12:34:26.701 INFO:teuthology.orchestra.run.smithi055.stdout: "start_stamp": "0.000000", 2024-05-27T12:34:26.701 INFO:teuthology.orchestra.run.smithi055.stdout: "gid": 0, 2024-05-27T12:34:26.701 INFO:teuthology.orchestra.run.smithi055.stdout: "addr": "(unrecognized address family 0)/0", 2024-05-27T12:34:26.701 INFO:teuthology.orchestra.run.smithi055.stdout: "metadata": {}, 2024-05-27T12:34:26.702 INFO:teuthology.orchestra.run.smithi055.stdout: "task_status": {} 2024-05-27T12:34:26.702 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-05-27T12:34:26.702 INFO:teuthology.orchestra.run.smithi055.stdout: "d": { 2024-05-27T12:34:26.702 INFO:teuthology.orchestra.run.smithi055.stdout: "start_epoch": 0, 2024-05-27T12:34:26.702 INFO:teuthology.orchestra.run.smithi055.stdout: "start_stamp": "0.000000", 2024-05-27T12:34:26.702 INFO:teuthology.orchestra.run.smithi055.stdout: "gid": 0, 2024-05-27T12:34:26.702 INFO:teuthology.orchestra.run.smithi055.stdout: "addr": "(unrecognized address family 0)/0", 2024-05-27T12:34:26.702 INFO:teuthology.orchestra.run.smithi055.stdout: "metadata": {}, 2024-05-27T12:34:26.702 INFO:teuthology.orchestra.run.smithi055.stdout: "task_status": {} 2024-05-27T12:34:26.702 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-05-27T12:34:26.702 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-05-27T12:34:26.702 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-05-27T12:34:26.702 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-05-27T12:34:26.702 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-05-27T12:34:26.702 INFO:teuthology.orchestra.run.smithi055.stdout: "progress_events": {} 2024-05-27T12:34:26.703 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-05-27T12:34:26.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:26.696+0000 7fea8d14b640 1 -- 172.21.15.55:0/1083222070 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fea6806c9b0 msgr2=0x7fea6806ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:34:26.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:26.696+0000 7fea8d14b640 1 --2- 172.21.15.55:0/1083222070 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fea6806c9b0 0x7fea6806ee70 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fea78034000 tx=0x7fea7802e000 comp rx=0 tx=0).stop 2024-05-27T12:34:26.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:26.696+0000 7fea8d14b640 1 -- 172.21.15.55:0/1083222070 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea880d1630 msgr2=0x7fea880c6e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:34:26.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:26.696+0000 7fea8d14b640 1 --2- 172.21.15.55:0/1083222070 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea880d1630 0x7fea880c6e30 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fea7000d830 tx=0x7fea7000dcf0 comp rx=0 tx=0).stop 2024-05-27T12:34:26.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:26.696+0000 7fea8d14b640 1 -- 172.21.15.55:0/1083222070 shutdown_connections 2024-05-27T12:34:26.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:26.696+0000 7fea8d14b640 1 --2- 172.21.15.55:0/1083222070 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fea6806c9b0 0x7fea6806ee70 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:34:26.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:26.696+0000 7fea8d14b640 1 --2- 172.21.15.55:0/1083222070 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fea8815eb00 0x7fea880cefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:34:26.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:26.696+0000 7fea8d14b640 1 --2- 172.21.15.55:0/1083222070 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea880d1630 0x7fea880c6e30 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:34:26.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:26.696+0000 7fea8d14b640 1 --2- 172.21.15.55:0/1083222070 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fea8809af70 0x7fea88156da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:34:26.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:26.696+0000 7fea8d14b640 1 -- 172.21.15.55:0/1083222070 >> 172.21.15.55:0/1083222070 conn(0x7fea880b4100 msgr2=0x7fea880b3030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:34:26.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:26.696+0000 7fea8d14b640 1 -- 172.21.15.55:0/1083222070 shutdown_connections 2024-05-27T12:34:26.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:26.696+0000 7fea8d14b640 1 -- 172.21.15.55:0/1083222070 wait complete. 2024-05-27T12:34:28.708 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-27T12:34:28.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:28.826+0000 7f08a5744640 1 Processor -- start 2024-05-27T12:34:28.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:28.826+0000 7f08a5744640 1 -- start start 2024-05-27T12:34:28.826 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:28.826+0000 7f08a5744640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f08a015e960 0x7f08a006e740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:34:28.826 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:28.826+0000 7f08a5744640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f08a006ec80 0x7f08a00ae780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:34:28.826 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:28.826+0000 7f08a5744640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08a015ed40 con 0x7f08a00aecc0 2024-05-27T12:34:28.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:28.826+0000 7f08a5744640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f08a00b5170 con 0x7f08a015e960 2024-05-27T12:34:28.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:28.826+0000 7f08a5744640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f08a0073a20 con 0x7f08a006ec80 2024-05-27T12:34:28.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:28.827+0000 7f089effd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f08a015e960 0x7f08a006e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:34:28.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:28.827+0000 7f089effd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f08a015e960 0x7f08a006e740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51228/0 (socket says 172.21.15.55:51228) 2024-05-27T12:34:28.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:28.827+0000 7f089effd640 1 -- 172.21.15.55:0/1114954470 learned_addr learned my addr 172.21.15.55:0/1114954470 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:34:28.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:28.827+0000 7f089e7fc640 1 --2- 172.21.15.55:0/1114954470 >> v2:172.21.15.72:3300/0 conn(0x7f08a006ec80 0x7f08a00ae780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:34:28.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:28.827+0000 7f089effd640 1 -- 172.21.15.55:0/1114954470 >> v2:172.21.15.72:3300/0 conn(0x7f08a006ec80 msgr2=0x7f08a00ae780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:34:28.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:28.827+0000 7f089effd640 1 --2- 172.21.15.55:0/1114954470 >> v2:172.21.15.72:3300/0 conn(0x7f08a006ec80 0x7f08a00ae780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:34:28.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:28.827+0000 7f089effd640 1 -- 172.21.15.55:0/1114954470 >> v1:172.21.15.72:6789/0 conn(0x7f08a00aecc0 legacy=0x7f08a006c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:34:28.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:28.827+0000 7f089effd640 1 -- 172.21.15.55:0/1114954470 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08a00b4840 con 0x7f08a015e960 2024-05-27T12:34:28.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:28.827+0000 7f089e7fc640 1 --2- 172.21.15.55:0/1114954470 >> v2:172.21.15.72:3300/0 conn(0x7f08a006ec80 0x7f08a00ae780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T12:34:28.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:28.828+0000 7f089effd640 1 --2- 172.21.15.55:0/1114954470 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f08a015e960 0x7f08a006e740 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f08a009eeb0 tx=0x7f089802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=807c8ba0df75cd3b server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:34:28.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:28.828+0000 7f089dffb640 1 -- 172.21.15.55:0/1114954470 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0898036070 con 0x7f08a015e960 2024-05-27T12:34:28.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:28.828+0000 7f089dffb640 1 -- 172.21.15.55:0/1114954470 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0898031600 con 0x7f08a015e960 2024-05-27T12:34:28.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:28.828+0000 7f089dffb640 1 -- 172.21.15.55:0/1114954470 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08980319d0 con 0x7f08a015e960 2024-05-27T12:34:28.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:28.829+0000 7f08a5744640 1 -- 172.21.15.55:0/1114954470 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f08a015e960 msgr2=0x7f08a006e740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:34:28.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:28.829+0000 7f08a5744640 1 --2- 172.21.15.55:0/1114954470 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f08a015e960 0x7f08a006e740 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f08a009eeb0 tx=0x7f089802a660 comp rx=0 tx=0).stop 2024-05-27T12:34:28.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:28.829+0000 7f08a5744640 1 -- 172.21.15.55:0/1114954470 shutdown_connections 2024-05-27T12:34:28.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:28.829+0000 7f08a5744640 1 --2- 172.21.15.55:0/1114954470 >> v2:172.21.15.72:3300/0 conn(0x7f08a006ec80 0x7f08a00ae780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:34:28.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:28.829+0000 7f08a5744640 1 --2- 172.21.15.55:0/1114954470 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f08a015e960 0x7f08a006e740 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:34:28.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:28.829+0000 7f08a5744640 1 -- 172.21.15.55:0/1114954470 >> 172.21.15.55:0/1114954470 conn(0x7f08a00727b0 msgr2=0x7f08a0072bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:34:28.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:28.829+0000 7f08a5744640 1 -- 172.21.15.55:0/1114954470 shutdown_connections 2024-05-27T12:34:28.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:28.829+0000 7f08a5744640 1 -- 172.21.15.55:0/1114954470 wait complete. 2024-05-27T12:34:28.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:28.830+0000 7f08a5744640 1 Processor -- start 2024-05-27T12:34:28.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:28.830+0000 7f08a5744640 1 -- start start 2024-05-27T12:34:28.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:28.831+0000 7f08a5744640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f08a006ec80 0x7f08a01ea220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:34:28.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:28.831+0000 7f08a5744640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f08a00aecc0 0x7f08a0160990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:34:28.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:28.831+0000 7f08a5744640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f08a015e960 0x7f08a01f4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:34:28.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:28.831+0000 7f08a5744640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f08a00af2f0 con 0x7f08a006ec80 2024-05-27T12:34:28.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:28.831+0000 7f08a5744640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f08a00b4e00 con 0x7f08a015e960 2024-05-27T12:34:28.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:28.831+0000 7f08a5744640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f08a006d050 con 0x7f08a00aecc0 2024-05-27T12:34:28.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:28.831+0000 7f089effd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f08a006ec80 0x7f08a01ea220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:34:28.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:28.831+0000 7f089effd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f08a006ec80 0x7f08a01ea220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51238/0 (socket says 172.21.15.55:51238) 2024-05-27T12:34:28.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:28.831+0000 7f089effd640 1 -- 172.21.15.55:0/3777672639 learned_addr learned my addr 172.21.15.55:0/3777672639 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:34:28.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:28.831+0000 7f089f7fe640 1 --2- 172.21.15.55:0/3777672639 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f08a015e960 0x7f08a01f4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:34:28.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:28.831+0000 7f089e7fc640 1 --2- 172.21.15.55:0/3777672639 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f08a00aecc0 0x7f08a0160990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:34:28.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:28.831+0000 7f089effd640 1 -- 172.21.15.55:0/3777672639 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f08a00aecc0 msgr2=0x7f08a0160990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:34:28.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:28.831+0000 7f089effd640 1 --2- 172.21.15.55:0/3777672639 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f08a00aecc0 0x7f08a0160990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:34:28.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:28.831+0000 7f089effd640 1 -- 172.21.15.55:0/3777672639 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f08a015e960 msgr2=0x7f08a01f4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:34:28.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:28.831+0000 7f089effd640 1 --2- 172.21.15.55:0/3777672639 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f08a015e960 0x7f08a01f4ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:34:28.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:28.831+0000 7f089effd640 1 -- 172.21.15.55:0/3777672639 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08a0161410 con 0x7f08a006ec80 2024-05-27T12:34:28.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:28.831+0000 7f089e7fc640 1 --2- 172.21.15.55:0/3777672639 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f08a00aecc0 0x7f08a0160990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T12:34:28.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:28.832+0000 7f089effd640 1 --2- 172.21.15.55:0/3777672639 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f08a006ec80 0x7f08a01ea220 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f0898034040 tx=0x7f0898004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:34:28.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:28.832+0000 7f08977fe640 1 -- 172.21.15.55:0/3777672639 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0898036050 con 0x7f08a006ec80 2024-05-27T12:34:28.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:28.832+0000 7f08977fe640 1 -- 172.21.15.55:0/3777672639 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0898042070 con 0x7f08a006ec80 2024-05-27T12:34:28.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:28.832+0000 7f08a5744640 1 -- 172.21.15.55:0/3777672639 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08a01616f0 con 0x7f08a006ec80 2024-05-27T12:34:28.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:28.832+0000 7f08977fe640 1 -- 172.21.15.55:0/3777672639 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0898009510 con 0x7f08a006ec80 2024-05-27T12:34:28.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:28.832+0000 7f08a5744640 1 -- 172.21.15.55:0/3777672639 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08a015ccc0 con 0x7f08a006ec80 2024-05-27T12:34:28.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:28.833+0000 7f08a5744640 1 -- 172.21.15.55:0/3777672639 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08a00b1c40 con 0x7f08a006ec80 2024-05-27T12:34:28.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:28.833+0000 7f08977fe640 1 -- 172.21.15.55:0/3777672639 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 7) ==== 91193+0+0 (secure 0 0 0) 0x7f0898007c50 con 0x7f08a006ec80 2024-05-27T12:34:28.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:28.834+0000 7f08977fe640 1 --2- 172.21.15.55:0/3777672639 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f088006caa0 0x7f088006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:34:28.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:28.834+0000 7f08977fe640 1 -- 172.21.15.55:0/3777672639 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5709+0+0 (secure 0 0 0) 0x7f08980acf50 con 0x7f08a006ec80 2024-05-27T12:34:28.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:28.834+0000 7f089e7fc640 1 --2- 172.21.15.55:0/3777672639 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f088006caa0 0x7f088006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:34:28.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:28.835+0000 7f089e7fc640 1 --2- 172.21.15.55:0/3777672639 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f088006caa0 0x7f088006ef60 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f0888006fd0 tx=0x7f0888008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:34:28.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:28.838+0000 7f08977fe640 1 -- 172.21.15.55:0/3777672639 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f08a00b1c40 con 0x7f08a006ec80 2024-05-27T12:34:29.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:29.100+0000 7f08a5744640 1 -- 172.21.15.55:0/3777672639 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f08a0075460 con 0x7f08a006ec80 2024-05-27T12:34:29.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:29.100+0000 7f08977fe640 1 -- 172.21.15.55:0/3777672639 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+3267 (secure 0 0 0) 0x7f089807b080 con 0x7f08a006ec80 2024-05-27T12:34:29.100 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-27T12:34:29.100 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-05-27T12:34:29.100 INFO:teuthology.orchestra.run.smithi055.stdout: "fsid": "c3ff4e3b-8dae-4856-9593-e5cc66c59982", 2024-05-27T12:34:29.100 INFO:teuthology.orchestra.run.smithi055.stdout: "health": { 2024-05-27T12:34:29.100 INFO:teuthology.orchestra.run.smithi055.stdout: "status": "HEALTH_OK", 2024-05-27T12:34:29.100 INFO:teuthology.orchestra.run.smithi055.stdout: "checks": {}, 2024-05-27T12:34:29.100 INFO:teuthology.orchestra.run.smithi055.stdout: "mutes": [] 2024-05-27T12:34:29.100 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-05-27T12:34:29.101 INFO:teuthology.orchestra.run.smithi055.stdout: "election_epoch": 4, 2024-05-27T12:34:29.101 INFO:teuthology.orchestra.run.smithi055.stdout: "quorum": [ 2024-05-27T12:34:29.101 INFO:teuthology.orchestra.run.smithi055.stdout: 0, 2024-05-27T12:34:29.101 INFO:teuthology.orchestra.run.smithi055.stdout: 1, 2024-05-27T12:34:29.101 INFO:teuthology.orchestra.run.smithi055.stdout: 2 2024-05-27T12:34:29.101 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-05-27T12:34:29.101 INFO:teuthology.orchestra.run.smithi055.stdout: "quorum_names": [ 2024-05-27T12:34:29.101 INFO:teuthology.orchestra.run.smithi055.stdout: "a", 2024-05-27T12:34:29.101 INFO:teuthology.orchestra.run.smithi055.stdout: "b", 2024-05-27T12:34:29.101 INFO:teuthology.orchestra.run.smithi055.stdout: "c" 2024-05-27T12:34:29.101 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-05-27T12:34:29.101 INFO:teuthology.orchestra.run.smithi055.stdout: "quorum_age": 132, 2024-05-27T12:34:29.101 INFO:teuthology.orchestra.run.smithi055.stdout: "monmap": { 2024-05-27T12:34:29.101 INFO:teuthology.orchestra.run.smithi055.stdout: "epoch": 1, 2024-05-27T12:34:29.102 INFO:teuthology.orchestra.run.smithi055.stdout: "min_mon_release_name": "squid", 2024-05-27T12:34:29.102 INFO:teuthology.orchestra.run.smithi055.stdout: "num_mons": 3 2024-05-27T12:34:29.102 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-05-27T12:34:29.102 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap": { 2024-05-27T12:34:29.102 INFO:teuthology.orchestra.run.smithi055.stdout: "epoch": 36, 2024-05-27T12:34:29.102 INFO:teuthology.orchestra.run.smithi055.stdout: "num_osds": 8, 2024-05-27T12:34:29.102 INFO:teuthology.orchestra.run.smithi055.stdout: "num_up_osds": 8, 2024-05-27T12:34:29.102 INFO:teuthology.orchestra.run.smithi055.stdout: "osd_up_since": 1716813148, 2024-05-27T12:34:29.102 INFO:teuthology.orchestra.run.smithi055.stdout: "num_in_osds": 8, 2024-05-27T12:34:29.102 INFO:teuthology.orchestra.run.smithi055.stdout: "osd_in_since": 1716813139, 2024-05-27T12:34:29.102 INFO:teuthology.orchestra.run.smithi055.stdout: "num_remapped_pgs": 0 2024-05-27T12:34:29.102 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-05-27T12:34:29.102 INFO:teuthology.orchestra.run.smithi055.stdout: "pgmap": { 2024-05-27T12:34:29.103 INFO:teuthology.orchestra.run.smithi055.stdout: "pgs_by_state": [ 2024-05-27T12:34:29.103 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-05-27T12:34:29.103 INFO:teuthology.orchestra.run.smithi055.stdout: "state_name": "active+clean", 2024-05-27T12:34:29.103 INFO:teuthology.orchestra.run.smithi055.stdout: "count": 97 2024-05-27T12:34:29.103 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-05-27T12:34:29.103 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-05-27T12:34:29.103 INFO:teuthology.orchestra.run.smithi055.stdout: "num_pgs": 97, 2024-05-27T12:34:29.103 INFO:teuthology.orchestra.run.smithi055.stdout: "num_pools": 3, 2024-05-27T12:34:29.103 INFO:teuthology.orchestra.run.smithi055.stdout: "num_objects": 2572, 2024-05-27T12:34:29.103 INFO:teuthology.orchestra.run.smithi055.stdout: "data_bytes": 10683935380, 2024-05-27T12:34:29.103 INFO:teuthology.orchestra.run.smithi055.stdout: "bytes_used": 20967981056, 2024-05-27T12:34:29.103 INFO:teuthology.orchestra.run.smithi055.stdout: "bytes_avail": 752126132224, 2024-05-27T12:34:29.103 INFO:teuthology.orchestra.run.smithi055.stdout: "bytes_total": 773094113280, 2024-05-27T12:34:29.103 INFO:teuthology.orchestra.run.smithi055.stdout: "write_bytes_sec": 263838282, 2024-05-27T12:34:29.103 INFO:teuthology.orchestra.run.smithi055.stdout: "read_op_per_sec": 0, 2024-05-27T12:34:29.104 INFO:teuthology.orchestra.run.smithi055.stdout: "write_op_per_sec": 66 2024-05-27T12:34:29.104 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-05-27T12:34:29.104 INFO:teuthology.orchestra.run.smithi055.stdout: "fsmap": { 2024-05-27T12:34:29.104 INFO:teuthology.orchestra.run.smithi055.stdout: "epoch": 15, 2024-05-27T12:34:29.104 INFO:teuthology.orchestra.run.smithi055.stdout: "id": 2, 2024-05-27T12:34:29.104 INFO:teuthology.orchestra.run.smithi055.stdout: "up": 1, 2024-05-27T12:34:29.104 INFO:teuthology.orchestra.run.smithi055.stdout: "in": 1, 2024-05-27T12:34:29.104 INFO:teuthology.orchestra.run.smithi055.stdout: "max": 1, 2024-05-27T12:34:29.104 INFO:teuthology.orchestra.run.smithi055.stdout: "by_rank": [ 2024-05-27T12:34:29.104 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-05-27T12:34:29.104 INFO:teuthology.orchestra.run.smithi055.stdout: "filesystem_id": 2, 2024-05-27T12:34:29.104 INFO:teuthology.orchestra.run.smithi055.stdout: "rank": 0, 2024-05-27T12:34:29.104 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "a", 2024-05-27T12:34:29.105 INFO:teuthology.orchestra.run.smithi055.stdout: "status": "up:active", 2024-05-27T12:34:29.105 INFO:teuthology.orchestra.run.smithi055.stdout: "gid": 5151 2024-05-27T12:34:29.105 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-05-27T12:34:29.105 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-05-27T12:34:29.105 INFO:teuthology.orchestra.run.smithi055.stdout: "up:standby": 3 2024-05-27T12:34:29.105 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-05-27T12:34:29.105 INFO:teuthology.orchestra.run.smithi055.stdout: "mgrmap": { 2024-05-27T12:34:29.105 INFO:teuthology.orchestra.run.smithi055.stdout: "available": true, 2024-05-27T12:34:29.105 INFO:teuthology.orchestra.run.smithi055.stdout: "num_standbys": 1, 2024-05-27T12:34:29.105 INFO:teuthology.orchestra.run.smithi055.stdout: "modules": [ 2024-05-27T12:34:29.105 INFO:teuthology.orchestra.run.smithi055.stdout: "iostat", 2024-05-27T12:34:29.105 INFO:teuthology.orchestra.run.smithi055.stdout: "nfs", 2024-05-27T12:34:29.105 INFO:teuthology.orchestra.run.smithi055.stdout: "restful" 2024-05-27T12:34:29.105 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-05-27T12:34:29.106 INFO:teuthology.orchestra.run.smithi055.stdout: "services": {} 2024-05-27T12:34:29.106 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-05-27T12:34:29.106 INFO:teuthology.orchestra.run.smithi055.stdout: "servicemap": { 2024-05-27T12:34:29.106 INFO:teuthology.orchestra.run.smithi055.stdout: "epoch": 3, 2024-05-27T12:34:29.106 INFO:teuthology.orchestra.run.smithi055.stdout: "modified": "2024-05-27T12:33:29.273941+0000", 2024-05-27T12:34:29.106 INFO:teuthology.orchestra.run.smithi055.stdout: "services": { 2024-05-27T12:34:29.106 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": { 2024-05-27T12:34:29.106 INFO:teuthology.orchestra.run.smithi055.stdout: "daemons": { 2024-05-27T12:34:29.106 INFO:teuthology.orchestra.run.smithi055.stdout: "summary": "", 2024-05-27T12:34:29.106 INFO:teuthology.orchestra.run.smithi055.stdout: "a": { 2024-05-27T12:34:29.106 INFO:teuthology.orchestra.run.smithi055.stdout: "start_epoch": 0, 2024-05-27T12:34:29.106 INFO:teuthology.orchestra.run.smithi055.stdout: "start_stamp": "0.000000", 2024-05-27T12:34:29.106 INFO:teuthology.orchestra.run.smithi055.stdout: "gid": 0, 2024-05-27T12:34:29.106 INFO:teuthology.orchestra.run.smithi055.stdout: "addr": "(unrecognized address family 0)/0", 2024-05-27T12:34:29.107 INFO:teuthology.orchestra.run.smithi055.stdout: "metadata": {}, 2024-05-27T12:34:29.107 INFO:teuthology.orchestra.run.smithi055.stdout: "task_status": {} 2024-05-27T12:34:29.107 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-05-27T12:34:29.107 INFO:teuthology.orchestra.run.smithi055.stdout: "b": { 2024-05-27T12:34:29.107 INFO:teuthology.orchestra.run.smithi055.stdout: "start_epoch": 0, 2024-05-27T12:34:29.107 INFO:teuthology.orchestra.run.smithi055.stdout: "start_stamp": "0.000000", 2024-05-27T12:34:29.107 INFO:teuthology.orchestra.run.smithi055.stdout: "gid": 0, 2024-05-27T12:34:29.107 INFO:teuthology.orchestra.run.smithi055.stdout: "addr": "(unrecognized address family 0)/0", 2024-05-27T12:34:29.107 INFO:teuthology.orchestra.run.smithi055.stdout: "metadata": {}, 2024-05-27T12:34:29.107 INFO:teuthology.orchestra.run.smithi055.stdout: "task_status": {} 2024-05-27T12:34:29.107 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-05-27T12:34:29.107 INFO:teuthology.orchestra.run.smithi055.stdout: "c": { 2024-05-27T12:34:29.107 INFO:teuthology.orchestra.run.smithi055.stdout: "start_epoch": 0, 2024-05-27T12:34:29.107 INFO:teuthology.orchestra.run.smithi055.stdout: "start_stamp": "0.000000", 2024-05-27T12:34:29.108 INFO:teuthology.orchestra.run.smithi055.stdout: "gid": 0, 2024-05-27T12:34:29.108 INFO:teuthology.orchestra.run.smithi055.stdout: "addr": "(unrecognized address family 0)/0", 2024-05-27T12:34:29.108 INFO:teuthology.orchestra.run.smithi055.stdout: "metadata": {}, 2024-05-27T12:34:29.108 INFO:teuthology.orchestra.run.smithi055.stdout: "task_status": {} 2024-05-27T12:34:29.108 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-05-27T12:34:29.108 INFO:teuthology.orchestra.run.smithi055.stdout: "d": { 2024-05-27T12:34:29.108 INFO:teuthology.orchestra.run.smithi055.stdout: "start_epoch": 0, 2024-05-27T12:34:29.108 INFO:teuthology.orchestra.run.smithi055.stdout: "start_stamp": "0.000000", 2024-05-27T12:34:29.108 INFO:teuthology.orchestra.run.smithi055.stdout: "gid": 0, 2024-05-27T12:34:29.108 INFO:teuthology.orchestra.run.smithi055.stdout: "addr": "(unrecognized address family 0)/0", 2024-05-27T12:34:29.108 INFO:teuthology.orchestra.run.smithi055.stdout: "metadata": {}, 2024-05-27T12:34:29.108 INFO:teuthology.orchestra.run.smithi055.stdout: "task_status": {} 2024-05-27T12:34:29.108 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-05-27T12:34:29.108 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-05-27T12:34:29.108 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-05-27T12:34:29.109 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-05-27T12:34:29.109 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-05-27T12:34:29.109 INFO:teuthology.orchestra.run.smithi055.stdout: "progress_events": {} 2024-05-27T12:34:29.109 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-05-27T12:34:29.110 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:29.102+0000 7f08a5744640 1 -- 172.21.15.55:0/3777672639 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f088006caa0 msgr2=0x7f088006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:34:29.110 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:29.102+0000 7f08a5744640 1 --2- 172.21.15.55:0/3777672639 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f088006caa0 0x7f088006ef60 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f0888006fd0 tx=0x7f0888008040 comp rx=0 tx=0).stop 2024-05-27T12:34:29.110 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:29.102+0000 7f08a5744640 1 -- 172.21.15.55:0/3777672639 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f08a006ec80 msgr2=0x7f08a01ea220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:34:29.110 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:29.102+0000 7f08a5744640 1 --2- 172.21.15.55:0/3777672639 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f08a006ec80 0x7f08a01ea220 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f0898034040 tx=0x7f0898004a40 comp rx=0 tx=0).stop 2024-05-27T12:34:29.110 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:29.102+0000 7f08a5744640 1 -- 172.21.15.55:0/3777672639 shutdown_connections 2024-05-27T12:34:29.110 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:29.102+0000 7f08a5744640 1 --2- 172.21.15.55:0/3777672639 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f088006caa0 0x7f088006ef60 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:34:29.110 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:29.102+0000 7f08a5744640 1 --2- 172.21.15.55:0/3777672639 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f08a015e960 0x7f08a01f4ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:34:29.110 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:29.102+0000 7f08a5744640 1 --2- 172.21.15.55:0/3777672639 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f08a00aecc0 0x7f08a0160990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:34:29.110 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:29.102+0000 7f08a5744640 1 --2- 172.21.15.55:0/3777672639 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f08a006ec80 0x7f08a01ea220 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:34:29.110 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:29.102+0000 7f08a5744640 1 -- 172.21.15.55:0/3777672639 >> 172.21.15.55:0/3777672639 conn(0x7f08a00727b0 msgr2=0x7f08a00b1e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:34:29.110 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:29.103+0000 7f08a5744640 1 -- 172.21.15.55:0/3777672639 shutdown_connections 2024-05-27T12:34:29.110 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:29.103+0000 7f08a5744640 1 -- 172.21.15.55:0/3777672639 wait complete. 2024-05-27T12:34:31.115 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-27T12:34:31.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:31.267+0000 7f46db635640 1 Processor -- start 2024-05-27T12:34:31.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:31.267+0000 7f46db635640 1 -- start start 2024-05-27T12:34:31.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:31.268+0000 7f46db635640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f46d4070c70 0x7f46d40701b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:34:31.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:31.268+0000 7f46db635640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f46d415dd90 0x7f46d415e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:34:31.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:31.268+0000 7f46db635640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46d40b3ad0 con 0x7f46d415f480 2024-05-27T12:34:31.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:31.268+0000 7f46db635640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f46d41603c0 con 0x7f46d415dd90 2024-05-27T12:34:31.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:31.268+0000 7f46db635640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f46d41600e0 con 0x7f46d4070c70 2024-05-27T12:34:31.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:31.271+0000 7f46d9bd2640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f46d415dd90 0x7f46d415e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:34:31.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:31.271+0000 7f46d9bd2640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f46d415dd90 0x7f46d415e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.55:45654/0 (socket says 172.21.15.55:45654) 2024-05-27T12:34:31.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:31.271+0000 7f46d9bd2640 1 -- 172.21.15.55:0/2770563670 learned_addr learned my addr 172.21.15.55:0/2770563670 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:34:31.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:31.271+0000 7f46d8bd0640 1 --2- 172.21.15.55:0/2770563670 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f46d4070c70 0x7f46d40701b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:34:31.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:31.272+0000 7f46d9bd2640 1 -- 172.21.15.55:0/2770563670 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f46d4070c70 msgr2=0x7f46d40701b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:34:31.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:31.272+0000 7f46d9bd2640 1 --2- 172.21.15.55:0/2770563670 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f46d4070c70 0x7f46d40701b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:34:31.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:31.272+0000 7f46d9bd2640 1 -- 172.21.15.55:0/2770563670 >> v1:172.21.15.72:6789/0 conn(0x7f46d415f480 legacy=0x7f46d415f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:34:31.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:31.272+0000 7f46d9bd2640 1 -- 172.21.15.55:0/2770563670 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46d40cfc10 con 0x7f46d415dd90 2024-05-27T12:34:31.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:31.274+0000 7f46d9bd2640 1 --2- 172.21.15.55:0/2770563670 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f46d415dd90 0x7f46d415e220 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f46cc00d150 tx=0x7f46cc02c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=69d92324b5c18ade server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:34:31.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:31.275+0000 7f46cbfff640 1 -- 172.21.15.55:0/2770563670 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46cc039070 con 0x7f46d415dd90 2024-05-27T12:34:31.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:31.275+0000 7f46cbfff640 1 -- 172.21.15.55:0/2770563670 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46cc009600 con 0x7f46d415dd90 2024-05-27T12:34:31.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:31.275+0000 7f46cbfff640 1 -- 172.21.15.55:0/2770563670 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46cc0099d0 con 0x7f46d415dd90 2024-05-27T12:34:31.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:31.276+0000 7f46db635640 1 -- 172.21.15.55:0/2770563670 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f46d415dd90 msgr2=0x7f46d415e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:34:31.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:31.276+0000 7f46db635640 1 --2- 172.21.15.55:0/2770563670 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f46d415dd90 0x7f46d415e220 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f46cc00d150 tx=0x7f46cc02c890 comp rx=0 tx=0).stop 2024-05-27T12:34:31.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:31.276+0000 7f46db635640 1 -- 172.21.15.55:0/2770563670 shutdown_connections 2024-05-27T12:34:31.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:31.276+0000 7f46db635640 1 --2- 172.21.15.55:0/2770563670 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f46d415dd90 0x7f46d415e220 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:34:31.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:31.276+0000 7f46db635640 1 --2- 172.21.15.55:0/2770563670 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f46d4070c70 0x7f46d40701b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:34:31.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:31.276+0000 7f46db635640 1 -- 172.21.15.55:0/2770563670 >> 172.21.15.55:0/2770563670 conn(0x7f46d409aa30 msgr2=0x7f46d40b3050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:34:31.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:31.276+0000 7f46db635640 1 -- 172.21.15.55:0/2770563670 shutdown_connections 2024-05-27T12:34:31.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:31.276+0000 7f46db635640 1 -- 172.21.15.55:0/2770563670 wait complete. 2024-05-27T12:34:31.277 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:31.277+0000 7f46db635640 1 Processor -- start 2024-05-27T12:34:31.277 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:31.277+0000 7f46db635640 1 -- start start 2024-05-27T12:34:31.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:31.278+0000 7f46db635640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f46d4070c70 0x7f46d40b6540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:34:31.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:31.278+0000 7f46db635640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f46d415dd90 0x7f46d40ca550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:34:31.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:31.278+0000 7f46db635640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f46d415f480 0x7f46d40af6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:34:31.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:31.278+0000 7f46db635640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f46d40b0bd0 con 0x7f46d415dd90 2024-05-27T12:34:31.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:31.278+0000 7f46db635640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f46d40b3760 con 0x7f46d415f480 2024-05-27T12:34:31.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:31.278+0000 7f46db635640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f46d40b0d50 con 0x7f46d4070c70 2024-05-27T12:34:31.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:31.278+0000 7f46d8bd0640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f46d415dd90 0x7f46d40ca550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:34:31.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:31.278+0000 7f46d8bd0640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f46d415dd90 0x7f46d40ca550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51252/0 (socket says 172.21.15.55:51252) 2024-05-27T12:34:31.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:31.278+0000 7f46d8bd0640 1 -- 172.21.15.55:0/569915857 learned_addr learned my addr 172.21.15.55:0/569915857 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:34:31.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:31.279+0000 7f46d8bd0640 1 -- 172.21.15.55:0/569915857 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f46d4070c70 msgr2=0x7f46d40b6540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:34:31.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:31.279+0000 7f46d8bd0640 1 --2- 172.21.15.55:0/569915857 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f46d4070c70 0x7f46d40b6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:34:31.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:31.279+0000 7f46d8bd0640 1 -- 172.21.15.55:0/569915857 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f46d415f480 msgr2=0x7f46d40af6e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-27T12:34:31.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:31.279+0000 7f46d8bd0640 1 --2- 172.21.15.55:0/569915857 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f46d415f480 0x7f46d40af6e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:34:31.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:31.279+0000 7f46d8bd0640 1 -- 172.21.15.55:0/569915857 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46d40caff0 con 0x7f46d415dd90 2024-05-27T12:34:31.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:31.279+0000 7f46d8bd0640 1 --2- 172.21.15.55:0/569915857 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f46d415dd90 0x7f46d40ca550 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f46c400d5f0 tx=0x7f46c400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:34:31.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:31.279+0000 7f46c9ffb640 1 -- 172.21.15.55:0/569915857 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46c40125f0 con 0x7f46d415dd90 2024-05-27T12:34:31.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:31.279+0000 7f46c9ffb640 1 -- 172.21.15.55:0/569915857 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46c4019070 con 0x7f46d415dd90 2024-05-27T12:34:31.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:31.280+0000 7f46db635640 1 -- 172.21.15.55:0/569915857 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46d40cb2d0 con 0x7f46d415dd90 2024-05-27T12:34:31.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:31.280+0000 7f46c9ffb640 1 -- 172.21.15.55:0/569915857 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46c40129d0 con 0x7f46d415dd90 2024-05-27T12:34:31.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:31.280+0000 7f46db635640 1 -- 172.21.15.55:0/569915857 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46d40c41b0 con 0x7f46d415dd90 2024-05-27T12:34:31.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:31.282+0000 7f46db635640 1 -- 172.21.15.55:0/569915857 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46d4075460 con 0x7f46d415dd90 2024-05-27T12:34:31.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:31.282+0000 7f46c9ffb640 1 -- 172.21.15.55:0/569915857 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 7) ==== 91193+0+0 (secure 0 0 0) 0x7f46c4012b70 con 0x7f46d415dd90 2024-05-27T12:34:31.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:31.283+0000 7f46c9ffb640 1 --2- 172.21.15.55:0/569915857 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f46b806cad0 0x7f46b806ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:34:31.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:31.283+0000 7f46c9ffb640 1 -- 172.21.15.55:0/569915857 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5709+0+0 (secure 0 0 0) 0x7f46c408c270 con 0x7f46d415dd90 2024-05-27T12:34:31.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:31.284+0000 7f46d93d1640 1 --2- 172.21.15.55:0/569915857 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f46b806cad0 0x7f46b806ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:34:31.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:31.288+0000 7f46d93d1640 1 --2- 172.21.15.55:0/569915857 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f46b806cad0 0x7f46b806ef90 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f46d0000f60 tx=0x7f46d00079d0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:34:31.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:31.288+0000 7f46c9ffb640 1 -- 172.21.15.55:0/569915857 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f46c405a410 con 0x7f46d415dd90 2024-05-27T12:34:31.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:31.659+0000 7f46db635640 1 -- 172.21.15.55:0/569915857 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f46d40b7480 con 0x7f46d415dd90 2024-05-27T12:34:31.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:31.660+0000 7f46c9ffb640 1 -- 172.21.15.55:0/569915857 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+3532 (secure 0 0 0) 0x7f46c4059d10 con 0x7f46d415dd90 2024-05-27T12:34:31.659 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-27T12:34:31.659 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-05-27T12:34:31.659 INFO:teuthology.orchestra.run.smithi055.stdout: "fsid": "c3ff4e3b-8dae-4856-9593-e5cc66c59982", 2024-05-27T12:34:31.660 INFO:teuthology.orchestra.run.smithi055.stdout: "health": { 2024-05-27T12:34:31.660 INFO:teuthology.orchestra.run.smithi055.stdout: "status": "HEALTH_OK", 2024-05-27T12:34:31.660 INFO:teuthology.orchestra.run.smithi055.stdout: "checks": {}, 2024-05-27T12:34:31.660 INFO:teuthology.orchestra.run.smithi055.stdout: "mutes": [] 2024-05-27T12:34:31.660 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-05-27T12:34:31.660 INFO:teuthology.orchestra.run.smithi055.stdout: "election_epoch": 4, 2024-05-27T12:34:31.660 INFO:teuthology.orchestra.run.smithi055.stdout: "quorum": [ 2024-05-27T12:34:31.660 INFO:teuthology.orchestra.run.smithi055.stdout: 0, 2024-05-27T12:34:31.660 INFO:teuthology.orchestra.run.smithi055.stdout: 1, 2024-05-27T12:34:31.660 INFO:teuthology.orchestra.run.smithi055.stdout: 2 2024-05-27T12:34:31.660 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-05-27T12:34:31.660 INFO:teuthology.orchestra.run.smithi055.stdout: "quorum_names": [ 2024-05-27T12:34:31.661 INFO:teuthology.orchestra.run.smithi055.stdout: "a", 2024-05-27T12:34:31.661 INFO:teuthology.orchestra.run.smithi055.stdout: "b", 2024-05-27T12:34:31.661 INFO:teuthology.orchestra.run.smithi055.stdout: "c" 2024-05-27T12:34:31.661 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-05-27T12:34:31.661 INFO:teuthology.orchestra.run.smithi055.stdout: "quorum_age": 134, 2024-05-27T12:34:31.661 INFO:teuthology.orchestra.run.smithi055.stdout: "monmap": { 2024-05-27T12:34:31.661 INFO:teuthology.orchestra.run.smithi055.stdout: "epoch": 1, 2024-05-27T12:34:31.661 INFO:teuthology.orchestra.run.smithi055.stdout: "min_mon_release_name": "squid", 2024-05-27T12:34:31.661 INFO:teuthology.orchestra.run.smithi055.stdout: "num_mons": 3 2024-05-27T12:34:31.661 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-05-27T12:34:31.661 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap": { 2024-05-27T12:34:31.662 INFO:teuthology.orchestra.run.smithi055.stdout: "epoch": 36, 2024-05-27T12:34:31.662 INFO:teuthology.orchestra.run.smithi055.stdout: "num_osds": 8, 2024-05-27T12:34:31.662 INFO:teuthology.orchestra.run.smithi055.stdout: "num_up_osds": 8, 2024-05-27T12:34:31.662 INFO:teuthology.orchestra.run.smithi055.stdout: "osd_up_since": 1716813148, 2024-05-27T12:34:31.662 INFO:teuthology.orchestra.run.smithi055.stdout: "num_in_osds": 8, 2024-05-27T12:34:31.662 INFO:teuthology.orchestra.run.smithi055.stdout: "osd_in_since": 1716813139, 2024-05-27T12:34:31.662 INFO:teuthology.orchestra.run.smithi055.stdout: "num_remapped_pgs": 0 2024-05-27T12:34:31.662 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-05-27T12:34:31.662 INFO:teuthology.orchestra.run.smithi055.stdout: "pgmap": { 2024-05-27T12:34:31.663 INFO:teuthology.orchestra.run.smithi055.stdout: "pgs_by_state": [ 2024-05-27T12:34:31.663 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-05-27T12:34:31.663 INFO:teuthology.orchestra.run.smithi055.stdout: "state_name": "active+clean", 2024-05-27T12:34:31.663 INFO:teuthology.orchestra.run.smithi055.stdout: "count": 97 2024-05-27T12:34:31.663 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-05-27T12:34:31.663 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-05-27T12:34:31.663 INFO:teuthology.orchestra.run.smithi055.stdout: "num_pgs": 97, 2024-05-27T12:34:31.663 INFO:teuthology.orchestra.run.smithi055.stdout: "num_pools": 3, 2024-05-27T12:34:31.663 INFO:teuthology.orchestra.run.smithi055.stdout: "num_objects": 2588, 2024-05-27T12:34:31.663 INFO:teuthology.orchestra.run.smithi055.stdout: "data_bytes": 10738561707, 2024-05-27T12:34:31.663 INFO:teuthology.orchestra.run.smithi055.stdout: "bytes_used": 21731565568, 2024-05-27T12:34:31.664 INFO:teuthology.orchestra.run.smithi055.stdout: "bytes_avail": 751362547712, 2024-05-27T12:34:31.664 INFO:teuthology.orchestra.run.smithi055.stdout: "bytes_total": 773094113280, 2024-05-27T12:34:31.664 INFO:teuthology.orchestra.run.smithi055.stdout: "read_bytes_sec": 85, 2024-05-27T12:34:31.664 INFO:teuthology.orchestra.run.smithi055.stdout: "write_bytes_sec": 268389739, 2024-05-27T12:34:31.664 INFO:teuthology.orchestra.run.smithi055.stdout: "read_op_per_sec": 0, 2024-05-27T12:34:31.664 INFO:teuthology.orchestra.run.smithi055.stdout: "write_op_per_sec": 69 2024-05-27T12:34:31.664 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-05-27T12:34:31.664 INFO:teuthology.orchestra.run.smithi055.stdout: "fsmap": { 2024-05-27T12:34:31.664 INFO:teuthology.orchestra.run.smithi055.stdout: "epoch": 15, 2024-05-27T12:34:31.664 INFO:teuthology.orchestra.run.smithi055.stdout: "id": 2, 2024-05-27T12:34:31.664 INFO:teuthology.orchestra.run.smithi055.stdout: "up": 1, 2024-05-27T12:34:31.664 INFO:teuthology.orchestra.run.smithi055.stdout: "in": 1, 2024-05-27T12:34:31.664 INFO:teuthology.orchestra.run.smithi055.stdout: "max": 1, 2024-05-27T12:34:31.664 INFO:teuthology.orchestra.run.smithi055.stdout: "by_rank": [ 2024-05-27T12:34:31.665 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-05-27T12:34:31.665 INFO:teuthology.orchestra.run.smithi055.stdout: "filesystem_id": 2, 2024-05-27T12:34:31.665 INFO:teuthology.orchestra.run.smithi055.stdout: "rank": 0, 2024-05-27T12:34:31.665 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "a", 2024-05-27T12:34:31.665 INFO:teuthology.orchestra.run.smithi055.stdout: "status": "up:active", 2024-05-27T12:34:31.665 INFO:teuthology.orchestra.run.smithi055.stdout: "gid": 5151 2024-05-27T12:34:31.665 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-05-27T12:34:31.665 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-05-27T12:34:31.665 INFO:teuthology.orchestra.run.smithi055.stdout: "up:standby": 3 2024-05-27T12:34:31.665 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-05-27T12:34:31.665 INFO:teuthology.orchestra.run.smithi055.stdout: "mgrmap": { 2024-05-27T12:34:31.666 INFO:teuthology.orchestra.run.smithi055.stdout: "available": true, 2024-05-27T12:34:31.666 INFO:teuthology.orchestra.run.smithi055.stdout: "num_standbys": 1, 2024-05-27T12:34:31.666 INFO:teuthology.orchestra.run.smithi055.stdout: "modules": [ 2024-05-27T12:34:31.666 INFO:teuthology.orchestra.run.smithi055.stdout: "iostat", 2024-05-27T12:34:31.666 INFO:teuthology.orchestra.run.smithi055.stdout: "nfs", 2024-05-27T12:34:31.666 INFO:teuthology.orchestra.run.smithi055.stdout: "restful" 2024-05-27T12:34:31.666 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-05-27T12:34:31.666 INFO:teuthology.orchestra.run.smithi055.stdout: "services": {} 2024-05-27T12:34:31.666 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-05-27T12:34:31.666 INFO:teuthology.orchestra.run.smithi055.stdout: "servicemap": { 2024-05-27T12:34:31.666 INFO:teuthology.orchestra.run.smithi055.stdout: "epoch": 3, 2024-05-27T12:34:31.666 INFO:teuthology.orchestra.run.smithi055.stdout: "modified": "2024-05-27T12:33:29.273941+0000", 2024-05-27T12:34:31.666 INFO:teuthology.orchestra.run.smithi055.stdout: "services": { 2024-05-27T12:34:31.667 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": { 2024-05-27T12:34:31.667 INFO:teuthology.orchestra.run.smithi055.stdout: "daemons": { 2024-05-27T12:34:31.667 INFO:teuthology.orchestra.run.smithi055.stdout: "summary": "", 2024-05-27T12:34:31.667 INFO:teuthology.orchestra.run.smithi055.stdout: "a": { 2024-05-27T12:34:31.667 INFO:teuthology.orchestra.run.smithi055.stdout: "start_epoch": 0, 2024-05-27T12:34:31.667 INFO:teuthology.orchestra.run.smithi055.stdout: "start_stamp": "0.000000", 2024-05-27T12:34:31.667 INFO:teuthology.orchestra.run.smithi055.stdout: "gid": 0, 2024-05-27T12:34:31.667 INFO:teuthology.orchestra.run.smithi055.stdout: "addr": "(unrecognized address family 0)/0", 2024-05-27T12:34:31.667 INFO:teuthology.orchestra.run.smithi055.stdout: "metadata": {}, 2024-05-27T12:34:31.667 INFO:teuthology.orchestra.run.smithi055.stdout: "task_status": {} 2024-05-27T12:34:31.667 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-05-27T12:34:31.667 INFO:teuthology.orchestra.run.smithi055.stdout: "b": { 2024-05-27T12:34:31.667 INFO:teuthology.orchestra.run.smithi055.stdout: "start_epoch": 0, 2024-05-27T12:34:31.667 INFO:teuthology.orchestra.run.smithi055.stdout: "start_stamp": "0.000000", 2024-05-27T12:34:31.668 INFO:teuthology.orchestra.run.smithi055.stdout: "gid": 0, 2024-05-27T12:34:31.668 INFO:teuthology.orchestra.run.smithi055.stdout: "addr": "(unrecognized address family 0)/0", 2024-05-27T12:34:31.668 INFO:teuthology.orchestra.run.smithi055.stdout: "metadata": {}, 2024-05-27T12:34:31.668 INFO:teuthology.orchestra.run.smithi055.stdout: "task_status": {} 2024-05-27T12:34:31.668 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-05-27T12:34:31.668 INFO:teuthology.orchestra.run.smithi055.stdout: "c": { 2024-05-27T12:34:31.668 INFO:teuthology.orchestra.run.smithi055.stdout: "start_epoch": 0, 2024-05-27T12:34:31.668 INFO:teuthology.orchestra.run.smithi055.stdout: "start_stamp": "0.000000", 2024-05-27T12:34:31.668 INFO:teuthology.orchestra.run.smithi055.stdout: "gid": 0, 2024-05-27T12:34:31.668 INFO:teuthology.orchestra.run.smithi055.stdout: "addr": "(unrecognized address family 0)/0", 2024-05-27T12:34:31.669 INFO:teuthology.orchestra.run.smithi055.stdout: "metadata": {}, 2024-05-27T12:34:31.669 INFO:teuthology.orchestra.run.smithi055.stdout: "task_status": {} 2024-05-27T12:34:31.669 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-05-27T12:34:31.669 INFO:teuthology.orchestra.run.smithi055.stdout: "d": { 2024-05-27T12:34:31.669 INFO:teuthology.orchestra.run.smithi055.stdout: "start_epoch": 0, 2024-05-27T12:34:31.669 INFO:teuthology.orchestra.run.smithi055.stdout: "start_stamp": "0.000000", 2024-05-27T12:34:31.669 INFO:teuthology.orchestra.run.smithi055.stdout: "gid": 0, 2024-05-27T12:34:31.669 INFO:teuthology.orchestra.run.smithi055.stdout: "addr": "(unrecognized address family 0)/0", 2024-05-27T12:34:31.669 INFO:teuthology.orchestra.run.smithi055.stdout: "metadata": {}, 2024-05-27T12:34:31.669 INFO:teuthology.orchestra.run.smithi055.stdout: "task_status": {} 2024-05-27T12:34:31.669 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-05-27T12:34:31.669 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-05-27T12:34:31.669 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-05-27T12:34:31.669 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-05-27T12:34:31.670 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-05-27T12:34:31.670 INFO:teuthology.orchestra.run.smithi055.stdout: "progress_events": { 2024-05-27T12:34:31.670 INFO:teuthology.orchestra.run.smithi055.stdout: "9790db59-2553-4e9d-97e4-4d0c80d5b839": { 2024-05-27T12:34:31.670 INFO:teuthology.orchestra.run.smithi055.stdout: "message": "1 ongoing clones; Avg progress is 0.0% (0s)\n [............................] ", 2024-05-27T12:34:31.670 INFO:teuthology.orchestra.run.smithi055.stdout: "progress": 0, 2024-05-27T12:34:31.670 INFO:teuthology.orchestra.run.smithi055.stdout: "add_to_ceph_s": true 2024-05-27T12:34:31.670 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-05-27T12:34:31.670 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-05-27T12:34:31.671 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-05-27T12:34:31.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:31.662+0000 7f46db635640 1 -- 172.21.15.55:0/569915857 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f46b806cad0 msgr2=0x7f46b806ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:34:31.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:31.662+0000 7f46db635640 1 --2- 172.21.15.55:0/569915857 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f46b806cad0 0x7f46b806ef90 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f46d0000f60 tx=0x7f46d00079d0 comp rx=0 tx=0).stop 2024-05-27T12:34:31.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:31.662+0000 7f46db635640 1 -- 172.21.15.55:0/569915857 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f46d415dd90 msgr2=0x7f46d40ca550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:34:31.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:31.662+0000 7f46db635640 1 --2- 172.21.15.55:0/569915857 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f46d415dd90 0x7f46d40ca550 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f46c400d5f0 tx=0x7f46c400dab0 comp rx=0 tx=0).stop 2024-05-27T12:34:31.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:31.662+0000 7f46db635640 1 -- 172.21.15.55:0/569915857 shutdown_connections 2024-05-27T12:34:31.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:31.662+0000 7f46db635640 1 --2- 172.21.15.55:0/569915857 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f46b806cad0 0x7f46b806ef90 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:34:31.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:31.662+0000 7f46db635640 1 --2- 172.21.15.55:0/569915857 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f46d415f480 0x7f46d40af6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:34:31.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:31.662+0000 7f46db635640 1 --2- 172.21.15.55:0/569915857 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f46d415dd90 0x7f46d40ca550 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:34:31.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:31.662+0000 7f46db635640 1 --2- 172.21.15.55:0/569915857 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f46d4070c70 0x7f46d40b6540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:34:31.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:31.662+0000 7f46db635640 1 -- 172.21.15.55:0/569915857 >> 172.21.15.55:0/569915857 conn(0x7f46d409aa30 msgr2=0x7f46d40cc1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:34:31.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:31.662+0000 7f46db635640 1 -- 172.21.15.55:0/569915857 shutdown_connections 2024-05-27T12:34:31.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:31.663+0000 7f46db635640 1 -- 172.21.15.55:0/569915857 wait complete. 2024-05-27T12:34:31.680 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs ss1clone1 2024-05-27T12:34:31.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:31.828+0000 7f6e9c643640 1 Processor -- start 2024-05-27T12:34:31.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:31.828+0000 7f6e9c643640 1 -- start start 2024-05-27T12:34:31.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:31.829+0000 7f6e9c643640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6e9415ea60 0x7f6e940d0f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:34:31.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:31.829+0000 7f6e9c643640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6e940d1450 0x7f6e940cf040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:34:31.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:31.829+0000 7f6e9c643640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e940b34a0 con 0x7f6e940cf580 2024-05-27T12:34:31.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:31.829+0000 7f6e9c643640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f6e940d0a80 con 0x7f6e9415ea60 2024-05-27T12:34:31.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:31.829+0000 7f6e9c643640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f6e940d0430 con 0x7f6e940d1450 2024-05-27T12:34:31.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:31.829+0000 7f6e9a3df640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6e9415ea60 0x7f6e940d0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:34:31.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:31.829+0000 7f6e9a3df640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6e9415ea60 0x7f6e940d0f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51262/0 (socket says 172.21.15.55:51262) 2024-05-27T12:34:31.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:31.829+0000 7f6e9a3df640 1 -- 172.21.15.55:0/1058602187 learned_addr learned my addr 172.21.15.55:0/1058602187 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:34:31.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:31.830+0000 7f6e9a3df640 1 -- 172.21.15.55:0/1058602187 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6e940d1450 msgr2=0x7f6e940cf040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:34:31.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:31.830+0000 7f6e9a3df640 1 --2- 172.21.15.55:0/1058602187 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6e940d1450 0x7f6e940cf040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:34:31.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:31.830+0000 7f6e9a3df640 1 -- 172.21.15.55:0/1058602187 >> v1:172.21.15.72:6789/0 conn(0x7f6e940cf580 legacy=0x7f6e940cd1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:34:31.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:31.830+0000 7f6e9a3df640 1 -- 172.21.15.55:0/1058602187 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e940d0710 con 0x7f6e9415ea60 2024-05-27T12:34:31.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:31.832+0000 7f6e9a3df640 1 --2- 172.21.15.55:0/1058602187 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e9415ea60 0x7f6e940d0f10 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f6e90009870 tx=0x7f6e9002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee0b01fdf13753bb server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:34:31.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:31.832+0000 7f6e993dd640 1 -- 172.21.15.55:0/1058602187 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e90037070 con 0x7f6e9415ea60 2024-05-27T12:34:31.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:31.832+0000 7f6e993dd640 1 -- 172.21.15.55:0/1058602187 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e90032440 con 0x7f6e9415ea60 2024-05-27T12:34:31.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:31.832+0000 7f6e993dd640 1 -- 172.21.15.55:0/1058602187 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e90032810 con 0x7f6e9415ea60 2024-05-27T12:34:31.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:31.833+0000 7f6e9c643640 1 -- 172.21.15.55:0/1058602187 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e9415ea60 msgr2=0x7f6e940d0f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:34:31.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:31.833+0000 7f6e9c643640 1 --2- 172.21.15.55:0/1058602187 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e9415ea60 0x7f6e940d0f10 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f6e90009870 tx=0x7f6e9002a210 comp rx=0 tx=0).stop 2024-05-27T12:34:31.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:31.834+0000 7f6e9c643640 1 -- 172.21.15.55:0/1058602187 shutdown_connections 2024-05-27T12:34:31.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:31.834+0000 7f6e9c643640 1 --2- 172.21.15.55:0/1058602187 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6e940d1450 0x7f6e940cf040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:34:31.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:31.834+0000 7f6e9c643640 1 --2- 172.21.15.55:0/1058602187 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e9415ea60 0x7f6e940d0f10 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:34:31.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:31.834+0000 7f6e9c643640 1 -- 172.21.15.55:0/1058602187 >> 172.21.15.55:0/1058602187 conn(0x7f6e940d2650 msgr2=0x7f6e940d2a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:34:31.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:31.834+0000 7f6e9c643640 1 -- 172.21.15.55:0/1058602187 shutdown_connections 2024-05-27T12:34:31.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:31.834+0000 7f6e9c643640 1 -- 172.21.15.55:0/1058602187 wait complete. 2024-05-27T12:34:31.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:31.836+0000 7f6e9c643640 1 Processor -- start 2024-05-27T12:34:31.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:31.836+0000 7f6e9c643640 1 -- start start 2024-05-27T12:34:31.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:31.837+0000 7f6e9c643640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6e940cf580 0x7f6e941564b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:34:31.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:31.837+0000 7f6e9c643640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6e940d1450 0x7f6e940c7390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:34:31.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:31.837+0000 7f6e9c643640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e9415ea60 0x7f6e9415f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:34:31.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:31.837+0000 7f6e9c643640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f6e940cda60 con 0x7f6e9415ea60 2024-05-27T12:34:31.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:31.837+0000 7f6e9c643640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f6e940cd8e0 con 0x7f6e940cf580 2024-05-27T12:34:31.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:31.837+0000 7f6e9c643640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f6e940cdbe0 con 0x7f6e940d1450 2024-05-27T12:34:31.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:31.837+0000 7f6e9abe0640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e9415ea60 0x7f6e9415f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:34:31.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:31.837+0000 7f6e9abe0640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e9415ea60 0x7f6e9415f9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51274/0 (socket says 172.21.15.55:51274) 2024-05-27T12:34:31.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:31.837+0000 7f6e9abe0640 1 -- 172.21.15.55:0/3879375975 learned_addr learned my addr 172.21.15.55:0/3879375975 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:34:31.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:31.837+0000 7f6e9a3df640 1 --2- 172.21.15.55:0/3879375975 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6e940cf580 0x7f6e941564b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:34:31.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:31.837+0000 7f6e99bde640 1 --2- 172.21.15.55:0/3879375975 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6e940d1450 0x7f6e940c7390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:34:31.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:31.838+0000 7f6e9abe0640 1 -- 172.21.15.55:0/3879375975 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6e940d1450 msgr2=0x7f6e940c7390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:34:31.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:31.838+0000 7f6e9abe0640 1 --2- 172.21.15.55:0/3879375975 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6e940d1450 0x7f6e940c7390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:34:31.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:31.838+0000 7f6e9abe0640 1 -- 172.21.15.55:0/3879375975 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6e940cf580 msgr2=0x7f6e941564b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:34:31.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:31.838+0000 7f6e9abe0640 1 --2- 172.21.15.55:0/3879375975 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6e940cf580 0x7f6e941564b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:34:31.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:31.838+0000 7f6e9abe0640 1 -- 172.21.15.55:0/3879375975 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e940c6e90 con 0x7f6e9415ea60 2024-05-27T12:34:31.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:31.838+0000 7f6e9abe0640 1 --2- 172.21.15.55:0/3879375975 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e9415ea60 0x7f6e9415f9d0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f6e8c00c780 tx=0x7f6e8c00cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:34:31.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:31.838+0000 7f6e8affd640 1 -- 172.21.15.55:0/3879375975 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e8c004b60 con 0x7f6e9415ea60 2024-05-27T12:34:31.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:31.838+0000 7f6e8affd640 1 -- 172.21.15.55:0/3879375975 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e8c004d20 con 0x7f6e9415ea60 2024-05-27T12:34:31.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:31.838+0000 7f6e8affd640 1 -- 172.21.15.55:0/3879375975 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e8c005270 con 0x7f6e9415ea60 2024-05-27T12:34:31.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:31.838+0000 7f6e9c643640 1 -- 172.21.15.55:0/3879375975 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e940af580 con 0x7f6e9415ea60 2024-05-27T12:34:31.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:31.838+0000 7f6e9c643640 1 -- 172.21.15.55:0/3879375975 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e940afb40 con 0x7f6e9415ea60 2024-05-27T12:34:31.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:31.839+0000 7f6e9c643640 1 -- 172.21.15.55:0/3879375975 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e940af3a0 con 0x7f6e9415ea60 2024-05-27T12:34:31.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:31.840+0000 7f6e8affd640 1 -- 172.21.15.55:0/3879375975 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 7) ==== 91193+0+0 (secure 0 0 0) 0x7f6e8c005410 con 0x7f6e9415ea60 2024-05-27T12:34:31.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:31.840+0000 7f6e8affd640 1 --2- 172.21.15.55:0/3879375975 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f6e7806cb20 0x7f6e7806efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:34:31.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:31.840+0000 7f6e8affd640 1 -- 172.21.15.55:0/3879375975 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5709+0+0 (secure 0 0 0) 0x7f6e8c08be20 con 0x7f6e9415ea60 2024-05-27T12:34:31.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:31.841+0000 7f6e9a3df640 1 --2- 172.21.15.55:0/3879375975 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f6e7806cb20 0x7f6e7806efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:34:31.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:31.844+0000 7f6e9a3df640 1 --2- 172.21.15.55:0/3879375975 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f6e7806cb20 0x7f6e7806efe0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f6e90034000 tx=0x7f6e9002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:34:31.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:31.845+0000 7f6e8affd640 1 -- 172.21.15.55:0/3879375975 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6e940af3a0 con 0x7f6e9415ea60 2024-05-27T12:34:32.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.182+0000 7f6e9c643640 1 -- 172.21.15.55:0/3879375975 --> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "ss1clone1", "target": ["mon-mgr", ""]}) -- 0x7f6e940afd40 con 0x7f6e7806cb20 2024-05-27T12:34:32.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.318+0000 7f6e8affd640 1 -- 172.21.15.55:0/3879375975 <== mgr.4105 v2:172.21.15.72:6832/3152720583 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f6e940afd40 con 0x7f6e7806cb20 2024-05-27T12:34:32.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.320+0000 7f6e9c643640 1 -- 172.21.15.55:0/3879375975 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f6e7806cb20 msgr2=0x7f6e7806efe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:34:32.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.320+0000 7f6e9c643640 1 --2- 172.21.15.55:0/3879375975 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f6e7806cb20 0x7f6e7806efe0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f6e90034000 tx=0x7f6e9002e000 comp rx=0 tx=0).stop 2024-05-27T12:34:32.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.320+0000 7f6e9c643640 1 -- 172.21.15.55:0/3879375975 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e9415ea60 msgr2=0x7f6e9415f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:34:32.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.320+0000 7f6e9c643640 1 --2- 172.21.15.55:0/3879375975 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e9415ea60 0x7f6e9415f9d0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f6e8c00c780 tx=0x7f6e8c00cb80 comp rx=0 tx=0).stop 2024-05-27T12:34:32.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.320+0000 7f6e9c643640 1 -- 172.21.15.55:0/3879375975 shutdown_connections 2024-05-27T12:34:32.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.320+0000 7f6e9c643640 1 --2- 172.21.15.55:0/3879375975 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e9415ea60 0x7f6e9415f9d0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:34:32.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.320+0000 7f6e9c643640 1 --2- 172.21.15.55:0/3879375975 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6e940d1450 0x7f6e940c7390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:34:32.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.320+0000 7f6e9c643640 1 --2- 172.21.15.55:0/3879375975 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f6e7806cb20 0x7f6e7806efe0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:34:32.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.320+0000 7f6e9c643640 1 --2- 172.21.15.55:0/3879375975 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6e940cf580 0x7f6e941564b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:34:32.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.320+0000 7f6e9c643640 1 -- 172.21.15.55:0/3879375975 >> 172.21.15.55:0/3879375975 conn(0x7f6e940d2650 msgr2=0x7f6e94157470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:34:32.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.321+0000 7f6e9c643640 1 -- 172.21.15.55:0/3879375975 shutdown_connections 2024-05-27T12:34:32.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.321+0000 7f6e9c643640 1 -- 172.21.15.55:0/3879375975 wait complete. 2024-05-27T12:34:32.331 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-05-27T12:34:32.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.438+0000 7f8f219d8640 1 Processor -- start 2024-05-27T12:34:32.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.438+0000 7f8f219d8640 1 -- start start 2024-05-27T12:34:32.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.439+0000 7f8f219d8640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8f1c06cc50 0x7f8f1c0ccbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:34:32.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.439+0000 7f8f219d8640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8f1c0cd110 0x7f8f1c1626d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:34:32.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.439+0000 7f8f219d8640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f1c15efe0 con 0x7f8f1c15ec00 2024-05-27T12:34:32.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.439+0000 7f8f219d8640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f8f1c0d1840 con 0x7f8f1c0cd110 2024-05-27T12:34:32.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.439+0000 7f8f219d8640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f8f1c0d0c30 con 0x7f8f1c06cc50 2024-05-27T12:34:32.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.439+0000 7f8f1b7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8f1c0cd110 0x7f8f1c1626d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:34:32.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.439+0000 7f8f1b7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8f1c0cd110 0x7f8f1c1626d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51280/0 (socket says 172.21.15.55:51280) 2024-05-27T12:34:32.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.439+0000 7f8f1b7fe640 1 -- 172.21.15.55:0/338739905 learned_addr learned my addr 172.21.15.55:0/338739905 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:34:32.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.439+0000 7f8f1a7fc640 1 --2- 172.21.15.55:0/338739905 >> v2:172.21.15.72:3300/0 conn(0x7f8f1c06cc50 0x7f8f1c0ccbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:34:32.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.440+0000 7f8f1b7fe640 1 -- 172.21.15.55:0/338739905 >> v2:172.21.15.72:3300/0 conn(0x7f8f1c06cc50 msgr2=0x7f8f1c0ccbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:34:32.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.440+0000 7f8f1b7fe640 1 --2- 172.21.15.55:0/338739905 >> v2:172.21.15.72:3300/0 conn(0x7f8f1c06cc50 0x7f8f1c0ccbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:34:32.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.440+0000 7f8f1b7fe640 1 -- 172.21.15.55:0/338739905 >> v1:172.21.15.72:6789/0 conn(0x7f8f1c15ec00 legacy=0x7f8f1c0d1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:34:32.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.440+0000 7f8f1b7fe640 1 -- 172.21.15.55:0/338739905 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f1c0d0f10 con 0x7f8f1c0cd110 2024-05-27T12:34:32.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.440+0000 7f8f1a7fc640 1 --2- 172.21.15.55:0/338739905 >> v2:172.21.15.72:3300/0 conn(0x7f8f1c06cc50 0x7f8f1c0ccbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T12:34:32.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.440+0000 7f8f1b7fe640 1 --2- 172.21.15.55:0/338739905 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f1c0cd110 0x7f8f1c1626d0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f8f1c0b1e30 tx=0x7f8f1402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8aa087ee38342ea server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:34:32.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.440+0000 7f8f19ffb640 1 -- 172.21.15.55:0/338739905 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f14037070 con 0x7f8f1c0cd110 2024-05-27T12:34:32.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.440+0000 7f8f19ffb640 1 -- 172.21.15.55:0/338739905 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f14032440 con 0x7f8f1c0cd110 2024-05-27T12:34:32.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.440+0000 7f8f19ffb640 1 -- 172.21.15.55:0/338739905 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f14032810 con 0x7f8f1c0cd110 2024-05-27T12:34:32.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.441+0000 7f8f219d8640 1 -- 172.21.15.55:0/338739905 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f1c0cd110 msgr2=0x7f8f1c1626d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:34:32.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.441+0000 7f8f219d8640 1 --2- 172.21.15.55:0/338739905 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f1c0cd110 0x7f8f1c1626d0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f8f1c0b1e30 tx=0x7f8f1402a270 comp rx=0 tx=0).stop 2024-05-27T12:34:32.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.441+0000 7f8f219d8640 1 -- 172.21.15.55:0/338739905 shutdown_connections 2024-05-27T12:34:32.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.441+0000 7f8f219d8640 1 --2- 172.21.15.55:0/338739905 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f1c0cd110 0x7f8f1c1626d0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:34:32.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.441+0000 7f8f219d8640 1 --2- 172.21.15.55:0/338739905 >> v2:172.21.15.72:3300/0 conn(0x7f8f1c06cc50 0x7f8f1c0ccbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:34:32.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.441+0000 7f8f219d8640 1 -- 172.21.15.55:0/338739905 >> 172.21.15.55:0/338739905 conn(0x7f8f1c0b4070 msgr2=0x7f8f1c0b4480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:34:32.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.441+0000 7f8f219d8640 1 -- 172.21.15.55:0/338739905 shutdown_connections 2024-05-27T12:34:32.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.441+0000 7f8f219d8640 1 -- 172.21.15.55:0/338739905 wait complete. 2024-05-27T12:34:32.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.442+0000 7f8f219d8640 1 Processor -- start 2024-05-27T12:34:32.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.442+0000 7f8f219d8640 1 -- start start 2024-05-27T12:34:32.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.443+0000 7f8f219d8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f1c06cc50 0x7f8f1c1f5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:34:32.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.443+0000 7f8f219d8640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8f1c0cd110 0x7f8f1c0c7650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:34:32.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.443+0000 7f8f219d8640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8f1c15ec00 0x7f8f1c0cd8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:34:32.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.443+0000 7f8f219d8640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f8f1c0cd5a0 con 0x7f8f1c06cc50 2024-05-27T12:34:32.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.443+0000 7f8f219d8640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f8f1c0d14d0 con 0x7f8f1c15ec00 2024-05-27T12:34:32.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.443+0000 7f8f219d8640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f8f1c0cd720 con 0x7f8f1c0cd110 2024-05-27T12:34:32.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.443+0000 7f8f1affd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f1c06cc50 0x7f8f1c1f5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:34:32.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.443+0000 7f8f1affd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f1c06cc50 0x7f8f1c1f5c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51284/0 (socket says 172.21.15.55:51284) 2024-05-27T12:34:32.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.443+0000 7f8f1affd640 1 -- 172.21.15.55:0/1173877499 learned_addr learned my addr 172.21.15.55:0/1173877499 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:34:32.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.443+0000 7f8f1b7fe640 1 --2- 172.21.15.55:0/1173877499 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8f1c15ec00 0x7f8f1c0cd8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:34:32.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.443+0000 7f8f1a7fc640 1 --2- 172.21.15.55:0/1173877499 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8f1c0cd110 0x7f8f1c0c7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:34:32.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.443+0000 7f8f1affd640 1 -- 172.21.15.55:0/1173877499 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8f1c0cd110 msgr2=0x7f8f1c0c7650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:34:32.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.443+0000 7f8f1affd640 1 --2- 172.21.15.55:0/1173877499 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8f1c0cd110 0x7f8f1c0c7650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:34:32.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.443+0000 7f8f1affd640 1 -- 172.21.15.55:0/1173877499 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8f1c15ec00 msgr2=0x7f8f1c0cd8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:34:32.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.443+0000 7f8f1affd640 1 --2- 172.21.15.55:0/1173877499 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8f1c15ec00 0x7f8f1c0cd8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:34:32.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.444+0000 7f8f1affd640 1 -- 172.21.15.55:0/1173877499 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f1c0c7b90 con 0x7f8f1c06cc50 2024-05-27T12:34:32.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.444+0000 7f8f1affd640 1 --2- 172.21.15.55:0/1173877499 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f1c06cc50 0x7f8f1c1f5c40 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f8f0c00c7c0 tx=0x7f8f0c00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:34:32.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.444+0000 7f8f13fff640 1 -- 172.21.15.55:0/1173877499 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f0c016020 con 0x7f8f1c06cc50 2024-05-27T12:34:32.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.444+0000 7f8f13fff640 1 -- 172.21.15.55:0/1173877499 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f0c006d50 con 0x7f8f1c06cc50 2024-05-27T12:34:32.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.444+0000 7f8f13fff640 1 -- 172.21.15.55:0/1173877499 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f0c003bb0 con 0x7f8f1c06cc50 2024-05-27T12:34:32.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.444+0000 7f8f219d8640 1 -- 172.21.15.55:0/1173877499 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f1c0c7e20 con 0x7f8f1c06cc50 2024-05-27T12:34:32.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.444+0000 7f8f219d8640 1 -- 172.21.15.55:0/1173877499 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f1c0c83e0 con 0x7f8f1c06cc50 2024-05-27T12:34:32.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.445+0000 7f8f219d8640 1 -- 172.21.15.55:0/1173877499 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f1c075460 con 0x7f8f1c06cc50 2024-05-27T12:34:32.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.445+0000 7f8f13fff640 1 -- 172.21.15.55:0/1173877499 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 7) ==== 91193+0+0 (secure 0 0 0) 0x7f8f0c00a850 con 0x7f8f1c06cc50 2024-05-27T12:34:32.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.446+0000 7f8f13fff640 1 --2- 172.21.15.55:0/1173877499 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f8efc06cad0 0x7f8efc06ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:34:32.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.446+0000 7f8f13fff640 1 -- 172.21.15.55:0/1173877499 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5709+0+0 (secure 0 0 0) 0x7f8f0c08bbc0 con 0x7f8f1c06cc50 2024-05-27T12:34:32.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.446+0000 7f8f1a7fc640 1 --2- 172.21.15.55:0/1173877499 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f8efc06cad0 0x7f8efc06ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:34:32.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.446+0000 7f8f1a7fc640 1 --2- 172.21.15.55:0/1173877499 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f8efc06cad0 0x7f8efc06ef90 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f8f04006fd0 tx=0x7f8f04008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:34:32.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.450+0000 7f8f13fff640 1 -- 172.21.15.55:0/1173877499 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8f0c020020 con 0x7f8f1c06cc50 2024-05-27T12:34:32.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.661+0000 7f8f219d8640 1 -- 172.21.15.55:0/1173877499 --> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7f8f1c0b21a0 con 0x7f8efc06cad0 2024-05-27T12:34:32.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.663+0000 7f8f13fff640 1 -- 172.21.15.55:0/1173877499 <== mgr.4105 v2:172.21.15.72:6832/3152720583 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7f8f1c0b21a0 con 0x7f8efc06cad0 2024-05-27T12:34:32.662 INFO:teuthology.orchestra.run.smithi055.stdout:[ 2024-05-27T12:34:32.662 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-05-27T12:34:32.662 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "cephfs" 2024-05-27T12:34:32.662 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-05-27T12:34:32.663 INFO:teuthology.orchestra.run.smithi055.stdout:] 2024-05-27T12:34:32.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.665+0000 7f8f219d8640 1 -- 172.21.15.55:0/1173877499 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f8efc06cad0 msgr2=0x7f8efc06ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:34:32.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.665+0000 7f8f219d8640 1 --2- 172.21.15.55:0/1173877499 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f8efc06cad0 0x7f8efc06ef90 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f8f04006fd0 tx=0x7f8f04008040 comp rx=0 tx=0).stop 2024-05-27T12:34:32.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.665+0000 7f8f219d8640 1 -- 172.21.15.55:0/1173877499 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f1c06cc50 msgr2=0x7f8f1c1f5c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:34:32.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.665+0000 7f8f219d8640 1 --2- 172.21.15.55:0/1173877499 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f1c06cc50 0x7f8f1c1f5c40 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f8f0c00c7c0 tx=0x7f8f0c00cc80 comp rx=0 tx=0).stop 2024-05-27T12:34:32.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.665+0000 7f8f219d8640 1 -- 172.21.15.55:0/1173877499 shutdown_connections 2024-05-27T12:34:32.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.665+0000 7f8f219d8640 1 --2- 172.21.15.55:0/1173877499 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f8efc06cad0 0x7f8efc06ef90 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:34:32.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.665+0000 7f8f219d8640 1 --2- 172.21.15.55:0/1173877499 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8f1c15ec00 0x7f8f1c0cd8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:34:32.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.665+0000 7f8f219d8640 1 --2- 172.21.15.55:0/1173877499 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8f1c0cd110 0x7f8f1c0c7650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:34:32.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.665+0000 7f8f219d8640 1 --2- 172.21.15.55:0/1173877499 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f1c06cc50 0x7f8f1c1f5c40 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:34:32.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.665+0000 7f8f219d8640 1 -- 172.21.15.55:0/1173877499 >> 172.21.15.55:0/1173877499 conn(0x7f8f1c0b4070 msgr2=0x7f8f1c0b26c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:34:32.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.665+0000 7f8f219d8640 1 -- 172.21.15.55:0/1173877499 shutdown_connections 2024-05-27T12:34:32.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.665+0000 7f8f219d8640 1 -- 172.21.15.55:0/1173877499 wait complete. 2024-05-27T12:34:32.675 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-27T12:34:32.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.779+0000 7f1b14df0640 1 Processor -- start 2024-05-27T12:34:32.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.779+0000 7f1b14df0640 1 -- start start 2024-05-27T12:34:32.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.780+0000 7f1b14df0640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1b1015a250 0x7f1b1006ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:34:32.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.780+0000 7f1b14df0640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1b1006f280 0x7f1b100cf400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:34:32.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.780+0000 7f1b14df0640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1b100cf940 0x7f1b10071f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:34:32.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.780+0000 7f1b14df0640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f1b100cfdb0 con 0x7f1b100cf940 2024-05-27T12:34:32.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.780+0000 7f1b14df0640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f1b10160f70 con 0x7f1b1015a250 2024-05-27T12:34:32.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.780+0000 7f1b14df0640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f1b10160360 con 0x7f1b1006f280 2024-05-27T12:34:32.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.780+0000 7f1b0ed9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1b100cf940 0x7f1b10071f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:34:32.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.780+0000 7f1b0ed9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1b100cf940 0x7f1b10071f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38460/0 (socket says 172.21.15.55:38460) 2024-05-27T12:34:32.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.780+0000 7f1b0ed9d640 1 -- 172.21.15.55:0/1797812026 learned_addr learned my addr 172.21.15.55:0/1797812026 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:34:32.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.780+0000 7f1b07fff640 1 --2- 172.21.15.55:0/1797812026 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1b1006f280 0x7f1b100cf400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:34:32.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.780+0000 7f1b0e59c640 1 --2- 172.21.15.55:0/1797812026 >> v2:172.21.15.72:3300/0 conn(0x7f1b1015a250 0x7f1b1006ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:34:32.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.781+0000 7f1b0ed9d640 1 -- 172.21.15.55:0/1797812026 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1b1006f280 msgr2=0x7f1b100cf400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:34:32.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.781+0000 7f1b0ed9d640 1 --2- 172.21.15.55:0/1797812026 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1b1006f280 0x7f1b100cf400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:34:32.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.781+0000 7f1b0ed9d640 1 -- 172.21.15.55:0/1797812026 >> v2:172.21.15.72:3300/0 conn(0x7f1b1015a250 msgr2=0x7f1b1006ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:34:32.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.781+0000 7f1b0ed9d640 1 --2- 172.21.15.55:0/1797812026 >> v2:172.21.15.72:3300/0 conn(0x7f1b1015a250 0x7f1b1006ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:34:32.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.781+0000 7f1b0ed9d640 1 -- 172.21.15.55:0/1797812026 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b10160640 con 0x7f1b100cf940 2024-05-27T12:34:32.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.781+0000 7f1b0ed9d640 1 --2- 172.21.15.55:0/1797812026 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1b100cf940 0x7f1b10071f20 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f1b10071650 tx=0x7f1b0802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad51dba2fd11287 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:34:32.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.781+0000 7f1b0dd9b640 1 -- 172.21.15.55:0/1797812026 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b08036070 con 0x7f1b100cf940 2024-05-27T12:34:32.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.781+0000 7f1b0dd9b640 1 -- 172.21.15.55:0/1797812026 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b08031600 con 0x7f1b100cf940 2024-05-27T12:34:32.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.781+0000 7f1b0dd9b640 1 -- 172.21.15.55:0/1797812026 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b080319d0 con 0x7f1b100cf940 2024-05-27T12:34:32.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.782+0000 7f1b14df0640 1 -- 172.21.15.55:0/1797812026 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1b100cf940 msgr2=0x7f1b10071f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:34:32.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.782+0000 7f1b14df0640 1 --2- 172.21.15.55:0/1797812026 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1b100cf940 0x7f1b10071f20 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f1b10071650 tx=0x7f1b0802a6a0 comp rx=0 tx=0).stop 2024-05-27T12:34:32.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.782+0000 7f1b14df0640 1 -- 172.21.15.55:0/1797812026 shutdown_connections 2024-05-27T12:34:32.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.782+0000 7f1b14df0640 1 --2- 172.21.15.55:0/1797812026 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1b100cf940 0x7f1b10071f20 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:34:32.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.782+0000 7f1b14df0640 1 --2- 172.21.15.55:0/1797812026 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1b1006f280 0x7f1b100cf400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:34:32.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.782+0000 7f1b14df0640 1 --2- 172.21.15.55:0/1797812026 >> v2:172.21.15.72:3300/0 conn(0x7f1b1015a250 0x7f1b1006ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:34:32.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.782+0000 7f1b14df0640 1 -- 172.21.15.55:0/1797812026 >> 172.21.15.55:0/1797812026 conn(0x7f1b100b3830 msgr2=0x7f1b100b3c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:34:32.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.782+0000 7f1b14df0640 1 -- 172.21.15.55:0/1797812026 shutdown_connections 2024-05-27T12:34:32.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.782+0000 7f1b14df0640 1 -- 172.21.15.55:0/1797812026 wait complete. 2024-05-27T12:34:32.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.783+0000 7f1b14df0640 1 Processor -- start 2024-05-27T12:34:32.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.783+0000 7f1b14df0640 1 -- start start 2024-05-27T12:34:32.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.784+0000 7f1b14df0640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b1006f280 0x7f1b10143da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:34:32.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.784+0000 7f1b14df0640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1b100cf940 0x7f1b101595d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:34:32.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.784+0000 7f1b14df0640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1b1015a250 0x7f1b10143320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:34:32.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.784+0000 7f1b14df0640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f1b1015a630 con 0x7f1b100cf940 2024-05-27T12:34:32.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.784+0000 7f1b14df0640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f1b10160c00 con 0x7f1b1006f280 2024-05-27T12:34:32.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.784+0000 7f1b14df0640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f1b1006e7f0 con 0x7f1b1015a250 2024-05-27T12:34:32.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.784+0000 7f1b07fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1b100cf940 0x7f1b101595d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:34:32.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.784+0000 7f1b07fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1b100cf940 0x7f1b101595d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38468/0 (socket says 172.21.15.55:38468) 2024-05-27T12:34:32.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.784+0000 7f1b07fff640 1 -- 172.21.15.55:0/1375731308 learned_addr learned my addr 172.21.15.55:0/1375731308 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:34:32.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.784+0000 7f1b0e59c640 1 --2- 172.21.15.55:0/1375731308 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b1006f280 0x7f1b10143da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:34:32.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.784+0000 7f1b0ed9d640 1 --2- 172.21.15.55:0/1375731308 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1b1015a250 0x7f1b10143320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:34:32.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.785+0000 7f1b07fff640 1 -- 172.21.15.55:0/1375731308 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1b1015a250 msgr2=0x7f1b10143320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:34:32.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.785+0000 7f1b07fff640 1 --2- 172.21.15.55:0/1375731308 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1b1015a250 0x7f1b10143320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:34:32.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.785+0000 7f1b07fff640 1 -- 172.21.15.55:0/1375731308 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b1006f280 msgr2=0x7f1b10143da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:34:32.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.785+0000 7f1b07fff640 1 --2- 172.21.15.55:0/1375731308 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b1006f280 0x7f1b10143da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:34:32.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.785+0000 7f1b07fff640 1 -- 172.21.15.55:0/1375731308 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b10143860 con 0x7f1b100cf940 2024-05-27T12:34:32.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.785+0000 7f1b07fff640 1 --2- 172.21.15.55:0/1375731308 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1b100cf940 0x7f1b101595d0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f1af800e9e0 tx=0x7f1af800eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:34:32.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.785+0000 7f1b06ffd640 1 -- 172.21.15.55:0/1375731308 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1af8017070 con 0x7f1b100cf940 2024-05-27T12:34:32.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.785+0000 7f1b06ffd640 1 -- 172.21.15.55:0/1375731308 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1af800c9d0 con 0x7f1b100cf940 2024-05-27T12:34:32.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.785+0000 7f1b14df0640 1 -- 172.21.15.55:0/1375731308 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b1015d120 con 0x7f1b100cf940 2024-05-27T12:34:32.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.785+0000 7f1b06ffd640 1 -- 172.21.15.55:0/1375731308 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1af800cdc0 con 0x7f1b100cf940 2024-05-27T12:34:32.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.785+0000 7f1b14df0640 1 -- 172.21.15.55:0/1375731308 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b1015d6e0 con 0x7f1b100cf940 2024-05-27T12:34:32.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.786+0000 7f1b14df0640 1 -- 172.21.15.55:0/1375731308 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b10075460 con 0x7f1b100cf940 2024-05-27T12:34:32.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.787+0000 7f1b06ffd640 1 -- 172.21.15.55:0/1375731308 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 7) ==== 91193+0+0 (secure 0 0 0) 0x7f1af801a070 con 0x7f1b100cf940 2024-05-27T12:34:32.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.787+0000 7f1b06ffd640 1 --2- 172.21.15.55:0/1375731308 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f1af006caa0 0x7f1af006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:34:32.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.787+0000 7f1b06ffd640 1 -- 172.21.15.55:0/1375731308 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5709+0+0 (secure 0 0 0) 0x7f1af808bd30 con 0x7f1b100cf940 2024-05-27T12:34:32.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.787+0000 7f1b0e59c640 1 --2- 172.21.15.55:0/1375731308 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f1af006caa0 0x7f1af006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:34:32.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.788+0000 7f1b0e59c640 1 --2- 172.21.15.55:0/1375731308 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f1af006caa0 0x7f1af006ef60 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f1b00009a20 tx=0x7f1b00009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:34:32.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:32.791+0000 7f1b06ffd640 1 -- 172.21.15.55:0/1375731308 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f1af8059950 con 0x7f1b100cf940 2024-05-27T12:34:33.049 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:33.050+0000 7f1b14df0640 1 -- 172.21.15.55:0/1375731308 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f1b100b2940 con 0x7f1b100cf940 2024-05-27T12:34:33.049 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:33.050+0000 7f1b06ffd640 1 -- 172.21.15.55:0/1375731308 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2548 (secure 0 0 0) 0x7f1af805dc50 con 0x7f1b100cf940 2024-05-27T12:34:33.049 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-27T12:34:33.050 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-05-27T12:34:33.050 INFO:teuthology.orchestra.run.smithi055.stdout: "fsid": "c3ff4e3b-8dae-4856-9593-e5cc66c59982", 2024-05-27T12:34:33.050 INFO:teuthology.orchestra.run.smithi055.stdout: "health": { 2024-05-27T12:34:33.050 INFO:teuthology.orchestra.run.smithi055.stdout: "status": "HEALTH_OK", 2024-05-27T12:34:33.050 INFO:teuthology.orchestra.run.smithi055.stdout: "checks": {}, 2024-05-27T12:34:33.050 INFO:teuthology.orchestra.run.smithi055.stdout: "mutes": [] 2024-05-27T12:34:33.050 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-05-27T12:34:33.050 INFO:teuthology.orchestra.run.smithi055.stdout: "election_epoch": 4, 2024-05-27T12:34:33.050 INFO:teuthology.orchestra.run.smithi055.stdout: "quorum": [ 2024-05-27T12:34:33.050 INFO:teuthology.orchestra.run.smithi055.stdout: 0, 2024-05-27T12:34:33.050 INFO:teuthology.orchestra.run.smithi055.stdout: 1, 2024-05-27T12:34:33.050 INFO:teuthology.orchestra.run.smithi055.stdout: 2 2024-05-27T12:34:33.051 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-05-27T12:34:33.051 INFO:teuthology.orchestra.run.smithi055.stdout: "quorum_names": [ 2024-05-27T12:34:33.051 INFO:teuthology.orchestra.run.smithi055.stdout: "a", 2024-05-27T12:34:33.051 INFO:teuthology.orchestra.run.smithi055.stdout: "b", 2024-05-27T12:34:33.051 INFO:teuthology.orchestra.run.smithi055.stdout: "c" 2024-05-27T12:34:33.051 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-05-27T12:34:33.051 INFO:teuthology.orchestra.run.smithi055.stdout: "quorum_age": 136, 2024-05-27T12:34:33.051 INFO:teuthology.orchestra.run.smithi055.stdout: "monmap": { 2024-05-27T12:34:33.051 INFO:teuthology.orchestra.run.smithi055.stdout: "epoch": 1, 2024-05-27T12:34:33.051 INFO:teuthology.orchestra.run.smithi055.stdout: "min_mon_release_name": "squid", 2024-05-27T12:34:33.051 INFO:teuthology.orchestra.run.smithi055.stdout: "num_mons": 3 2024-05-27T12:34:33.051 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-05-27T12:34:33.051 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap": { 2024-05-27T12:34:33.052 INFO:teuthology.orchestra.run.smithi055.stdout: "epoch": 36, 2024-05-27T12:34:33.052 INFO:teuthology.orchestra.run.smithi055.stdout: "num_osds": 8, 2024-05-27T12:34:33.052 INFO:teuthology.orchestra.run.smithi055.stdout: "num_up_osds": 8, 2024-05-27T12:34:33.052 INFO:teuthology.orchestra.run.smithi055.stdout: "osd_up_since": 1716813148, 2024-05-27T12:34:33.052 INFO:teuthology.orchestra.run.smithi055.stdout: "num_in_osds": 8, 2024-05-27T12:34:33.052 INFO:teuthology.orchestra.run.smithi055.stdout: "osd_in_since": 1716813139, 2024-05-27T12:34:33.052 INFO:teuthology.orchestra.run.smithi055.stdout: "num_remapped_pgs": 0 2024-05-27T12:34:33.052 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-05-27T12:34:33.052 INFO:teuthology.orchestra.run.smithi055.stdout: "pgmap": { 2024-05-27T12:34:33.052 INFO:teuthology.orchestra.run.smithi055.stdout: "pgs_by_state": [ 2024-05-27T12:34:33.052 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-05-27T12:34:33.052 INFO:teuthology.orchestra.run.smithi055.stdout: "state_name": "active+clean", 2024-05-27T12:34:33.053 INFO:teuthology.orchestra.run.smithi055.stdout: "count": 97 2024-05-27T12:34:33.053 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-05-27T12:34:33.053 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-05-27T12:34:33.053 INFO:teuthology.orchestra.run.smithi055.stdout: "num_pgs": 97, 2024-05-27T12:34:33.053 INFO:teuthology.orchestra.run.smithi055.stdout: "num_pools": 3, 2024-05-27T12:34:33.053 INFO:teuthology.orchestra.run.smithi055.stdout: "num_objects": 2588, 2024-05-27T12:34:33.053 INFO:teuthology.orchestra.run.smithi055.stdout: "data_bytes": 10738561707, 2024-05-27T12:34:33.053 INFO:teuthology.orchestra.run.smithi055.stdout: "bytes_used": 21731565568, 2024-05-27T12:34:33.053 INFO:teuthology.orchestra.run.smithi055.stdout: "bytes_avail": 751362547712, 2024-05-27T12:34:33.053 INFO:teuthology.orchestra.run.smithi055.stdout: "bytes_total": 773094113280, 2024-05-27T12:34:33.053 INFO:teuthology.orchestra.run.smithi055.stdout: "read_bytes_sec": 85, 2024-05-27T12:34:33.053 INFO:teuthology.orchestra.run.smithi055.stdout: "write_bytes_sec": 178924152, 2024-05-27T12:34:33.053 INFO:teuthology.orchestra.run.smithi055.stdout: "read_op_per_sec": 0, 2024-05-27T12:34:33.053 INFO:teuthology.orchestra.run.smithi055.stdout: "write_op_per_sec": 46 2024-05-27T12:34:33.054 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-05-27T12:34:33.054 INFO:teuthology.orchestra.run.smithi055.stdout: "fsmap": { 2024-05-27T12:34:33.054 INFO:teuthology.orchestra.run.smithi055.stdout: "epoch": 15, 2024-05-27T12:34:33.054 INFO:teuthology.orchestra.run.smithi055.stdout: "id": 2, 2024-05-27T12:34:33.054 INFO:teuthology.orchestra.run.smithi055.stdout: "up": 1, 2024-05-27T12:34:33.054 INFO:teuthology.orchestra.run.smithi055.stdout: "in": 1, 2024-05-27T12:34:33.054 INFO:teuthology.orchestra.run.smithi055.stdout: "max": 1, 2024-05-27T12:34:33.054 INFO:teuthology.orchestra.run.smithi055.stdout: "by_rank": [ 2024-05-27T12:34:33.054 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-05-27T12:34:33.054 INFO:teuthology.orchestra.run.smithi055.stdout: "filesystem_id": 2, 2024-05-27T12:34:33.054 INFO:teuthology.orchestra.run.smithi055.stdout: "rank": 0, 2024-05-27T12:34:33.054 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "a", 2024-05-27T12:34:33.055 INFO:teuthology.orchestra.run.smithi055.stdout: "status": "up:active", 2024-05-27T12:34:33.055 INFO:teuthology.orchestra.run.smithi055.stdout: "gid": 5151 2024-05-27T12:34:33.055 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-05-27T12:34:33.055 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-05-27T12:34:33.055 INFO:teuthology.orchestra.run.smithi055.stdout: "up:standby": 3 2024-05-27T12:34:33.055 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-05-27T12:34:33.055 INFO:teuthology.orchestra.run.smithi055.stdout: "mgrmap": { 2024-05-27T12:34:33.055 INFO:teuthology.orchestra.run.smithi055.stdout: "available": true, 2024-05-27T12:34:33.055 INFO:teuthology.orchestra.run.smithi055.stdout: "num_standbys": 1, 2024-05-27T12:34:33.055 INFO:teuthology.orchestra.run.smithi055.stdout: "modules": [ 2024-05-27T12:34:33.055 INFO:teuthology.orchestra.run.smithi055.stdout: "iostat", 2024-05-27T12:34:33.055 INFO:teuthology.orchestra.run.smithi055.stdout: "nfs", 2024-05-27T12:34:33.055 INFO:teuthology.orchestra.run.smithi055.stdout: "restful" 2024-05-27T12:34:33.056 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-05-27T12:34:33.056 INFO:teuthology.orchestra.run.smithi055.stdout: "services": {} 2024-05-27T12:34:33.056 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-05-27T12:34:33.056 INFO:teuthology.orchestra.run.smithi055.stdout: "servicemap": { 2024-05-27T12:34:33.056 INFO:teuthology.orchestra.run.smithi055.stdout: "epoch": 4, 2024-05-27T12:34:33.056 INFO:teuthology.orchestra.run.smithi055.stdout: "modified": "2024-05-27T12:34:31.287201+0000", 2024-05-27T12:34:33.056 INFO:teuthology.orchestra.run.smithi055.stdout: "services": { 2024-05-27T12:34:33.056 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": { 2024-05-27T12:34:33.056 INFO:teuthology.orchestra.run.smithi055.stdout: "daemons": { 2024-05-27T12:34:33.056 INFO:teuthology.orchestra.run.smithi055.stdout: "summary": "", 2024-05-27T12:34:33.056 INFO:teuthology.orchestra.run.smithi055.stdout: "a": { 2024-05-27T12:34:33.056 INFO:teuthology.orchestra.run.smithi055.stdout: "start_epoch": 0, 2024-05-27T12:34:33.057 INFO:teuthology.orchestra.run.smithi055.stdout: "start_stamp": "0.000000", 2024-05-27T12:34:33.057 INFO:teuthology.orchestra.run.smithi055.stdout: "gid": 0, 2024-05-27T12:34:33.057 INFO:teuthology.orchestra.run.smithi055.stdout: "addr": "(unrecognized address family 0)/0", 2024-05-27T12:34:33.057 INFO:teuthology.orchestra.run.smithi055.stdout: "metadata": {}, 2024-05-27T12:34:33.057 INFO:teuthology.orchestra.run.smithi055.stdout: "task_status": {} 2024-05-27T12:34:33.057 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-05-27T12:34:33.057 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-05-27T12:34:33.057 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-05-27T12:34:33.057 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-05-27T12:34:33.057 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-05-27T12:34:33.057 INFO:teuthology.orchestra.run.smithi055.stdout: "progress_events": { 2024-05-27T12:34:33.057 INFO:teuthology.orchestra.run.smithi055.stdout: "9790db59-2553-4e9d-97e4-4d0c80d5b839": { 2024-05-27T12:34:33.058 INFO:teuthology.orchestra.run.smithi055.stdout: "message": "1 ongoing clones; Avg progress is 0.0% (1s)\n [............................] ", 2024-05-27T12:34:33.058 INFO:teuthology.orchestra.run.smithi055.stdout: "progress": 0, 2024-05-27T12:34:33.058 INFO:teuthology.orchestra.run.smithi055.stdout: "add_to_ceph_s": true 2024-05-27T12:34:33.058 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-05-27T12:34:33.058 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-05-27T12:34:33.058 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-05-27T12:34:33.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:33.052+0000 7f1b14df0640 1 -- 172.21.15.55:0/1375731308 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f1af006caa0 msgr2=0x7f1af006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:34:33.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:33.052+0000 7f1b14df0640 1 --2- 172.21.15.55:0/1375731308 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f1af006caa0 0x7f1af006ef60 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f1b00009a20 tx=0x7f1b00009190 comp rx=0 tx=0).stop 2024-05-27T12:34:33.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:33.052+0000 7f1b14df0640 1 -- 172.21.15.55:0/1375731308 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1b100cf940 msgr2=0x7f1b101595d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:34:33.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:33.052+0000 7f1b14df0640 1 --2- 172.21.15.55:0/1375731308 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1b100cf940 0x7f1b101595d0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f1af800e9e0 tx=0x7f1af800eea0 comp rx=0 tx=0).stop 2024-05-27T12:34:33.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:33.052+0000 7f1b14df0640 1 -- 172.21.15.55:0/1375731308 shutdown_connections 2024-05-27T12:34:33.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:33.052+0000 7f1b14df0640 1 --2- 172.21.15.55:0/1375731308 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1b1015a250 0x7f1b10143320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:34:33.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:33.052+0000 7f1b14df0640 1 --2- 172.21.15.55:0/1375731308 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1b100cf940 0x7f1b101595d0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:34:33.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:33.052+0000 7f1b14df0640 1 --2- 172.21.15.55:0/1375731308 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f1af006caa0 0x7f1af006ef60 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:34:33.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:33.052+0000 7f1b14df0640 1 --2- 172.21.15.55:0/1375731308 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b1006f280 0x7f1b10143da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:34:33.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:33.052+0000 7f1b14df0640 1 -- 172.21.15.55:0/1375731308 >> 172.21.15.55:0/1375731308 conn(0x7f1b100b3830 msgr2=0x7f1b100b5b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:34:33.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:33.052+0000 7f1b14df0640 1 -- 172.21.15.55:0/1375731308 shutdown_connections 2024-05-27T12:34:33.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:33.052+0000 7f1b14df0640 1 -- 172.21.15.55:0/1375731308 wait complete. 2024-05-27T12:34:37.968 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T12:34:37.971 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T12:34:38.063 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-27T12:34:38.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:38.177+0000 7fcc22e59640 1 Processor -- start 2024-05-27T12:34:38.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:38.177+0000 7fcc22e59640 1 -- start start 2024-05-27T12:34:38.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:38.178+0000 7fcc22e59640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcc1c15e920 0x7fcc1c162e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:34:38.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:38.178+0000 7fcc22e59640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc1c15ed00 con 0x7fcc1c072630 2024-05-27T12:34:38.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:38.178+0000 7fcc22e59640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc1c0cd580 con 0x7fcc1c0b2f10 2024-05-27T12:34:38.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:38.178+0000 7fcc22e59640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7fcc1c0cd860 con 0x7fcc1c15e920 2024-05-27T12:34:38.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:38.178+0000 7fcc20bf5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcc1c15e920 0x7fcc1c162e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:34:38.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:38.178+0000 7fcc213f6640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fcc1c072630 0x7fcc1c0ce920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:51212/0 (socket says 172.21.15.55:51212) 2024-05-27T12:34:38.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:38.178+0000 7fcc213f6640 1 -- 172.21.15.55:0/85494663 learned_addr learned my addr 172.21.15.55:0/85494663 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-27T12:34:38.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:38.178+0000 7fcc20bf5640 1 -- 172.21.15.55:0/85494663 >> v1:172.21.15.72:6789/0 conn(0x7fcc1c0b2f10 legacy=0x7fcc1c071f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:34:38.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:38.178+0000 7fcc20bf5640 1 -- 172.21.15.55:0/85494663 >> v1:172.21.15.55:6789/0 conn(0x7fcc1c072630 legacy=0x7fcc1c0ce920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:34:38.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:38.178+0000 7fcc20bf5640 1 -- 172.21.15.55:0/85494663 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc1c0cdb40 con 0x7fcc1c15e920 2024-05-27T12:34:38.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:38.178+0000 7fcc1b7fe640 1 -- 172.21.15.55:0/85494663 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2414582544 0 0) 0x7fcc1c15ed00 con 0x7fcc1c072630 2024-05-27T12:34:38.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:38.179+0000 7fcc20bf5640 1 --2- 172.21.15.55:0/85494663 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc1c15e920 0x7fcc1c162e40 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fcc0c0097a0 tx=0x7fcc0c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e846be3a57ce6b28 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:34:38.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:38.179+0000 7fcc1b7fe640 1 -- 172.21.15.55:0/85494663 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc0c037070 con 0x7fcc1c15e920 2024-05-27T12:34:38.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:38.179+0000 7fcc1b7fe640 1 -- 172.21.15.55:0/85494663 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc0c032440 con 0x7fcc1c15e920 2024-05-27T12:34:38.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:38.179+0000 7fcc1b7fe640 1 -- 172.21.15.55:0/85494663 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc0c032810 con 0x7fcc1c15e920 2024-05-27T12:34:38.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:38.180+0000 7fcc22e59640 1 -- 172.21.15.55:0/85494663 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc1c15e920 msgr2=0x7fcc1c162e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:34:38.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:38.180+0000 7fcc22e59640 1 --2- 172.21.15.55:0/85494663 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc1c15e920 0x7fcc1c162e40 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fcc0c0097a0 tx=0x7fcc0c02a1e0 comp rx=0 tx=0).stop 2024-05-27T12:34:38.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:38.180+0000 7fcc22e59640 1 -- 172.21.15.55:0/85494663 shutdown_connections 2024-05-27T12:34:38.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:38.180+0000 7fcc22e59640 1 --2- 172.21.15.55:0/85494663 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc1c15e920 0x7fcc1c162e40 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:34:38.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:38.180+0000 7fcc22e59640 1 -- 172.21.15.55:0/85494663 >> 172.21.15.55:0/85494663 conn(0x7fcc1c0b3830 msgr2=0x7fcc1c0b3c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:34:38.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:38.180+0000 7fcc22e59640 1 -- 172.21.15.55:0/85494663 shutdown_connections 2024-05-27T12:34:38.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:38.180+0000 7fcc22e59640 1 -- 172.21.15.55:0/85494663 wait complete. 2024-05-27T12:34:38.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:38.181+0000 7fcc22e59640 1 Processor -- start 2024-05-27T12:34:38.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:38.181+0000 7fcc22e59640 1 -- start start 2024-05-27T12:34:38.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:38.182+0000 7fcc22e59640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc1c072630 0x7fcc1c14fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:34:38.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:38.182+0000 7fcc22e59640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc1c0b2f10 0x7fcc1c1610d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:34:38.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:38.182+0000 7fcc22e59640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcc1c15e920 0x7fcc1c161610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:34:38.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:38.182+0000 7fcc22e59640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7fcc1c163380 con 0x7fcc1c072630 2024-05-27T12:34:38.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:38.182+0000 7fcc22e59640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fcc1c0ce100 con 0x7fcc1c0b2f10 2024-05-27T12:34:38.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:38.182+0000 7fcc22e59640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fcc1c0cf030 con 0x7fcc1c15e920 2024-05-27T12:34:38.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:38.182+0000 7fcc20bf5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc1c072630 0x7fcc1c14fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:34:38.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:38.182+0000 7fcc20bf5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc1c072630 0x7fcc1c14fb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38480/0 (socket says 172.21.15.55:38480) 2024-05-27T12:34:38.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:38.182+0000 7fcc20bf5640 1 -- 172.21.15.55:0/761196902 learned_addr learned my addr 172.21.15.55:0/761196902 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:34:38.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:38.182+0000 7fcc213f6640 1 --2- 172.21.15.55:0/761196902 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcc1c15e920 0x7fcc1c161610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:34:38.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:38.182+0000 7fcc1bfff640 1 --2- 172.21.15.55:0/761196902 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc1c0b2f10 0x7fcc1c1610d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:34:38.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:38.182+0000 7fcc20bf5640 1 -- 172.21.15.55:0/761196902 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcc1c15e920 msgr2=0x7fcc1c161610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:34:38.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:38.182+0000 7fcc20bf5640 1 --2- 172.21.15.55:0/761196902 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcc1c15e920 0x7fcc1c161610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:34:38.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:38.182+0000 7fcc20bf5640 1 -- 172.21.15.55:0/761196902 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc1c0b2f10 msgr2=0x7fcc1c1610d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:34:38.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:38.182+0000 7fcc20bf5640 1 --2- 172.21.15.55:0/761196902 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc1c0b2f10 0x7fcc1c1610d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:34:38.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:38.182+0000 7fcc20bf5640 1 -- 172.21.15.55:0/761196902 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc1c1554f0 con 0x7fcc1c072630 2024-05-27T12:34:38.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:38.182+0000 7fcc1bfff640 1 --2- 172.21.15.55:0/761196902 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc1c0b2f10 0x7fcc1c1610d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T12:34:38.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:38.182+0000 7fcc20bf5640 1 --2- 172.21.15.55:0/761196902 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc1c072630 0x7fcc1c14fb60 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fcc0c0097a0 tx=0x7fcc0c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:34:38.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:38.183+0000 7fcc197fa640 1 -- 172.21.15.55:0/761196902 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc0c041070 con 0x7fcc1c072630 2024-05-27T12:34:38.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:38.183+0000 7fcc197fa640 1 -- 172.21.15.55:0/761196902 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc0c03c870 con 0x7fcc1c072630 2024-05-27T12:34:38.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:38.183+0000 7fcc22e59640 1 -- 172.21.15.55:0/761196902 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc1c154c50 con 0x7fcc1c072630 2024-05-27T12:34:38.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:38.183+0000 7fcc197fa640 1 -- 172.21.15.55:0/761196902 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc0c037040 con 0x7fcc1c072630 2024-05-27T12:34:38.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:38.183+0000 7fcc22e59640 1 -- 172.21.15.55:0/761196902 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc1c155210 con 0x7fcc1c072630 2024-05-27T12:34:38.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:38.184+0000 7fcc22e59640 1 -- 172.21.15.55:0/761196902 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc1c075460 con 0x7fcc1c072630 2024-05-27T12:34:38.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:38.184+0000 7fcc197fa640 1 -- 172.21.15.55:0/761196902 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 7) ==== 91193+0+0 (secure 0 0 0) 0x7fcc0c044070 con 0x7fcc1c072630 2024-05-27T12:34:38.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:38.185+0000 7fcc197fa640 1 --2- 172.21.15.55:0/761196902 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fcbfc06caa0 0x7fcbfc06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:34:38.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:38.185+0000 7fcc197fa640 1 -- 172.21.15.55:0/761196902 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5709+0+0 (secure 0 0 0) 0x7fcc0c0ac920 con 0x7fcc1c072630 2024-05-27T12:34:38.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:38.185+0000 7fcc1bfff640 1 --2- 172.21.15.55:0/761196902 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fcbfc06caa0 0x7fcbfc06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:34:38.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:38.185+0000 7fcc1bfff640 1 --2- 172.21.15.55:0/761196902 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fcbfc06caa0 0x7fcbfc06ef60 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c15a130 tx=0x7fcc04009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:34:38.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:38.189+0000 7fcc197fa640 1 -- 172.21.15.55:0/761196902 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fcc0c07ac80 con 0x7fcc1c072630 2024-05-27T12:34:38.448 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:38.447+0000 7fcc22e59640 1 -- 172.21.15.55:0/761196902 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fcc1c0730f0 con 0x7fcc1c072630 2024-05-27T12:34:38.448 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:38.448+0000 7fcc197fa640 1 -- 172.21.15.55:0/761196902 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2575 (secure 0 0 0) 0x7fcc0c07a580 con 0x7fcc1c072630 2024-05-27T12:34:38.448 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-27T12:34:38.448 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-05-27T12:34:38.449 INFO:teuthology.orchestra.run.smithi055.stdout: "fsid": "c3ff4e3b-8dae-4856-9593-e5cc66c59982", 2024-05-27T12:34:38.449 INFO:teuthology.orchestra.run.smithi055.stdout: "health": { 2024-05-27T12:34:38.449 INFO:teuthology.orchestra.run.smithi055.stdout: "status": "HEALTH_OK", 2024-05-27T12:34:38.449 INFO:teuthology.orchestra.run.smithi055.stdout: "checks": {}, 2024-05-27T12:34:38.449 INFO:teuthology.orchestra.run.smithi055.stdout: "mutes": [] 2024-05-27T12:34:38.449 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-05-27T12:34:38.449 INFO:teuthology.orchestra.run.smithi055.stdout: "election_epoch": 4, 2024-05-27T12:34:38.449 INFO:teuthology.orchestra.run.smithi055.stdout: "quorum": [ 2024-05-27T12:34:38.449 INFO:teuthology.orchestra.run.smithi055.stdout: 0, 2024-05-27T12:34:38.449 INFO:teuthology.orchestra.run.smithi055.stdout: 1, 2024-05-27T12:34:38.449 INFO:teuthology.orchestra.run.smithi055.stdout: 2 2024-05-27T12:34:38.449 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-05-27T12:34:38.449 INFO:teuthology.orchestra.run.smithi055.stdout: "quorum_names": [ 2024-05-27T12:34:38.450 INFO:teuthology.orchestra.run.smithi055.stdout: "a", 2024-05-27T12:34:38.450 INFO:teuthology.orchestra.run.smithi055.stdout: "b", 2024-05-27T12:34:38.450 INFO:teuthology.orchestra.run.smithi055.stdout: "c" 2024-05-27T12:34:38.450 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-05-27T12:34:38.450 INFO:teuthology.orchestra.run.smithi055.stdout: "quorum_age": 141, 2024-05-27T12:34:38.450 INFO:teuthology.orchestra.run.smithi055.stdout: "monmap": { 2024-05-27T12:34:38.450 INFO:teuthology.orchestra.run.smithi055.stdout: "epoch": 1, 2024-05-27T12:34:38.450 INFO:teuthology.orchestra.run.smithi055.stdout: "min_mon_release_name": "squid", 2024-05-27T12:34:38.450 INFO:teuthology.orchestra.run.smithi055.stdout: "num_mons": 3 2024-05-27T12:34:38.450 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-05-27T12:34:38.450 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap": { 2024-05-27T12:34:38.450 INFO:teuthology.orchestra.run.smithi055.stdout: "epoch": 36, 2024-05-27T12:34:38.450 INFO:teuthology.orchestra.run.smithi055.stdout: "num_osds": 8, 2024-05-27T12:34:38.451 INFO:teuthology.orchestra.run.smithi055.stdout: "num_up_osds": 8, 2024-05-27T12:34:38.451 INFO:teuthology.orchestra.run.smithi055.stdout: "osd_up_since": 1716813148, 2024-05-27T12:34:38.451 INFO:teuthology.orchestra.run.smithi055.stdout: "num_in_osds": 8, 2024-05-27T12:34:38.451 INFO:teuthology.orchestra.run.smithi055.stdout: "osd_in_since": 1716813139, 2024-05-27T12:34:38.451 INFO:teuthology.orchestra.run.smithi055.stdout: "num_remapped_pgs": 0 2024-05-27T12:34:38.451 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-05-27T12:34:38.451 INFO:teuthology.orchestra.run.smithi055.stdout: "pgmap": { 2024-05-27T12:34:38.451 INFO:teuthology.orchestra.run.smithi055.stdout: "pgs_by_state": [ 2024-05-27T12:34:38.451 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-05-27T12:34:38.451 INFO:teuthology.orchestra.run.smithi055.stdout: "state_name": "active+clean", 2024-05-27T12:34:38.451 INFO:teuthology.orchestra.run.smithi055.stdout: "count": 97 2024-05-27T12:34:38.451 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-05-27T12:34:38.451 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-05-27T12:34:38.452 INFO:teuthology.orchestra.run.smithi055.stdout: "num_pgs": 97, 2024-05-27T12:34:38.452 INFO:teuthology.orchestra.run.smithi055.stdout: "num_pools": 3, 2024-05-27T12:34:38.452 INFO:teuthology.orchestra.run.smithi055.stdout: "num_objects": 3096, 2024-05-27T12:34:38.452 INFO:teuthology.orchestra.run.smithi055.stdout: "data_bytes": 12852612973, 2024-05-27T12:34:38.452 INFO:teuthology.orchestra.run.smithi055.stdout: "bytes_used": 25863290880, 2024-05-27T12:34:38.452 INFO:teuthology.orchestra.run.smithi055.stdout: "bytes_avail": 747230822400, 2024-05-27T12:34:38.452 INFO:teuthology.orchestra.run.smithi055.stdout: "bytes_total": 773094113280, 2024-05-27T12:34:38.452 INFO:teuthology.orchestra.run.smithi055.stdout: "read_bytes_sec": 177510925, 2024-05-27T12:34:38.452 INFO:teuthology.orchestra.run.smithi055.stdout: "write_bytes_sec": 180676353, 2024-05-27T12:34:38.452 INFO:teuthology.orchestra.run.smithi055.stdout: "read_op_per_sec": 42, 2024-05-27T12:34:38.452 INFO:teuthology.orchestra.run.smithi055.stdout: "write_op_per_sec": 49 2024-05-27T12:34:38.452 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-05-27T12:34:38.452 INFO:teuthology.orchestra.run.smithi055.stdout: "fsmap": { 2024-05-27T12:34:38.452 INFO:teuthology.orchestra.run.smithi055.stdout: "epoch": 15, 2024-05-27T12:34:38.453 INFO:teuthology.orchestra.run.smithi055.stdout: "id": 2, 2024-05-27T12:34:38.453 INFO:teuthology.orchestra.run.smithi055.stdout: "up": 1, 2024-05-27T12:34:38.453 INFO:teuthology.orchestra.run.smithi055.stdout: "in": 1, 2024-05-27T12:34:38.453 INFO:teuthology.orchestra.run.smithi055.stdout: "max": 1, 2024-05-27T12:34:38.453 INFO:teuthology.orchestra.run.smithi055.stdout: "by_rank": [ 2024-05-27T12:34:38.453 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-05-27T12:34:38.453 INFO:teuthology.orchestra.run.smithi055.stdout: "filesystem_id": 2, 2024-05-27T12:34:38.453 INFO:teuthology.orchestra.run.smithi055.stdout: "rank": 0, 2024-05-27T12:34:38.453 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "a", 2024-05-27T12:34:38.453 INFO:teuthology.orchestra.run.smithi055.stdout: "status": "up:active", 2024-05-27T12:34:38.453 INFO:teuthology.orchestra.run.smithi055.stdout: "gid": 5151 2024-05-27T12:34:38.453 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-05-27T12:34:38.453 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-05-27T12:34:38.454 INFO:teuthology.orchestra.run.smithi055.stdout: "up:standby": 3 2024-05-27T12:34:38.454 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-05-27T12:34:38.454 INFO:teuthology.orchestra.run.smithi055.stdout: "mgrmap": { 2024-05-27T12:34:38.454 INFO:teuthology.orchestra.run.smithi055.stdout: "available": true, 2024-05-27T12:34:38.454 INFO:teuthology.orchestra.run.smithi055.stdout: "num_standbys": 1, 2024-05-27T12:34:38.454 INFO:teuthology.orchestra.run.smithi055.stdout: "modules": [ 2024-05-27T12:34:38.454 INFO:teuthology.orchestra.run.smithi055.stdout: "iostat", 2024-05-27T12:34:38.454 INFO:teuthology.orchestra.run.smithi055.stdout: "nfs", 2024-05-27T12:34:38.454 INFO:teuthology.orchestra.run.smithi055.stdout: "restful" 2024-05-27T12:34:38.454 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-05-27T12:34:38.454 INFO:teuthology.orchestra.run.smithi055.stdout: "services": {} 2024-05-27T12:34:38.454 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-05-27T12:34:38.454 INFO:teuthology.orchestra.run.smithi055.stdout: "servicemap": { 2024-05-27T12:34:38.455 INFO:teuthology.orchestra.run.smithi055.stdout: "epoch": 4, 2024-05-27T12:34:38.455 INFO:teuthology.orchestra.run.smithi055.stdout: "modified": "2024-05-27T12:34:31.287201+0000", 2024-05-27T12:34:38.455 INFO:teuthology.orchestra.run.smithi055.stdout: "services": { 2024-05-27T12:34:38.455 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": { 2024-05-27T12:34:38.455 INFO:teuthology.orchestra.run.smithi055.stdout: "daemons": { 2024-05-27T12:34:38.455 INFO:teuthology.orchestra.run.smithi055.stdout: "summary": "", 2024-05-27T12:34:38.455 INFO:teuthology.orchestra.run.smithi055.stdout: "a": { 2024-05-27T12:34:38.455 INFO:teuthology.orchestra.run.smithi055.stdout: "start_epoch": 0, 2024-05-27T12:34:38.455 INFO:teuthology.orchestra.run.smithi055.stdout: "start_stamp": "0.000000", 2024-05-27T12:34:38.455 INFO:teuthology.orchestra.run.smithi055.stdout: "gid": 0, 2024-05-27T12:34:38.455 INFO:teuthology.orchestra.run.smithi055.stdout: "addr": "(unrecognized address family 0)/0", 2024-05-27T12:34:38.455 INFO:teuthology.orchestra.run.smithi055.stdout: "metadata": {}, 2024-05-27T12:34:38.455 INFO:teuthology.orchestra.run.smithi055.stdout: "task_status": {} 2024-05-27T12:34:38.455 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-05-27T12:34:38.456 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-05-27T12:34:38.456 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-05-27T12:34:38.456 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-05-27T12:34:38.456 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-05-27T12:34:38.456 INFO:teuthology.orchestra.run.smithi055.stdout: "progress_events": { 2024-05-27T12:34:38.456 INFO:teuthology.orchestra.run.smithi055.stdout: "9790db59-2553-4e9d-97e4-4d0c80d5b839": { 2024-05-27T12:34:38.456 INFO:teuthology.orchestra.run.smithi055.stdout: "message": "All cloning finished, waiting 26.0 seconds before exiting (7s)\n [============================] ", 2024-05-27T12:34:38.456 INFO:teuthology.orchestra.run.smithi055.stdout: "progress": 1, 2024-05-27T12:34:38.456 INFO:teuthology.orchestra.run.smithi055.stdout: "add_to_ceph_s": true 2024-05-27T12:34:38.456 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-05-27T12:34:38.456 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-05-27T12:34:38.456 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-05-27T12:34:38.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:38.450+0000 7fcc22e59640 1 -- 172.21.15.55:0/761196902 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fcbfc06caa0 msgr2=0x7fcbfc06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:34:38.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:38.450+0000 7fcc22e59640 1 --2- 172.21.15.55:0/761196902 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fcbfc06caa0 0x7fcbfc06ef60 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c15a130 tx=0x7fcc04009040 comp rx=0 tx=0).stop 2024-05-27T12:34:38.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:38.450+0000 7fcc22e59640 1 -- 172.21.15.55:0/761196902 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc1c072630 msgr2=0x7fcc1c14fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:34:38.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:38.450+0000 7fcc22e59640 1 --2- 172.21.15.55:0/761196902 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc1c072630 0x7fcc1c14fb60 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fcc0c0097a0 tx=0x7fcc0c0046c0 comp rx=0 tx=0).stop 2024-05-27T12:34:38.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:38.450+0000 7fcc22e59640 1 -- 172.21.15.55:0/761196902 shutdown_connections 2024-05-27T12:34:38.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:38.450+0000 7fcc22e59640 1 --2- 172.21.15.55:0/761196902 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcc1c15e920 0x7fcc1c161610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:34:38.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:38.450+0000 7fcc22e59640 1 --2- 172.21.15.55:0/761196902 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fcbfc06caa0 0x7fcbfc06ef60 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:34:38.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:38.450+0000 7fcc22e59640 1 --2- 172.21.15.55:0/761196902 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc1c0b2f10 0x7fcc1c1610d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:34:38.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:38.450+0000 7fcc22e59640 1 --2- 172.21.15.55:0/761196902 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc1c072630 0x7fcc1c14fb60 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:34:38.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:38.450+0000 7fcc22e59640 1 -- 172.21.15.55:0/761196902 >> 172.21.15.55:0/761196902 conn(0x7fcc1c0b3830 msgr2=0x7fcc1c0cafb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:34:38.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:38.450+0000 7fcc22e59640 1 -- 172.21.15.55:0/761196902 shutdown_connections 2024-05-27T12:34:38.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:38.450+0000 7fcc22e59640 1 -- 172.21.15.55:0/761196902 wait complete. 2024-05-27T12:34:43.462 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-27T12:34:43.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:43.578+0000 7f84e9dfe640 1 Processor -- start 2024-05-27T12:34:43.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:43.578+0000 7f84e9dfe640 1 -- start start 2024-05-27T12:34:43.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:43.579+0000 7f84e9dfe640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f84e415a250 0x7f84e406ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:34:43.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:43.579+0000 7f84e9dfe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f84e406f280 0x7f84e40cf400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:34:43.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:43.579+0000 7f84e9dfe640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f84e40cf940 0x7f84e4071f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:34:43.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:43.579+0000 7f84e9dfe640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f84e40cfdb0 con 0x7f84e406f280 2024-05-27T12:34:43.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:43.579+0000 7f84e9dfe640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f84e4160f70 con 0x7f84e40cf940 2024-05-27T12:34:43.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:43.579+0000 7f84e9dfe640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f84e4160360 con 0x7f84e415a250 2024-05-27T12:34:43.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:43.579+0000 7f84e2ffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f84e406f280 0x7f84e40cf400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:34:43.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:43.580+0000 7f84e2ffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f84e406f280 0x7f84e40cf400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52870/0 (socket says 172.21.15.55:52870) 2024-05-27T12:34:43.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:43.580+0000 7f84e2ffd640 1 -- 172.21.15.55:0/3728176595 learned_addr learned my addr 172.21.15.55:0/3728176595 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:34:43.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:43.580+0000 7f84e37fe640 1 --2- 172.21.15.55:0/3728176595 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f84e415a250 0x7f84e406ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:34:43.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:43.580+0000 7f84e3fff640 1 --2- 172.21.15.55:0/3728176595 >> v2:172.21.15.72:3300/0 conn(0x7f84e40cf940 0x7f84e4071f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:34:43.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:43.580+0000 7f84e2ffd640 1 -- 172.21.15.55:0/3728176595 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f84e415a250 msgr2=0x7f84e406ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:34:43.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:43.580+0000 7f84e2ffd640 1 --2- 172.21.15.55:0/3728176595 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f84e415a250 0x7f84e406ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:34:43.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:43.580+0000 7f84e2ffd640 1 -- 172.21.15.55:0/3728176595 >> v2:172.21.15.72:3300/0 conn(0x7f84e40cf940 msgr2=0x7f84e4071f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:34:43.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:43.580+0000 7f84e2ffd640 1 --2- 172.21.15.55:0/3728176595 >> v2:172.21.15.72:3300/0 conn(0x7f84e40cf940 0x7f84e4071f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:34:43.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:43.580+0000 7f84e2ffd640 1 -- 172.21.15.55:0/3728176595 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84e4160640 con 0x7f84e406f280 2024-05-27T12:34:43.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:43.581+0000 7f84e2ffd640 1 --2- 172.21.15.55:0/3728176595 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84e406f280 0x7f84e40cf400 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f84e40b37c0 tx=0x7f84d802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26085406c16847b0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:34:43.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:43.581+0000 7f84e27fc640 1 -- 172.21.15.55:0/3728176595 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84d8037070 con 0x7f84e406f280 2024-05-27T12:34:43.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:43.581+0000 7f84e27fc640 1 -- 172.21.15.55:0/3728176595 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84d8032440 con 0x7f84e406f280 2024-05-27T12:34:43.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:43.581+0000 7f84e27fc640 1 -- 172.21.15.55:0/3728176595 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84d8032810 con 0x7f84e406f280 2024-05-27T12:34:43.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:43.581+0000 7f84e9dfe640 1 -- 172.21.15.55:0/3728176595 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84e406f280 msgr2=0x7f84e40cf400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:34:43.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:43.581+0000 7f84e9dfe640 1 --2- 172.21.15.55:0/3728176595 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84e406f280 0x7f84e40cf400 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f84e40b37c0 tx=0x7f84d802a1e0 comp rx=0 tx=0).stop 2024-05-27T12:34:43.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:43.581+0000 7f84e9dfe640 1 -- 172.21.15.55:0/3728176595 shutdown_connections 2024-05-27T12:34:43.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:43.581+0000 7f84e9dfe640 1 --2- 172.21.15.55:0/3728176595 >> v2:172.21.15.72:3300/0 conn(0x7f84e40cf940 0x7f84e4071f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:34:43.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:43.581+0000 7f84e9dfe640 1 --2- 172.21.15.55:0/3728176595 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84e406f280 0x7f84e40cf400 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:34:43.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:43.581+0000 7f84e9dfe640 1 --2- 172.21.15.55:0/3728176595 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f84e415a250 0x7f84e406ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:34:43.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:43.581+0000 7f84e9dfe640 1 -- 172.21.15.55:0/3728176595 >> 172.21.15.55:0/3728176595 conn(0x7f84e40b3830 msgr2=0x7f84e40b3c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:34:43.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:43.582+0000 7f84e9dfe640 1 -- 172.21.15.55:0/3728176595 shutdown_connections 2024-05-27T12:34:43.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:43.582+0000 7f84e9dfe640 1 -- 172.21.15.55:0/3728176595 wait complete. 2024-05-27T12:34:43.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:43.583+0000 7f84e9dfe640 1 Processor -- start 2024-05-27T12:34:43.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:43.583+0000 7f84e9dfe640 1 -- start start 2024-05-27T12:34:43.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:43.584+0000 7f84e9dfe640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f84e406f280 0x7f84e4154080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:34:43.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:43.584+0000 7f84e9dfe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84e40cf940 0x7f84e40c95b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:34:43.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:43.584+0000 7f84e9dfe640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f84e415a250 0x7f84e40c9af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:34:43.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:43.584+0000 7f84e9dfe640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f84e415a630 con 0x7f84e40cf940 2024-05-27T12:34:43.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:43.584+0000 7f84e9dfe640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f84e4160c00 con 0x7f84e415a250 2024-05-27T12:34:43.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:43.584+0000 7f84e9dfe640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f84e406e7f0 con 0x7f84e406f280 2024-05-27T12:34:43.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:43.584+0000 7f84e2ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84e40cf940 0x7f84e40c95b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:34:43.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:43.584+0000 7f84e2ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84e40cf940 0x7f84e40c95b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52872/0 (socket says 172.21.15.55:52872) 2024-05-27T12:34:43.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:43.584+0000 7f84e2ffd640 1 -- 172.21.15.55:0/520841275 learned_addr learned my addr 172.21.15.55:0/520841275 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:34:43.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:43.584+0000 7f84e37fe640 1 --2- 172.21.15.55:0/520841275 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f84e406f280 0x7f84e4154080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:34:43.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:43.584+0000 7f84e3fff640 1 --2- 172.21.15.55:0/520841275 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f84e415a250 0x7f84e40c9af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:34:43.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:43.584+0000 7f84e2ffd640 1 -- 172.21.15.55:0/520841275 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f84e406f280 msgr2=0x7f84e4154080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:34:43.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:43.584+0000 7f84e2ffd640 1 --2- 172.21.15.55:0/520841275 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f84e406f280 0x7f84e4154080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:34:43.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:43.584+0000 7f84e2ffd640 1 -- 172.21.15.55:0/520841275 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f84e415a250 msgr2=0x7f84e40c9af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:34:43.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:43.584+0000 7f84e2ffd640 1 --2- 172.21.15.55:0/520841275 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f84e415a250 0x7f84e40c9af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:34:43.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:43.584+0000 7f84e2ffd640 1 -- 172.21.15.55:0/520841275 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84e41545c0 con 0x7f84e40cf940 2024-05-27T12:34:43.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:43.584+0000 7f84e3fff640 1 --2- 172.21.15.55:0/520841275 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f84e415a250 0x7f84e40c9af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T12:34:43.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:43.584+0000 7f84e2ffd640 1 --2- 172.21.15.55:0/520841275 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84e40cf940 0x7f84e40c95b0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f84d802a220 tx=0x7f84d80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:34:43.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:43.584+0000 7f84cbfff640 1 -- 172.21.15.55:0/520841275 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84d8041020 con 0x7f84e40cf940 2024-05-27T12:34:43.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:43.585+0000 7f84cbfff640 1 -- 172.21.15.55:0/520841275 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84d803d620 con 0x7f84e40cf940 2024-05-27T12:34:43.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:43.585+0000 7f84e9dfe640 1 -- 172.21.15.55:0/520841275 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84e40cc3e0 con 0x7f84e40cf940 2024-05-27T12:34:43.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:43.585+0000 7f84cbfff640 1 -- 172.21.15.55:0/520841275 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84d8037040 con 0x7f84e40cf940 2024-05-27T12:34:43.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:43.585+0000 7f84e9dfe640 1 -- 172.21.15.55:0/520841275 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84e4158130 con 0x7f84e40cf940 2024-05-27T12:34:43.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:43.585+0000 7f84e9dfe640 1 -- 172.21.15.55:0/520841275 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84e40b3520 con 0x7f84e40cf940 2024-05-27T12:34:43.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:43.586+0000 7f84cbfff640 1 -- 172.21.15.55:0/520841275 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 7) ==== 91193+0+0 (secure 0 0 0) 0x7f84d8044020 con 0x7f84e40cf940 2024-05-27T12:34:43.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:43.586+0000 7f84cbfff640 1 --2- 172.21.15.55:0/520841275 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f84d006cad0 0x7f84d006ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:34:43.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:43.587+0000 7f84cbfff640 1 -- 172.21.15.55:0/520841275 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5709+0+0 (secure 0 0 0) 0x7f84d80ac410 con 0x7f84e40cf940 2024-05-27T12:34:43.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:43.587+0000 7f84e37fe640 1 --2- 172.21.15.55:0/520841275 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f84d006cad0 0x7f84d006ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:34:43.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:43.587+0000 7f84e37fe640 1 --2- 172.21.15.55:0/520841275 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f84d006cad0 0x7f84d006ef90 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f84d4009a20 tx=0x7f84d4009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:34:43.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:43.591+0000 7f84cbfff640 1 -- 172.21.15.55:0/520841275 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f84e40b3520 con 0x7f84e40cf940 2024-05-27T12:34:43.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:43.847+0000 7f84e9dfe640 1 -- 172.21.15.55:0/520841275 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f84e406e1c0 con 0x7f84e40cf940 2024-05-27T12:34:43.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:43.847+0000 7f84cbfff640 1 -- 172.21.15.55:0/520841275 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2123 (secure 0 0 0) 0x7f84d804b030 con 0x7f84e40cf940 2024-05-27T12:34:43.847 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-27T12:34:43.847 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-05-27T12:34:43.847 INFO:teuthology.orchestra.run.smithi055.stdout: "fsid": "c3ff4e3b-8dae-4856-9593-e5cc66c59982", 2024-05-27T12:34:43.847 INFO:teuthology.orchestra.run.smithi055.stdout: "health": { 2024-05-27T12:34:43.847 INFO:teuthology.orchestra.run.smithi055.stdout: "status": "HEALTH_OK", 2024-05-27T12:34:43.847 INFO:teuthology.orchestra.run.smithi055.stdout: "checks": {}, 2024-05-27T12:34:43.847 INFO:teuthology.orchestra.run.smithi055.stdout: "mutes": [] 2024-05-27T12:34:43.847 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-05-27T12:34:43.847 INFO:teuthology.orchestra.run.smithi055.stdout: "election_epoch": 4, 2024-05-27T12:34:43.847 INFO:teuthology.orchestra.run.smithi055.stdout: "quorum": [ 2024-05-27T12:34:43.847 INFO:teuthology.orchestra.run.smithi055.stdout: 0, 2024-05-27T12:34:43.847 INFO:teuthology.orchestra.run.smithi055.stdout: 1, 2024-05-27T12:34:43.847 INFO:teuthology.orchestra.run.smithi055.stdout: 2 2024-05-27T12:34:43.848 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-05-27T12:34:43.848 INFO:teuthology.orchestra.run.smithi055.stdout: "quorum_names": [ 2024-05-27T12:34:43.848 INFO:teuthology.orchestra.run.smithi055.stdout: "a", 2024-05-27T12:34:43.848 INFO:teuthology.orchestra.run.smithi055.stdout: "b", 2024-05-27T12:34:43.848 INFO:teuthology.orchestra.run.smithi055.stdout: "c" 2024-05-27T12:34:43.848 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-05-27T12:34:43.848 INFO:teuthology.orchestra.run.smithi055.stdout: "quorum_age": 146, 2024-05-27T12:34:43.848 INFO:teuthology.orchestra.run.smithi055.stdout: "monmap": { 2024-05-27T12:34:43.848 INFO:teuthology.orchestra.run.smithi055.stdout: "epoch": 1, 2024-05-27T12:34:43.848 INFO:teuthology.orchestra.run.smithi055.stdout: "min_mon_release_name": "squid", 2024-05-27T12:34:43.848 INFO:teuthology.orchestra.run.smithi055.stdout: "num_mons": 3 2024-05-27T12:34:43.848 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-05-27T12:34:43.848 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap": { 2024-05-27T12:34:43.848 INFO:teuthology.orchestra.run.smithi055.stdout: "epoch": 36, 2024-05-27T12:34:43.848 INFO:teuthology.orchestra.run.smithi055.stdout: "num_osds": 8, 2024-05-27T12:34:43.848 INFO:teuthology.orchestra.run.smithi055.stdout: "num_up_osds": 8, 2024-05-27T12:34:43.849 INFO:teuthology.orchestra.run.smithi055.stdout: "osd_up_since": 1716813148, 2024-05-27T12:34:43.849 INFO:teuthology.orchestra.run.smithi055.stdout: "num_in_osds": 8, 2024-05-27T12:34:43.849 INFO:teuthology.orchestra.run.smithi055.stdout: "osd_in_since": 1716813139, 2024-05-27T12:34:43.849 INFO:teuthology.orchestra.run.smithi055.stdout: "num_remapped_pgs": 0 2024-05-27T12:34:43.849 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-05-27T12:34:43.849 INFO:teuthology.orchestra.run.smithi055.stdout: "pgmap": { 2024-05-27T12:34:43.849 INFO:teuthology.orchestra.run.smithi055.stdout: "pgs_by_state": [ 2024-05-27T12:34:43.849 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-05-27T12:34:43.849 INFO:teuthology.orchestra.run.smithi055.stdout: "state_name": "active+clean", 2024-05-27T12:34:43.849 INFO:teuthology.orchestra.run.smithi055.stdout: "count": 97 2024-05-27T12:34:43.849 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-05-27T12:34:43.849 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-05-27T12:34:43.849 INFO:teuthology.orchestra.run.smithi055.stdout: "num_pgs": 97, 2024-05-27T12:34:43.849 INFO:teuthology.orchestra.run.smithi055.stdout: "num_pools": 3, 2024-05-27T12:34:43.849 INFO:teuthology.orchestra.run.smithi055.stdout: "num_objects": 3093, 2024-05-27T12:34:43.850 INFO:teuthology.orchestra.run.smithi055.stdout: "data_bytes": 12852642789, 2024-05-27T12:34:43.850 INFO:teuthology.orchestra.run.smithi055.stdout: "bytes_used": 25968246784, 2024-05-27T12:34:43.850 INFO:teuthology.orchestra.run.smithi055.stdout: "bytes_avail": 747125866496, 2024-05-27T12:34:43.850 INFO:teuthology.orchestra.run.smithi055.stdout: "bytes_total": 773094113280, 2024-05-27T12:34:43.850 INFO:teuthology.orchestra.run.smithi055.stdout: "read_bytes_sec": 177513855, 2024-05-27T12:34:43.850 INFO:teuthology.orchestra.run.smithi055.stdout: "write_bytes_sec": 176130106, 2024-05-27T12:34:43.850 INFO:teuthology.orchestra.run.smithi055.stdout: "read_op_per_sec": 43, 2024-05-27T12:34:43.850 INFO:teuthology.orchestra.run.smithi055.stdout: "write_op_per_sec": 47 2024-05-27T12:34:43.850 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-05-27T12:34:43.850 INFO:teuthology.orchestra.run.smithi055.stdout: "fsmap": { 2024-05-27T12:34:43.850 INFO:teuthology.orchestra.run.smithi055.stdout: "epoch": 15, 2024-05-27T12:34:43.850 INFO:teuthology.orchestra.run.smithi055.stdout: "id": 2, 2024-05-27T12:34:43.851 INFO:teuthology.orchestra.run.smithi055.stdout: "up": 1, 2024-05-27T12:34:43.851 INFO:teuthology.orchestra.run.smithi055.stdout: "in": 1, 2024-05-27T12:34:43.851 INFO:teuthology.orchestra.run.smithi055.stdout: "max": 1, 2024-05-27T12:34:43.851 INFO:teuthology.orchestra.run.smithi055.stdout: "by_rank": [ 2024-05-27T12:34:43.851 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-05-27T12:34:43.851 INFO:teuthology.orchestra.run.smithi055.stdout: "filesystem_id": 2, 2024-05-27T12:34:43.851 INFO:teuthology.orchestra.run.smithi055.stdout: "rank": 0, 2024-05-27T12:34:43.851 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "a", 2024-05-27T12:34:43.851 INFO:teuthology.orchestra.run.smithi055.stdout: "status": "up:active", 2024-05-27T12:34:43.851 INFO:teuthology.orchestra.run.smithi055.stdout: "gid": 5151 2024-05-27T12:34:43.851 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-05-27T12:34:43.851 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-05-27T12:34:43.851 INFO:teuthology.orchestra.run.smithi055.stdout: "up:standby": 3 2024-05-27T12:34:43.852 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-05-27T12:34:43.852 INFO:teuthology.orchestra.run.smithi055.stdout: "mgrmap": { 2024-05-27T12:34:43.852 INFO:teuthology.orchestra.run.smithi055.stdout: "available": true, 2024-05-27T12:34:43.852 INFO:teuthology.orchestra.run.smithi055.stdout: "num_standbys": 1, 2024-05-27T12:34:43.852 INFO:teuthology.orchestra.run.smithi055.stdout: "modules": [ 2024-05-27T12:34:43.852 INFO:teuthology.orchestra.run.smithi055.stdout: "iostat", 2024-05-27T12:34:43.852 INFO:teuthology.orchestra.run.smithi055.stdout: "nfs", 2024-05-27T12:34:43.852 INFO:teuthology.orchestra.run.smithi055.stdout: "restful" 2024-05-27T12:34:43.852 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-05-27T12:34:43.852 INFO:teuthology.orchestra.run.smithi055.stdout: "services": {} 2024-05-27T12:34:43.852 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-05-27T12:34:43.852 INFO:teuthology.orchestra.run.smithi055.stdout: "servicemap": { 2024-05-27T12:34:43.852 INFO:teuthology.orchestra.run.smithi055.stdout: "epoch": 5, 2024-05-27T12:34:43.852 INFO:teuthology.orchestra.run.smithi055.stdout: "modified": "2024-05-27T12:34:41.289759+0000", 2024-05-27T12:34:43.853 INFO:teuthology.orchestra.run.smithi055.stdout: "services": {} 2024-05-27T12:34:43.853 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-05-27T12:34:43.853 INFO:teuthology.orchestra.run.smithi055.stdout: "progress_events": { 2024-05-27T12:34:43.853 INFO:teuthology.orchestra.run.smithi055.stdout: "9790db59-2553-4e9d-97e4-4d0c80d5b839": { 2024-05-27T12:34:43.853 INFO:teuthology.orchestra.run.smithi055.stdout: "message": "All cloning finished, waiting 22.0 seconds before exiting (11s)\n [============================] ", 2024-05-27T12:34:43.853 INFO:teuthology.orchestra.run.smithi055.stdout: "progress": 1, 2024-05-27T12:34:43.853 INFO:teuthology.orchestra.run.smithi055.stdout: "add_to_ceph_s": true 2024-05-27T12:34:43.853 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-05-27T12:34:43.853 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-05-27T12:34:43.853 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-05-27T12:34:43.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:43.849+0000 7f84e9dfe640 1 -- 172.21.15.55:0/520841275 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f84d006cad0 msgr2=0x7f84d006ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:34:43.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:43.849+0000 7f84e9dfe640 1 --2- 172.21.15.55:0/520841275 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f84d006cad0 0x7f84d006ef90 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f84d4009a20 tx=0x7f84d4009190 comp rx=0 tx=0).stop 2024-05-27T12:34:43.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:43.849+0000 7f84e9dfe640 1 -- 172.21.15.55:0/520841275 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84e40cf940 msgr2=0x7f84e40c95b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:34:43.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:43.849+0000 7f84e9dfe640 1 --2- 172.21.15.55:0/520841275 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84e40cf940 0x7f84e40c95b0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f84d802a220 tx=0x7f84d80046c0 comp rx=0 tx=0).stop 2024-05-27T12:34:43.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:43.849+0000 7f84e9dfe640 1 -- 172.21.15.55:0/520841275 shutdown_connections 2024-05-27T12:34:43.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:43.849+0000 7f84e9dfe640 1 --2- 172.21.15.55:0/520841275 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f84d006cad0 0x7f84d006ef90 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:34:43.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:43.849+0000 7f84e9dfe640 1 --2- 172.21.15.55:0/520841275 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f84e415a250 0x7f84e40c9af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:34:43.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:43.849+0000 7f84e9dfe640 1 --2- 172.21.15.55:0/520841275 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84e40cf940 0x7f84e40c95b0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:34:43.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:43.849+0000 7f84e9dfe640 1 --2- 172.21.15.55:0/520841275 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f84e406f280 0x7f84e4154080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:34:43.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:43.849+0000 7f84e9dfe640 1 -- 172.21.15.55:0/520841275 >> 172.21.15.55:0/520841275 conn(0x7f84e40b3830 msgr2=0x7f84e415e270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:34:43.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:43.849+0000 7f84e9dfe640 1 -- 172.21.15.55:0/520841275 shutdown_connections 2024-05-27T12:34:43.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:43.849+0000 7f84e9dfe640 1 -- 172.21.15.55:0/520841275 wait complete. 2024-05-27T12:34:48.861 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-27T12:34:48.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:48.977+0000 7fdfbd7f7640 1 Processor -- start 2024-05-27T12:34:48.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:48.978+0000 7fdfbd7f7640 1 -- start start 2024-05-27T12:34:48.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:48.978+0000 7fdfbd7f7640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fdfb815ec00 0x7fdfb80b3db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:34:48.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:48.978+0000 7fdfbd7f7640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdfb80b3860 0x7fdfb80cfd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:34:48.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:48.978+0000 7fdfbd7f7640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdfb81632f0 con 0x7fdfb80b6370 2024-05-27T12:34:48.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:48.978+0000 7fdfbd7f7640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fdfb80cf2e0 con 0x7fdfb815ec00 2024-05-27T12:34:48.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:48.978+0000 7fdfbd7f7640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fdfb81635d0 con 0x7fdfb80b3860 2024-05-27T12:34:48.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:48.979+0000 7fdfb67fc640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdfb80b3860 0x7fdfb80cfd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:34:48.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:48.979+0000 7fdfb67fc640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdfb80b3860 0x7fdfb80cfd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.55:40764/0 (socket says 172.21.15.55:40764) 2024-05-27T12:34:48.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:48.979+0000 7fdfb67fc640 1 -- 172.21.15.55:0/1363802436 learned_addr learned my addr 172.21.15.55:0/1363802436 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:34:48.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:48.979+0000 7fdfb6ffd640 1 --2- 172.21.15.55:0/1363802436 >> v2:172.21.15.72:3300/0 conn(0x7fdfb815ec00 0x7fdfb80b3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:34:48.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:48.979+0000 7fdfb67fc640 1 -- 172.21.15.55:0/1363802436 >> v2:172.21.15.72:3300/0 conn(0x7fdfb815ec00 msgr2=0x7fdfb80b3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:34:48.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:48.979+0000 7fdfb67fc640 1 --2- 172.21.15.55:0/1363802436 >> v2:172.21.15.72:3300/0 conn(0x7fdfb815ec00 0x7fdfb80b3db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:34:48.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:48.979+0000 7fdfb67fc640 1 -- 172.21.15.55:0/1363802436 >> v1:172.21.15.72:6789/0 conn(0x7fdfb80b6370 legacy=0x7fdfb80d2980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:34:48.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:48.979+0000 7fdfb67fc640 1 -- 172.21.15.55:0/1363802436 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfb80cf530 con 0x7fdfb80b3860 2024-05-27T12:34:48.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:48.980+0000 7fdfb67fc640 1 --2- 172.21.15.55:0/1363802436 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdfb80b3860 0x7fdfb80cfd30 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fdfac009870 tx=0x7fdfac02a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d125fac1644ee775 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:34:48.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:48.980+0000 7fdfb5ffb640 1 -- 172.21.15.55:0/1363802436 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfac037070 con 0x7fdfb80b3860 2024-05-27T12:34:48.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:48.980+0000 7fdfb5ffb640 1 -- 172.21.15.55:0/1363802436 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfac032440 con 0x7fdfb80b3860 2024-05-27T12:34:48.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:48.980+0000 7fdfb5ffb640 1 -- 172.21.15.55:0/1363802436 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfac032810 con 0x7fdfb80b3860 2024-05-27T12:34:48.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:48.981+0000 7fdfbd7f7640 1 -- 172.21.15.55:0/1363802436 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdfb80b3860 msgr2=0x7fdfb80cfd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:34:48.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:48.981+0000 7fdfbd7f7640 1 --2- 172.21.15.55:0/1363802436 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdfb80b3860 0x7fdfb80cfd30 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fdfac009870 tx=0x7fdfac02a270 comp rx=0 tx=0).stop 2024-05-27T12:34:48.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:48.981+0000 7fdfbd7f7640 1 -- 172.21.15.55:0/1363802436 shutdown_connections 2024-05-27T12:34:48.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:48.981+0000 7fdfbd7f7640 1 --2- 172.21.15.55:0/1363802436 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdfb80b3860 0x7fdfb80cfd30 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:34:48.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:48.981+0000 7fdfbd7f7640 1 --2- 172.21.15.55:0/1363802436 >> v2:172.21.15.72:3300/0 conn(0x7fdfb815ec00 0x7fdfb80b3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:34:48.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:48.981+0000 7fdfbd7f7640 1 -- 172.21.15.55:0/1363802436 >> 172.21.15.55:0/1363802436 conn(0x7fdfb80d1370 msgr2=0x7fdfb80d1780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:34:48.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:48.981+0000 7fdfbd7f7640 1 -- 172.21.15.55:0/1363802436 shutdown_connections 2024-05-27T12:34:48.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:48.981+0000 7fdfbd7f7640 1 -- 172.21.15.55:0/1363802436 wait complete. 2024-05-27T12:34:48.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:48.982+0000 7fdfbd7f7640 1 Processor -- start 2024-05-27T12:34:48.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:48.982+0000 7fdfbd7f7640 1 -- start start 2024-05-27T12:34:48.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:48.983+0000 7fdfbd7f7640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdfb80b3860 0x7fdfb80cde40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:34:48.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:48.983+0000 7fdfbd7f7640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdfb80b6370 0x7fdfb81611b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:34:48.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:48.983+0000 7fdfbd7f7640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdfb815ec00 0x7fdfb81599c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:34:48.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:48.983+0000 7fdfbd7f7640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7fdfb80b3530 con 0x7fdfb80b3860 2024-05-27T12:34:48.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:48.983+0000 7fdfbd7f7640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fdfb80d0270 con 0x7fdfb815ec00 2024-05-27T12:34:48.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:48.983+0000 7fdfbd7f7640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fdfb815efe0 con 0x7fdfb80b6370 2024-05-27T12:34:48.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:48.983+0000 7fdfb6ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdfb80b3860 0x7fdfb80cde40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:34:48.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:48.983+0000 7fdfb6ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdfb80b3860 0x7fdfb80cde40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52886/0 (socket says 172.21.15.55:52886) 2024-05-27T12:34:48.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:48.983+0000 7fdfb6ffd640 1 -- 172.21.15.55:0/3238615722 learned_addr learned my addr 172.21.15.55:0/3238615722 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:34:48.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:48.983+0000 7fdfb67fc640 1 --2- 172.21.15.55:0/3238615722 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdfb80b6370 0x7fdfb81611b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:34:48.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:48.983+0000 7fdfb77fe640 1 --2- 172.21.15.55:0/3238615722 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdfb815ec00 0x7fdfb81599c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:34:48.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:48.984+0000 7fdfb6ffd640 1 -- 172.21.15.55:0/3238615722 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdfb80b6370 msgr2=0x7fdfb81611b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:34:48.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:48.984+0000 7fdfb6ffd640 1 --2- 172.21.15.55:0/3238615722 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdfb80b6370 0x7fdfb81611b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:34:48.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:48.984+0000 7fdfb6ffd640 1 -- 172.21.15.55:0/3238615722 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdfb815ec00 msgr2=0x7fdfb81599c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:34:48.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:48.984+0000 7fdfb6ffd640 1 --2- 172.21.15.55:0/3238615722 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdfb815ec00 0x7fdfb81599c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:34:48.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:48.984+0000 7fdfb6ffd640 1 -- 172.21.15.55:0/3238615722 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfb80cc7f0 con 0x7fdfb80b3860 2024-05-27T12:34:48.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:48.984+0000 7fdfb6ffd640 1 --2- 172.21.15.55:0/3238615722 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdfb80b3860 0x7fdfb80cde40 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fdfa800efc0 tx=0x7fdfa800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:34:48.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:48.984+0000 7fdf9f7fe640 1 -- 172.21.15.55:0/3238615722 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfa8018020 con 0x7fdfb80b3860 2024-05-27T12:34:48.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:48.984+0000 7fdf9f7fe640 1 -- 172.21.15.55:0/3238615722 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfa8014480 con 0x7fdfb80b3860 2024-05-27T12:34:48.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:48.984+0000 7fdfbd7f7640 1 -- 172.21.15.55:0/3238615722 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfb80ccad0 con 0x7fdfb80b3860 2024-05-27T12:34:48.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:48.984+0000 7fdf9f7fe640 1 -- 172.21.15.55:0/3238615722 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfa8014850 con 0x7fdfb80b3860 2024-05-27T12:34:48.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:48.984+0000 7fdfbd7f7640 1 -- 172.21.15.55:0/3238615722 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfb80cd090 con 0x7fdfb80b3860 2024-05-27T12:34:48.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:48.985+0000 7fdfbd7f7640 1 -- 172.21.15.55:0/3238615722 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdfb806db20 con 0x7fdfb80b3860 2024-05-27T12:34:48.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:48.986+0000 7fdf9f7fe640 1 -- 172.21.15.55:0/3238615722 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 7) ==== 91193+0+0 (secure 0 0 0) 0x7fdfa801b020 con 0x7fdfb80b3860 2024-05-27T12:34:48.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:48.986+0000 7fdf9f7fe640 1 --2- 172.21.15.55:0/3238615722 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fdfa406caa0 0x7fdfa406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:34:48.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:48.986+0000 7fdf9f7fe640 1 -- 172.21.15.55:0/3238615722 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5709+0+0 (secure 0 0 0) 0x7fdfa808cd80 con 0x7fdfb80b3860 2024-05-27T12:34:48.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:48.986+0000 7fdfb67fc640 1 --2- 172.21.15.55:0/3238615722 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fdfa406caa0 0x7fdfa406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:34:48.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:48.987+0000 7fdfb67fc640 1 --2- 172.21.15.55:0/3238615722 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fdfa406caa0 0x7fdfa406ef60 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fdfac034000 tx=0x7fdfac02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:34:48.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:48.991+0000 7fdf9f7fe640 1 -- 172.21.15.55:0/3238615722 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fdfb806db20 con 0x7fdfb80b3860 2024-05-27T12:34:49.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:49.252+0000 7fdfbd7f7640 1 -- 172.21.15.55:0/3238615722 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fdfb8075460 con 0x7fdfb80b3860 2024-05-27T12:34:49.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:49.252+0000 7fdf9f7fe640 1 -- 172.21.15.55:0/3238615722 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2110 (secure 0 0 0) 0x7fdfa8022020 con 0x7fdfb80b3860 2024-05-27T12:34:49.252 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-27T12:34:49.252 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-05-27T12:34:49.252 INFO:teuthology.orchestra.run.smithi055.stdout: "fsid": "c3ff4e3b-8dae-4856-9593-e5cc66c59982", 2024-05-27T12:34:49.252 INFO:teuthology.orchestra.run.smithi055.stdout: "health": { 2024-05-27T12:34:49.252 INFO:teuthology.orchestra.run.smithi055.stdout: "status": "HEALTH_OK", 2024-05-27T12:34:49.252 INFO:teuthology.orchestra.run.smithi055.stdout: "checks": {}, 2024-05-27T12:34:49.252 INFO:teuthology.orchestra.run.smithi055.stdout: "mutes": [] 2024-05-27T12:34:49.252 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-05-27T12:34:49.253 INFO:teuthology.orchestra.run.smithi055.stdout: "election_epoch": 4, 2024-05-27T12:34:49.253 INFO:teuthology.orchestra.run.smithi055.stdout: "quorum": [ 2024-05-27T12:34:49.253 INFO:teuthology.orchestra.run.smithi055.stdout: 0, 2024-05-27T12:34:49.253 INFO:teuthology.orchestra.run.smithi055.stdout: 1, 2024-05-27T12:34:49.253 INFO:teuthology.orchestra.run.smithi055.stdout: 2 2024-05-27T12:34:49.253 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-05-27T12:34:49.253 INFO:teuthology.orchestra.run.smithi055.stdout: "quorum_names": [ 2024-05-27T12:34:49.253 INFO:teuthology.orchestra.run.smithi055.stdout: "a", 2024-05-27T12:34:49.253 INFO:teuthology.orchestra.run.smithi055.stdout: "b", 2024-05-27T12:34:49.253 INFO:teuthology.orchestra.run.smithi055.stdout: "c" 2024-05-27T12:34:49.253 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-05-27T12:34:49.253 INFO:teuthology.orchestra.run.smithi055.stdout: "quorum_age": 152, 2024-05-27T12:34:49.254 INFO:teuthology.orchestra.run.smithi055.stdout: "monmap": { 2024-05-27T12:34:49.254 INFO:teuthology.orchestra.run.smithi055.stdout: "epoch": 1, 2024-05-27T12:34:49.254 INFO:teuthology.orchestra.run.smithi055.stdout: "min_mon_release_name": "squid", 2024-05-27T12:34:49.254 INFO:teuthology.orchestra.run.smithi055.stdout: "num_mons": 3 2024-05-27T12:34:49.254 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-05-27T12:34:49.254 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap": { 2024-05-27T12:34:49.254 INFO:teuthology.orchestra.run.smithi055.stdout: "epoch": 36, 2024-05-27T12:34:49.254 INFO:teuthology.orchestra.run.smithi055.stdout: "num_osds": 8, 2024-05-27T12:34:49.254 INFO:teuthology.orchestra.run.smithi055.stdout: "num_up_osds": 8, 2024-05-27T12:34:49.254 INFO:teuthology.orchestra.run.smithi055.stdout: "osd_up_since": 1716813148, 2024-05-27T12:34:49.254 INFO:teuthology.orchestra.run.smithi055.stdout: "num_in_osds": 8, 2024-05-27T12:34:49.254 INFO:teuthology.orchestra.run.smithi055.stdout: "osd_in_since": 1716813139, 2024-05-27T12:34:49.255 INFO:teuthology.orchestra.run.smithi055.stdout: "num_remapped_pgs": 0 2024-05-27T12:34:49.255 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-05-27T12:34:49.255 INFO:teuthology.orchestra.run.smithi055.stdout: "pgmap": { 2024-05-27T12:34:49.255 INFO:teuthology.orchestra.run.smithi055.stdout: "pgs_by_state": [ 2024-05-27T12:34:49.255 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-05-27T12:34:49.255 INFO:teuthology.orchestra.run.smithi055.stdout: "state_name": "active+clean", 2024-05-27T12:34:49.255 INFO:teuthology.orchestra.run.smithi055.stdout: "count": 97 2024-05-27T12:34:49.255 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-05-27T12:34:49.255 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-05-27T12:34:49.255 INFO:teuthology.orchestra.run.smithi055.stdout: "num_pgs": 97, 2024-05-27T12:34:49.255 INFO:teuthology.orchestra.run.smithi055.stdout: "num_pools": 3, 2024-05-27T12:34:49.255 INFO:teuthology.orchestra.run.smithi055.stdout: "num_objects": 3093, 2024-05-27T12:34:49.256 INFO:teuthology.orchestra.run.smithi055.stdout: "data_bytes": 12852669351, 2024-05-27T12:34:49.256 INFO:teuthology.orchestra.run.smithi055.stdout: "bytes_used": 25968295936, 2024-05-27T12:34:49.256 INFO:teuthology.orchestra.run.smithi055.stdout: "bytes_avail": 747125817344, 2024-05-27T12:34:49.256 INFO:teuthology.orchestra.run.smithi055.stdout: "bytes_total": 773094113280, 2024-05-27T12:34:49.256 INFO:teuthology.orchestra.run.smithi055.stdout: "read_bytes_sec": 341, 2024-05-27T12:34:49.256 INFO:teuthology.orchestra.run.smithi055.stdout: "write_bytes_sec": 5886, 2024-05-27T12:34:49.256 INFO:teuthology.orchestra.run.smithi055.stdout: "read_op_per_sec": 0, 2024-05-27T12:34:49.256 INFO:teuthology.orchestra.run.smithi055.stdout: "write_op_per_sec": 2 2024-05-27T12:34:49.256 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-05-27T12:34:49.256 INFO:teuthology.orchestra.run.smithi055.stdout: "fsmap": { 2024-05-27T12:34:49.256 INFO:teuthology.orchestra.run.smithi055.stdout: "epoch": 15, 2024-05-27T12:34:49.256 INFO:teuthology.orchestra.run.smithi055.stdout: "id": 2, 2024-05-27T12:34:49.257 INFO:teuthology.orchestra.run.smithi055.stdout: "up": 1, 2024-05-27T12:34:49.257 INFO:teuthology.orchestra.run.smithi055.stdout: "in": 1, 2024-05-27T12:34:49.257 INFO:teuthology.orchestra.run.smithi055.stdout: "max": 1, 2024-05-27T12:34:49.257 INFO:teuthology.orchestra.run.smithi055.stdout: "by_rank": [ 2024-05-27T12:34:49.257 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-05-27T12:34:49.257 INFO:teuthology.orchestra.run.smithi055.stdout: "filesystem_id": 2, 2024-05-27T12:34:49.257 INFO:teuthology.orchestra.run.smithi055.stdout: "rank": 0, 2024-05-27T12:34:49.257 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "a", 2024-05-27T12:34:49.257 INFO:teuthology.orchestra.run.smithi055.stdout: "status": "up:active", 2024-05-27T12:34:49.257 INFO:teuthology.orchestra.run.smithi055.stdout: "gid": 5151 2024-05-27T12:34:49.257 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-05-27T12:34:49.257 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-05-27T12:34:49.257 INFO:teuthology.orchestra.run.smithi055.stdout: "up:standby": 3 2024-05-27T12:34:49.258 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-05-27T12:34:49.258 INFO:teuthology.orchestra.run.smithi055.stdout: "mgrmap": { 2024-05-27T12:34:49.258 INFO:teuthology.orchestra.run.smithi055.stdout: "available": true, 2024-05-27T12:34:49.258 INFO:teuthology.orchestra.run.smithi055.stdout: "num_standbys": 1, 2024-05-27T12:34:49.258 INFO:teuthology.orchestra.run.smithi055.stdout: "modules": [ 2024-05-27T12:34:49.258 INFO:teuthology.orchestra.run.smithi055.stdout: "iostat", 2024-05-27T12:34:49.258 INFO:teuthology.orchestra.run.smithi055.stdout: "nfs", 2024-05-27T12:34:49.258 INFO:teuthology.orchestra.run.smithi055.stdout: "restful" 2024-05-27T12:34:49.258 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-05-27T12:34:49.258 INFO:teuthology.orchestra.run.smithi055.stdout: "services": {} 2024-05-27T12:34:49.258 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-05-27T12:34:49.259 INFO:teuthology.orchestra.run.smithi055.stdout: "servicemap": { 2024-05-27T12:34:49.259 INFO:teuthology.orchestra.run.smithi055.stdout: "epoch": 5, 2024-05-27T12:34:49.259 INFO:teuthology.orchestra.run.smithi055.stdout: "modified": "2024-05-27T12:34:41.289759+0000", 2024-05-27T12:34:49.259 INFO:teuthology.orchestra.run.smithi055.stdout: "services": {} 2024-05-27T12:34:49.259 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-05-27T12:34:49.259 INFO:teuthology.orchestra.run.smithi055.stdout: "progress_events": { 2024-05-27T12:34:49.259 INFO:teuthology.orchestra.run.smithi055.stdout: "9790db59-2553-4e9d-97e4-4d0c80d5b839": { 2024-05-27T12:34:49.259 INFO:teuthology.orchestra.run.smithi055.stdout: "message": "All cloning finished, waiting 16.0 seconds before exiting (17s)\n [============================] ", 2024-05-27T12:34:49.259 INFO:teuthology.orchestra.run.smithi055.stdout: "progress": 1, 2024-05-27T12:34:49.259 INFO:teuthology.orchestra.run.smithi055.stdout: "add_to_ceph_s": true 2024-05-27T12:34:49.259 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-05-27T12:34:49.259 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-05-27T12:34:49.259 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-05-27T12:34:49.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:49.254+0000 7fdfbd7f7640 1 -- 172.21.15.55:0/3238615722 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fdfa406caa0 msgr2=0x7fdfa406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:34:49.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:49.254+0000 7fdfbd7f7640 1 --2- 172.21.15.55:0/3238615722 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fdfa406caa0 0x7fdfa406ef60 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fdfac034000 tx=0x7fdfac02e000 comp rx=0 tx=0).stop 2024-05-27T12:34:49.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:49.254+0000 7fdfbd7f7640 1 -- 172.21.15.55:0/3238615722 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdfb80b3860 msgr2=0x7fdfb80cde40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:34:49.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:49.254+0000 7fdfbd7f7640 1 --2- 172.21.15.55:0/3238615722 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdfb80b3860 0x7fdfb80cde40 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fdfa800efc0 tx=0x7fdfa800c490 comp rx=0 tx=0).stop 2024-05-27T12:34:49.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:49.254+0000 7fdfbd7f7640 1 -- 172.21.15.55:0/3238615722 shutdown_connections 2024-05-27T12:34:49.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:49.254+0000 7fdfbd7f7640 1 --2- 172.21.15.55:0/3238615722 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fdfa406caa0 0x7fdfa406ef60 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:34:49.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:49.254+0000 7fdfbd7f7640 1 --2- 172.21.15.55:0/3238615722 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdfb815ec00 0x7fdfb81599c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:34:49.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:49.254+0000 7fdfbd7f7640 1 --2- 172.21.15.55:0/3238615722 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdfb80b6370 0x7fdfb81611b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:34:49.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:49.254+0000 7fdfbd7f7640 1 --2- 172.21.15.55:0/3238615722 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdfb80b3860 0x7fdfb80cde40 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:34:49.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:49.254+0000 7fdfbd7f7640 1 -- 172.21.15.55:0/3238615722 >> 172.21.15.55:0/3238615722 conn(0x7fdfb80d1370 msgr2=0x7fdfb815cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:34:49.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:49.254+0000 7fdfbd7f7640 1 -- 172.21.15.55:0/3238615722 shutdown_connections 2024-05-27T12:34:49.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:49.254+0000 7fdfbd7f7640 1 -- 172.21.15.55:0/3238615722 wait complete. 2024-05-27T12:34:54.266 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-27T12:34:54.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:54.383+0000 7f8a1277d640 1 Processor -- start 2024-05-27T12:34:54.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:54.383+0000 7f8a1277d640 1 -- start start 2024-05-27T12:34:54.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:54.383+0000 7f8a1277d640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8a0c0b3860 0x7f8a0c0b3db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:34:54.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:54.383+0000 7f8a1277d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8a0c0b6370 0x7f8a0c0b6800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:34:54.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:54.383+0000 7f8a1277d640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a0c1632f0 con 0x7f8a0c15ec00 2024-05-27T12:34:54.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:54.383+0000 7f8a1277d640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f8a0c0cf2e0 con 0x7f8a0c0b6370 2024-05-27T12:34:54.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:54.383+0000 7f8a1277d640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f8a0c1635d0 con 0x7f8a0c0b3860 2024-05-27T12:34:54.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:54.384+0000 7f8a10d1a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8a0c0b6370 0x7f8a0c0b6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:34:54.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:54.384+0000 7f8a10d1a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8a0c0b6370 0x7f8a0c0b6800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34900/0 (socket says 172.21.15.55:34900) 2024-05-27T12:34:54.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:54.384+0000 7f8a10d1a640 1 -- 172.21.15.55:0/4088946068 learned_addr learned my addr 172.21.15.55:0/4088946068 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:34:54.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:54.384+0000 7f8a0b7fe640 1 --2- 172.21.15.55:0/4088946068 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8a0c0b3860 0x7f8a0c0b3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:34:54.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:54.384+0000 7f8a10d1a640 1 -- 172.21.15.55:0/4088946068 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8a0c0b3860 msgr2=0x7f8a0c0b3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:34:54.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:54.384+0000 7f8a10d1a640 1 --2- 172.21.15.55:0/4088946068 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8a0c0b3860 0x7f8a0c0b3db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:34:54.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:54.384+0000 7f8a10d1a640 1 -- 172.21.15.55:0/4088946068 >> v1:172.21.15.72:6789/0 conn(0x7f8a0c15ec00 legacy=0x7f8a0c0cfd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:34:54.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:54.384+0000 7f8a10d1a640 1 -- 172.21.15.55:0/4088946068 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a0c0cf530 con 0x7f8a0c0b6370 2024-05-27T12:34:54.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:54.385+0000 7f8a10d1a640 1 --2- 172.21.15.55:0/4088946068 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a0c0b6370 0x7f8a0c0b6800 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f8a04009e50 tx=0x7f8a0402a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96824fb1307543bd server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:34:54.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:54.385+0000 7f8a0affd640 1 -- 172.21.15.55:0/4088946068 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a04036070 con 0x7f8a0c0b6370 2024-05-27T12:34:54.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:54.385+0000 7f8a0affd640 1 -- 172.21.15.55:0/4088946068 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a04031600 con 0x7f8a0c0b6370 2024-05-27T12:34:54.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:54.385+0000 7f8a0affd640 1 -- 172.21.15.55:0/4088946068 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a040319d0 con 0x7f8a0c0b6370 2024-05-27T12:34:54.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:54.385+0000 7f8a1277d640 1 -- 172.21.15.55:0/4088946068 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a0c0b6370 msgr2=0x7f8a0c0b6800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:34:54.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:54.385+0000 7f8a1277d640 1 --2- 172.21.15.55:0/4088946068 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a0c0b6370 0x7f8a0c0b6800 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f8a04009e50 tx=0x7f8a0402a6c0 comp rx=0 tx=0).stop 2024-05-27T12:34:54.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:54.385+0000 7f8a1277d640 1 -- 172.21.15.55:0/4088946068 shutdown_connections 2024-05-27T12:34:54.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:54.385+0000 7f8a1277d640 1 --2- 172.21.15.55:0/4088946068 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a0c0b6370 0x7f8a0c0b6800 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:34:54.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:54.385+0000 7f8a1277d640 1 --2- 172.21.15.55:0/4088946068 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8a0c0b3860 0x7f8a0c0b3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:34:54.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:54.386+0000 7f8a1277d640 1 -- 172.21.15.55:0/4088946068 >> 172.21.15.55:0/4088946068 conn(0x7f8a0c0d1370 msgr2=0x7f8a0c0d1780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:34:54.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:54.386+0000 7f8a1277d640 1 -- 172.21.15.55:0/4088946068 shutdown_connections 2024-05-27T12:34:54.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:54.386+0000 7f8a1277d640 1 -- 172.21.15.55:0/4088946068 wait complete. 2024-05-27T12:34:54.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:54.387+0000 7f8a1277d640 1 Processor -- start 2024-05-27T12:34:54.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:54.387+0000 7f8a1277d640 1 -- start start 2024-05-27T12:34:54.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:54.388+0000 7f8a1277d640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a0c0b3860 0x7f8a0c159ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:34:54.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:54.388+0000 7f8a1277d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a0c0b6370 0x7f8a0c0cb9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:34:54.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:54.388+0000 7f8a1277d640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8a0c15ec00 0x7f8a0c0b5c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:34:54.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:54.388+0000 7f8a1277d640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f8a0c15efe0 con 0x7f8a0c0b6370 2024-05-27T12:34:54.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:54.388+0000 7f8a1277d640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f8a0c0b3530 con 0x7f8a0c0b3860 2024-05-27T12:34:54.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:54.388+0000 7f8a1277d640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f8a0c15f160 con 0x7f8a0c15ec00 2024-05-27T12:34:54.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:54.388+0000 7f8a0b7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a0c0b6370 0x7f8a0c0cb9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:34:54.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:54.388+0000 7f8a0b7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a0c0b6370 0x7f8a0c0cb9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34908/0 (socket says 172.21.15.55:34908) 2024-05-27T12:34:54.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:54.388+0000 7f8a0b7fe640 1 -- 172.21.15.55:0/4042505427 learned_addr learned my addr 172.21.15.55:0/4042505427 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:34:54.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:54.388+0000 7f8a10d1a640 1 --2- 172.21.15.55:0/4042505427 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8a0c15ec00 0x7f8a0c0b5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:34:54.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:54.388+0000 7f8a0bfff640 1 --2- 172.21.15.55:0/4042505427 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a0c0b3860 0x7f8a0c159ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:34:54.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:54.388+0000 7f8a0b7fe640 1 -- 172.21.15.55:0/4042505427 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8a0c15ec00 msgr2=0x7f8a0c0b5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:34:54.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:54.388+0000 7f8a0b7fe640 1 --2- 172.21.15.55:0/4042505427 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8a0c15ec00 0x7f8a0c0b5c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:34:54.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:54.388+0000 7f8a0b7fe640 1 -- 172.21.15.55:0/4042505427 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a0c0b3860 msgr2=0x7f8a0c159ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:34:54.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:54.388+0000 7f8a0b7fe640 1 --2- 172.21.15.55:0/4042505427 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a0c0b3860 0x7f8a0c159ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:34:54.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:54.388+0000 7f8a0b7fe640 1 -- 172.21.15.55:0/4042505427 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a0c0b6140 con 0x7f8a0c0b6370 2024-05-27T12:34:54.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:54.388+0000 7f8a0bfff640 1 --2- 172.21.15.55:0/4042505427 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a0c0b3860 0x7f8a0c159ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T12:34:54.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:54.388+0000 7f8a0b7fe640 1 --2- 172.21.15.55:0/4042505427 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a0c0b6370 0x7f8a0c0cb9c0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f8a0000d800 tx=0x7f8a0000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:34:54.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:54.389+0000 7f8a08ff9640 1 -- 172.21.15.55:0/4042505427 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a0000b6c0 con 0x7f8a0c0b6370 2024-05-27T12:34:54.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:54.389+0000 7f8a08ff9640 1 -- 172.21.15.55:0/4042505427 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a00019070 con 0x7f8a0c0b6370 2024-05-27T12:34:54.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:54.389+0000 7f8a08ff9640 1 -- 172.21.15.55:0/4042505427 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a0000ba80 con 0x7f8a0c0b6370 2024-05-27T12:34:54.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:54.389+0000 7f8a1277d640 1 -- 172.21.15.55:0/4042505427 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a0c1f50d0 con 0x7f8a0c0b6370 2024-05-27T12:34:54.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:54.389+0000 7f8a1277d640 1 -- 172.21.15.55:0/4042505427 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a0c1f5690 con 0x7f8a0c0b6370 2024-05-27T12:34:54.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:54.390+0000 7f8a1277d640 1 -- 172.21.15.55:0/4042505427 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a0c06db20 con 0x7f8a0c0b6370 2024-05-27T12:34:54.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:54.390+0000 7f8a08ff9640 1 -- 172.21.15.55:0/4042505427 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 7) ==== 91193+0+0 (secure 0 0 0) 0x7f8a0000bc20 con 0x7f8a0c0b6370 2024-05-27T12:34:54.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:54.391+0000 7f8a08ff9640 1 --2- 172.21.15.55:0/4042505427 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f89f806caa0 0x7f89f806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:34:54.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:54.391+0000 7f8a08ff9640 1 -- 172.21.15.55:0/4042505427 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5709+0+0 (secure 0 0 0) 0x7f8a0008c370 con 0x7f8a0c0b6370 2024-05-27T12:34:54.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:54.391+0000 7f8a0bfff640 1 --2- 172.21.15.55:0/4042505427 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f89f806caa0 0x7f89f806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:34:54.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:54.391+0000 7f8a0bfff640 1 --2- 172.21.15.55:0/4042505427 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f89f806caa0 0x7f89f806ef60 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c06cbb0 tx=0x7f89fc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:34:54.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:54.395+0000 7f8a08ff9640 1 -- 172.21.15.55:0/4042505427 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8a0c06db20 con 0x7f8a0c0b6370 2024-05-27T12:34:54.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:54.660+0000 7f8a1277d640 1 -- 172.21.15.55:0/4042505427 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f8a0c075460 con 0x7f8a0c0b6370 2024-05-27T12:34:54.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:54.660+0000 7f8a08ff9640 1 -- 172.21.15.55:0/4042505427 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2079 (secure 0 0 0) 0x7f8a0005a520 con 0x7f8a0c0b6370 2024-05-27T12:34:54.660 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-27T12:34:54.660 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-05-27T12:34:54.660 INFO:teuthology.orchestra.run.smithi055.stdout: "fsid": "c3ff4e3b-8dae-4856-9593-e5cc66c59982", 2024-05-27T12:34:54.660 INFO:teuthology.orchestra.run.smithi055.stdout: "health": { 2024-05-27T12:34:54.660 INFO:teuthology.orchestra.run.smithi055.stdout: "status": "HEALTH_OK", 2024-05-27T12:34:54.660 INFO:teuthology.orchestra.run.smithi055.stdout: "checks": {}, 2024-05-27T12:34:54.660 INFO:teuthology.orchestra.run.smithi055.stdout: "mutes": [] 2024-05-27T12:34:54.660 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-05-27T12:34:54.660 INFO:teuthology.orchestra.run.smithi055.stdout: "election_epoch": 4, 2024-05-27T12:34:54.660 INFO:teuthology.orchestra.run.smithi055.stdout: "quorum": [ 2024-05-27T12:34:54.660 INFO:teuthology.orchestra.run.smithi055.stdout: 0, 2024-05-27T12:34:54.660 INFO:teuthology.orchestra.run.smithi055.stdout: 1, 2024-05-27T12:34:54.661 INFO:teuthology.orchestra.run.smithi055.stdout: 2 2024-05-27T12:34:54.661 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-05-27T12:34:54.661 INFO:teuthology.orchestra.run.smithi055.stdout: "quorum_names": [ 2024-05-27T12:34:54.661 INFO:teuthology.orchestra.run.smithi055.stdout: "a", 2024-05-27T12:34:54.661 INFO:teuthology.orchestra.run.smithi055.stdout: "b", 2024-05-27T12:34:54.661 INFO:teuthology.orchestra.run.smithi055.stdout: "c" 2024-05-27T12:34:54.661 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-05-27T12:34:54.661 INFO:teuthology.orchestra.run.smithi055.stdout: "quorum_age": 157, 2024-05-27T12:34:54.661 INFO:teuthology.orchestra.run.smithi055.stdout: "monmap": { 2024-05-27T12:34:54.661 INFO:teuthology.orchestra.run.smithi055.stdout: "epoch": 1, 2024-05-27T12:34:54.661 INFO:teuthology.orchestra.run.smithi055.stdout: "min_mon_release_name": "squid", 2024-05-27T12:34:54.661 INFO:teuthology.orchestra.run.smithi055.stdout: "num_mons": 3 2024-05-27T12:34:54.661 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-05-27T12:34:54.661 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap": { 2024-05-27T12:34:54.662 INFO:teuthology.orchestra.run.smithi055.stdout: "epoch": 36, 2024-05-27T12:34:54.662 INFO:teuthology.orchestra.run.smithi055.stdout: "num_osds": 8, 2024-05-27T12:34:54.662 INFO:teuthology.orchestra.run.smithi055.stdout: "num_up_osds": 8, 2024-05-27T12:34:54.662 INFO:teuthology.orchestra.run.smithi055.stdout: "osd_up_since": 1716813148, 2024-05-27T12:34:54.662 INFO:teuthology.orchestra.run.smithi055.stdout: "num_in_osds": 8, 2024-05-27T12:34:54.662 INFO:teuthology.orchestra.run.smithi055.stdout: "osd_in_since": 1716813139, 2024-05-27T12:34:54.662 INFO:teuthology.orchestra.run.smithi055.stdout: "num_remapped_pgs": 0 2024-05-27T12:34:54.662 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-05-27T12:34:54.662 INFO:teuthology.orchestra.run.smithi055.stdout: "pgmap": { 2024-05-27T12:34:54.662 INFO:teuthology.orchestra.run.smithi055.stdout: "pgs_by_state": [ 2024-05-27T12:34:54.662 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-05-27T12:34:54.662 INFO:teuthology.orchestra.run.smithi055.stdout: "state_name": "active+clean", 2024-05-27T12:34:54.662 INFO:teuthology.orchestra.run.smithi055.stdout: "count": 97 2024-05-27T12:34:54.663 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-05-27T12:34:54.663 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-05-27T12:34:54.663 INFO:teuthology.orchestra.run.smithi055.stdout: "num_pgs": 97, 2024-05-27T12:34:54.663 INFO:teuthology.orchestra.run.smithi055.stdout: "num_pools": 3, 2024-05-27T12:34:54.663 INFO:teuthology.orchestra.run.smithi055.stdout: "num_objects": 3093, 2024-05-27T12:34:54.663 INFO:teuthology.orchestra.run.smithi055.stdout: "data_bytes": 12852688031, 2024-05-27T12:34:54.663 INFO:teuthology.orchestra.run.smithi055.stdout: "bytes_used": 25968336896, 2024-05-27T12:34:54.663 INFO:teuthology.orchestra.run.smithi055.stdout: "bytes_avail": 747125776384, 2024-05-27T12:34:54.663 INFO:teuthology.orchestra.run.smithi055.stdout: "bytes_total": 773094113280, 2024-05-27T12:34:54.663 INFO:teuthology.orchestra.run.smithi055.stdout: "write_bytes_sec": 4180, 2024-05-27T12:34:54.663 INFO:teuthology.orchestra.run.smithi055.stdout: "read_op_per_sec": 0, 2024-05-27T12:34:54.663 INFO:teuthology.orchestra.run.smithi055.stdout: "write_op_per_sec": 1 2024-05-27T12:34:54.663 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-05-27T12:34:54.663 INFO:teuthology.orchestra.run.smithi055.stdout: "fsmap": { 2024-05-27T12:34:54.664 INFO:teuthology.orchestra.run.smithi055.stdout: "epoch": 15, 2024-05-27T12:34:54.664 INFO:teuthology.orchestra.run.smithi055.stdout: "id": 2, 2024-05-27T12:34:54.664 INFO:teuthology.orchestra.run.smithi055.stdout: "up": 1, 2024-05-27T12:34:54.664 INFO:teuthology.orchestra.run.smithi055.stdout: "in": 1, 2024-05-27T12:34:54.664 INFO:teuthology.orchestra.run.smithi055.stdout: "max": 1, 2024-05-27T12:34:54.664 INFO:teuthology.orchestra.run.smithi055.stdout: "by_rank": [ 2024-05-27T12:34:54.664 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-05-27T12:34:54.664 INFO:teuthology.orchestra.run.smithi055.stdout: "filesystem_id": 2, 2024-05-27T12:34:54.664 INFO:teuthology.orchestra.run.smithi055.stdout: "rank": 0, 2024-05-27T12:34:54.664 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "a", 2024-05-27T12:34:54.664 INFO:teuthology.orchestra.run.smithi055.stdout: "status": "up:active", 2024-05-27T12:34:54.664 INFO:teuthology.orchestra.run.smithi055.stdout: "gid": 5151 2024-05-27T12:34:54.664 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-05-27T12:34:54.664 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-05-27T12:34:54.665 INFO:teuthology.orchestra.run.smithi055.stdout: "up:standby": 3 2024-05-27T12:34:54.665 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-05-27T12:34:54.665 INFO:teuthology.orchestra.run.smithi055.stdout: "mgrmap": { 2024-05-27T12:34:54.665 INFO:teuthology.orchestra.run.smithi055.stdout: "available": true, 2024-05-27T12:34:54.665 INFO:teuthology.orchestra.run.smithi055.stdout: "num_standbys": 1, 2024-05-27T12:34:54.665 INFO:teuthology.orchestra.run.smithi055.stdout: "modules": [ 2024-05-27T12:34:54.665 INFO:teuthology.orchestra.run.smithi055.stdout: "iostat", 2024-05-27T12:34:54.665 INFO:teuthology.orchestra.run.smithi055.stdout: "nfs", 2024-05-27T12:34:54.665 INFO:teuthology.orchestra.run.smithi055.stdout: "restful" 2024-05-27T12:34:54.665 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-05-27T12:34:54.665 INFO:teuthology.orchestra.run.smithi055.stdout: "services": {} 2024-05-27T12:34:54.665 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-05-27T12:34:54.665 INFO:teuthology.orchestra.run.smithi055.stdout: "servicemap": { 2024-05-27T12:34:54.665 INFO:teuthology.orchestra.run.smithi055.stdout: "epoch": 5, 2024-05-27T12:34:54.666 INFO:teuthology.orchestra.run.smithi055.stdout: "modified": "2024-05-27T12:34:41.289759+0000", 2024-05-27T12:34:54.666 INFO:teuthology.orchestra.run.smithi055.stdout: "services": {} 2024-05-27T12:34:54.666 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-05-27T12:34:54.666 INFO:teuthology.orchestra.run.smithi055.stdout: "progress_events": { 2024-05-27T12:34:54.666 INFO:teuthology.orchestra.run.smithi055.stdout: "9790db59-2553-4e9d-97e4-4d0c80d5b839": { 2024-05-27T12:34:54.666 INFO:teuthology.orchestra.run.smithi055.stdout: "message": "All cloning finished, waiting 10.0 seconds before exiting (23s)\n [============================] ", 2024-05-27T12:34:54.666 INFO:teuthology.orchestra.run.smithi055.stdout: "progress": 1, 2024-05-27T12:34:54.666 INFO:teuthology.orchestra.run.smithi055.stdout: "add_to_ceph_s": true 2024-05-27T12:34:54.666 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-05-27T12:34:54.666 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-05-27T12:34:54.666 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-05-27T12:34:54.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:54.662+0000 7f8a1277d640 1 -- 172.21.15.55:0/4042505427 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f89f806caa0 msgr2=0x7f89f806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:34:54.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:54.662+0000 7f8a1277d640 1 --2- 172.21.15.55:0/4042505427 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f89f806caa0 0x7f89f806ef60 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c06cbb0 tx=0x7f89fc008040 comp rx=0 tx=0).stop 2024-05-27T12:34:54.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:54.662+0000 7f8a1277d640 1 -- 172.21.15.55:0/4042505427 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a0c0b6370 msgr2=0x7f8a0c0cb9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:34:54.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:54.662+0000 7f8a1277d640 1 --2- 172.21.15.55:0/4042505427 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a0c0b6370 0x7f8a0c0cb9c0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f8a0000d800 tx=0x7f8a0000dcc0 comp rx=0 tx=0).stop 2024-05-27T12:34:54.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:54.662+0000 7f8a1277d640 1 -- 172.21.15.55:0/4042505427 shutdown_connections 2024-05-27T12:34:54.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:54.662+0000 7f8a1277d640 1 --2- 172.21.15.55:0/4042505427 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8a0c15ec00 0x7f8a0c0b5c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:34:54.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:54.662+0000 7f8a1277d640 1 --2- 172.21.15.55:0/4042505427 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a0c0b6370 0x7f8a0c0cb9c0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:34:54.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:54.662+0000 7f8a1277d640 1 --2- 172.21.15.55:0/4042505427 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f89f806caa0 0x7f89f806ef60 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:34:54.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:54.662+0000 7f8a1277d640 1 --2- 172.21.15.55:0/4042505427 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a0c0b3860 0x7f8a0c159ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:34:54.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:54.662+0000 7f8a1277d640 1 -- 172.21.15.55:0/4042505427 >> 172.21.15.55:0/4042505427 conn(0x7f8a0c0d1370 msgr2=0x7f8a0c0d1750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:34:54.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:54.663+0000 7f8a1277d640 1 -- 172.21.15.55:0/4042505427 shutdown_connections 2024-05-27T12:34:54.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:54.663+0000 7f8a1277d640 1 -- 172.21.15.55:0/4042505427 wait complete. 2024-05-27T12:34:59.674 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-27T12:34:59.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:59.790+0000 7f5a3f423640 1 Processor -- start 2024-05-27T12:34:59.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:59.791+0000 7f5a3f423640 1 -- start start 2024-05-27T12:34:59.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:59.791+0000 7f5a3f423640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5a3815eb00 0x7f5a3815f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:34:59.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:59.791+0000 7f5a3f423640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a380d08b0 con 0x7f5a380d1630 2024-05-27T12:34:59.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:59.791+0000 7f5a3f423640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a380d1a50 con 0x7f5a3809b140 2024-05-27T12:34:59.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:59.791+0000 7f5a3f423640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f5a380d0b50 con 0x7f5a3815eb00 2024-05-27T12:34:59.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:59.792+0000 7f5a3d1bf640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5a3815eb00 0x7f5a3815f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:34:59.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:59.792+0000 7f5a3c9be640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f5a380d1630 0x7f5a3809aa30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:50506/0 (socket says 172.21.15.55:50506) 2024-05-27T12:34:59.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:59.792+0000 7f5a3c9be640 1 -- 172.21.15.55:0/2502578409 learned_addr learned my addr 172.21.15.55:0/2502578409 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-27T12:34:59.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:59.792+0000 7f5a3d1bf640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5a3815eb00 0x7f5a3815f9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34922/0 (socket says 172.21.15.55:34922) 2024-05-27T12:34:59.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:59.792+0000 7f5a3d1bf640 1 -- 172.21.15.55:0/2502578409 >> v1:172.21.15.72:6789/0 conn(0x7f5a3809b140 legacy=0x7f5a381684f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:34:59.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:59.792+0000 7f5a3d1bf640 1 -- 172.21.15.55:0/2502578409 >> v1:172.21.15.55:6789/0 conn(0x7f5a380d1630 legacy=0x7f5a3809aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:34:59.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:59.792+0000 7f5a2ffff640 1 -- 172.21.15.55:0/2502578409 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 101996433 0 0) 0x7f5a380d08b0 con 0x7f5a380d1630 2024-05-27T12:34:59.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:59.792+0000 7f5a3d1bf640 1 -- 172.21.15.55:0/2502578409 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a380d0e30 con 0x7f5a3815eb00 2024-05-27T12:34:59.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:59.793+0000 7f5a3d1bf640 1 --2- 172.21.15.55:0/2502578409 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5a3815eb00 0x7f5a3815f9b0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f5a34009d90 tx=0x7f5a3402a780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ad45de16d6eeb73 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:34:59.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:59.793+0000 7f5a2ffff640 1 -- 172.21.15.55:0/2502578409 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a34037070 con 0x7f5a3815eb00 2024-05-27T12:34:59.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:59.793+0000 7f5a2ffff640 1 -- 172.21.15.55:0/2502578409 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a34007740 con 0x7f5a3815eb00 2024-05-27T12:34:59.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:59.793+0000 7f5a2ffff640 1 -- 172.21.15.55:0/2502578409 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a34007b10 con 0x7f5a3815eb00 2024-05-27T12:34:59.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:59.793+0000 7f5a3f423640 1 -- 172.21.15.55:0/2502578409 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5a3815eb00 msgr2=0x7f5a3815f9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:34:59.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:59.793+0000 7f5a3f423640 1 --2- 172.21.15.55:0/2502578409 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5a3815eb00 0x7f5a3815f9b0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f5a34009d90 tx=0x7f5a3402a780 comp rx=0 tx=0).stop 2024-05-27T12:34:59.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:59.793+0000 7f5a3f423640 1 -- 172.21.15.55:0/2502578409 shutdown_connections 2024-05-27T12:34:59.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:59.793+0000 7f5a3f423640 1 --2- 172.21.15.55:0/2502578409 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5a3815eb00 0x7f5a3815f9b0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:34:59.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:59.793+0000 7f5a3f423640 1 -- 172.21.15.55:0/2502578409 >> 172.21.15.55:0/2502578409 conn(0x7f5a380b4100 msgr2=0x7f5a380b4510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:34:59.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:59.794+0000 7f5a3f423640 1 -- 172.21.15.55:0/2502578409 shutdown_connections 2024-05-27T12:34:59.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:59.794+0000 7f5a3f423640 1 -- 172.21.15.55:0/2502578409 wait complete. 2024-05-27T12:34:59.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:59.795+0000 7f5a3f423640 1 Processor -- start 2024-05-27T12:34:59.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:59.795+0000 7f5a3f423640 1 -- start start 2024-05-27T12:34:59.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:59.796+0000 7f5a3f423640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5a3809b140 0x7f5a380cbe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:34:59.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:59.796+0000 7f5a3f423640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5a380d1630 0x7f5a380cd870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:34:59.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:59.796+0000 7f5a3f423640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5a3815eb00 0x7f5a380ca620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:34:59.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:59.796+0000 7f5a3f423640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f5a3809b590 con 0x7f5a380d1630 2024-05-27T12:34:59.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:59.796+0000 7f5a3f423640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f5a38160040 con 0x7f5a3809b140 2024-05-27T12:34:59.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:59.796+0000 7f5a3f423640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f5a3809b710 con 0x7f5a3815eb00 2024-05-27T12:34:59.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:59.796+0000 7f5a3c9be640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5a380d1630 0x7f5a380cd870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:34:59.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:59.796+0000 7f5a3c9be640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5a380d1630 0x7f5a380cd870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34928/0 (socket says 172.21.15.55:34928) 2024-05-27T12:34:59.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:59.796+0000 7f5a3c9be640 1 -- 172.21.15.55:0/1110564110 learned_addr learned my addr 172.21.15.55:0/1110564110 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:34:59.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:59.796+0000 7f5a3d1bf640 1 --2- 172.21.15.55:0/1110564110 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5a3809b140 0x7f5a380cbe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:34:59.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:59.796+0000 7f5a3d9c0640 1 --2- 172.21.15.55:0/1110564110 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5a3815eb00 0x7f5a380ca620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:34:59.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:59.796+0000 7f5a3c9be640 1 -- 172.21.15.55:0/1110564110 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5a3815eb00 msgr2=0x7f5a380ca620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:34:59.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:59.796+0000 7f5a3c9be640 1 --2- 172.21.15.55:0/1110564110 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5a3815eb00 0x7f5a380ca620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:34:59.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:59.796+0000 7f5a3c9be640 1 -- 172.21.15.55:0/1110564110 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5a3809b140 msgr2=0x7f5a380cbe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:34:59.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:59.796+0000 7f5a3c9be640 1 --2- 172.21.15.55:0/1110564110 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5a3809b140 0x7f5a380cbe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:34:59.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:59.796+0000 7f5a3c9be640 1 -- 172.21.15.55:0/1110564110 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a380c9880 con 0x7f5a380d1630 2024-05-27T12:34:59.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:59.796+0000 7f5a3d9c0640 1 --2- 172.21.15.55:0/1110564110 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5a3815eb00 0x7f5a380ca620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T12:34:59.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:59.796+0000 7f5a3c9be640 1 --2- 172.21.15.55:0/1110564110 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5a380d1630 0x7f5a380cd870 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f5a2800c460 tx=0x7f5a2800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:34:59.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:59.796+0000 7f5a2dffb640 1 -- 172.21.15.55:0/1110564110 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a28005ce0 con 0x7f5a380d1630 2024-05-27T12:34:59.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:59.797+0000 7f5a2dffb640 1 -- 172.21.15.55:0/1110564110 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a28007070 con 0x7f5a380d1630 2024-05-27T12:34:59.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:59.797+0000 7f5a3f423640 1 -- 172.21.15.55:0/1110564110 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a380c9b60 con 0x7f5a380d1630 2024-05-27T12:34:59.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:59.797+0000 7f5a2dffb640 1 -- 172.21.15.55:0/1110564110 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a28007460 con 0x7f5a380d1630 2024-05-27T12:34:59.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:59.797+0000 7f5a3f423640 1 -- 172.21.15.55:0/1110564110 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a380cc3c0 con 0x7f5a380d1630 2024-05-27T12:34:59.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:59.798+0000 7f5a3f423640 1 -- 172.21.15.55:0/1110564110 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a380c9f50 con 0x7f5a380d1630 2024-05-27T12:34:59.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:59.799+0000 7f5a2dffb640 1 -- 172.21.15.55:0/1110564110 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 7) ==== 91193+0+0 (secure 0 0 0) 0x7f5a28007600 con 0x7f5a380d1630 2024-05-27T12:34:59.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:59.799+0000 7f5a2dffb640 1 --2- 172.21.15.55:0/1110564110 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f5a1c06caa0 0x7f5a1c06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:34:59.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:59.799+0000 7f5a2dffb640 1 -- 172.21.15.55:0/1110564110 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5709+0+0 (secure 0 0 0) 0x7f5a2808bb80 con 0x7f5a380d1630 2024-05-27T12:34:59.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:59.799+0000 7f5a3d1bf640 1 --2- 172.21.15.55:0/1110564110 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f5a1c06caa0 0x7f5a1c06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:34:59.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:59.800+0000 7f5a3d1bf640 1 --2- 172.21.15.55:0/1110564110 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f5a1c06caa0 0x7f5a1c06ef60 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f5a34034000 tx=0x7f5a3402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:34:59.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:34:59.803+0000 7f5a2dffb640 1 -- 172.21.15.55:0/1110564110 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5a28059d30 con 0x7f5a380d1630 2024-05-27T12:35:00.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:00.064+0000 7f5a3f423640 1 -- 172.21.15.55:0/1110564110 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f5a380c9d30 con 0x7f5a380d1630 2024-05-27T12:35:00.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:00.065+0000 7f5a2dffb640 1 -- 172.21.15.55:0/1110564110 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2078 (secure 0 0 0) 0x7f5a28059630 con 0x7f5a380d1630 2024-05-27T12:35:00.064 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-27T12:35:00.064 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-05-27T12:35:00.064 INFO:teuthology.orchestra.run.smithi055.stdout: "fsid": "c3ff4e3b-8dae-4856-9593-e5cc66c59982", 2024-05-27T12:35:00.065 INFO:teuthology.orchestra.run.smithi055.stdout: "health": { 2024-05-27T12:35:00.065 INFO:teuthology.orchestra.run.smithi055.stdout: "status": "HEALTH_OK", 2024-05-27T12:35:00.065 INFO:teuthology.orchestra.run.smithi055.stdout: "checks": {}, 2024-05-27T12:35:00.065 INFO:teuthology.orchestra.run.smithi055.stdout: "mutes": [] 2024-05-27T12:35:00.065 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-05-27T12:35:00.065 INFO:teuthology.orchestra.run.smithi055.stdout: "election_epoch": 4, 2024-05-27T12:35:00.065 INFO:teuthology.orchestra.run.smithi055.stdout: "quorum": [ 2024-05-27T12:35:00.065 INFO:teuthology.orchestra.run.smithi055.stdout: 0, 2024-05-27T12:35:00.065 INFO:teuthology.orchestra.run.smithi055.stdout: 1, 2024-05-27T12:35:00.065 INFO:teuthology.orchestra.run.smithi055.stdout: 2 2024-05-27T12:35:00.065 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-05-27T12:35:00.065 INFO:teuthology.orchestra.run.smithi055.stdout: "quorum_names": [ 2024-05-27T12:35:00.065 INFO:teuthology.orchestra.run.smithi055.stdout: "a", 2024-05-27T12:35:00.066 INFO:teuthology.orchestra.run.smithi055.stdout: "b", 2024-05-27T12:35:00.066 INFO:teuthology.orchestra.run.smithi055.stdout: "c" 2024-05-27T12:35:00.066 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-05-27T12:35:00.066 INFO:teuthology.orchestra.run.smithi055.stdout: "quorum_age": 163, 2024-05-27T12:35:00.066 INFO:teuthology.orchestra.run.smithi055.stdout: "monmap": { 2024-05-27T12:35:00.066 INFO:teuthology.orchestra.run.smithi055.stdout: "epoch": 1, 2024-05-27T12:35:00.066 INFO:teuthology.orchestra.run.smithi055.stdout: "min_mon_release_name": "squid", 2024-05-27T12:35:00.066 INFO:teuthology.orchestra.run.smithi055.stdout: "num_mons": 3 2024-05-27T12:35:00.066 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-05-27T12:35:00.066 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap": { 2024-05-27T12:35:00.066 INFO:teuthology.orchestra.run.smithi055.stdout: "epoch": 36, 2024-05-27T12:35:00.066 INFO:teuthology.orchestra.run.smithi055.stdout: "num_osds": 8, 2024-05-27T12:35:00.067 INFO:teuthology.orchestra.run.smithi055.stdout: "num_up_osds": 8, 2024-05-27T12:35:00.067 INFO:teuthology.orchestra.run.smithi055.stdout: "osd_up_since": 1716813148, 2024-05-27T12:35:00.067 INFO:teuthology.orchestra.run.smithi055.stdout: "num_in_osds": 8, 2024-05-27T12:35:00.067 INFO:teuthology.orchestra.run.smithi055.stdout: "osd_in_since": 1716813139, 2024-05-27T12:35:00.067 INFO:teuthology.orchestra.run.smithi055.stdout: "num_remapped_pgs": 0 2024-05-27T12:35:00.067 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-05-27T12:35:00.067 INFO:teuthology.orchestra.run.smithi055.stdout: "pgmap": { 2024-05-27T12:35:00.067 INFO:teuthology.orchestra.run.smithi055.stdout: "pgs_by_state": [ 2024-05-27T12:35:00.067 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-05-27T12:35:00.067 INFO:teuthology.orchestra.run.smithi055.stdout: "state_name": "active+clean", 2024-05-27T12:35:00.067 INFO:teuthology.orchestra.run.smithi055.stdout: "count": 97 2024-05-27T12:35:00.068 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-05-27T12:35:00.068 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-05-27T12:35:00.068 INFO:teuthology.orchestra.run.smithi055.stdout: "num_pgs": 97, 2024-05-27T12:35:00.068 INFO:teuthology.orchestra.run.smithi055.stdout: "num_pools": 3, 2024-05-27T12:35:00.068 INFO:teuthology.orchestra.run.smithi055.stdout: "num_objects": 3093, 2024-05-27T12:35:00.068 INFO:teuthology.orchestra.run.smithi055.stdout: "data_bytes": 12852688031, 2024-05-27T12:35:00.068 INFO:teuthology.orchestra.run.smithi055.stdout: "bytes_used": 25968336896, 2024-05-27T12:35:00.068 INFO:teuthology.orchestra.run.smithi055.stdout: "bytes_avail": 747125776384, 2024-05-27T12:35:00.068 INFO:teuthology.orchestra.run.smithi055.stdout: "bytes_total": 773094113280, 2024-05-27T12:35:00.069 INFO:teuthology.orchestra.run.smithi055.stdout: "write_bytes_sec": 1706, 2024-05-27T12:35:00.069 INFO:teuthology.orchestra.run.smithi055.stdout: "read_op_per_sec": 0, 2024-05-27T12:35:00.069 INFO:teuthology.orchestra.run.smithi055.stdout: "write_op_per_sec": 0 2024-05-27T12:35:00.069 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-05-27T12:35:00.069 INFO:teuthology.orchestra.run.smithi055.stdout: "fsmap": { 2024-05-27T12:35:00.069 INFO:teuthology.orchestra.run.smithi055.stdout: "epoch": 15, 2024-05-27T12:35:00.069 INFO:teuthology.orchestra.run.smithi055.stdout: "id": 2, 2024-05-27T12:35:00.069 INFO:teuthology.orchestra.run.smithi055.stdout: "up": 1, 2024-05-27T12:35:00.069 INFO:teuthology.orchestra.run.smithi055.stdout: "in": 1, 2024-05-27T12:35:00.070 INFO:teuthology.orchestra.run.smithi055.stdout: "max": 1, 2024-05-27T12:35:00.070 INFO:teuthology.orchestra.run.smithi055.stdout: "by_rank": [ 2024-05-27T12:35:00.070 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-05-27T12:35:00.070 INFO:teuthology.orchestra.run.smithi055.stdout: "filesystem_id": 2, 2024-05-27T12:35:00.070 INFO:teuthology.orchestra.run.smithi055.stdout: "rank": 0, 2024-05-27T12:35:00.070 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "a", 2024-05-27T12:35:00.070 INFO:teuthology.orchestra.run.smithi055.stdout: "status": "up:active", 2024-05-27T12:35:00.070 INFO:teuthology.orchestra.run.smithi055.stdout: "gid": 5151 2024-05-27T12:35:00.070 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-05-27T12:35:00.070 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-05-27T12:35:00.070 INFO:teuthology.orchestra.run.smithi055.stdout: "up:standby": 3 2024-05-27T12:35:00.070 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-05-27T12:35:00.070 INFO:teuthology.orchestra.run.smithi055.stdout: "mgrmap": { 2024-05-27T12:35:00.071 INFO:teuthology.orchestra.run.smithi055.stdout: "available": true, 2024-05-27T12:35:00.071 INFO:teuthology.orchestra.run.smithi055.stdout: "num_standbys": 1, 2024-05-27T12:35:00.071 INFO:teuthology.orchestra.run.smithi055.stdout: "modules": [ 2024-05-27T12:35:00.071 INFO:teuthology.orchestra.run.smithi055.stdout: "iostat", 2024-05-27T12:35:00.071 INFO:teuthology.orchestra.run.smithi055.stdout: "nfs", 2024-05-27T12:35:00.071 INFO:teuthology.orchestra.run.smithi055.stdout: "restful" 2024-05-27T12:35:00.071 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-05-27T12:35:00.071 INFO:teuthology.orchestra.run.smithi055.stdout: "services": {} 2024-05-27T12:35:00.071 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-05-27T12:35:00.071 INFO:teuthology.orchestra.run.smithi055.stdout: "servicemap": { 2024-05-27T12:35:00.071 INFO:teuthology.orchestra.run.smithi055.stdout: "epoch": 5, 2024-05-27T12:35:00.071 INFO:teuthology.orchestra.run.smithi055.stdout: "modified": "2024-05-27T12:34:41.289759+0000", 2024-05-27T12:35:00.071 INFO:teuthology.orchestra.run.smithi055.stdout: "services": {} 2024-05-27T12:35:00.071 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-05-27T12:35:00.072 INFO:teuthology.orchestra.run.smithi055.stdout: "progress_events": { 2024-05-27T12:35:00.072 INFO:teuthology.orchestra.run.smithi055.stdout: "9790db59-2553-4e9d-97e4-4d0c80d5b839": { 2024-05-27T12:35:00.072 INFO:teuthology.orchestra.run.smithi055.stdout: "message": "All cloning finished, waiting 6.0 seconds before exiting (27s)\n [============================] ", 2024-05-27T12:35:00.072 INFO:teuthology.orchestra.run.smithi055.stdout: "progress": 1, 2024-05-27T12:35:00.072 INFO:teuthology.orchestra.run.smithi055.stdout: "add_to_ceph_s": true 2024-05-27T12:35:00.072 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-05-27T12:35:00.072 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-05-27T12:35:00.072 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-05-27T12:35:00.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:00.067+0000 7f5a3f423640 1 -- 172.21.15.55:0/1110564110 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f5a1c06caa0 msgr2=0x7f5a1c06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:35:00.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:00.067+0000 7f5a3f423640 1 --2- 172.21.15.55:0/1110564110 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f5a1c06caa0 0x7f5a1c06ef60 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f5a34034000 tx=0x7f5a3402e000 comp rx=0 tx=0).stop 2024-05-27T12:35:00.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:00.067+0000 7f5a3f423640 1 -- 172.21.15.55:0/1110564110 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5a380d1630 msgr2=0x7f5a380cd870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:35:00.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:00.067+0000 7f5a3f423640 1 --2- 172.21.15.55:0/1110564110 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5a380d1630 0x7f5a380cd870 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f5a2800c460 tx=0x7f5a2800c920 comp rx=0 tx=0).stop 2024-05-27T12:35:00.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:00.067+0000 7f5a3f423640 1 -- 172.21.15.55:0/1110564110 shutdown_connections 2024-05-27T12:35:00.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:00.067+0000 7f5a3f423640 1 --2- 172.21.15.55:0/1110564110 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5a3815eb00 0x7f5a380ca620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:35:00.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:00.067+0000 7f5a3f423640 1 --2- 172.21.15.55:0/1110564110 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5a380d1630 0x7f5a380cd870 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:35:00.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:00.067+0000 7f5a3f423640 1 --2- 172.21.15.55:0/1110564110 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f5a1c06caa0 0x7f5a1c06ef60 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:35:00.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:00.067+0000 7f5a3f423640 1 --2- 172.21.15.55:0/1110564110 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5a3809b140 0x7f5a380cbe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:35:00.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:00.067+0000 7f5a3f423640 1 -- 172.21.15.55:0/1110564110 >> 172.21.15.55:0/1110564110 conn(0x7f5a380b4100 msgr2=0x7f5a3809aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:35:00.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:00.067+0000 7f5a3f423640 1 -- 172.21.15.55:0/1110564110 shutdown_connections 2024-05-27T12:35:00.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:00.067+0000 7f5a3f423640 1 -- 172.21.15.55:0/1110564110 wait complete. 2024-05-27T12:35:05.079 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-27T12:35:05.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.196+0000 7f23c0431640 1 Processor -- start 2024-05-27T12:35:05.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.196+0000 7f23c0431640 1 -- start start 2024-05-27T12:35:05.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.197+0000 7f23c0431640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f23b815e960 0x7f23b806e740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:35:05.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.197+0000 7f23c0431640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f23b806c940 0x7f23b806cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:35:05.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.197+0000 7f23c0431640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23b815ed40 con 0x7f23b806ec80 2024-05-27T12:35:05.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.197+0000 7f23c0431640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f23b80b5170 con 0x7f23b806c940 2024-05-27T12:35:05.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.197+0000 7f23c0431640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f23b8073a20 con 0x7f23b815e960 2024-05-27T12:35:05.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.197+0000 7f23be9ce640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f23b806c940 0x7f23b806cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:35:05.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.197+0000 7f23bd9cc640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f23b806ec80 0x7f23b80ae780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:51234/0 (socket says 172.21.15.55:51234) 2024-05-27T12:35:05.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.197+0000 7f23be9ce640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f23b806c940 0x7f23b806cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54034/0 (socket says 172.21.15.55:54034) 2024-05-27T12:35:05.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.197+0000 7f23bd9cc640 1 -- 172.21.15.55:0/1711089457 learned_addr learned my addr 172.21.15.55:0/1711089457 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-27T12:35:05.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.197+0000 7f23be1cd640 1 --2- 172.21.15.55:0/1711089457 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f23b815e960 0x7f23b806e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:35:05.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.197+0000 7f23be9ce640 1 -- 172.21.15.55:0/1711089457 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f23b815e960 msgr2=0x7f23b806e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:35:05.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.197+0000 7f23be9ce640 1 --2- 172.21.15.55:0/1711089457 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f23b815e960 0x7f23b806e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:35:05.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.197+0000 7f23be9ce640 1 -- 172.21.15.55:0/1711089457 >> v1:172.21.15.55:6789/0 conn(0x7f23b806ec80 legacy=0x7f23b80ae780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:35:05.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.197+0000 7f23be9ce640 1 -- 172.21.15.55:0/1711089457 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23b80b4840 con 0x7f23b806c940 2024-05-27T12:35:05.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.197+0000 7f23be1cd640 1 --2- 172.21.15.55:0/1711089457 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f23b815e960 0x7f23b806e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T12:35:05.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.198+0000 7f23be9ce640 1 --2- 172.21.15.55:0/1711089457 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f23b806c940 0x7f23b806cdf0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f23b0009d90 tx=0x7f23b002a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd868dba236e3702 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:35:05.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.198+0000 7f23bd1cb640 1 -- 172.21.15.55:0/1711089457 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23b0031600 con 0x7f23b806c940 2024-05-27T12:35:05.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.198+0000 7f23bd1cb640 1 -- 172.21.15.55:0/1711089457 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23b00317a0 con 0x7f23b806c940 2024-05-27T12:35:05.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.198+0000 7f23bd1cb640 1 -- 172.21.15.55:0/1711089457 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23b0031b70 con 0x7f23b806c940 2024-05-27T12:35:05.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.199+0000 7f23c0431640 1 -- 172.21.15.55:0/1711089457 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f23b806c940 msgr2=0x7f23b806cdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:35:05.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.199+0000 7f23c0431640 1 --2- 172.21.15.55:0/1711089457 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f23b806c940 0x7f23b806cdf0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f23b0009d90 tx=0x7f23b002a5d0 comp rx=0 tx=0).stop 2024-05-27T12:35:05.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.199+0000 7f23c0431640 1 -- 172.21.15.55:0/1711089457 shutdown_connections 2024-05-27T12:35:05.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.199+0000 7f23c0431640 1 --2- 172.21.15.55:0/1711089457 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f23b806c940 0x7f23b806cdf0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:35:05.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.199+0000 7f23c0431640 1 --2- 172.21.15.55:0/1711089457 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f23b815e960 0x7f23b806e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:35:05.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.199+0000 7f23c0431640 1 -- 172.21.15.55:0/1711089457 >> 172.21.15.55:0/1711089457 conn(0x7f23b80727b0 msgr2=0x7f23b8072bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:35:05.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.199+0000 7f23c0431640 1 -- 172.21.15.55:0/1711089457 shutdown_connections 2024-05-27T12:35:05.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.199+0000 7f23c0431640 1 -- 172.21.15.55:0/1711089457 wait complete. 2024-05-27T12:35:05.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.200+0000 7f23c0431640 1 Processor -- start 2024-05-27T12:35:05.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.200+0000 7f23c0431640 1 -- start start 2024-05-27T12:35:05.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.201+0000 7f23c0431640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f23b806c940 0x7f23b8149710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:35:05.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.201+0000 7f23c0431640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23b806ec80 0x7f23b815cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:35:05.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.201+0000 7f23c0431640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f23b815e960 0x7f23b815d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:35:05.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.201+0000 7f23c0431640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f23b80af2f0 con 0x7f23b815e960 2024-05-27T12:35:05.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.201+0000 7f23c0431640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f23b80b4e00 con 0x7f23b806ec80 2024-05-27T12:35:05.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.201+0000 7f23c0431640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f23b80aee90 con 0x7f23b806c940 2024-05-27T12:35:05.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.201+0000 7f23be9ce640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f23b815e960 0x7f23b815d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:35:05.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.201+0000 7f23be9ce640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f23b815e960 0x7f23b815d520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54044/0 (socket says 172.21.15.55:54044) 2024-05-27T12:35:05.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.201+0000 7f23be9ce640 1 -- 172.21.15.55:0/1418545143 learned_addr learned my addr 172.21.15.55:0/1418545143 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:35:05.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.201+0000 7f23be1cd640 1 --2- 172.21.15.55:0/1418545143 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f23b806c940 0x7f23b8149710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:35:05.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.201+0000 7f23bd9cc640 1 --2- 172.21.15.55:0/1418545143 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23b806ec80 0x7f23b815cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:35:05.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.201+0000 7f23be9ce640 1 -- 172.21.15.55:0/1418545143 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f23b806c940 msgr2=0x7f23b8149710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:35:05.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.201+0000 7f23be9ce640 1 --2- 172.21.15.55:0/1418545143 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f23b806c940 0x7f23b8149710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:35:05.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.201+0000 7f23be9ce640 1 -- 172.21.15.55:0/1418545143 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23b806ec80 msgr2=0x7f23b815cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:35:05.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.201+0000 7f23be9ce640 1 --2- 172.21.15.55:0/1418545143 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23b806ec80 0x7f23b815cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:35:05.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.201+0000 7f23be9ce640 1 -- 172.21.15.55:0/1418545143 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23b815da60 con 0x7f23b815e960 2024-05-27T12:35:05.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.201+0000 7f23bd9cc640 1 --2- 172.21.15.55:0/1418545143 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23b806ec80 0x7f23b815cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T12:35:05.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.202+0000 7f23be9ce640 1 --2- 172.21.15.55:0/1418545143 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f23b815e960 0x7f23b815d520 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f23b0009eb0 tx=0x7f23b0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:35:05.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.202+0000 7f23aeffd640 1 -- 172.21.15.55:0/1418545143 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23b0040070 con 0x7f23b815e960 2024-05-27T12:35:05.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.202+0000 7f23aeffd640 1 -- 172.21.15.55:0/1418545143 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23b0030b60 con 0x7f23b815e960 2024-05-27T12:35:05.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.202+0000 7f23c0431640 1 -- 172.21.15.55:0/1418545143 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23b815dd00 con 0x7f23b815e960 2024-05-27T12:35:05.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.202+0000 7f23aeffd640 1 -- 172.21.15.55:0/1418545143 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23b0045460 con 0x7f23b815e960 2024-05-27T12:35:05.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.202+0000 7f23c0431640 1 -- 172.21.15.55:0/1418545143 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23b81e86d0 con 0x7f23b815e960 2024-05-27T12:35:05.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.203+0000 7f23c0431640 1 -- 172.21.15.55:0/1418545143 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23b8075460 con 0x7f23b815e960 2024-05-27T12:35:05.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.203+0000 7f23aeffd640 1 -- 172.21.15.55:0/1418545143 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 7) ==== 91193+0+0 (secure 0 0 0) 0x7f23b0039040 con 0x7f23b815e960 2024-05-27T12:35:05.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.204+0000 7f23aeffd640 1 --2- 172.21.15.55:0/1418545143 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f239c06caa0 0x7f239c06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:35:05.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.204+0000 7f23aeffd640 1 -- 172.21.15.55:0/1418545143 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5709+0+0 (secure 0 0 0) 0x7f23b00ad800 con 0x7f23b815e960 2024-05-27T12:35:05.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.204+0000 7f23be1cd640 1 --2- 172.21.15.55:0/1418545143 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f239c06caa0 0x7f239c06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:35:05.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.205+0000 7f23be1cd640 1 --2- 172.21.15.55:0/1418545143 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f239c06caa0 0x7f239c06ef60 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f23b400a950 tx=0x7f23b4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:35:05.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.208+0000 7f23aeffd640 1 -- 172.21.15.55:0/1418545143 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f23b007b950 con 0x7f23b815e960 2024-05-27T12:35:05.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.466+0000 7f23c0431640 1 -- 172.21.15.55:0/1418545143 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f23b80b6220 con 0x7f23b815e960 2024-05-27T12:35:05.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.466+0000 7f23aeffd640 1 -- 172.21.15.55:0/1418545143 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1824 (secure 0 0 0) 0x7f23b007b250 con 0x7f23b815e960 2024-05-27T12:35:05.466 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-27T12:35:05.466 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-05-27T12:35:05.466 INFO:teuthology.orchestra.run.smithi055.stdout: "fsid": "c3ff4e3b-8dae-4856-9593-e5cc66c59982", 2024-05-27T12:35:05.466 INFO:teuthology.orchestra.run.smithi055.stdout: "health": { 2024-05-27T12:35:05.466 INFO:teuthology.orchestra.run.smithi055.stdout: "status": "HEALTH_OK", 2024-05-27T12:35:05.466 INFO:teuthology.orchestra.run.smithi055.stdout: "checks": {}, 2024-05-27T12:35:05.466 INFO:teuthology.orchestra.run.smithi055.stdout: "mutes": [] 2024-05-27T12:35:05.466 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-05-27T12:35:05.466 INFO:teuthology.orchestra.run.smithi055.stdout: "election_epoch": 4, 2024-05-27T12:35:05.467 INFO:teuthology.orchestra.run.smithi055.stdout: "quorum": [ 2024-05-27T12:35:05.467 INFO:teuthology.orchestra.run.smithi055.stdout: 0, 2024-05-27T12:35:05.467 INFO:teuthology.orchestra.run.smithi055.stdout: 1, 2024-05-27T12:35:05.467 INFO:teuthology.orchestra.run.smithi055.stdout: 2 2024-05-27T12:35:05.467 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-05-27T12:35:05.467 INFO:teuthology.orchestra.run.smithi055.stdout: "quorum_names": [ 2024-05-27T12:35:05.467 INFO:teuthology.orchestra.run.smithi055.stdout: "a", 2024-05-27T12:35:05.467 INFO:teuthology.orchestra.run.smithi055.stdout: "b", 2024-05-27T12:35:05.467 INFO:teuthology.orchestra.run.smithi055.stdout: "c" 2024-05-27T12:35:05.467 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-05-27T12:35:05.467 INFO:teuthology.orchestra.run.smithi055.stdout: "quorum_age": 168, 2024-05-27T12:35:05.467 INFO:teuthology.orchestra.run.smithi055.stdout: "monmap": { 2024-05-27T12:35:05.467 INFO:teuthology.orchestra.run.smithi055.stdout: "epoch": 1, 2024-05-27T12:35:05.467 INFO:teuthology.orchestra.run.smithi055.stdout: "min_mon_release_name": "squid", 2024-05-27T12:35:05.468 INFO:teuthology.orchestra.run.smithi055.stdout: "num_mons": 3 2024-05-27T12:35:05.468 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-05-27T12:35:05.468 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap": { 2024-05-27T12:35:05.468 INFO:teuthology.orchestra.run.smithi055.stdout: "epoch": 36, 2024-05-27T12:35:05.468 INFO:teuthology.orchestra.run.smithi055.stdout: "num_osds": 8, 2024-05-27T12:35:05.468 INFO:teuthology.orchestra.run.smithi055.stdout: "num_up_osds": 8, 2024-05-27T12:35:05.468 INFO:teuthology.orchestra.run.smithi055.stdout: "osd_up_since": 1716813148, 2024-05-27T12:35:05.468 INFO:teuthology.orchestra.run.smithi055.stdout: "num_in_osds": 8, 2024-05-27T12:35:05.468 INFO:teuthology.orchestra.run.smithi055.stdout: "osd_in_since": 1716813139, 2024-05-27T12:35:05.468 INFO:teuthology.orchestra.run.smithi055.stdout: "num_remapped_pgs": 0 2024-05-27T12:35:05.468 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-05-27T12:35:05.468 INFO:teuthology.orchestra.run.smithi055.stdout: "pgmap": { 2024-05-27T12:35:05.468 INFO:teuthology.orchestra.run.smithi055.stdout: "pgs_by_state": [ 2024-05-27T12:35:05.468 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-05-27T12:35:05.469 INFO:teuthology.orchestra.run.smithi055.stdout: "state_name": "active+clean", 2024-05-27T12:35:05.469 INFO:teuthology.orchestra.run.smithi055.stdout: "count": 97 2024-05-27T12:35:05.469 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-05-27T12:35:05.469 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-05-27T12:35:05.469 INFO:teuthology.orchestra.run.smithi055.stdout: "num_pgs": 97, 2024-05-27T12:35:05.469 INFO:teuthology.orchestra.run.smithi055.stdout: "num_pools": 3, 2024-05-27T12:35:05.469 INFO:teuthology.orchestra.run.smithi055.stdout: "num_objects": 3093, 2024-05-27T12:35:05.469 INFO:teuthology.orchestra.run.smithi055.stdout: "data_bytes": 12852705096, 2024-05-27T12:35:05.469 INFO:teuthology.orchestra.run.smithi055.stdout: "bytes_used": 25968369664, 2024-05-27T12:35:05.469 INFO:teuthology.orchestra.run.smithi055.stdout: "bytes_avail": 747125743616, 2024-05-27T12:35:05.469 INFO:teuthology.orchestra.run.smithi055.stdout: "bytes_total": 773094113280, 2024-05-27T12:35:05.469 INFO:teuthology.orchestra.run.smithi055.stdout: "write_bytes_sec": 1706, 2024-05-27T12:35:05.469 INFO:teuthology.orchestra.run.smithi055.stdout: "read_op_per_sec": 0, 2024-05-27T12:35:05.469 INFO:teuthology.orchestra.run.smithi055.stdout: "write_op_per_sec": 0 2024-05-27T12:35:05.470 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-05-27T12:35:05.470 INFO:teuthology.orchestra.run.smithi055.stdout: "fsmap": { 2024-05-27T12:35:05.470 INFO:teuthology.orchestra.run.smithi055.stdout: "epoch": 15, 2024-05-27T12:35:05.470 INFO:teuthology.orchestra.run.smithi055.stdout: "id": 2, 2024-05-27T12:35:05.470 INFO:teuthology.orchestra.run.smithi055.stdout: "up": 1, 2024-05-27T12:35:05.470 INFO:teuthology.orchestra.run.smithi055.stdout: "in": 1, 2024-05-27T12:35:05.470 INFO:teuthology.orchestra.run.smithi055.stdout: "max": 1, 2024-05-27T12:35:05.470 INFO:teuthology.orchestra.run.smithi055.stdout: "by_rank": [ 2024-05-27T12:35:05.470 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-05-27T12:35:05.470 INFO:teuthology.orchestra.run.smithi055.stdout: "filesystem_id": 2, 2024-05-27T12:35:05.470 INFO:teuthology.orchestra.run.smithi055.stdout: "rank": 0, 2024-05-27T12:35:05.470 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "a", 2024-05-27T12:35:05.470 INFO:teuthology.orchestra.run.smithi055.stdout: "status": "up:active", 2024-05-27T12:35:05.470 INFO:teuthology.orchestra.run.smithi055.stdout: "gid": 5151 2024-05-27T12:35:05.471 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-05-27T12:35:05.471 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-05-27T12:35:05.471 INFO:teuthology.orchestra.run.smithi055.stdout: "up:standby": 3 2024-05-27T12:35:05.471 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-05-27T12:35:05.471 INFO:teuthology.orchestra.run.smithi055.stdout: "mgrmap": { 2024-05-27T12:35:05.471 INFO:teuthology.orchestra.run.smithi055.stdout: "available": true, 2024-05-27T12:35:05.471 INFO:teuthology.orchestra.run.smithi055.stdout: "num_standbys": 1, 2024-05-27T12:35:05.471 INFO:teuthology.orchestra.run.smithi055.stdout: "modules": [ 2024-05-27T12:35:05.471 INFO:teuthology.orchestra.run.smithi055.stdout: "iostat", 2024-05-27T12:35:05.471 INFO:teuthology.orchestra.run.smithi055.stdout: "nfs", 2024-05-27T12:35:05.471 INFO:teuthology.orchestra.run.smithi055.stdout: "restful" 2024-05-27T12:35:05.471 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-05-27T12:35:05.471 INFO:teuthology.orchestra.run.smithi055.stdout: "services": {} 2024-05-27T12:35:05.472 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-05-27T12:35:05.472 INFO:teuthology.orchestra.run.smithi055.stdout: "servicemap": { 2024-05-27T12:35:05.472 INFO:teuthology.orchestra.run.smithi055.stdout: "epoch": 5, 2024-05-27T12:35:05.472 INFO:teuthology.orchestra.run.smithi055.stdout: "modified": "2024-05-27T12:34:41.289759+0000", 2024-05-27T12:35:05.472 INFO:teuthology.orchestra.run.smithi055.stdout: "services": {} 2024-05-27T12:35:05.472 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-05-27T12:35:05.472 INFO:teuthology.orchestra.run.smithi055.stdout: "progress_events": {} 2024-05-27T12:35:05.472 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-05-27T12:35:05.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.468+0000 7f23c0431640 1 -- 172.21.15.55:0/1418545143 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f239c06caa0 msgr2=0x7f239c06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:35:05.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.468+0000 7f23c0431640 1 --2- 172.21.15.55:0/1418545143 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f239c06caa0 0x7f239c06ef60 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f23b400a950 tx=0x7f23b4008040 comp rx=0 tx=0).stop 2024-05-27T12:35:05.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.468+0000 7f23c0431640 1 -- 172.21.15.55:0/1418545143 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f23b815e960 msgr2=0x7f23b815d520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:35:05.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.468+0000 7f23c0431640 1 --2- 172.21.15.55:0/1418545143 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f23b815e960 0x7f23b815d520 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f23b0009eb0 tx=0x7f23b0004a40 comp rx=0 tx=0).stop 2024-05-27T12:35:05.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.468+0000 7f23c0431640 1 -- 172.21.15.55:0/1418545143 shutdown_connections 2024-05-27T12:35:05.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.468+0000 7f23c0431640 1 --2- 172.21.15.55:0/1418545143 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f23b815e960 0x7f23b815d520 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:35:05.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.468+0000 7f23c0431640 1 --2- 172.21.15.55:0/1418545143 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f239c06caa0 0x7f239c06ef60 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:35:05.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.468+0000 7f23c0431640 1 --2- 172.21.15.55:0/1418545143 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23b806ec80 0x7f23b815cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:35:05.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.468+0000 7f23c0431640 1 --2- 172.21.15.55:0/1418545143 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f23b806c940 0x7f23b8149710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:35:05.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.468+0000 7f23c0431640 1 -- 172.21.15.55:0/1418545143 >> 172.21.15.55:0/1418545143 conn(0x7f23b80727b0 msgr2=0x7f23b8070640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:35:05.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.469+0000 7f23c0431640 1 -- 172.21.15.55:0/1418545143 shutdown_connections 2024-05-27T12:35:05.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.469+0000 7f23c0431640 1 -- 172.21.15.55:0/1418545143 wait complete. 2024-05-27T12:35:05.479 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume ls cephfs --format json 2024-05-27T12:35:05.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.586+0000 7f089019b640 1 Processor -- start 2024-05-27T12:35:05.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.586+0000 7f089019b640 1 -- start start 2024-05-27T12:35:05.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.587+0000 7f089019b640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f088815eb60 0x7f088806d930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:35:05.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.587+0000 7f089019b640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f088809b980 0x7f08880d1390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:35:05.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.587+0000 7f089019b640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f088806cb70 con 0x7f088809aa30 2024-05-27T12:35:05.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.587+0000 7f089019b640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f08880d1cc0 con 0x7f088809b980 2024-05-27T12:35:05.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.587+0000 7f089019b640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f088806ce50 con 0x7f088815eb60 2024-05-27T12:35:05.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.587+0000 7f088d736640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f088809b980 0x7f08880d1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:35:05.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.587+0000 7f088df37640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f088815eb60 0x7f088806d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:35:05.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.587+0000 7f088e738640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f088809aa30 0x7f08880cccc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.55:47416/0 (socket says 172.21.15.55:47416) 2024-05-27T12:35:05.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.587+0000 7f088e738640 1 -- 172.21.15.55:0/3659097150 learned_addr learned my addr 172.21.15.55:0/3659097150 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-27T12:35:05.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.588+0000 7f088d736640 1 -- 172.21.15.55:0/3659097150 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f088815eb60 msgr2=0x7f088806d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:35:05.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.588+0000 7f088d736640 1 --2- 172.21.15.55:0/3659097150 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f088815eb60 0x7f088806d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:35:05.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.588+0000 7f088d736640 1 -- 172.21.15.55:0/3659097150 >> v1:172.21.15.72:6789/0 conn(0x7f088809aa30 legacy=0x7f08880cccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:35:05.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.588+0000 7f088d736640 1 -- 172.21.15.55:0/3659097150 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f088806d130 con 0x7f088809b980 2024-05-27T12:35:05.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.588+0000 7f088df37640 1 --2- 172.21.15.55:0/3659097150 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f088815eb60 0x7f088806d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T12:35:05.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.589+0000 7f088d736640 1 --2- 172.21.15.55:0/3659097150 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f088809b980 0x7f08880d1390 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f08840097a0 tx=0x7f088402a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3798cf00c41a159e server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:35:05.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.589+0000 7f088cf35640 1 -- 172.21.15.55:0/3659097150 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0884037070 con 0x7f088809b980 2024-05-27T12:35:05.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.589+0000 7f088cf35640 1 -- 172.21.15.55:0/3659097150 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f088402ae50 con 0x7f088809b980 2024-05-27T12:35:05.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.589+0000 7f088cf35640 1 -- 172.21.15.55:0/3659097150 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0884032660 con 0x7f088809b980 2024-05-27T12:35:05.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.589+0000 7f089019b640 1 -- 172.21.15.55:0/3659097150 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f088809b980 msgr2=0x7f08880d1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:35:05.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.589+0000 7f089019b640 1 --2- 172.21.15.55:0/3659097150 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f088809b980 0x7f08880d1390 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f08840097a0 tx=0x7f088402a100 comp rx=0 tx=0).stop 2024-05-27T12:35:05.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.589+0000 7f089019b640 1 -- 172.21.15.55:0/3659097150 shutdown_connections 2024-05-27T12:35:05.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.589+0000 7f089019b640 1 --2- 172.21.15.55:0/3659097150 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f088809b980 0x7f08880d1390 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:35:05.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.590+0000 7f089019b640 1 --2- 172.21.15.55:0/3659097150 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f088815eb60 0x7f088806d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:35:05.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.590+0000 7f089019b640 1 -- 172.21.15.55:0/3659097150 >> 172.21.15.55:0/3659097150 conn(0x7f08880b4160 msgr2=0x7f08880b4570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:35:05.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.590+0000 7f089019b640 1 -- 172.21.15.55:0/3659097150 shutdown_connections 2024-05-27T12:35:05.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.590+0000 7f089019b640 1 -- 172.21.15.55:0/3659097150 wait complete. 2024-05-27T12:35:05.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.591+0000 7f089019b640 1 Processor -- start 2024-05-27T12:35:05.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.591+0000 7f089019b640 1 -- start start 2024-05-27T12:35:05.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.591+0000 7f089019b640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f088809aa30 0x7f08880b7bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:35:05.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.591+0000 7f089019b640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f088809b980 0x7f08881f4a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:35:05.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.592+0000 7f089019b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f088815eb60 0x7f08880b5a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:35:05.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.592+0000 7f089019b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f08880d18d0 con 0x7f088815eb60 2024-05-27T12:35:05.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.592+0000 7f089019b640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f088806de70 con 0x7f088809b980 2024-05-27T12:35:05.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.592+0000 7f089019b640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f08880d1a50 con 0x7f088809aa30 2024-05-27T12:35:05.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.592+0000 7f088e738640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f088815eb60 0x7f08880b5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:35:05.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.592+0000 7f088e738640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f088815eb60 0x7f08880b5a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54052/0 (socket says 172.21.15.55:54052) 2024-05-27T12:35:05.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.592+0000 7f088e738640 1 -- 172.21.15.55:0/3654720520 learned_addr learned my addr 172.21.15.55:0/3654720520 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:35:05.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.592+0000 7f088df37640 1 --2- 172.21.15.55:0/3654720520 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f088809aa30 0x7f08880b7bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:35:05.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.592+0000 7f088d736640 1 --2- 172.21.15.55:0/3654720520 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f088809b980 0x7f08881f4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:35:05.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.592+0000 7f088e738640 1 -- 172.21.15.55:0/3654720520 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f088809aa30 msgr2=0x7f08880b7bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:35:05.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.592+0000 7f088e738640 1 --2- 172.21.15.55:0/3654720520 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f088809aa30 0x7f08880b7bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:35:05.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.592+0000 7f088e738640 1 -- 172.21.15.55:0/3654720520 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f088809b980 msgr2=0x7f08881f4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:35:05.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.592+0000 7f088e738640 1 --2- 172.21.15.55:0/3654720520 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f088809b980 0x7f08881f4a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:35:05.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.592+0000 7f088e738640 1 -- 172.21.15.55:0/3654720520 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08880b8110 con 0x7f088815eb60 2024-05-27T12:35:05.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.592+0000 7f088df37640 1 --2- 172.21.15.55:0/3654720520 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f088809aa30 0x7f08880b7bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T12:35:05.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.592+0000 7f088e738640 1 --2- 172.21.15.55:0/3654720520 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f088815eb60 0x7f08880b5a70 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f088000cbf0 tx=0x7f088000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:35:05.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.592+0000 7f087a7fc640 1 -- 172.21.15.55:0/3654720520 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0880017070 con 0x7f088815eb60 2024-05-27T12:35:05.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.592+0000 7f087a7fc640 1 -- 172.21.15.55:0/3654720520 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f088000ad40 con 0x7f088815eb60 2024-05-27T12:35:05.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.592+0000 7f089019b640 1 -- 172.21.15.55:0/3654720520 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08880b6e10 con 0x7f088815eb60 2024-05-27T12:35:05.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.592+0000 7f087a7fc640 1 -- 172.21.15.55:0/3654720520 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0880012600 con 0x7f088815eb60 2024-05-27T12:35:05.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.592+0000 7f089019b640 1 -- 172.21.15.55:0/3654720520 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08880b73d0 con 0x7f088815eb60 2024-05-27T12:35:05.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.593+0000 7f089019b640 1 -- 172.21.15.55:0/3654720520 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0888068a70 con 0x7f088815eb60 2024-05-27T12:35:05.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.594+0000 7f087a7fc640 1 -- 172.21.15.55:0/3654720520 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 7) ==== 91193+0+0 (secure 0 0 0) 0x7f088001a070 con 0x7f088815eb60 2024-05-27T12:35:05.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.594+0000 7f087a7fc640 1 --2- 172.21.15.55:0/3654720520 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f086c06caa0 0x7f086c06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:35:05.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.595+0000 7f087a7fc640 1 -- 172.21.15.55:0/3654720520 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5709+0+0 (secure 0 0 0) 0x7f088008bc20 con 0x7f088815eb60 2024-05-27T12:35:05.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.595+0000 7f088df37640 1 --2- 172.21.15.55:0/3654720520 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f086c06caa0 0x7f086c06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:35:05.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.595+0000 7f088df37640 1 --2- 172.21.15.55:0/3654720520 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f086c06caa0 0x7f086c06ef60 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f08880b3f50 tx=0x7f087c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:35:05.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.599+0000 7f087a7fc640 1 -- 172.21.15.55:0/3654720520 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f08800596e0 con 0x7f088815eb60 2024-05-27T12:35:05.812 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.813+0000 7f089019b640 1 -- 172.21.15.55:0/3654720520 --> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] -- mgr_command(tid 0: {"prefix": "fs subvolume ls", "vol_name": "cephfs", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f088806e1a0 con 0x7f086c06caa0 2024-05-27T12:35:05.817 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.818+0000 7f087a7fc640 1 -- 172.21.15.55:0/3654720520 <== mgr.4105 v2:172.21.15.72:6832/3152720583 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+79 (secure 0 0 0) 0x7f088806e1a0 con 0x7f086c06caa0 2024-05-27T12:35:05.818 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-27T12:35:05.818 INFO:teuthology.orchestra.run.smithi055.stdout:[ 2024-05-27T12:35:05.818 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-05-27T12:35:05.818 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "sv1" 2024-05-27T12:35:05.818 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-05-27T12:35:05.818 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-05-27T12:35:05.818 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "ss1clone1" 2024-05-27T12:35:05.818 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-05-27T12:35:05.818 INFO:teuthology.orchestra.run.smithi055.stdout:] 2024-05-27T12:35:05.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.820+0000 7f089019b640 1 -- 172.21.15.55:0/3654720520 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f086c06caa0 msgr2=0x7f086c06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:35:05.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.820+0000 7f089019b640 1 --2- 172.21.15.55:0/3654720520 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f086c06caa0 0x7f086c06ef60 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f08880b3f50 tx=0x7f087c008040 comp rx=0 tx=0).stop 2024-05-27T12:35:05.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.820+0000 7f089019b640 1 -- 172.21.15.55:0/3654720520 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f088815eb60 msgr2=0x7f08880b5a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:35:05.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.820+0000 7f089019b640 1 --2- 172.21.15.55:0/3654720520 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f088815eb60 0x7f08880b5a70 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f088000cbf0 tx=0x7f088000a430 comp rx=0 tx=0).stop 2024-05-27T12:35:05.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.820+0000 7f089019b640 1 -- 172.21.15.55:0/3654720520 shutdown_connections 2024-05-27T12:35:05.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.820+0000 7f089019b640 1 --2- 172.21.15.55:0/3654720520 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f088815eb60 0x7f08880b5a70 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:35:05.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.820+0000 7f089019b640 1 --2- 172.21.15.55:0/3654720520 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f086c06caa0 0x7f086c06ef60 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:35:05.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.820+0000 7f089019b640 1 --2- 172.21.15.55:0/3654720520 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f088809b980 0x7f08881f4a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:35:05.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.820+0000 7f089019b640 1 --2- 172.21.15.55:0/3654720520 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f088809aa30 0x7f08880b7bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:35:05.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.820+0000 7f089019b640 1 -- 172.21.15.55:0/3654720520 >> 172.21.15.55:0/3654720520 conn(0x7f08880b4160 msgr2=0x7f088815add0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:35:05.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.820+0000 7f089019b640 1 -- 172.21.15.55:0/3654720520 shutdown_connections 2024-05-27T12:35:05.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.820+0000 7f089019b640 1 -- 172.21.15.55:0/3654720520 wait complete. 2024-05-27T12:35:05.831 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot ls cephfs sv1 --format json 2024-05-27T12:35:05.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.940+0000 7f50d2b7d640 1 Processor -- start 2024-05-27T12:35:05.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.940+0000 7f50d2b7d640 1 -- start start 2024-05-27T12:35:05.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.941+0000 7f50d2b7d640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f50cc0b8900 0x7f50cc169610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:35:05.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.941+0000 7f50d2b7d640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50cc15eee0 con 0x7f50cc0cfb40 2024-05-27T12:35:05.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.941+0000 7f50d2b7d640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50cc0d4660 con 0x7f50cc15eb00 2024-05-27T12:35:05.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.941+0000 7f50d2b7d640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f50cc0d5700 con 0x7f50cc0b8900 2024-05-27T12:35:05.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.941+0000 7f50c3fff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f50cc0cfb40 0x7f50cc0d1830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:51246/0 (socket says 172.21.15.55:51246) 2024-05-27T12:35:05.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.941+0000 7f50c3fff640 1 -- 172.21.15.55:0/208254563 learned_addr learned my addr 172.21.15.55:0/208254563 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-27T12:35:05.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.941+0000 7f50d111a640 1 --2- 172.21.15.55:0/208254563 >> v2:172.21.15.72:3300/0 conn(0x7f50cc0b8900 0x7f50cc169610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:35:05.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.941+0000 7f50c37fe640 1 -- 172.21.15.55:0/208254563 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4149066007 0 0) 0x7f50cc15eee0 con 0x7f50cc0cfb40 2024-05-27T12:35:05.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.941+0000 7f50c37fe640 1 -- 172.21.15.55:0/208254563 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f50b4003520 con 0x7f50cc0cfb40 2024-05-27T12:35:05.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.941+0000 7f50c37fe640 1 -- 172.21.15.55:0/208254563 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4087002872 0 0) 0x7f50b4003520 con 0x7f50cc0cfb40 2024-05-27T12:35:05.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.941+0000 7f50c37fe640 1 -- 172.21.15.55:0/208254563 >> v2:172.21.15.72:3300/0 conn(0x7f50cc0b8900 msgr2=0x7f50cc169610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:35:05.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.941+0000 7f50c37fe640 1 --2- 172.21.15.55:0/208254563 >> v2:172.21.15.72:3300/0 conn(0x7f50cc0b8900 0x7f50cc169610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:35:05.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.941+0000 7f50c37fe640 1 -- 172.21.15.55:0/208254563 >> v1:172.21.15.72:6789/0 conn(0x7f50cc15eb00 legacy=0x7f50cc0d3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:35:05.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.941+0000 7f50c37fe640 1 -- 172.21.15.55:0/208254563 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50cc0d4940 con 0x7f50cc0cfb40 2024-05-27T12:35:05.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.941+0000 7f50c37fe640 1 -- 172.21.15.55:0/208254563 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 793017739 0 0) 0x7f50bc001670 con 0x7f50cc0cfb40 2024-05-27T12:35:05.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.941+0000 7f50c37fe640 1 -- 172.21.15.55:0/208254563 >> v1:172.21.15.55:6789/0 conn(0x7f50cc0cfb40 legacy=0x7f50cc0d1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:35:05.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.942+0000 7f50c37fe640 1 --2- 172.21.15.55:0/208254563 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f50b40039b0 0x7f50b4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:35:05.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.942+0000 7f50c37fe640 1 --2- 172.21.15.55:0/208254563 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f50b40043b0 0x7f50b4004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:35:05.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.942+0000 7f50c37fe640 1 --2- 172.21.15.55:0/208254563 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f50b4005080 0x7f50b400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:35:05.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.942+0000 7f50c37fe640 1 -- 172.21.15.55:0/208254563 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f50cc0d5700 con 0x7f50b4005080 2024-05-27T12:35:05.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.942+0000 7f50c37fe640 1 -- 172.21.15.55:0/208254563 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f50b400bf30 con 0x7f50b40043b0 2024-05-27T12:35:05.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.942+0000 7f50c37fe640 1 -- 172.21.15.55:0/208254563 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f50b400c130 con 0x7f50b40039b0 2024-05-27T12:35:05.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.942+0000 7f50d111a640 1 --2- 172.21.15.55:0/208254563 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f50b4005080 0x7f50b400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:35:05.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.942+0000 7f50c3fff640 1 --2- 172.21.15.55:0/208254563 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f50b40043b0 0x7f50b4004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:35:05.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.942+0000 7f50d0919640 1 --2- 172.21.15.55:0/208254563 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f50b40039b0 0x7f50b4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:35:05.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.942+0000 7f50d111a640 1 -- 172.21.15.55:0/208254563 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f50b40039b0 msgr2=0x7f50b4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:35:05.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.942+0000 7f50d111a640 1 --2- 172.21.15.55:0/208254563 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f50b40039b0 0x7f50b4003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:35:05.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.942+0000 7f50d111a640 1 -- 172.21.15.55:0/208254563 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f50b40043b0 msgr2=0x7f50b4004880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:35:05.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.942+0000 7f50d111a640 1 --2- 172.21.15.55:0/208254563 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f50b40043b0 0x7f50b4004880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:35:05.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.942+0000 7f50d111a640 1 -- 172.21.15.55:0/208254563 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50b4003520 con 0x7f50b4005080 2024-05-27T12:35:05.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.943+0000 7f50d111a640 1 -- 172.21.15.55:0/208254563 reap_dead start 2024-05-27T12:35:05.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.943+0000 7f50d111a640 1 --2- 172.21.15.55:0/208254563 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f50b4005080 0x7f50b400b9c0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f50c4009ac0 tx=0x7f50b4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aeb1f4310f68698c server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:35:05.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.943+0000 7f50c37fe640 1 -- 172.21.15.55:0/208254563 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50c4009690 con 0x7f50b4005080 2024-05-27T12:35:05.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.943+0000 7f50c37fe640 1 -- 172.21.15.55:0/208254563 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50c4004020 con 0x7f50b4005080 2024-05-27T12:35:05.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.943+0000 7f50c37fe640 1 -- 172.21.15.55:0/208254563 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50c4004410 con 0x7f50b4005080 2024-05-27T12:35:05.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.943+0000 7f50d2b7d640 1 -- 172.21.15.55:0/208254563 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f50b4005080 msgr2=0x7f50b400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:35:05.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.943+0000 7f50d2b7d640 1 --2- 172.21.15.55:0/208254563 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f50b4005080 0x7f50b400b9c0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f50c4009ac0 tx=0x7f50b4005830 comp rx=0 tx=0).stop 2024-05-27T12:35:05.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.943+0000 7f50d2b7d640 1 -- 172.21.15.55:0/208254563 shutdown_connections 2024-05-27T12:35:05.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.943+0000 7f50d2b7d640 1 --2- 172.21.15.55:0/208254563 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f50b4005080 0x7f50b400b9c0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:35:05.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.943+0000 7f50d2b7d640 1 -- 172.21.15.55:0/208254563 >> 172.21.15.55:0/208254563 conn(0x7f50cc067a50 msgr2=0x7f50cc067e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:35:05.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.943+0000 7f50d2b7d640 1 -- 172.21.15.55:0/208254563 shutdown_connections 2024-05-27T12:35:05.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.943+0000 7f50d2b7d640 1 -- 172.21.15.55:0/208254563 wait complete. 2024-05-27T12:35:05.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.945+0000 7f50d2b7d640 1 Processor -- start 2024-05-27T12:35:05.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.945+0000 7f50d2b7d640 1 -- start start 2024-05-27T12:35:05.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.945+0000 7f50d2b7d640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f50b4005080 0x7f50cc146b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:35:05.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.946+0000 7f50d2b7d640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f50cc15f700 0x7f50cc0b7e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:35:05.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.946+0000 7f50d2b7d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f50cc0cdb00 0x7f50cc0cdf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:35:05.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.946+0000 7f50d2b7d640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f50cc0d51e0 con 0x7f50cc0cdb00 2024-05-27T12:35:05.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.946+0000 7f50d2b7d640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f50cc0d4f00 con 0x7f50cc15f700 2024-05-27T12:35:05.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.946+0000 7f50d2b7d640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f50cc0d3e50 con 0x7f50b4005080 2024-05-27T12:35:05.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.946+0000 7f50d111a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f50cc0cdb00 0x7f50cc0cdf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:35:05.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.946+0000 7f50d111a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f50cc0cdb00 0x7f50cc0cdf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54084/0 (socket says 172.21.15.55:54084) 2024-05-27T12:35:05.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.946+0000 7f50d111a640 1 -- 172.21.15.55:0/3474945568 learned_addr learned my addr 172.21.15.55:0/3474945568 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:35:05.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.946+0000 7f50c3fff640 1 --2- 172.21.15.55:0/3474945568 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f50cc15f700 0x7f50cc0b7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:35:05.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.946+0000 7f50d0919640 1 --2- 172.21.15.55:0/3474945568 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f50b4005080 0x7f50cc146b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:35:05.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.946+0000 7f50d111a640 1 -- 172.21.15.55:0/3474945568 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f50b4005080 msgr2=0x7f50cc146b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:35:05.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.946+0000 7f50d111a640 1 --2- 172.21.15.55:0/3474945568 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f50b4005080 0x7f50cc146b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:35:05.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.946+0000 7f50d111a640 1 -- 172.21.15.55:0/3474945568 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f50cc15f700 msgr2=0x7f50cc0b7e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:35:05.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.946+0000 7f50d111a640 1 --2- 172.21.15.55:0/3474945568 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f50cc15f700 0x7f50cc0b7e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:35:05.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.946+0000 7f50d111a640 1 -- 172.21.15.55:0/3474945568 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50cc147170 con 0x7f50cc0cdb00 2024-05-27T12:35:05.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.946+0000 7f50d111a640 1 --2- 172.21.15.55:0/3474945568 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f50cc0cdb00 0x7f50cc0cdf80 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f50c402abe0 tx=0x7f50c4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:35:05.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.946+0000 7f50c17fa640 1 -- 172.21.15.55:0/3474945568 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50c4003e20 con 0x7f50cc0cdb00 2024-05-27T12:35:05.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.946+0000 7f50c17fa640 1 -- 172.21.15.55:0/3474945568 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50c4040070 con 0x7f50cc0cdb00 2024-05-27T12:35:05.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.946+0000 7f50d2b7d640 1 -- 172.21.15.55:0/3474945568 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50cc147450 con 0x7f50cc0cdb00 2024-05-27T12:35:05.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.946+0000 7f50c17fa640 1 -- 172.21.15.55:0/3474945568 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50c403a470 con 0x7f50cc0cdb00 2024-05-27T12:35:05.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.947+0000 7f50d2b7d640 1 -- 172.21.15.55:0/3474945568 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50cc147a10 con 0x7f50cc0cdb00 2024-05-27T12:35:05.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.948+0000 7f50d2b7d640 1 -- 172.21.15.55:0/3474945568 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50cc0ce4c0 con 0x7f50cc0cdb00 2024-05-27T12:35:05.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.948+0000 7f50c17fa640 1 -- 172.21.15.55:0/3474945568 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 7) ==== 91193+0+0 (secure 0 0 0) 0x7f50c403a610 con 0x7f50cc0cdb00 2024-05-27T12:35:05.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.948+0000 7f50c17fa640 1 --2- 172.21.15.55:0/3474945568 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f50b806caa0 0x7f50b806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:35:05.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.949+0000 7f50c17fa640 1 -- 172.21.15.55:0/3474945568 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5709+0+0 (secure 0 0 0) 0x7f50c40ac170 con 0x7f50cc0cdb00 2024-05-27T12:35:05.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.949+0000 7f50d0919640 1 --2- 172.21.15.55:0/3474945568 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f50b806caa0 0x7f50b806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:35:05.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.949+0000 7f50d0919640 1 --2- 172.21.15.55:0/3474945568 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f50b806caa0 0x7f50b806ef60 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f50c8003fa0 tx=0x7f50c8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:35:05.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:05.953+0000 7f50c17fa640 1 -- 172.21.15.55:0/3474945568 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f50c407a280 con 0x7f50cc0cdb00 2024-05-27T12:35:06.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.169+0000 7f50d2b7d640 1 -- 172.21.15.55:0/3474945568 --> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot ls", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f50cc0d0cd0 con 0x7f50b806caa0 2024-05-27T12:35:06.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.183+0000 7f50c17fa640 1 -- 172.21.15.55:0/3474945568 <== mgr.4105 v2:172.21.15.72:6832/3152720583 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f50cc0d0cd0 con 0x7f50b806caa0 2024-05-27T12:35:06.182 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-27T12:35:06.182 INFO:teuthology.orchestra.run.smithi055.stdout:[ 2024-05-27T12:35:06.182 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-05-27T12:35:06.183 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "ss1" 2024-05-27T12:35:06.183 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-05-27T12:35:06.183 INFO:teuthology.orchestra.run.smithi055.stdout:] 2024-05-27T12:35:06.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.185+0000 7f50d2b7d640 1 -- 172.21.15.55:0/3474945568 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f50b806caa0 msgr2=0x7f50b806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:35:06.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.185+0000 7f50d2b7d640 1 --2- 172.21.15.55:0/3474945568 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f50b806caa0 0x7f50b806ef60 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f50c8003fa0 tx=0x7f50c8009040 comp rx=0 tx=0).stop 2024-05-27T12:35:06.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.185+0000 7f50d2b7d640 1 -- 172.21.15.55:0/3474945568 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f50cc0cdb00 msgr2=0x7f50cc0cdf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:35:06.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.185+0000 7f50d2b7d640 1 --2- 172.21.15.55:0/3474945568 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f50cc0cdb00 0x7f50cc0cdf80 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f50c402abe0 tx=0x7f50c4004730 comp rx=0 tx=0).stop 2024-05-27T12:35:06.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.185+0000 7f50d2b7d640 1 -- 172.21.15.55:0/3474945568 shutdown_connections 2024-05-27T12:35:06.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.185+0000 7f50d2b7d640 1 --2- 172.21.15.55:0/3474945568 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f50cc0cdb00 0x7f50cc0cdf80 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:35:06.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.185+0000 7f50d2b7d640 1 --2- 172.21.15.55:0/3474945568 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f50b806caa0 0x7f50b806ef60 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:35:06.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.185+0000 7f50d2b7d640 1 --2- 172.21.15.55:0/3474945568 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f50cc15f700 0x7f50cc0b7e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:35:06.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.185+0000 7f50d2b7d640 1 --2- 172.21.15.55:0/3474945568 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f50b4005080 0x7f50cc146b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:35:06.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.185+0000 7f50d2b7d640 1 -- 172.21.15.55:0/3474945568 >> 172.21.15.55:0/3474945568 conn(0x7f50cc067a50 msgr2=0x7f50cc06d530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:35:06.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.185+0000 7f50d2b7d640 1 -- 172.21.15.55:0/3474945568 shutdown_connections 2024-05-27T12:35:06.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.185+0000 7f50d2b7d640 1 -- 172.21.15.55:0/3474945568 wait complete. 2024-05-27T12:35:06.196 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot rm --force --format json cephfs sv1 ss1 2024-05-27T12:35:06.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.308+0000 7fbf5154f640 1 Processor -- start 2024-05-27T12:35:06.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.308+0000 7fbf5154f640 1 -- start start 2024-05-27T12:35:06.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.309+0000 7fbf5154f640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbf4c15eb00 0x7fbf4c0cfb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:35:06.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.309+0000 7fbf5154f640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbf4c0d3e50 0x7fbf4c0d1830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:35:06.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.309+0000 7fbf5154f640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbf4c0d1d70 0x7fbf4c0d2910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:35:06.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.309+0000 7fbf5154f640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7fbf4c0d5700 con 0x7fbf4c0d3e50 2024-05-27T12:35:06.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.309+0000 7fbf5154f640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fbf4c0d21a0 con 0x7fbf4c0d1d70 2024-05-27T12:35:06.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.309+0000 7fbf5154f640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fbf4c15eee0 con 0x7fbf4c15eb00 2024-05-27T12:35:06.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.309+0000 7fbf4a7fc640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbf4c0d3e50 0x7fbf4c0d1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:35:06.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.309+0000 7fbf4a7fc640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbf4c0d3e50 0x7fbf4c0d1830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54092/0 (socket says 172.21.15.55:54092) 2024-05-27T12:35:06.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.309+0000 7fbf4a7fc640 1 -- 172.21.15.55:0/1046564891 learned_addr learned my addr 172.21.15.55:0/1046564891 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:35:06.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.309+0000 7fbf4b7fe640 1 --2- 172.21.15.55:0/1046564891 >> v2:172.21.15.72:3300/0 conn(0x7fbf4c0d1d70 0x7fbf4c0d2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:35:06.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.309+0000 7fbf4affd640 1 --2- 172.21.15.55:0/1046564891 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbf4c15eb00 0x7fbf4c0cfb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:35:06.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.309+0000 7fbf4a7fc640 1 -- 172.21.15.55:0/1046564891 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbf4c15eb00 msgr2=0x7fbf4c0cfb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:35:06.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.309+0000 7fbf4a7fc640 1 --2- 172.21.15.55:0/1046564891 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbf4c15eb00 0x7fbf4c0cfb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:35:06.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.309+0000 7fbf4a7fc640 1 -- 172.21.15.55:0/1046564891 >> v2:172.21.15.72:3300/0 conn(0x7fbf4c0d1d70 msgr2=0x7fbf4c0d2910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:35:06.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.309+0000 7fbf4a7fc640 1 --2- 172.21.15.55:0/1046564891 >> v2:172.21.15.72:3300/0 conn(0x7fbf4c0d1d70 0x7fbf4c0d2910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:35:06.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.310+0000 7fbf4a7fc640 1 -- 172.21.15.55:0/1046564891 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf4c0d4660 con 0x7fbf4c0d3e50 2024-05-27T12:35:06.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.310+0000 7fbf4a7fc640 1 --2- 172.21.15.55:0/1046564891 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf4c0d3e50 0x7fbf4c0d1830 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fbf4c0ba580 tx=0x7fbf3402a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d98199fc3166363 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:35:06.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.310+0000 7fbf49ffb640 1 -- 172.21.15.55:0/1046564891 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf34037070 con 0x7fbf4c0d3e50 2024-05-27T12:35:06.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.310+0000 7fbf49ffb640 1 -- 172.21.15.55:0/1046564891 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf34032440 con 0x7fbf4c0d3e50 2024-05-27T12:35:06.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.310+0000 7fbf49ffb640 1 -- 172.21.15.55:0/1046564891 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf34032810 con 0x7fbf4c0d3e50 2024-05-27T12:35:06.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.311+0000 7fbf5154f640 1 -- 172.21.15.55:0/1046564891 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf4c0d3e50 msgr2=0x7fbf4c0d1830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:35:06.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.311+0000 7fbf5154f640 1 --2- 172.21.15.55:0/1046564891 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf4c0d3e50 0x7fbf4c0d1830 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fbf4c0ba580 tx=0x7fbf3402a2a0 comp rx=0 tx=0).stop 2024-05-27T12:35:06.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.311+0000 7fbf5154f640 1 -- 172.21.15.55:0/1046564891 shutdown_connections 2024-05-27T12:35:06.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.311+0000 7fbf5154f640 1 --2- 172.21.15.55:0/1046564891 >> v2:172.21.15.72:3300/0 conn(0x7fbf4c0d1d70 0x7fbf4c0d2910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:35:06.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.311+0000 7fbf5154f640 1 --2- 172.21.15.55:0/1046564891 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf4c0d3e50 0x7fbf4c0d1830 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:35:06.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.311+0000 7fbf5154f640 1 --2- 172.21.15.55:0/1046564891 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbf4c15eb00 0x7fbf4c0cfb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:35:06.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.311+0000 7fbf5154f640 1 -- 172.21.15.55:0/1046564891 >> 172.21.15.55:0/1046564891 conn(0x7fbf4c067a50 msgr2=0x7fbf4c067e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:35:06.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.311+0000 7fbf5154f640 1 -- 172.21.15.55:0/1046564891 shutdown_connections 2024-05-27T12:35:06.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.311+0000 7fbf5154f640 1 -- 172.21.15.55:0/1046564891 wait complete. 2024-05-27T12:35:06.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.312+0000 7fbf5154f640 1 Processor -- start 2024-05-27T12:35:06.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.312+0000 7fbf5154f640 1 -- start start 2024-05-27T12:35:06.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.313+0000 7fbf5154f640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbf4c0d1d70 0x7fbf4c15f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:35:06.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.313+0000 7fbf5154f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf4c0d3e50 0x7fbf4c15f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:35:06.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.313+0000 7fbf5154f640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbf4c15eb00 0x7fbf4c146e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:35:06.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.313+0000 7fbf5154f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7fbf4c0d4f00 con 0x7fbf4c0d3e50 2024-05-27T12:35:06.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.313+0000 7fbf5154f640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fbf4c0d4c20 con 0x7fbf4c0d1d70 2024-05-27T12:35:06.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.313+0000 7fbf5154f640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7fbf4c0d51e0 con 0x7fbf4c15eb00 2024-05-27T12:35:06.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.313+0000 7fbf4a7fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf4c0d3e50 0x7fbf4c15f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:35:06.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.313+0000 7fbf4a7fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf4c0d3e50 0x7fbf4c15f610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54094/0 (socket says 172.21.15.55:54094) 2024-05-27T12:35:06.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.313+0000 7fbf4a7fc640 1 -- 172.21.15.55:0/1850308281 learned_addr learned my addr 172.21.15.55:0/1850308281 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:35:06.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.313+0000 7fbf4b7fe640 1 --2- 172.21.15.55:0/1850308281 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbf4c15eb00 0x7fbf4c146e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:35:06.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.313+0000 7fbf4affd640 1 --2- 172.21.15.55:0/1850308281 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbf4c0d1d70 0x7fbf4c15f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:35:06.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.314+0000 7fbf4a7fc640 1 -- 172.21.15.55:0/1850308281 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbf4c15eb00 msgr2=0x7fbf4c146e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:35:06.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.314+0000 7fbf4a7fc640 1 --2- 172.21.15.55:0/1850308281 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbf4c15eb00 0x7fbf4c146e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:35:06.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.314+0000 7fbf4a7fc640 1 -- 172.21.15.55:0/1850308281 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbf4c0d1d70 msgr2=0x7fbf4c15f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:35:06.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.314+0000 7fbf4a7fc640 1 --2- 172.21.15.55:0/1850308281 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbf4c0d1d70 0x7fbf4c15f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:35:06.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.314+0000 7fbf4a7fc640 1 -- 172.21.15.55:0/1850308281 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf4c0ccf20 con 0x7fbf4c0d3e50 2024-05-27T12:35:06.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.314+0000 7fbf4a7fc640 1 --2- 172.21.15.55:0/1850308281 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf4c0d3e50 0x7fbf4c15f610 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fbf34000c00 tx=0x7fbf340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:35:06.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.314+0000 7fbf437fe640 1 -- 172.21.15.55:0/1850308281 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf34041020 con 0x7fbf4c0d3e50 2024-05-27T12:35:06.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.314+0000 7fbf437fe640 1 -- 172.21.15.55:0/1850308281 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf3403d620 con 0x7fbf4c0d3e50 2024-05-27T12:35:06.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.314+0000 7fbf437fe640 1 -- 172.21.15.55:0/1850308281 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf34037040 con 0x7fbf4c0d3e50 2024-05-27T12:35:06.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.314+0000 7fbf5154f640 1 -- 172.21.15.55:0/1850308281 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf4c0cd200 con 0x7fbf4c0d3e50 2024-05-27T12:35:06.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.314+0000 7fbf5154f640 1 -- 172.21.15.55:0/1850308281 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf4c0cd7c0 con 0x7fbf4c0d3e50 2024-05-27T12:35:06.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.315+0000 7fbf5154f640 1 -- 172.21.15.55:0/1850308281 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf4c068a70 con 0x7fbf4c0d3e50 2024-05-27T12:35:06.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.316+0000 7fbf437fe640 1 -- 172.21.15.55:0/1850308281 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 7) ==== 91193+0+0 (secure 0 0 0) 0x7fbf34044020 con 0x7fbf4c0d3e50 2024-05-27T12:35:06.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.316+0000 7fbf437fe640 1 --2- 172.21.15.55:0/1850308281 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fbf2c06caa0 0x7fbf2c06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:35:06.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.316+0000 7fbf437fe640 1 -- 172.21.15.55:0/1850308281 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5709+0+0 (secure 0 0 0) 0x7fbf340ac390 con 0x7fbf4c0d3e50 2024-05-27T12:35:06.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.317+0000 7fbf4affd640 1 --2- 172.21.15.55:0/1850308281 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fbf2c06caa0 0x7fbf2c06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:35:06.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.317+0000 7fbf4affd640 1 --2- 172.21.15.55:0/1850308281 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fbf2c06caa0 0x7fbf2c06ef60 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fbf4c0b6090 tx=0x7fbf44009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:35:06.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.321+0000 7fbf437fe640 1 -- 172.21.15.55:0/1850308281 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fbf3404b030 con 0x7fbf4c0d3e50 2024-05-27T12:35:06.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.542+0000 7fbf5154f640 1 -- 172.21.15.55:0/1850308281 --> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot rm", "force": true, "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbf4c0b5b00 con 0x7fbf2c06caa0 2024-05-27T12:35:06.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.589+0000 7fbf437fe640 1 -- 172.21.15.55:0/1850308281 <== mgr.4105 v2:172.21.15.72:6832/3152720583 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fbf4c0b5b00 con 0x7fbf2c06caa0 2024-05-27T12:35:06.588 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-27T12:35:06.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.591+0000 7fbf5154f640 1 -- 172.21.15.55:0/1850308281 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fbf2c06caa0 msgr2=0x7fbf2c06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:35:06.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.591+0000 7fbf5154f640 1 --2- 172.21.15.55:0/1850308281 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fbf2c06caa0 0x7fbf2c06ef60 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fbf4c0b6090 tx=0x7fbf44009190 comp rx=0 tx=0).stop 2024-05-27T12:35:06.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.591+0000 7fbf5154f640 1 -- 172.21.15.55:0/1850308281 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf4c0d3e50 msgr2=0x7fbf4c15f610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:35:06.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.591+0000 7fbf5154f640 1 --2- 172.21.15.55:0/1850308281 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf4c0d3e50 0x7fbf4c15f610 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fbf34000c00 tx=0x7fbf340046c0 comp rx=0 tx=0).stop 2024-05-27T12:35:06.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.591+0000 7fbf5154f640 1 -- 172.21.15.55:0/1850308281 shutdown_connections 2024-05-27T12:35:06.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.591+0000 7fbf5154f640 1 --2- 172.21.15.55:0/1850308281 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbf4c15eb00 0x7fbf4c146e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:35:06.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.591+0000 7fbf5154f640 1 --2- 172.21.15.55:0/1850308281 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf4c0d3e50 0x7fbf4c15f610 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:35:06.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.591+0000 7fbf5154f640 1 --2- 172.21.15.55:0/1850308281 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7fbf2c06caa0 0x7fbf2c06ef60 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:35:06.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.591+0000 7fbf5154f640 1 --2- 172.21.15.55:0/1850308281 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbf4c0d1d70 0x7fbf4c15f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:35:06.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.591+0000 7fbf5154f640 1 -- 172.21.15.55:0/1850308281 >> 172.21.15.55:0/1850308281 conn(0x7fbf4c067a50 msgr2=0x7fbf4c0b78f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:35:06.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.591+0000 7fbf5154f640 1 -- 172.21.15.55:0/1850308281 shutdown_connections 2024-05-27T12:35:06.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.591+0000 7fbf5154f640 1 -- 172.21.15.55:0/1850308281 wait complete. 2024-05-27T12:35:06.602 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs sv1 2024-05-27T12:35:06.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.710+0000 7f7e0fe7c640 1 Processor -- start 2024-05-27T12:35:06.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.710+0000 7f7e0fe7c640 1 -- start start 2024-05-27T12:35:06.710 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.711+0000 7f7e0fe7c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7e0815eb00 0x7f7e080cfb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:35:06.710 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.711+0000 7f7e0fe7c640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7e080d3e50 0x7f7e080d1830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:35:06.711 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.711+0000 7f7e0fe7c640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e080d2180 con 0x7f7e080d1d70 2024-05-27T12:35:06.711 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.711+0000 7f7e0fe7c640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f7e080d5700 con 0x7f7e0815eb00 2024-05-27T12:35:06.711 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.711+0000 7f7e0fe7c640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f7e0815eee0 con 0x7f7e080d3e50 2024-05-27T12:35:06.711 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.711+0000 7f7e0dc18640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7e0815eb00 0x7f7e080cfb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:35:06.711 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.711+0000 7f7e0e419640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f7e080d1d70 0x7f7e080d2910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:51260/0 (socket says 172.21.15.55:51260) 2024-05-27T12:35:06.711 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.711+0000 7f7e0e419640 1 -- 172.21.15.55:0/2722312688 learned_addr learned my addr 172.21.15.55:0/2722312688 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-27T12:35:06.711 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.711+0000 7f7e0dc18640 1 -- 172.21.15.55:0/2722312688 >> v2:172.21.15.72:3300/0 conn(0x7f7e080d3e50 msgr2=0x7f7e080d1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:35:06.711 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.711+0000 7f7e0dc18640 1 --2- 172.21.15.55:0/2722312688 >> v2:172.21.15.72:3300/0 conn(0x7f7e080d3e50 0x7f7e080d1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:35:06.711 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.711+0000 7f7e0dc18640 1 -- 172.21.15.55:0/2722312688 >> v1:172.21.15.55:6789/0 conn(0x7f7e080d1d70 legacy=0x7f7e080d2910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:35:06.711 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.711+0000 7f7e0dc18640 1 -- 172.21.15.55:0/2722312688 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e080d4660 con 0x7f7e0815eb00 2024-05-27T12:35:06.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.712+0000 7f7e0dc18640 1 --2- 172.21.15.55:0/2722312688 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e0815eb00 0x7f7e080cfb40 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f7e080b7760 tx=0x7f7e0402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=437150ea7b2aaf10 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:35:06.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.712+0000 7f7e0cc16640 1 -- 172.21.15.55:0/2722312688 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e04037070 con 0x7f7e0815eb00 2024-05-27T12:35:06.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.712+0000 7f7e0cc16640 1 -- 172.21.15.55:0/2722312688 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e04032440 con 0x7f7e0815eb00 2024-05-27T12:35:06.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.712+0000 7f7e0cc16640 1 -- 172.21.15.55:0/2722312688 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e04032810 con 0x7f7e0815eb00 2024-05-27T12:35:06.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.713+0000 7f7e0fe7c640 1 -- 172.21.15.55:0/2722312688 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e0815eb00 msgr2=0x7f7e080cfb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:35:06.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.713+0000 7f7e0fe7c640 1 --2- 172.21.15.55:0/2722312688 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e0815eb00 0x7f7e080cfb40 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f7e080b7760 tx=0x7f7e0402a230 comp rx=0 tx=0).stop 2024-05-27T12:35:06.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.713+0000 7f7e0fe7c640 1 -- 172.21.15.55:0/2722312688 shutdown_connections 2024-05-27T12:35:06.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.713+0000 7f7e0fe7c640 1 --2- 172.21.15.55:0/2722312688 >> v2:172.21.15.72:3300/0 conn(0x7f7e080d3e50 0x7f7e080d1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:35:06.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.713+0000 7f7e0fe7c640 1 --2- 172.21.15.55:0/2722312688 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e0815eb00 0x7f7e080cfb40 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:35:06.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.713+0000 7f7e0fe7c640 1 -- 172.21.15.55:0/2722312688 >> 172.21.15.55:0/2722312688 conn(0x7f7e08067a50 msgr2=0x7f7e08067e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:35:06.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.713+0000 7f7e0fe7c640 1 -- 172.21.15.55:0/2722312688 shutdown_connections 2024-05-27T12:35:06.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.713+0000 7f7e0fe7c640 1 -- 172.21.15.55:0/2722312688 wait complete. 2024-05-27T12:35:06.716 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.714+0000 7f7e0fe7c640 1 Processor -- start 2024-05-27T12:35:06.716 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.714+0000 7f7e0fe7c640 1 -- start start 2024-05-27T12:35:06.716 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.715+0000 7f7e0fe7c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e080d1d70 0x7f7e080cad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:35:06.716 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.715+0000 7f7e0fe7c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e080d3e50 0x7f7e0815fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:35:06.716 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.715+0000 7f7e0fe7c640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7e0815eb00 0x7f7e080c9150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:35:06.716 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.715+0000 7f7e0fe7c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f7e080d4f00 con 0x7f7e080d3e50 2024-05-27T12:35:06.716 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.715+0000 7f7e0fe7c640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f7e080d4c20 con 0x7f7e080d1d70 2024-05-27T12:35:06.716 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.715+0000 7f7e0fe7c640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f7e080d51e0 con 0x7f7e0815eb00 2024-05-27T12:35:06.716 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.715+0000 7f7e0d417640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e080d3e50 0x7f7e0815fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:35:06.716 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.715+0000 7f7e0d417640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e080d3e50 0x7f7e0815fa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54104/0 (socket says 172.21.15.55:54104) 2024-05-27T12:35:06.716 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.715+0000 7f7e0d417640 1 -- 172.21.15.55:0/998689423 learned_addr learned my addr 172.21.15.55:0/998689423 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:35:06.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.715+0000 7f7e0dc18640 1 --2- 172.21.15.55:0/998689423 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e080d1d70 0x7f7e080cad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:35:06.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.715+0000 7f7e0e419640 1 --2- 172.21.15.55:0/998689423 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7e0815eb00 0x7f7e080c9150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:35:06.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.715+0000 7f7e0d417640 1 -- 172.21.15.55:0/998689423 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7e0815eb00 msgr2=0x7f7e080c9150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:35:06.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.715+0000 7f7e0d417640 1 --2- 172.21.15.55:0/998689423 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7e0815eb00 0x7f7e080c9150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:35:06.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.715+0000 7f7e0d417640 1 -- 172.21.15.55:0/998689423 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e080d1d70 msgr2=0x7f7e080cad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:35:06.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.715+0000 7f7e0d417640 1 --2- 172.21.15.55:0/998689423 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e080d1d70 0x7f7e080cad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:35:06.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.715+0000 7f7e0d417640 1 -- 172.21.15.55:0/998689423 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e08161ea0 con 0x7f7e080d3e50 2024-05-27T12:35:06.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.715+0000 7f7e0dc18640 1 --2- 172.21.15.55:0/998689423 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e080d1d70 0x7f7e080cad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T12:35:06.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.715+0000 7f7e0e419640 1 --2- 172.21.15.55:0/998689423 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7e0815eb00 0x7f7e080c9150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T12:35:06.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.715+0000 7f7e0d417640 1 --2- 172.21.15.55:0/998689423 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e080d3e50 0x7f7e0815fa30 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f7df800b4d0 tx=0x7f7df800b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:35:06.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.716+0000 7f7dfe7fc640 1 -- 172.21.15.55:0/998689423 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7df8014070 con 0x7f7e080d3e50 2024-05-27T12:35:06.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.716+0000 7f7dfe7fc640 1 -- 172.21.15.55:0/998689423 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7df8010870 con 0x7f7e080d3e50 2024-05-27T12:35:06.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.716+0000 7f7e0fe7c640 1 -- 172.21.15.55:0/998689423 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e080c9c80 con 0x7f7e080d3e50 2024-05-27T12:35:06.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.716+0000 7f7dfe7fc640 1 -- 172.21.15.55:0/998689423 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7df8010c60 con 0x7f7e080d3e50 2024-05-27T12:35:06.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.716+0000 7f7e0fe7c640 1 -- 172.21.15.55:0/998689423 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e080ca240 con 0x7f7e080d3e50 2024-05-27T12:35:06.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.717+0000 7f7e0fe7c640 1 -- 172.21.15.55:0/998689423 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e08068a70 con 0x7f7e080d3e50 2024-05-27T12:35:06.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.717+0000 7f7dfe7fc640 1 -- 172.21.15.55:0/998689423 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 7) ==== 91193+0+0 (secure 0 0 0) 0x7f7df8017070 con 0x7f7e080d3e50 2024-05-27T12:35:06.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.718+0000 7f7dfe7fc640 1 --2- 172.21.15.55:0/998689423 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f7dec06cad0 0x7f7dec06ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:35:06.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.718+0000 7f7dfe7fc640 1 -- 172.21.15.55:0/998689423 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5709+0+0 (secure 0 0 0) 0x7f7df808bbe0 con 0x7f7e080d3e50 2024-05-27T12:35:06.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.718+0000 7f7e0dc18640 1 --2- 172.21.15.55:0/998689423 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f7dec06cad0 0x7f7dec06ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:35:06.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.719+0000 7f7e0dc18640 1 --2- 172.21.15.55:0/998689423 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f7dec06cad0 0x7f7dec06ef90 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f7e04034000 tx=0x7f7e0402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:35:06.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.722+0000 7f7dfe7fc640 1 -- 172.21.15.55:0/998689423 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7df8059e20 con 0x7f7e080d3e50 2024-05-27T12:35:06.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.939+0000 7f7e0fe7c640 1 -- 172.21.15.55:0/998689423 --> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""]}) -- 0x7f7e080caa20 con 0x7f7dec06cad0 2024-05-27T12:35:06.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.957+0000 7f7dfe7fc640 1 -- 172.21.15.55:0/998689423 <== mgr.4105 v2:172.21.15.72:6832/3152720583 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f7e040328f0 con 0x7f7dec06cad0 2024-05-27T12:35:06.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.959+0000 7f7e0fe7c640 1 -- 172.21.15.55:0/998689423 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f7dec06cad0 msgr2=0x7f7dec06ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:35:06.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.959+0000 7f7e0fe7c640 1 --2- 172.21.15.55:0/998689423 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f7dec06cad0 0x7f7dec06ef90 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f7e04034000 tx=0x7f7e0402e000 comp rx=0 tx=0).stop 2024-05-27T12:35:06.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.959+0000 7f7e0fe7c640 1 -- 172.21.15.55:0/998689423 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e080d3e50 msgr2=0x7f7e0815fa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:35:06.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.959+0000 7f7e0fe7c640 1 --2- 172.21.15.55:0/998689423 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e080d3e50 0x7f7e0815fa30 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f7df800b4d0 tx=0x7f7df800b990 comp rx=0 tx=0).stop 2024-05-27T12:35:06.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.959+0000 7f7e0fe7c640 1 -- 172.21.15.55:0/998689423 shutdown_connections 2024-05-27T12:35:06.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.959+0000 7f7e0fe7c640 1 --2- 172.21.15.55:0/998689423 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7e0815eb00 0x7f7e080c9150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:35:06.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.959+0000 7f7e0fe7c640 1 --2- 172.21.15.55:0/998689423 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e080d3e50 0x7f7e0815fa30 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:35:06.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.959+0000 7f7e0fe7c640 1 --2- 172.21.15.55:0/998689423 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f7dec06cad0 0x7f7dec06ef90 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:35:06.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.959+0000 7f7e0fe7c640 1 --2- 172.21.15.55:0/998689423 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e080d1d70 0x7f7e080cad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:35:06.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.959+0000 7f7e0fe7c640 1 -- 172.21.15.55:0/998689423 >> 172.21.15.55:0/998689423 conn(0x7f7e08067a50 msgr2=0x7f7e080ceb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:35:06.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.959+0000 7f7e0fe7c640 1 -- 172.21.15.55:0/998689423 shutdown_connections 2024-05-27T12:35:06.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:06.959+0000 7f7e0fe7c640 1 -- 172.21.15.55:0/998689423 wait complete. 2024-05-27T12:35:06.960 INFO:tasks.ceph.mgr.x.smithi072.stderr:2024-05-27T12:35:06.960+0000 7f91eb23e640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-27T12:35:06.960 INFO:tasks.ceph.mgr.x.smithi072.stderr:2024-05-27T12:35:06.960+0000 7f91eb23e640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-27T12:35:06.960 INFO:tasks.ceph.mgr.x.smithi072.stderr:2024-05-27T12:35:06.960+0000 7f91eb23e640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-27T12:35:06.960 INFO:tasks.ceph.mgr.x.smithi072.stderr:2024-05-27T12:35:06.960+0000 7f91eb23e640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-27T12:35:06.960 INFO:tasks.ceph.mgr.x.smithi072.stderr:2024-05-27T12:35:06.960+0000 7f91eb23e640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-27T12:35:06.970 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs ss1clone1 2024-05-27T12:35:06.979 INFO:tasks.ceph.mgr.x.smithi072.stderr:2024-05-27T12:35:06.979+0000 7f91e9a3b640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-27T12:35:06.979 INFO:tasks.ceph.mgr.x.smithi072.stderr:2024-05-27T12:35:06.979+0000 7f91e9a3b640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-27T12:35:06.979 INFO:tasks.ceph.mgr.x.smithi072.stderr:2024-05-27T12:35:06.979+0000 7f91e9a3b640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-27T12:35:06.979 INFO:tasks.ceph.mgr.x.smithi072.stderr:2024-05-27T12:35:06.979+0000 7f91e9a3b640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-27T12:35:06.979 INFO:tasks.ceph.mgr.x.smithi072.stderr:2024-05-27T12:35:06.979+0000 7f91e9a3b640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-27T12:35:07.082 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:07.083+0000 7f103227c640 1 Processor -- start 2024-05-27T12:35:07.082 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:07.083+0000 7f103227c640 1 -- start start 2024-05-27T12:35:07.083 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:07.084+0000 7f103227c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f102c15eb00 0x7f102c0cfb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:35:07.083 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:07.084+0000 7f103227c640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f102c15eee0 con 0x7f102c0d3e50 2024-05-27T12:35:07.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:07.084+0000 7f103227c640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f102c0d4660 con 0x7f102c0d1f40 2024-05-27T12:35:07.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:07.084+0000 7f103227c640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 -- 0x7f102c0d5700 con 0x7f102c15eb00 2024-05-27T12:35:07.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:07.084+0000 7f102bfff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f102c15eb00 0x7f102c0cfb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:35:07.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:07.084+0000 7f102b7fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f102c0d3e50 0x7f102c0d1830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:51270/0 (socket says 172.21.15.55:51270) 2024-05-27T12:35:07.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:07.084+0000 7f102b7fe640 1 -- 172.21.15.55:0/1854520086 learned_addr learned my addr 172.21.15.55:0/1854520086 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-27T12:35:07.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:07.084+0000 7f102bfff640 1 -- 172.21.15.55:0/1854520086 >> v1:172.21.15.72:6789/0 conn(0x7f102c0d1f40 legacy=0x7f102c0b78f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:35:07.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:07.084+0000 7f102bfff640 1 -- 172.21.15.55:0/1854520086 >> v1:172.21.15.55:6789/0 conn(0x7f102c0d3e50 legacy=0x7f102c0d1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:35:07.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:07.084+0000 7f102bfff640 1 -- 172.21.15.55:0/1854520086 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f102c0d4940 con 0x7f102c15eb00 2024-05-27T12:35:07.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:07.085+0000 7f102bfff640 1 --2- 172.21.15.55:0/1854520086 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f102c15eb00 0x7f102c0cfb40 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f101c0097a0 tx=0x7f101c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84df6e473e06895c server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:35:07.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:07.085+0000 7f102affd640 1 -- 172.21.15.55:0/1854520086 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f101c037070 con 0x7f102c15eb00 2024-05-27T12:35:07.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:07.085+0000 7f102affd640 1 -- 172.21.15.55:0/1854520086 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f101c032440 con 0x7f102c15eb00 2024-05-27T12:35:07.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:07.085+0000 7f102affd640 1 -- 172.21.15.55:0/1854520086 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f101c032810 con 0x7f102c15eb00 2024-05-27T12:35:07.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:07.086+0000 7f103227c640 1 -- 172.21.15.55:0/1854520086 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f102c15eb00 msgr2=0x7f102c0cfb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:35:07.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:07.086+0000 7f103227c640 1 --2- 172.21.15.55:0/1854520086 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f102c15eb00 0x7f102c0cfb40 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f101c0097a0 tx=0x7f101c02a270 comp rx=0 tx=0).stop 2024-05-27T12:35:07.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:07.086+0000 7f103227c640 1 -- 172.21.15.55:0/1854520086 shutdown_connections 2024-05-27T12:35:07.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:07.086+0000 7f103227c640 1 --2- 172.21.15.55:0/1854520086 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f102c15eb00 0x7f102c0cfb40 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:35:07.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:07.086+0000 7f103227c640 1 -- 172.21.15.55:0/1854520086 >> 172.21.15.55:0/1854520086 conn(0x7f102c067a50 msgr2=0x7f102c067e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:35:07.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:07.086+0000 7f103227c640 1 -- 172.21.15.55:0/1854520086 shutdown_connections 2024-05-27T12:35:07.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:07.086+0000 7f103227c640 1 -- 172.21.15.55:0/1854520086 wait complete. 2024-05-27T12:35:07.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:07.087+0000 7f103227c640 1 Processor -- start 2024-05-27T12:35:07.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:07.087+0000 7f103227c640 1 -- start start 2024-05-27T12:35:07.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:07.088+0000 7f103227c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f102c0d1f40 0x7f102c0cdcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:35:07.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:07.088+0000 7f103227c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f102c0d3e50 0x7f102c0c9e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:35:07.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:07.088+0000 7f103227c640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f102c15eb00 0x7f102c0ca900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:35:07.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:07.088+0000 7f103227c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f102c0d51e0 con 0x7f102c0d1f40 2024-05-27T12:35:07.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:07.088+0000 7f103227c640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f102c0d4f00 con 0x7f102c0d3e50 2024-05-27T12:35:07.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:07.088+0000 7f103227c640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f102c0d42c0 con 0x7f102c15eb00 2024-05-27T12:35:07.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:07.088+0000 7f102bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f102c0d1f40 0x7f102c0cdcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:35:07.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:07.088+0000 7f102bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f102c0d1f40 0x7f102c0cdcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54124/0 (socket says 172.21.15.55:54124) 2024-05-27T12:35:07.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:07.088+0000 7f102bfff640 1 -- 172.21.15.55:0/1787511202 learned_addr learned my addr 172.21.15.55:0/1787511202 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:35:07.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:07.088+0000 7f102b7fe640 1 --2- 172.21.15.55:0/1787511202 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f102c0d3e50 0x7f102c0c9e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:35:07.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:07.088+0000 7f1030819640 1 --2- 172.21.15.55:0/1787511202 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f102c15eb00 0x7f102c0ca900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:35:07.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:07.088+0000 7f102bfff640 1 -- 172.21.15.55:0/1787511202 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f102c15eb00 msgr2=0x7f102c0ca900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:35:07.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:07.088+0000 7f102bfff640 1 --2- 172.21.15.55:0/1787511202 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f102c15eb00 0x7f102c0ca900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:35:07.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:07.088+0000 7f102bfff640 1 -- 172.21.15.55:0/1787511202 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f102c0d3e50 msgr2=0x7f102c0c9e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:35:07.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:07.088+0000 7f102bfff640 1 --2- 172.21.15.55:0/1787511202 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f102c0d3e50 0x7f102c0c9e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:35:07.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:07.088+0000 7f102bfff640 1 -- 172.21.15.55:0/1787511202 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f102c0c8db0 con 0x7f102c0d1f40 2024-05-27T12:35:07.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:07.088+0000 7f1030819640 1 --2- 172.21.15.55:0/1787511202 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f102c15eb00 0x7f102c0ca900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T12:35:07.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:07.088+0000 7f102bfff640 1 --2- 172.21.15.55:0/1787511202 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f102c0d1f40 0x7f102c0cdcc0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f101c0098c0 tx=0x7f101c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:35:07.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:07.088+0000 7f1028ff9640 1 -- 172.21.15.55:0/1787511202 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f101c037040 con 0x7f102c0d1f40 2024-05-27T12:35:07.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:07.089+0000 7f1028ff9640 1 -- 172.21.15.55:0/1787511202 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f101c042070 con 0x7f102c0d1f40 2024-05-27T12:35:07.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:07.089+0000 7f103227c640 1 -- 172.21.15.55:0/1787511202 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f102c0c9090 con 0x7f102c0d1f40 2024-05-27T12:35:07.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:07.089+0000 7f1028ff9640 1 -- 172.21.15.55:0/1787511202 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f101c030a70 con 0x7f102c0d1f40 2024-05-27T12:35:07.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:07.089+0000 7f103227c640 1 -- 172.21.15.55:0/1787511202 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f102c0c9650 con 0x7f102c0d1f40 2024-05-27T12:35:07.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:07.090+0000 7f103227c640 1 -- 172.21.15.55:0/1787511202 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f102c0b8a70 con 0x7f102c0d1f40 2024-05-27T12:35:07.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:07.090+0000 7f1028ff9640 1 -- 172.21.15.55:0/1787511202 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 7) ==== 91193+0+0 (secure 0 0 0) 0x7f101c030c10 con 0x7f102c0d1f40 2024-05-27T12:35:07.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:07.091+0000 7f1028ff9640 1 --2- 172.21.15.55:0/1787511202 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f101806caa0 0x7f101806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:35:07.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:07.091+0000 7f1028ff9640 1 -- 172.21.15.55:0/1787511202 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5709+0+0 (secure 0 0 0) 0x7f101c0ac920 con 0x7f102c0d1f40 2024-05-27T12:35:07.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:07.091+0000 7f102b7fe640 1 --2- 172.21.15.55:0/1787511202 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f101806caa0 0x7f101806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:35:07.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:07.091+0000 7f102b7fe640 1 --2- 172.21.15.55:0/1787511202 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f101806caa0 0x7f101806ef60 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f102c0ce930 tx=0x7f1020009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:35:07.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:07.095+0000 7f1028ff9640 1 -- 172.21.15.55:0/1787511202 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f102c0b8a70 con 0x7f102c0d1f40 2024-05-27T12:35:07.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:07.307+0000 7f103227c640 1 -- 172.21.15.55:0/1787511202 --> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "ss1clone1", "target": ["mon-mgr", ""]}) -- 0x7f102c0c9aa0 con 0x7f101806caa0 2024-05-27T12:35:07.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:07.326+0000 7f1028ff9640 1 -- 172.21.15.55:0/1787511202 <== mgr.4105 v2:172.21.15.72:6832/3152720583 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f102c0c9aa0 con 0x7f101806caa0 2024-05-27T12:35:07.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:07.328+0000 7f103227c640 1 -- 172.21.15.55:0/1787511202 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f101806caa0 msgr2=0x7f101806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:35:07.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:07.328+0000 7f103227c640 1 --2- 172.21.15.55:0/1787511202 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f101806caa0 0x7f101806ef60 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f102c0ce930 tx=0x7f1020009040 comp rx=0 tx=0).stop 2024-05-27T12:35:07.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:07.328+0000 7f103227c640 1 -- 172.21.15.55:0/1787511202 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f102c0d1f40 msgr2=0x7f102c0cdcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:35:07.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:07.328+0000 7f103227c640 1 --2- 172.21.15.55:0/1787511202 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f102c0d1f40 0x7f102c0cdcc0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f101c0098c0 tx=0x7f101c0046c0 comp rx=0 tx=0).stop 2024-05-27T12:35:07.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:07.328+0000 7f103227c640 1 -- 172.21.15.55:0/1787511202 shutdown_connections 2024-05-27T12:35:07.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:07.328+0000 7f103227c640 1 --2- 172.21.15.55:0/1787511202 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f102c15eb00 0x7f102c0ca900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:35:07.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:07.328+0000 7f103227c640 1 --2- 172.21.15.55:0/1787511202 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f101806caa0 0x7f101806ef60 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:35:07.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:07.328+0000 7f103227c640 1 --2- 172.21.15.55:0/1787511202 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f102c0d3e50 0x7f102c0c9e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:35:07.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:07.328+0000 7f103227c640 1 --2- 172.21.15.55:0/1787511202 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f102c0d1f40 0x7f102c0cdcc0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:35:07.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:07.328+0000 7f103227c640 1 -- 172.21.15.55:0/1787511202 >> 172.21.15.55:0/1787511202 conn(0x7f102c067a50 msgr2=0x7f102c0d2910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:35:07.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:07.328+0000 7f103227c640 1 -- 172.21.15.55:0/1787511202 shutdown_connections 2024-05-27T12:35:07.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:07.328+0000 7f103227c640 1 -- 172.21.15.55:0/1787511202 wait complete. 2024-05-27T12:35:07.339 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2024-05-27T12:35:07.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:07 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-27T12:35:07.397 INFO:teuthology.orchestra.run.smithi055.stdout:2 2024-05-27T12:35:07.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-27T12:35:07.404 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rm cephfs --yes-i-really-mean-it 2024-05-27T12:35:07.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:07.512+0000 7efd26843640 1 Processor -- start 2024-05-27T12:35:07.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:07.512+0000 7efd26843640 1 -- start start 2024-05-27T12:35:07.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:07.513+0000 7efd26843640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7efd200b3f70 0x7efd2006b930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:35:07.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:07.513+0000 7efd26843640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd2006c280 con 0x7efd20146060 2024-05-27T12:35:07.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:07.513+0000 7efd26843640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd2015cfd0 con 0x7efd2006be70 2024-05-27T12:35:07.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:07.513+0000 7efd26843640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7efd2015dbe0 con 0x7efd200b3f70 2024-05-27T12:35:07.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:07.513+0000 7efd1ffff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7efd20146060 0x7efd200cd8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:51284/0 (socket says 172.21.15.55:51284) 2024-05-27T12:35:07.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:07.513+0000 7efd1ffff640 1 -- 172.21.15.55:0/2134090858 learned_addr learned my addr 172.21.15.55:0/2134090858 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-27T12:35:07.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:07.513+0000 7efd1f7fe640 1 --2- 172.21.15.55:0/2134090858 >> v2:172.21.15.72:3300/0 conn(0x7efd200b3f70 0x7efd2006b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:35:07.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:07.513+0000 7efd1effd640 1 -- 172.21.15.55:0/2134090858 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3254922644 0 0) 0x7efd10001110 con 0x7efd20146060 2024-05-27T12:35:07.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:07.513+0000 7efd1effd640 1 -- 172.21.15.55:0/2134090858 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efd08003520 con 0x7efd20146060 2024-05-27T12:35:07.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:07.513+0000 7efd1effd640 1 -- 172.21.15.55:0/2134090858 <== mon.1 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 602184901 0 0) 0x7efd2015cfd0 con 0x7efd2006be70 2024-05-27T12:35:07.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:07.513+0000 7efd1effd640 1 -- 172.21.15.55:0/2134090858 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efd10001110 con 0x7efd2006be70 2024-05-27T12:35:07.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:07.513+0000 7efd1effd640 1 -- 172.21.15.55:0/2134090858 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2904790082 0 0) 0x7efd08003520 con 0x7efd20146060 2024-05-27T12:35:07.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:07.513+0000 7efd1f7fe640 1 -- 172.21.15.55:0/2134090858 >> v1:172.21.15.72:6789/0 conn(0x7efd2006be70 legacy=0x7efd20072010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:35:07.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:07.513+0000 7efd1f7fe640 1 -- 172.21.15.55:0/2134090858 >> v1:172.21.15.55:6789/0 conn(0x7efd20146060 legacy=0x7efd200cd8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:35:07.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:07.513+0000 7efd1f7fe640 1 -- 172.21.15.55:0/2134090858 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd2015d2b0 con 0x7efd200b3f70 2024-05-27T12:35:07.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:07.514+0000 7efd1f7fe640 1 --2- 172.21.15.55:0/2134090858 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efd200b3f70 0x7efd2006b930 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7efd140097a0 tx=0x7efd1402a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2f4bd0e077cdf635 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:35:07.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:07.514+0000 7efd1effd640 1 -- 172.21.15.55:0/2134090858 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd14037070 con 0x7efd200b3f70 2024-05-27T12:35:07.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:07.514+0000 7efd1effd640 1 -- 172.21.15.55:0/2134090858 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd1402ac50 con 0x7efd200b3f70 2024-05-27T12:35:07.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:07.514+0000 7efd1effd640 1 -- 172.21.15.55:0/2134090858 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd10001840 con 0x7efd200b3f70 2024-05-27T12:35:07.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:07.515+0000 7efd26843640 1 -- 172.21.15.55:0/2134090858 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efd200b3f70 msgr2=0x7efd2006b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:35:07.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:07.515+0000 7efd26843640 1 --2- 172.21.15.55:0/2134090858 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efd200b3f70 0x7efd2006b930 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7efd140097a0 tx=0x7efd1402a1c0 comp rx=0 tx=0).stop 2024-05-27T12:35:07.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:07.515+0000 7efd26843640 1 -- 172.21.15.55:0/2134090858 shutdown_connections 2024-05-27T12:35:07.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:07.515+0000 7efd26843640 1 --2- 172.21.15.55:0/2134090858 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efd200b3f70 0x7efd2006b930 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:35:07.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:07.515+0000 7efd26843640 1 -- 172.21.15.55:0/2134090858 >> 172.21.15.55:0/2134090858 conn(0x7efd200b2240 msgr2=0x7efd200b2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:35:07.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:07.515+0000 7efd26843640 1 -- 172.21.15.55:0/2134090858 shutdown_connections 2024-05-27T12:35:07.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:07.515+0000 7efd26843640 1 -- 172.21.15.55:0/2134090858 wait complete. 2024-05-27T12:35:07.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:07.516+0000 7efd26843640 1 Processor -- start 2024-05-27T12:35:07.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:07.516+0000 7efd26843640 1 -- start start 2024-05-27T12:35:07.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:07.517+0000 7efd26843640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efd2006be70 0x7efd200a9b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:35:07.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:07.517+0000 7efd26843640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efd200b3f70 0x7efd200aa540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:35:07.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:07.517+0000 7efd26843640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd20146060 0x7efd200b1200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:35:07.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:07.517+0000 7efd26843640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7efd200cdfb0 con 0x7efd20146060 2024-05-27T12:35:07.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:07.517+0000 7efd26843640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7efd2015d870 con 0x7efd2006be70 2024-05-27T12:35:07.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:07.517+0000 7efd26843640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7efd20146440 con 0x7efd200b3f70 2024-05-27T12:35:07.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:07.517+0000 7efd24de0640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd20146060 0x7efd200b1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:35:07.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:07.517+0000 7efd24de0640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd20146060 0x7efd200b1200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54136/0 (socket says 172.21.15.55:54136) 2024-05-27T12:35:07.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:07.517+0000 7efd24de0640 1 -- 172.21.15.55:0/2283478745 learned_addr learned my addr 172.21.15.55:0/2283478745 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:35:07.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:07.517+0000 7efd1ffff640 1 --2- 172.21.15.55:0/2283478745 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efd2006be70 0x7efd200a9b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:35:07.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:07.517+0000 7efd1f7fe640 1 --2- 172.21.15.55:0/2283478745 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efd200b3f70 0x7efd200aa540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:35:07.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:07.517+0000 7efd24de0640 1 -- 172.21.15.55:0/2283478745 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efd200b3f70 msgr2=0x7efd200aa540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:35:07.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:07.517+0000 7efd24de0640 1 --2- 172.21.15.55:0/2283478745 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efd200b3f70 0x7efd200aa540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:35:07.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:07.517+0000 7efd24de0640 1 -- 172.21.15.55:0/2283478745 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efd2006be70 msgr2=0x7efd200a9b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:35:07.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:07.517+0000 7efd24de0640 1 --2- 172.21.15.55:0/2283478745 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efd2006be70 0x7efd200a9b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:35:07.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:07.517+0000 7efd24de0640 1 -- 172.21.15.55:0/2283478745 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd2013da60 con 0x7efd20146060 2024-05-27T12:35:07.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:07.518+0000 7efd24de0640 1 --2- 172.21.15.55:0/2283478745 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd20146060 0x7efd200b1200 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7efd1800c7c0 tx=0x7efd1800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:35:07.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:07.518+0000 7efd1cff9640 1 -- 172.21.15.55:0/2283478745 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd18003b70 con 0x7efd20146060 2024-05-27T12:35:07.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:07.518+0000 7efd1cff9640 1 -- 172.21.15.55:0/2283478745 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd18003d10 con 0x7efd20146060 2024-05-27T12:35:07.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:07.518+0000 7efd26843640 1 -- 172.21.15.55:0/2283478745 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd2013dd40 con 0x7efd20146060 2024-05-27T12:35:07.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:07.518+0000 7efd1cff9640 1 -- 172.21.15.55:0/2283478745 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd1800aa50 con 0x7efd20146060 2024-05-27T12:35:07.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:07.518+0000 7efd26843640 1 -- 172.21.15.55:0/2283478745 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd2013e300 con 0x7efd20146060 2024-05-27T12:35:07.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:07.519+0000 7efd26843640 1 -- 172.21.15.55:0/2283478745 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd20068a70 con 0x7efd20146060 2024-05-27T12:35:07.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:07.519+0000 7efd1cff9640 1 -- 172.21.15.55:0/2283478745 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 8) ==== 91295+0+0 (secure 0 0 0) 0x7efd1800abf0 con 0x7efd20146060 2024-05-27T12:35:07.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:07.520+0000 7efd1cff9640 1 --2- 172.21.15.55:0/2283478745 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7efd0c06cbc0 0x7efd0c06f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:35:07.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:07.520+0000 7efd1cff9640 1 -- 172.21.15.55:0/2283478745 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5709+0+0 (secure 0 0 0) 0x7efd1808be10 con 0x7efd20146060 2024-05-27T12:35:07.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:07.520+0000 7efd1ffff640 1 --2- 172.21.15.55:0/2283478745 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7efd0c06cbc0 0x7efd0c06f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:35:07.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:07.521+0000 7efd1ffff640 1 --2- 172.21.15.55:0/2283478745 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7efd0c06cbc0 0x7efd0c06f080 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7efd100013b0 tx=0x7efd10001d50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:35:07.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:07.525+0000 7efd1cff9640 1 -- 172.21.15.55:0/2283478745 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7efd180598a0 con 0x7efd20146060 2024-05-27T12:35:07.732 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:07.734+0000 7efd26843640 1 -- 172.21.15.55:0/2283478745 --> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] -- mgr_command(tid 0: {"prefix": "fs volume rm", "vol_name": "cephfs", "yes-i-really-mean-it": "--yes-i-really-mean-it", "target": ["mon-mgr", ""]}) -- 0x7efd200b59c0 con 0x7efd0c06cbc0 2024-05-27T12:35:07.754 INFO:tasks.ceph.mon.a.smithi055.stderr:2024-05-27T12:35:07.755+0000 7f66e8c3d640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-27T12:35:07.813 INFO:tasks.ceph.mds.a.smithi055.stdout:starting mds.a at 2024-05-27T12:35:08.034 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T12:35:08.037 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T12:35:09.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:09.780+0000 7efd1cff9640 1 -- 172.21.15.55:0/2283478745 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mgrmap(e 9) ==== 91244+0+0 (secure 0 0 0) 0x7efd18055f10 con 0x7efd20146060 2024-05-27T12:35:10.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:10.788+0000 7efd1cff9640 1 -- 172.21.15.55:0/2283478745 <== mgr.4105 v2:172.21.15.72:6832/3152720583 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+66 (secure 0 0 0) 0x7efd200b59c0 con 0x7efd0c06cbc0 2024-05-27T12:35:10.788 INFO:teuthology.orchestra.run.smithi055.stdout:metadata pool: cephfs_metadata data pool: ['cephfs_data'] removed 2024-05-27T12:35:10.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:10.793+0000 7efd26843640 1 -- 172.21.15.55:0/2283478745 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7efd0c06cbc0 msgr2=0x7efd0c06f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:35:10.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:10.793+0000 7efd26843640 1 --2- 172.21.15.55:0/2283478745 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7efd0c06cbc0 0x7efd0c06f080 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7efd100013b0 tx=0x7efd10001d50 comp rx=0 tx=0).stop 2024-05-27T12:35:10.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:10.793+0000 7efd26843640 1 -- 172.21.15.55:0/2283478745 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd20146060 msgr2=0x7efd200b1200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:35:10.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:10.793+0000 7efd26843640 1 --2- 172.21.15.55:0/2283478745 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd20146060 0x7efd200b1200 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7efd1800c7c0 tx=0x7efd1800cc80 comp rx=0 tx=0).stop 2024-05-27T12:35:10.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:10.793+0000 7efd26843640 1 -- 172.21.15.55:0/2283478745 shutdown_connections 2024-05-27T12:35:10.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:10.793+0000 7efd26843640 1 --2- 172.21.15.55:0/2283478745 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd20146060 0x7efd200b1200 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:35:10.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:10.793+0000 7efd26843640 1 --2- 172.21.15.55:0/2283478745 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efd200b3f70 0x7efd200aa540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:35:10.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:10.793+0000 7efd26843640 1 --2- 172.21.15.55:0/2283478745 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7efd0c06cbc0 0x7efd0c06f080 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:35:10.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:10.793+0000 7efd26843640 1 --2- 172.21.15.55:0/2283478745 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efd2006be70 0x7efd200a9b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:35:10.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:10.793+0000 7efd26843640 1 -- 172.21.15.55:0/2283478745 >> 172.21.15.55:0/2283478745 conn(0x7efd200b2240 msgr2=0x7efd2015c100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:35:10.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:10.793+0000 7efd26843640 1 -- 172.21.15.55:0/2283478745 shutdown_connections 2024-05-27T12:35:10.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:10.793+0000 7efd26843640 1 -- 172.21.15.55:0/2283478745 wait complete. 2024-05-27T12:35:10.814 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-05-27T12:35:10.814 DEBUG:teuthology.orchestra.run.smithi055:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-27T12:35:10.885 DEBUG:teuthology.orchestra.run.smithi072:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-27T12:35:10.948 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-05-27T12:35:10.949 INFO:tasks.cephfs.mount:Terminating background process 2024-05-27T12:35:10.949 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-05-27T12:35:10.949 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-27T12:35:10.967 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-05-27T12:35:10.967 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-27T12:35:11.035 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-27T12:35:11.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.255+0000 7f4c759fe640 1 Processor -- start 2024-05-27T12:35:11.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.257+0000 7f4c759fe640 1 -- start start 2024-05-27T12:35:11.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.258+0000 7f4c759fe640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4c700d16d0 0x7f4c700d1b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:35:11.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.258+0000 7f4c759fe640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4c70162af0 0x7f4c70162fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:35:11.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.258+0000 7f4c759fe640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c700d2d40 con 0x7f4c7015ed20 2024-05-27T12:35:11.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.258+0000 7f4c759fe640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f4c700d2070 con 0x7f4c700d16d0 2024-05-27T12:35:11.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.258+0000 7f4c759fe640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f4c700d3670 con 0x7f4c70162af0 2024-05-27T12:35:11.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.258+0000 7f4c751fd640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4c70162af0 0x7f4c70162fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:35:11.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.258+0000 7f4c6ffff640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4c700d16d0 0x7f4c700d1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:35:11.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.258+0000 7f4c751fd640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4c70162af0 0x7f4c70162fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.55:44190/0 (socket says 172.21.15.55:44190) 2024-05-27T12:35:11.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.258+0000 7f4c751fd640 1 -- 172.21.15.55:0/3726284335 learned_addr learned my addr 172.21.15.55:0/3726284335 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:35:11.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.259+0000 7f4c6ffff640 1 -- 172.21.15.55:0/3726284335 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4c70162af0 msgr2=0x7f4c70162fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:35:11.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.259+0000 7f4c6ffff640 1 --2- 172.21.15.55:0/3726284335 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4c70162af0 0x7f4c70162fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:35:11.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.259+0000 7f4c6ffff640 1 -- 172.21.15.55:0/3726284335 >> v1:172.21.15.72:6789/0 conn(0x7f4c7015ed20 legacy=0x7f4c700d3b00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-27T12:35:11.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.259+0000 7f4c6ffff640 1 -- 172.21.15.55:0/3726284335 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c700d3020 con 0x7f4c700d16d0 2024-05-27T12:35:11.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.259+0000 7f4c751fd640 1 --2- 172.21.15.55:0/3726284335 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4c70162af0 0x7f4c70162fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T12:35:11.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.260+0000 7f4c6ffff640 1 --2- 172.21.15.55:0/3726284335 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4c700d16d0 0x7f4c700d1b30 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4c5c0097a0 tx=0x7f4c5c02a130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9ed1178de780e77f server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:35:11.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.261+0000 7f4c6f7fe640 1 -- 172.21.15.55:0/3726284335 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c5c037070 con 0x7f4c700d16d0 2024-05-27T12:35:11.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.261+0000 7f4c6f7fe640 1 -- 172.21.15.55:0/3726284335 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c5c02ae40 con 0x7f4c700d16d0 2024-05-27T12:35:11.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.262+0000 7f4c759fe640 1 -- 172.21.15.55:0/3726284335 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4c700d16d0 msgr2=0x7f4c700d1b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:35:11.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.262+0000 7f4c6f7fe640 1 -- 172.21.15.55:0/3726284335 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c5c037070 con 0x7f4c700d16d0 2024-05-27T12:35:11.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.262+0000 7f4c759fe640 1 --2- 172.21.15.55:0/3726284335 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4c700d16d0 0x7f4c700d1b30 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4c5c0097a0 tx=0x7f4c5c02a130 comp rx=0 tx=0).stop 2024-05-27T12:35:11.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.262+0000 7f4c759fe640 1 -- 172.21.15.55:0/3726284335 shutdown_connections 2024-05-27T12:35:11.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.262+0000 7f4c759fe640 1 --2- 172.21.15.55:0/3726284335 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4c70162af0 0x7f4c70162fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:35:11.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.262+0000 7f4c759fe640 1 --2- 172.21.15.55:0/3726284335 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4c700d16d0 0x7f4c700d1b30 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:35:11.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.262+0000 7f4c759fe640 1 -- 172.21.15.55:0/3726284335 >> 172.21.15.55:0/3726284335 conn(0x7f4c7006d060 msgr2=0x7f4c7006d470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:35:11.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.263+0000 7f4c759fe640 1 -- 172.21.15.55:0/3726284335 shutdown_connections 2024-05-27T12:35:11.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.263+0000 7f4c759fe640 1 -- 172.21.15.55:0/3726284335 wait complete. 2024-05-27T12:35:11.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.264+0000 7f4c759fe640 1 Processor -- start 2024-05-27T12:35:11.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.265+0000 7f4c759fe640 1 -- start start 2024-05-27T12:35:11.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.266+0000 7f4c759fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4c700d16d0 0x7f4c700c7c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:35:11.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.266+0000 7f4c759fe640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4c7015ed20 0x7f4c70161e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:35:11.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.266+0000 7f4c759fe640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4c70162af0 0x7f4c701538d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:35:11.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.266+0000 7f4c749fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4c700d16d0 0x7f4c700c7c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:35:11.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.267+0000 7f4c6ffff640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4c7015ed20 0x7f4c70161e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:35:11.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.267+0000 7f4c6ffff640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4c7015ed20 0x7f4c70161e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.55:44196/0 (socket says 172.21.15.55:44196) 2024-05-27T12:35:11.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.267+0000 7f4c749fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4c700d16d0 0x7f4c700c7c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54164/0 (socket says 172.21.15.55:54164) 2024-05-27T12:35:11.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.267+0000 7f4c759fe640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f4c701634e0 con 0x7f4c700d16d0 2024-05-27T12:35:11.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.267+0000 7f4c759fe640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f4c7015f100 con 0x7f4c70162af0 2024-05-27T12:35:11.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.267+0000 7f4c759fe640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f4c700b7bf0 con 0x7f4c7015ed20 2024-05-27T12:35:11.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.267+0000 7f4c6ffff640 1 -- 172.21.15.55:0/534171256 learned_addr learned my addr 172.21.15.55:0/534171256 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:35:11.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.267+0000 7f4c6ffff640 1 -- 172.21.15.55:0/534171256 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4c70162af0 msgr2=0x7f4c701538d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:35:11.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.267+0000 7f4c751fd640 1 --2- 172.21.15.55:0/534171256 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4c70162af0 0x7f4c701538d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:35:11.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.268+0000 7f4c6ffff640 1 --2- 172.21.15.55:0/534171256 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4c70162af0 0x7f4c701538d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:35:11.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.268+0000 7f4c6ffff640 1 -- 172.21.15.55:0/534171256 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4c700d16d0 msgr2=0x7f4c700c7c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:35:11.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.268+0000 7f4c6ffff640 1 --2- 172.21.15.55:0/534171256 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4c700d16d0 0x7f4c700c7c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:35:11.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.268+0000 7f4c6ffff640 1 -- 172.21.15.55:0/534171256 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c70154020 con 0x7f4c7015ed20 2024-05-27T12:35:11.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.268+0000 7f4c751fd640 1 --2- 172.21.15.55:0/534171256 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4c70162af0 0x7f4c701538d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-27T12:35:11.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.268+0000 7f4c749fc640 1 --2- 172.21.15.55:0/534171256 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4c700d16d0 0x7f4c700c7c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T12:35:11.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.268+0000 7f4c6ffff640 1 --2- 172.21.15.55:0/534171256 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4c7015ed20 0x7f4c70161e00 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4c5c035040 tx=0x7f4c5c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:35:11.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.270+0000 7f4c6d7fa640 1 -- 172.21.15.55:0/534171256 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c5c037050 con 0x7f4c7015ed20 2024-05-27T12:35:11.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.270+0000 7f4c6d7fa640 1 -- 172.21.15.55:0/534171256 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c5c038040 con 0x7f4c7015ed20 2024-05-27T12:35:11.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.270+0000 7f4c759fe640 1 -- 172.21.15.55:0/534171256 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c70154300 con 0x7f4c7015ed20 2024-05-27T12:35:11.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.270+0000 7f4c759fe640 1 -- 172.21.15.55:0/534171256 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c701548c0 con 0x7f4c7015ed20 2024-05-27T12:35:11.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.270+0000 7f4c6d7fa640 1 -- 172.21.15.55:0/534171256 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c5c006e10 con 0x7f4c7015ed20 2024-05-27T12:35:11.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.272+0000 7f4c759fe640 1 -- 172.21.15.55:0/534171256 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c50005290 con 0x7f4c7015ed20 2024-05-27T12:35:11.277 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.277+0000 7f4c6d7fa640 1 -- 172.21.15.55:0/534171256 <== mon.2 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 9) ==== 91244+0+0 (secure 0 0 0) 0x7f4c5c045020 con 0x7f4c7015ed20 2024-05-27T12:35:11.277 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.277+0000 7f4c6d7fa640 1 --2- 172.21.15.55:0/534171256 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f4c5406cc00 0x7f4c5406f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:35:11.277 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.278+0000 7f4c6d7fa640 1 -- 172.21.15.55:0/534171256 <== mon.2 v2:172.21.15.72:3301/0 5 ==== osd_map(39..39 src has 1..39) ==== 4943+0+0 (secure 0 0 0) 0x7f4c5c0abdb0 con 0x7f4c7015ed20 2024-05-27T12:35:11.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.284+0000 7f4c749fc640 1 --2- 172.21.15.55:0/534171256 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f4c5406cc00 0x7f4c5406f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:35:11.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.285+0000 7f4c749fc640 1 --2- 172.21.15.55:0/534171256 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f4c5406cc00 0x7f4c5406f0c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f4c64006fd0 tx=0x7f4c640090e0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:35:11.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.285+0000 7f4c6d7fa640 1 -- 172.21.15.55:0/534171256 <== mon.2 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4c5c07a160 con 0x7f4c7015ed20 2024-05-27T12:35:11.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.562+0000 7f4c759fe640 1 -- 172.21.15.55:0/534171256 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4c50005850 con 0x7f4c7015ed20 2024-05-27T12:35:11.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.563+0000 7f4c6d7fa640 1 -- 172.21.15.55:0/534171256 <== mon.2 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) ==== 74+0+12972 (secure 0 0 0) 0x7f4c5c079a60 con 0x7f4c7015ed20 2024-05-27T12:35:11.563 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-05-27T12:35:11.563 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":39,"fsid":"c3ff4e3b-8dae-4856-9593-e5cc66c59982","created":"2024-05-27T12:32:17.019097+0000","modified":"2024-05-27T12:35:10.771856+0000","last_up_change":"2024-05-27T12:32:28.109744+0000","last_in_change":"2024-05-27T12:32:19.309872+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-27T12:32:29.277895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e607b598-061b-4b6f-92ff-95c20b330599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":807572567},{"type":"v1","addr":"172.21.15.55:6801","nonce":807572567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":807572567},{"type":"v1","addr":"172.21.15.55:6803","nonce":807572567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":807572567},{"type":"v1","addr":"172.21.15.55:6807","nonce":807572567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":807572567},{"type":"v1","addr":"172.21.15.55:6805","nonce":807572567}]},"public_addr":"172.21.15.55:6801/807572567","cluster_addr":"172.21.15.55:6803/807572567","heartbeat_back_addr":"172.21.15.55:6807/807572567","heartbeat_front_addr":"172.21.15.55:6805/807572567","state":["exists","up"]},{"osd":1,"uuid":"ba2b5b1d-71a9-4ecc-9a48-55aa7fe54261","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":3426897300},{"type":"v1","addr":"172.21.15.55:6825","nonce":3426897300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":3426897300},{"type":"v1","addr":"172.21.15.55:6827","nonce":3426897300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":3426897300},{"type":"v1","addr":"172.21.15.55:6831","nonce":3426897300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":3426897300},{"type":"v1","addr":"172.21.15.55:6829","nonce":3426897300}]},"public_addr":"172.21.15.55:6825/3426897300","cluster_addr":"172.21.15.55:6827/3426897300","heartbeat_back_addr":"172.21.15.55:6831/3426897300","heartbeat_front_addr":"172.21.15.55:6829/3426897300","state":["exists","up"]},{"osd":2,"uuid":"e6b81cc6-4ff1-45d0-87eb-9f04ccf986a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3510271725},{"type":"v1","addr":"172.21.15.55:6809","nonce":3510271725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3510271725},{"type":"v1","addr":"172.21.15.55:6811","nonce":3510271725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3510271725},{"type":"v1","addr":"172.21.15.55:6815","nonce":3510271725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3510271725},{"type":"v1","addr":"172.21.15.55:6813","nonce":3510271725}]},"public_addr":"172.21.15.55:6809/3510271725","cluster_addr":"172.21.15.55:6811/3510271725","heartbeat_back_addr":"172.21.15.55:6815/3510271725","heartbeat_front_addr":"172.21.15.55:6813/3510271725","state":["exists","up"]},{"osd":3,"uuid":"b6a34b75-807d-4693-b1c3-903cb4c618d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":1066693520},{"type":"v1","addr":"172.21.15.55:6817","nonce":1066693520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":1066693520},{"type":"v1","addr":"172.21.15.55:6819","nonce":1066693520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":1066693520},{"type":"v1","addr":"172.21.15.55:6823","nonce":1066693520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":1066693520},{"type":"v1","addr":"172.21.15.55:6821","nonce":1066693520}]},"public_addr":"172.21.15.55:6817/1066693520","cluster_addr":"172.21.15.55:6819/1066693520","heartbeat_back_addr":"172.21.15.55:6823/1066693520","heartbeat_front_addr":"172.21.15.55:6821/1066693520","state":["exists","up"]},{"osd":4,"uuid":"272ec937-56b4-4f0a-b2e1-b0bc189c9d79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":4190771237},{"type":"v1","addr":"172.21.15.72:6820","nonce":4190771237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":4190771237},{"type":"v1","addr":"172.21.15.72:6824","nonce":4190771237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":4190771237},{"type":"v1","addr":"172.21.15.72:6831","nonce":4190771237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":4190771237},{"type":"v1","addr":"172.21.15.72:6828","nonce":4190771237}]},"public_addr":"172.21.15.72:6820/4190771237","cluster_addr":"172.21.15.72:6824/4190771237","heartbeat_back_addr":"172.21.15.72:6831/4190771237","heartbeat_front_addr":"172.21.15.72:6828/4190771237","state":["exists","up"]},{"osd":5,"uuid":"56439854-72a0-4ef4-81ff-184a3d924a5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":2421889184},{"type":"v1","addr":"172.21.15.72:6801","nonce":2421889184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6803","nonce":2421889184},{"type":"v1","addr":"172.21.15.72:6805","nonce":2421889184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":2421889184},{"type":"v1","addr":"172.21.15.72:6813","nonce":2421889184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6807","nonce":2421889184},{"type":"v1","addr":"172.21.15.72:6809","nonce":2421889184}]},"public_addr":"172.21.15.72:6801/2421889184","cluster_addr":"172.21.15.72:6805/2421889184","heartbeat_back_addr":"172.21.15.72:6813/2421889184","heartbeat_front_addr":"172.21.15.72:6809/2421889184","state":["exists","up"]},{"osd":6,"uuid":"e248e2be-3b6e-49cf-8c8a-1a4152827582","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3796994599},{"type":"v1","addr":"172.21.15.72:6804","nonce":3796994599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":3796994599},{"type":"v1","addr":"172.21.15.72:6808","nonce":3796994599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":3796994599},{"type":"v1","addr":"172.21.15.72:6815","nonce":3796994599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":3796994599},{"type":"v1","addr":"172.21.15.72:6812","nonce":3796994599}]},"public_addr":"172.21.15.72:6804/3796994599","cluster_addr":"172.21.15.72:6808/3796994599","heartbeat_back_addr":"172.21.15.72:6815/3796994599","heartbeat_front_addr":"172.21.15.72:6812/3796994599","state":["exists","up"]},{"osd":7,"uuid":"505a62d3-322b-4629-b4fd-187a55563709","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":3024877895},{"type":"v1","addr":"172.21.15.72:6817","nonce":3024877895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":3024877895},{"type":"v1","addr":"172.21.15.72:6821","nonce":3024877895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6827","nonce":3024877895},{"type":"v1","addr":"172.21.15.72:6829","nonce":3024877895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6823","nonce":3024877895},{"type":"v1","addr":"172.21.15.72:6825","nonce":3024877895}]},"public_addr":"172.21.15.72:6817/3024877895","cluster_addr":"172.21.15.72:6821/3024877895","heartbeat_back_addr":"172.21.15.72:6829/3024877895","heartbeat_front_addr":"172.21.15.72:6825/3024877895","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.241014+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.450799+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.465018+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.507647+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.534763+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.495895+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.427110+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-27T12:32:24.547466+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:6833/1971815735":"2024-05-28T12:35:07.755944+0000","172.21.15.55:6832/1971815735":"2024-05-28T12:35:07.755944+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-27T12:35:11.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.566+0000 7f4c759fe640 1 -- 172.21.15.55:0/534171256 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f4c5406cc00 msgr2=0x7f4c5406f0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:35:11.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.566+0000 7f4c759fe640 1 --2- 172.21.15.55:0/534171256 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f4c5406cc00 0x7f4c5406f0c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f4c64006fd0 tx=0x7f4c640090e0 comp rx=0 tx=0).stop 2024-05-27T12:35:11.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.566+0000 7f4c759fe640 1 -- 172.21.15.55:0/534171256 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4c7015ed20 msgr2=0x7f4c70161e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:35:11.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.566+0000 7f4c759fe640 1 --2- 172.21.15.55:0/534171256 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4c7015ed20 0x7f4c70161e00 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4c5c035040 tx=0x7f4c5c0046c0 comp rx=0 tx=0).stop 2024-05-27T12:35:11.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.566+0000 7f4c759fe640 1 -- 172.21.15.55:0/534171256 shutdown_connections 2024-05-27T12:35:11.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.566+0000 7f4c759fe640 1 --2- 172.21.15.55:0/534171256 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f4c5406cc00 0x7f4c5406f0c0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:35:11.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.566+0000 7f4c759fe640 1 --2- 172.21.15.55:0/534171256 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4c70162af0 0x7f4c701538d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:35:11.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.566+0000 7f4c759fe640 1 --2- 172.21.15.55:0/534171256 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4c7015ed20 0x7f4c70161e00 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:35:11.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.566+0000 7f4c759fe640 1 --2- 172.21.15.55:0/534171256 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4c700d16d0 0x7f4c700c7c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:35:11.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.566+0000 7f4c759fe640 1 -- 172.21.15.55:0/534171256 >> 172.21.15.55:0/534171256 conn(0x7f4c7006d060 msgr2=0x7f4c700cabc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:35:11.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.566+0000 7f4c759fe640 1 -- 172.21.15.55:0/534171256 shutdown_connections 2024-05-27T12:35:11.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.566+0000 7f4c759fe640 1 -- 172.21.15.55:0/534171256 wait complete. 2024-05-27T12:35:11.577 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-27T12:32:29.277895+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-27T12:35:11.577 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-27T12:35:11.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.685+0000 7feb05344640 1 Processor -- start 2024-05-27T12:35:11.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.685+0000 7feb05344640 1 -- start start 2024-05-27T12:35:11.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.686+0000 7feb05344640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7feb000cd7d0 0x7feb000ce000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:35:11.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.686+0000 7feb05344640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb000cd160 con 0x7feb0015ca50 2024-05-27T12:35:11.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.686+0000 7feb05344640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb0015d2c0 con 0x7feb0015ce30 2024-05-27T12:35:11.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.686+0000 7feb05344640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7feb0006c450 con 0x7feb000cd7d0 2024-05-27T12:35:11.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.686+0000 7feafeffd640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7feb0015ca50 0x7feb000b52e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:51308/0 (socket says 172.21.15.55:51308) 2024-05-27T12:35:11.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.686+0000 7feafeffd640 1 -- 172.21.15.55:0/4100310203 learned_addr learned my addr 172.21.15.55:0/4100310203 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-27T12:35:11.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.686+0000 7feaf67fc640 1 --2- 172.21.15.55:0/4100310203 >> v2:172.21.15.72:3300/0 conn(0x7feb000cd7d0 0x7feb000ce000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:35:11.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.686+0000 7feafe7fc640 1 -- 172.21.15.55:0/4100310203 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2392844253 0 0) 0x7feb000cd160 con 0x7feb0015ca50 2024-05-27T12:35:11.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.686+0000 7feafe7fc640 1 -- 172.21.15.55:0/4100310203 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feaec003520 con 0x7feb0015ca50 2024-05-27T12:35:11.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.686+0000 7feafe7fc640 1 -- 172.21.15.55:0/4100310203 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2729416498 0 0) 0x7feaec003520 con 0x7feb0015ca50 2024-05-27T12:35:11.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.686+0000 7feafe7fc640 1 -- 172.21.15.55:0/4100310203 >> v2:172.21.15.72:3300/0 conn(0x7feb000cd7d0 msgr2=0x7feb000ce000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:35:11.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.686+0000 7feafe7fc640 1 --2- 172.21.15.55:0/4100310203 >> v2:172.21.15.72:3300/0 conn(0x7feb000cd7d0 0x7feb000ce000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:35:11.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.686+0000 7feafe7fc640 1 -- 172.21.15.55:0/4100310203 >> v1:172.21.15.72:6789/0 conn(0x7feb0015ce30 legacy=0x7feb000cf8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:35:11.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.686+0000 7feafe7fc640 1 -- 172.21.15.55:0/4100310203 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb00070a70 con 0x7feb0015ca50 2024-05-27T12:35:11.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.686+0000 7feafe7fc640 1 -- 172.21.15.55:0/4100310203 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 793017739 0 0) 0x7feaf0001670 con 0x7feb0015ca50 2024-05-27T12:35:11.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.686+0000 7feaf67fc640 1 --2- 172.21.15.55:0/4100310203 >> v2:172.21.15.72:3300/0 conn(0x7feb000cd7d0 0x7feb000ce000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-27T12:35:11.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.686+0000 7feafe7fc640 1 -- 172.21.15.55:0/4100310203 >> v1:172.21.15.55:6789/0 conn(0x7feb0015ca50 legacy=0x7feb000b52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:35:11.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.686+0000 7feafe7fc640 1 --2- 172.21.15.55:0/4100310203 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feaec0039b0 0x7feaec003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:35:11.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.686+0000 7feafe7fc640 1 --2- 172.21.15.55:0/4100310203 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feaec004800 0x7feaec004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:35:11.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.686+0000 7feafe7fc640 1 --2- 172.21.15.55:0/4100310203 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feaec0051c0 0x7feaec00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:35:11.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.686+0000 7feafe7fc640 1 -- 172.21.15.55:0/4100310203 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7feb0006c450 con 0x7feaec0051c0 2024-05-27T12:35:11.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.686+0000 7feafe7fc640 1 -- 172.21.15.55:0/4100310203 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7feaec00c160 con 0x7feaec004800 2024-05-27T12:35:11.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.686+0000 7feafe7fc640 1 -- 172.21.15.55:0/4100310203 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7feaec00c360 con 0x7feaec0039b0 2024-05-27T12:35:11.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.687+0000 7feafeffd640 1 --2- 172.21.15.55:0/4100310203 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feaec0039b0 0x7feaec003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:35:11.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.687+0000 7feaff7fe640 1 --2- 172.21.15.55:0/4100310203 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feaec0051c0 0x7feaec00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:35:11.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.687+0000 7feaf67fc640 1 --2- 172.21.15.55:0/4100310203 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feaec004800 0x7feaec004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:35:11.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.687+0000 7feaff7fe640 1 -- 172.21.15.55:0/4100310203 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feaec0039b0 msgr2=0x7feaec003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:35:11.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.687+0000 7feaff7fe640 1 --2- 172.21.15.55:0/4100310203 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feaec0039b0 0x7feaec003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:35:11.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.687+0000 7feaff7fe640 1 -- 172.21.15.55:0/4100310203 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feaec004800 msgr2=0x7feaec004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-27T12:35:11.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.687+0000 7feaff7fe640 1 --2- 172.21.15.55:0/4100310203 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feaec004800 0x7feaec004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:35:11.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.687+0000 7feaff7fe640 1 -- 172.21.15.55:0/4100310203 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feaec003520 con 0x7feaec0051c0 2024-05-27T12:35:11.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.687+0000 7feaff7fe640 1 -- 172.21.15.55:0/4100310203 reap_dead start 2024-05-27T12:35:11.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.687+0000 7feaff7fe640 1 --2- 172.21.15.55:0/4100310203 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feaec0051c0 0x7feaec00b9c0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7feaf8001e50 tx=0x7feaec005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d65970b33a89dabf server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:35:11.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.688+0000 7feafe7fc640 1 -- 172.21.15.55:0/4100310203 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaf8001a70 con 0x7feaec0051c0 2024-05-27T12:35:11.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.688+0000 7feafe7fc640 1 -- 172.21.15.55:0/4100310203 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feaf8003970 con 0x7feaec0051c0 2024-05-27T12:35:11.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.688+0000 7feafe7fc640 1 -- 172.21.15.55:0/4100310203 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaf8003d60 con 0x7feaec0051c0 2024-05-27T12:35:11.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.688+0000 7feb05344640 1 -- 172.21.15.55:0/4100310203 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feaec0051c0 msgr2=0x7feaec00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:35:11.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.688+0000 7feb05344640 1 --2- 172.21.15.55:0/4100310203 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feaec0051c0 0x7feaec00b9c0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7feaf8001e50 tx=0x7feaec005830 comp rx=0 tx=0).stop 2024-05-27T12:35:11.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.688+0000 7feb05344640 1 -- 172.21.15.55:0/4100310203 shutdown_connections 2024-05-27T12:35:11.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.688+0000 7feb05344640 1 --2- 172.21.15.55:0/4100310203 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feaec0051c0 0x7feaec00b9c0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:35:11.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.688+0000 7feb05344640 1 -- 172.21.15.55:0/4100310203 >> 172.21.15.55:0/4100310203 conn(0x7feb0006b930 msgr2=0x7feb0006bd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:35:11.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.688+0000 7feb05344640 1 -- 172.21.15.55:0/4100310203 shutdown_connections 2024-05-27T12:35:11.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.688+0000 7feb05344640 1 -- 172.21.15.55:0/4100310203 wait complete. 2024-05-27T12:35:11.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.689+0000 7feb05344640 1 Processor -- start 2024-05-27T12:35:11.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.690+0000 7feb05344640 1 -- start start 2024-05-27T12:35:11.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.690+0000 7feb05344640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feaec0051c0 0x7feb001440d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:35:11.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.690+0000 7feb05344640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb001447c0 0x7feb001e6c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:35:11.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.690+0000 7feb05344640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb00159e40 0x7feb0015a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:35:11.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.690+0000 7feb05344640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7feb000ce000 con 0x7feb00159e40 2024-05-27T12:35:11.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.690+0000 7feb05344640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7feb000cca50 con 0x7feb001447c0 2024-05-27T12:35:11.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.690+0000 7feb05344640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7feb000ce180 con 0x7feaec0051c0 2024-05-27T12:35:11.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.690+0000 7feaff7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb00159e40 0x7feb0015a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:35:11.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.690+0000 7feaff7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb00159e40 0x7feb0015a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54178/0 (socket says 172.21.15.55:54178) 2024-05-27T12:35:11.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.690+0000 7feaff7fe640 1 -- 172.21.15.55:0/3657845975 learned_addr learned my addr 172.21.15.55:0/3657845975 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:35:11.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.691+0000 7feaf67fc640 1 --2- 172.21.15.55:0/3657845975 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb001447c0 0x7feb001e6c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:35:11.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.691+0000 7feafeffd640 1 --2- 172.21.15.55:0/3657845975 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feaec0051c0 0x7feb001440d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:35:11.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.691+0000 7feaff7fe640 1 -- 172.21.15.55:0/3657845975 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feaec0051c0 msgr2=0x7feb001440d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:35:11.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.691+0000 7feaff7fe640 1 --2- 172.21.15.55:0/3657845975 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feaec0051c0 0x7feb001440d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:35:11.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.691+0000 7feaff7fe640 1 -- 172.21.15.55:0/3657845975 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb001447c0 msgr2=0x7feb001e6c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:35:11.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.691+0000 7feaff7fe640 1 --2- 172.21.15.55:0/3657845975 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb001447c0 0x7feb001e6c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:35:11.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.691+0000 7feaff7fe640 1 -- 172.21.15.55:0/3657845975 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb0006eeb0 con 0x7feb00159e40 2024-05-27T12:35:11.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.691+0000 7feafeffd640 1 --2- 172.21.15.55:0/3657845975 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feaec0051c0 0x7feb001440d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T12:35:11.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.691+0000 7feaff7fe640 1 --2- 172.21.15.55:0/3657845975 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb00159e40 0x7feb0015a2c0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7feaf8001f70 tx=0x7feaf80014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:35:11.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.691+0000 7feaf7fff640 1 -- 172.21.15.55:0/3657845975 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaf8001a70 con 0x7feb00159e40 2024-05-27T12:35:11.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.691+0000 7feaf7fff640 1 -- 172.21.15.55:0/3657845975 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feaf8006b50 con 0x7feb00159e40 2024-05-27T12:35:11.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.691+0000 7feb05344640 1 -- 172.21.15.55:0/3657845975 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb0006f190 con 0x7feb00159e40 2024-05-27T12:35:11.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.691+0000 7feaf7fff640 1 -- 172.21.15.55:0/3657845975 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaf8007030 con 0x7feb00159e40 2024-05-27T12:35:11.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.691+0000 7feb05344640 1 -- 172.21.15.55:0/3657845975 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb0006f750 con 0x7feb00159e40 2024-05-27T12:35:11.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.692+0000 7feb05344640 1 -- 172.21.15.55:0/3657845975 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb0015a800 con 0x7feb00159e40 2024-05-27T12:35:11.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.693+0000 7feaf7fff640 1 -- 172.21.15.55:0/3657845975 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 9) ==== 91244+0+0 (secure 0 0 0) 0x7feaf80071d0 con 0x7feb00159e40 2024-05-27T12:35:11.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.693+0000 7feaf7fff640 1 --2- 172.21.15.55:0/3657845975 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7feae006cb60 0x7feae006f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:35:11.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.693+0000 7feaf7fff640 1 -- 172.21.15.55:0/3657845975 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4943+0+0 (secure 0 0 0) 0x7feaf80ab670 con 0x7feb00159e40 2024-05-27T12:35:11.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.693+0000 7feafeffd640 1 --2- 172.21.15.55:0/3657845975 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7feae006cb60 0x7feae006f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:35:11.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.694+0000 7feafeffd640 1 --2- 172.21.15.55:0/3657845975 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7feae006cb60 0x7feae006f020 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7feaf0007d50 tx=0x7feaf0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:35:11.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.698+0000 7feaf7fff640 1 -- 172.21.15.55:0/3657845975 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7feaf8043060 con 0x7feb00159e40 2024-05-27T12:35:11.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.882+0000 7feb05344640 1 -- 172.21.15.55:0/3657845975 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7feb0006cb60 con 0x7feb00159e40 2024-05-27T12:35:11.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.883+0000 7feaf7fff640 1 -- 172.21.15.55:0/3657845975 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v39) ==== 93+0+10 (secure 0 0 0) 0x7feb0015d2c0 con 0x7feb00159e40 2024-05-27T12:35:11.882 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-05-27T12:35:11.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.885+0000 7feb05344640 1 -- 172.21.15.55:0/3657845975 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7feae006cb60 msgr2=0x7feae006f020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:35:11.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.885+0000 7feb05344640 1 --2- 172.21.15.55:0/3657845975 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7feae006cb60 0x7feae006f020 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7feaf0007d50 tx=0x7feaf0009040 comp rx=0 tx=0).stop 2024-05-27T12:35:11.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.885+0000 7feb05344640 1 -- 172.21.15.55:0/3657845975 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb00159e40 msgr2=0x7feb0015a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:35:11.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.885+0000 7feb05344640 1 --2- 172.21.15.55:0/3657845975 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb00159e40 0x7feb0015a2c0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7feaf8001f70 tx=0x7feaf80014a0 comp rx=0 tx=0).stop 2024-05-27T12:35:11.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.885+0000 7feb05344640 1 -- 172.21.15.55:0/3657845975 shutdown_connections 2024-05-27T12:35:11.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.885+0000 7feb05344640 1 --2- 172.21.15.55:0/3657845975 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb00159e40 0x7feb0015a2c0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:35:11.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.885+0000 7feb05344640 1 --2- 172.21.15.55:0/3657845975 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7feae006cb60 0x7feae006f020 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:35:11.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.885+0000 7feb05344640 1 --2- 172.21.15.55:0/3657845975 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb001447c0 0x7feb001e6c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:35:11.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.885+0000 7feb05344640 1 --2- 172.21.15.55:0/3657845975 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feaec0051c0 0x7feb001440d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:35:11.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.885+0000 7feb05344640 1 -- 172.21.15.55:0/3657845975 >> 172.21.15.55:0/3657845975 conn(0x7feb0006b930 msgr2=0x7feb001526c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:35:11.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.885+0000 7feb05344640 1 -- 172.21.15.55:0/3657845975 shutdown_connections 2024-05-27T12:35:11.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:11.885+0000 7feb05344640 1 -- 172.21.15.55:0/3657845975 wait complete. 2024-05-27T12:35:11.896 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-27T12:35:12.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:12.001+0000 7f683f76f640 1 Processor -- start 2024-05-27T12:35:12.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:12.001+0000 7f683f76f640 1 -- start start 2024-05-27T12:35:12.002 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:12.002+0000 7f683f76f640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6838146060 0x7f68380cd7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:35:12.002 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:12.002+0000 7f683f76f640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f683815cf30 con 0x7f683806c040 2024-05-27T12:35:12.002 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:12.002+0000 7f683f76f640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f683815d210 con 0x7f68380cdd30 2024-05-27T12:35:12.002 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:12.002+0000 7f683f76f640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f6838146440 con 0x7f6838146060 2024-05-27T12:35:12.002 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:12.002+0000 7f683dd0c640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f683806c040 0x7f6838160480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:51314/0 (socket says 172.21.15.55:51314) 2024-05-27T12:35:12.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:12.002+0000 7f683dd0c640 1 -- 172.21.15.55:0/2208389930 learned_addr learned my addr 172.21.15.55:0/2208389930 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-05-27T12:35:12.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:12.003+0000 7f683d50b640 1 --2- 172.21.15.55:0/2208389930 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6838146060 0x7f68380cd7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:35:12.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:12.003+0000 7f6837fff640 1 -- 172.21.15.55:0/2208389930 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2234363724 0 0) 0x7f683815cf30 con 0x7f683806c040 2024-05-27T12:35:12.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:12.003+0000 7f6837fff640 1 -- 172.21.15.55:0/2208389930 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6820003520 con 0x7f683806c040 2024-05-27T12:35:12.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:12.003+0000 7f6837fff640 1 -- 172.21.15.55:0/2208389930 <== mon.1 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2630175531 0 0) 0x7f683815d210 con 0x7f68380cdd30 2024-05-27T12:35:12.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:12.003+0000 7f6837fff640 1 -- 172.21.15.55:0/2208389930 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f683815cf30 con 0x7f68380cdd30 2024-05-27T12:35:12.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:12.003+0000 7f683d50b640 1 -- 172.21.15.55:0/2208389930 >> v1:172.21.15.72:6789/0 conn(0x7f68380cdd30 legacy=0x7f683806b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:35:12.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:12.003+0000 7f683d50b640 1 -- 172.21.15.55:0/2208389930 >> v1:172.21.15.55:6789/0 conn(0x7f683806c040 legacy=0x7f6838160480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:35:12.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:12.003+0000 7f6837fff640 1 -- 172.21.15.55:0/2208389930 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1094675808 0 0) 0x7f6820003520 con 0x7f683806c040 2024-05-27T12:35:12.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:12.003+0000 7f683d50b640 1 -- 172.21.15.55:0/2208389930 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f683815d4f0 con 0x7f6838146060 2024-05-27T12:35:12.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:12.004+0000 7f683d50b640 1 --2- 172.21.15.55:0/2208389930 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6838146060 0x7f68380cd7f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f68300097d0 tx=0x7f683002a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aab263fda0be5c0f server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:35:12.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:12.004+0000 7f6837fff640 1 -- 172.21.15.55:0/2208389930 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6830037070 con 0x7f6838146060 2024-05-27T12:35:12.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:12.004+0000 7f6837fff640 1 -- 172.21.15.55:0/2208389930 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f683002ac30 con 0x7f6838146060 2024-05-27T12:35:12.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:12.004+0000 7f6837fff640 1 -- 172.21.15.55:0/2208389930 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68280019f0 con 0x7f6838146060 2024-05-27T12:35:12.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:12.004+0000 7f683f76f640 1 -- 172.21.15.55:0/2208389930 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6838146060 msgr2=0x7f68380cd7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:35:12.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:12.004+0000 7f683f76f640 1 --2- 172.21.15.55:0/2208389930 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6838146060 0x7f68380cd7f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f68300097d0 tx=0x7f683002a1a0 comp rx=0 tx=0).stop 2024-05-27T12:35:12.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:12.004+0000 7f683f76f640 1 -- 172.21.15.55:0/2208389930 shutdown_connections 2024-05-27T12:35:12.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:12.004+0000 7f683f76f640 1 --2- 172.21.15.55:0/2208389930 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6838146060 0x7f68380cd7f0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:35:12.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:12.004+0000 7f683f76f640 1 -- 172.21.15.55:0/2208389930 >> 172.21.15.55:0/2208389930 conn(0x7f6838067d70 msgr2=0x7f68380b2270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:35:12.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:12.005+0000 7f683f76f640 1 -- 172.21.15.55:0/2208389930 shutdown_connections 2024-05-27T12:35:12.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:12.005+0000 7f683f76f640 1 -- 172.21.15.55:0/2208389930 wait complete. 2024-05-27T12:35:12.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:12.006+0000 7f683f76f640 1 Processor -- start 2024-05-27T12:35:12.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:12.006+0000 7f683f76f640 1 -- start start 2024-05-27T12:35:12.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:12.006+0000 7f683f76f640 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f68380cdd30 0x7f683813dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:35:12.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:12.006+0000 7f683f76f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6838146060 0x7f68381f33c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:35:12.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:12.006+0000 7f683f76f640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f68381531a0 0x7f683815ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:35:12.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:12.006+0000 7f683f76f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 -- 0x7f68380d0150 con 0x7f6838146060 2024-05-27T12:35:12.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:12.006+0000 7f683f76f640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f683815db40 con 0x7f68381531a0 2024-05-27T12:35:12.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:12.006+0000 7f683f76f640 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 -- 0x7f68380d02d0 con 0x7f68380cdd30 2024-05-27T12:35:12.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:12.007+0000 7f683cd0a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6838146060 0x7f68381f33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:35:12.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:12.007+0000 7f683cd0a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6838146060 0x7f68381f33c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54190/0 (socket says 172.21.15.55:54190) 2024-05-27T12:35:12.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:12.007+0000 7f683cd0a640 1 -- 172.21.15.55:0/2172055947 learned_addr learned my addr 172.21.15.55:0/2172055947 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-05-27T12:35:12.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:12.007+0000 7f683d50b640 1 --2- 172.21.15.55:0/2172055947 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f68380cdd30 0x7f683813dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:35:12.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:12.007+0000 7f683dd0c640 1 --2- 172.21.15.55:0/2172055947 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f68381531a0 0x7f683815ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:35:12.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:12.007+0000 7f683cd0a640 1 -- 172.21.15.55:0/2172055947 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f68380cdd30 msgr2=0x7f683813dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:35:12.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:12.007+0000 7f683cd0a640 1 --2- 172.21.15.55:0/2172055947 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f68380cdd30 0x7f683813dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:35:12.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:12.007+0000 7f683cd0a640 1 -- 172.21.15.55:0/2172055947 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f68381531a0 msgr2=0x7f683815ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:35:12.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:12.007+0000 7f683cd0a640 1 --2- 172.21.15.55:0/2172055947 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f68381531a0 0x7f683815ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:35:12.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:12.007+0000 7f683cd0a640 1 -- 172.21.15.55:0/2172055947 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68381f3900 con 0x7f6838146060 2024-05-27T12:35:12.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:12.007+0000 7f683d50b640 1 --2- 172.21.15.55:0/2172055947 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f68380cdd30 0x7f683813dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T12:35:12.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:12.007+0000 7f683dd0c640 1 --2- 172.21.15.55:0/2172055947 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f68381531a0 0x7f683815ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-27T12:35:12.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:12.007+0000 7f683cd0a640 1 --2- 172.21.15.55:0/2172055947 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6838146060 0x7f68381f33c0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f682c00c490 tx=0x7f682c00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:35:12.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:12.007+0000 7f6835ffb640 1 -- 172.21.15.55:0/2172055947 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f682c0052d0 con 0x7f6838146060 2024-05-27T12:35:12.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:12.007+0000 7f6835ffb640 1 -- 172.21.15.55:0/2172055947 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f682c005470 con 0x7f6838146060 2024-05-27T12:35:12.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:12.007+0000 7f683f76f640 1 -- 172.21.15.55:0/2172055947 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68381f3ba0 con 0x7f6838146060 2024-05-27T12:35:12.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:12.007+0000 7f6835ffb640 1 -- 172.21.15.55:0/2172055947 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f682c012850 con 0x7f6838146060 2024-05-27T12:35:12.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:12.008+0000 7f683f76f640 1 -- 172.21.15.55:0/2172055947 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68381f4160 con 0x7f6838146060 2024-05-27T12:35:12.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:12.009+0000 7f683f76f640 1 -- 172.21.15.55:0/2172055947 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6838075460 con 0x7f6838146060 2024-05-27T12:35:12.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:12.009+0000 7f6835ffb640 1 -- 172.21.15.55:0/2172055947 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 9) ==== 91244+0+0 (secure 0 0 0) 0x7f682c0129f0 con 0x7f6838146060 2024-05-27T12:35:12.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:12.009+0000 7f6835ffb640 1 --2- 172.21.15.55:0/2172055947 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f682406cb60 0x7f682406f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-27T12:35:12.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:12.010+0000 7f6835ffb640 1 -- 172.21.15.55:0/2172055947 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4943+0+0 (secure 0 0 0) 0x7f682c08b9a0 con 0x7f6838146060 2024-05-27T12:35:12.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:12.010+0000 7f683d50b640 1 --2- 172.21.15.55:0/2172055947 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f682406cb60 0x7f682406f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-27T12:35:12.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:12.010+0000 7f683d50b640 1 --2- 172.21.15.55:0/2172055947 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f682406cb60 0x7f682406f020 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f6830034000 tx=0x7f683002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-27T12:35:12.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:12.014+0000 7f6835ffb640 1 -- 172.21.15.55:0/2172055947 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f682c059d60 con 0x7f6838146060 2024-05-27T12:35:12.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:12.209+0000 7f683f76f640 1 -- 172.21.15.55:0/2172055947 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f68380b3860 con 0x7f6838146060 2024-05-27T12:35:12.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:12.210+0000 7f6835ffb640 1 -- 172.21.15.55:0/2172055947 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v39) ==== 80+0+122 (secure 0 0 0) 0x7f682c059660 con 0x7f6838146060 2024-05-27T12:35:12.209 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6833/1971815735 2024-05-28T12:35:07.755944+0000 2024-05-27T12:35:12.209 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6832/1971815735 2024-05-28T12:35:07.755944+0000 2024-05-27T12:35:12.210 INFO:teuthology.orchestra.run.smithi055.stderr:listed 2 entries 2024-05-27T12:35:12.212 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:12.212+0000 7f683f76f640 1 -- 172.21.15.55:0/2172055947 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f682406cb60 msgr2=0x7f682406f020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:35:12.212 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:12.212+0000 7f683f76f640 1 --2- 172.21.15.55:0/2172055947 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f682406cb60 0x7f682406f020 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f6830034000 tx=0x7f683002e000 comp rx=0 tx=0).stop 2024-05-27T12:35:12.212 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:12.212+0000 7f683f76f640 1 -- 172.21.15.55:0/2172055947 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6838146060 msgr2=0x7f68381f33c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-27T12:35:12.212 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:12.212+0000 7f683f76f640 1 --2- 172.21.15.55:0/2172055947 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6838146060 0x7f68381f33c0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f682c00c490 tx=0x7f682c00c950 comp rx=0 tx=0).stop 2024-05-27T12:35:12.212 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:12.212+0000 7f683f76f640 1 -- 172.21.15.55:0/2172055947 shutdown_connections 2024-05-27T12:35:12.212 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:12.212+0000 7f683f76f640 1 --2- 172.21.15.55:0/2172055947 >> [v2:172.21.15.72:6832/3152720583,v1:172.21.15.72:6833/3152720583] conn(0x7f682406cb60 0x7f682406f020 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:35:12.212 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:12.212+0000 7f683f76f640 1 --2- 172.21.15.55:0/2172055947 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f68381531a0 0x7f683815ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:35:12.212 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:12.212+0000 7f683f76f640 1 --2- 172.21.15.55:0/2172055947 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6838146060 0x7f68381f33c0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:35:12.212 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:12.212+0000 7f683f76f640 1 --2- 172.21.15.55:0/2172055947 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f68380cdd30 0x7f683813dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-27T12:35:12.212 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:12.212+0000 7f683f76f640 1 -- 172.21.15.55:0/2172055947 >> 172.21.15.55:0/2172055947 conn(0x7f683806c040 msgr2=0x7f6838144260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-27T12:35:12.212 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:12.212+0000 7f683f76f640 1 -- 172.21.15.55:0/2172055947 shutdown_connections 2024-05-27T12:35:12.213 INFO:teuthology.orchestra.run.smithi055.stderr:2024-05-27T12:35:12.212+0000 7f683f76f640 1 -- 172.21.15.55:0/2172055947 wait complete. 2024-05-27T12:35:12.223 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-05-27T12:35:12.223 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-27T12:35:12.223 DEBUG:teuthology.orchestra.run.smithi055:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-05-27T12:35:38.093 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T12:35:38.096 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T12:36:08.153 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T12:36:08.157 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T12:36:38.213 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T12:36:38.217 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T12:37:08.278 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T12:37:08.282 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T12:37:38.346 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T12:37:38.350 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T12:38:08.412 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T12:38:08.416 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T12:38:38.474 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T12:38:38.481 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T12:39:08.604 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T12:39:08.608 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T12:39:38.666 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T12:39:38.671 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T12:40:08.742 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T12:40:08.748 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T12:40:12.228 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e7ae7580c417d6ab27fda98fecadca5d9f85d63e/virtualenv/lib/python3.10/site-packages/paramiko/channel.py", line 745, in recv_stderr out = self.in_stderr_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_e7ae7580c417d6ab27fda98fecadca5d9f85d63e/virtualenv/lib/python3.10/site-packages/paramiko/buffered_pipe.py", line 154, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 908, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_teuthology_e7ae7580c417d6ab27fda98fecadca5d9f85d63e/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_teuthology_e7ae7580c417d6ab27fda98fecadca5d9f85d63e/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_teuthology_e7ae7580c417d6ab27fda98fecadca5d9f85d63e/virtualenv/lib/python3.10/site-packages/paramiko/file.py", line 109, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_teuthology_e7ae7580c417d6ab27fda98fecadca5d9f85d63e/virtualenv/lib/python3.10/site-packages/paramiko/file.py", line 275, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_teuthology_e7ae7580c417d6ab27fda98fecadca5d9f85d63e/virtualenv/lib/python3.10/site-packages/paramiko/channel.py", line 1374, in _read return self.channel.recv_stderr(size) File "/home/teuthworker/src/git.ceph.com_teuthology_e7ae7580c417d6ab27fda98fecadca5d9f85d63e/virtualenv/lib/python3.10/site-packages/paramiko/channel.py", line 747, in recv_stderr raise socket.timeout() TimeoutError 2024-05-27T12:40:12.230 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e7ae7580c417d6ab27fda98fecadca5d9f85d63e/virtualenv/lib/python3.10/site-packages/paramiko/channel.py", line 697, in recv out = self.in_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_e7ae7580c417d6ab27fda98fecadca5d9f85d63e/virtualenv/lib/python3.10/site-packages/paramiko/buffered_pipe.py", line 154, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 908, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_teuthology_e7ae7580c417d6ab27fda98fecadca5d9f85d63e/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_teuthology_e7ae7580c417d6ab27fda98fecadca5d9f85d63e/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_teuthology_e7ae7580c417d6ab27fda98fecadca5d9f85d63e/virtualenv/lib/python3.10/site-packages/paramiko/file.py", line 109, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_teuthology_e7ae7580c417d6ab27fda98fecadca5d9f85d63e/virtualenv/lib/python3.10/site-packages/paramiko/file.py", line 275, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_teuthology_e7ae7580c417d6ab27fda98fecadca5d9f85d63e/virtualenv/lib/python3.10/site-packages/paramiko/channel.py", line 1359, in _read return self.channel.recv(size) File "/home/teuthworker/src/git.ceph.com_teuthology_e7ae7580c417d6ab27fda98fecadca5d9f85d63e/virtualenv/lib/python3.10/site-packages/paramiko/channel.py", line 699, in recv raise socket.timeout() TimeoutError 2024-05-27T12:40:38.830 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T12:40:38.834 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T12:41:08.915 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T12:41:08.919 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T12:41:38.983 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T12:41:38.987 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T12:42:09.047 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T12:42:09.051 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T12:42:39.124 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T12:42:39.128 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T12:43:09.180 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T12:43:09.183 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T12:43:39.245 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T12:43:39.248 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T12:44:09.427 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T12:44:09.435 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T12:44:39.489 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T12:44:39.493 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T12:45:09.555 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T12:45:09.559 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T12:45:39.621 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T12:45:39.625 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T12:46:09.686 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T12:46:09.690 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T12:46:39.747 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T12:46:39.751 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T12:47:09.814 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T12:47:09.818 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T12:47:39.874 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T12:47:39.878 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T12:48:09.938 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T12:48:09.943 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T12:48:40.000 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T12:48:40.003 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T12:49:10.066 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T12:49:10.071 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T12:49:40.131 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T12:49:40.135 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T12:50:10.199 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T12:50:10.203 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T12:50:40.282 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T12:50:40.286 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T12:51:10.347 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T12:51:10.351 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T12:51:40.484 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T12:51:40.487 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T12:52:10.549 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T12:52:10.553 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T12:52:40.617 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T12:52:40.622 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T12:53:10.682 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T12:53:10.686 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T12:53:40.773 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T12:53:40.777 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T12:54:10.839 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T12:54:10.843 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T12:54:40.905 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T12:54:40.909 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T12:55:10.994 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T12:55:10.998 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T12:55:41.062 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T12:55:41.066 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T12:56:11.130 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T12:56:11.134 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T12:56:41.222 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T12:56:41.226 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T12:57:11.289 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T12:57:11.292 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T12:57:41.388 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T12:57:41.392 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T12:58:11.463 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T12:58:11.467 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T12:58:41.575 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T12:58:41.579 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T12:59:11.642 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T12:59:11.645 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T12:59:41.706 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T12:59:41.710 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:00:11.771 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:00:11.774 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:00:41.836 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:00:41.840 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:01:11.909 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:01:11.912 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:01:41.972 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:01:41.976 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:02:12.063 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:02:12.067 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:02:42.130 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:02:42.135 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:03:12.189 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:03:12.193 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:03:42.253 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:03:42.257 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:04:12.321 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:04:12.324 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:04:42.384 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:04:42.388 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:05:12.446 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:05:12.450 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:05:42.513 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:05:42.517 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:06:12.576 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:06:12.579 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:06:42.641 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:06:42.645 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:07:12.706 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:07:12.709 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:07:42.771 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:07:42.775 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:08:12.834 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:08:12.837 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:08:42.899 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:08:42.902 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:09:12.964 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:09:12.968 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:09:43.028 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:09:43.032 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:10:13.095 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:10:13.099 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:10:43.157 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:10:43.161 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:11:13.222 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:11:13.226 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:11:43.293 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:11:43.297 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:12:13.358 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:12:13.361 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:12:43.418 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:12:43.422 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:13:13.486 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:13:13.489 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:13:43.568 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:13:43.572 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:14:13.635 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:14:13.638 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:14:43.717 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:14:43.721 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:15:13.787 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:15:13.792 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:15:43.852 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:15:43.856 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:16:13.919 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:16:13.923 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:16:44.006 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:16:44.011 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:17:14.076 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:17:14.080 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:17:44.160 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:17:44.164 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:18:14.226 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:18:14.230 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:18:44.292 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:18:44.296 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:19:14.367 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:19:14.371 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:19:44.426 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:19:44.430 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:20:14.491 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:20:14.495 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:20:44.572 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:20:44.576 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:21:14.634 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:21:14.638 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:21:44.694 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:21:44.698 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:22:14.757 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:22:14.761 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:22:44.820 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:22:44.824 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:23:14.885 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:23:14.888 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:23:44.959 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:23:44.963 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:24:15.029 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:24:15.033 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:24:45.096 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:24:45.100 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:25:15.195 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:25:15.199 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:25:45.261 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:25:45.265 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:26:15.331 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:26:15.335 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:26:45.395 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:26:45.399 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:27:15.462 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:27:15.466 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:27:45.529 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:27:45.532 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:28:15.589 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:28:15.593 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:28:45.654 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:28:45.658 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:29:15.734 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:29:15.738 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:29:45.795 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:29:45.800 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:30:15.878 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:30:15.882 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:30:45.944 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:30:45.948 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:31:16.011 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:31:16.015 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:31:46.074 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:31:46.078 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:32:16.165 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:32:16.169 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:32:46.228 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:32:46.232 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:33:16.318 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:33:16.322 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:33:46.385 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:33:46.389 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:34:16.451 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:34:16.455 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:34:46.517 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:34:46.521 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:35:16.602 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:35:16.605 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:35:46.674 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:35:46.678 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:36:16.750 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:36:16.754 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:36:46.809 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:36:46.813 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:37:16.876 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:37:16.879 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:37:46.933 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:37:46.937 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:38:17.008 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:38:17.011 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:38:47.078 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:38:47.082 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:39:17.142 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:39:17.146 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:39:47.208 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:39:47.212 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:40:17.271 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:40:17.275 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:40:47.342 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:40:47.346 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:41:17.409 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:41:17.413 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:41:47.472 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:41:47.476 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:42:17.542 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:42:17.546 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:42:47.610 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:42:47.614 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:43:17.667 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:43:17.671 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:43:47.732 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:43:47.736 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:44:17.798 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:44:17.802 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:44:47.868 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:44:47.872 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:45:17.940 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:45:17.944 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:45:48.006 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:45:48.009 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:46:18.069 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:46:18.073 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:46:48.133 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:46:48.137 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:47:18.198 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:47:18.202 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:47:48.288 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:47:48.291 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:48:18.356 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:48:18.360 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:48:48.439 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:48:48.444 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:49:18.506 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:49:18.509 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:49:48.570 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:49:48.574 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:50:18.638 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:50:18.641 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:50:48.724 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:50:48.728 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:51:18.792 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:51:18.797 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:51:48.875 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:51:48.878 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:52:19.029 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:52:19.033 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:52:49.099 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:52:49.103 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:53:19.166 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:53:19.169 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:53:49.257 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:53:49.261 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:54:19.324 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:54:19.327 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:54:49.416 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:54:49.420 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:55:19.486 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:55:19.490 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:55:49.551 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:55:49.554 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:56:19.616 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:56:19.619 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:56:49.681 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:56:49.685 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:57:19.750 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:57:19.753 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:57:49.817 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:57:49.820 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:58:19.876 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:58:19.879 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:58:49.948 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:58:49.952 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:59:20.013 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:59:20.017 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:59:50.077 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T13:59:50.082 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:00:20.145 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:00:20.149 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:00:50.225 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:00:50.229 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:01:20.290 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:01:20.294 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:01:50.364 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:01:50.369 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:02:20.429 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:02:20.433 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:02:50.495 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:02:50.500 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:03:20.554 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:03:20.558 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:03:50.624 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:03:50.627 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:04:20.688 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:04:20.692 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:04:50.754 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:04:50.758 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:05:20.818 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:05:20.822 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:05:50.886 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:05:50.889 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:06:20.965 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:06:20.968 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:06:51.031 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:06:51.035 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:07:21.112 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:07:21.116 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:07:51.176 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:07:51.179 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:08:21.241 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:08:21.244 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:08:51.313 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:08:51.317 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:09:21.396 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:09:21.399 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:09:51.460 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:09:51.465 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:10:21.552 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:10:21.555 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:10:51.615 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:10:51.619 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:11:21.687 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:11:21.690 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:11:51.761 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:11:51.766 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:12:21.968 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:12:21.971 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:12:52.034 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:12:52.038 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:13:22.117 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:13:22.120 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:13:52.174 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:13:52.177 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:14:22.235 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:14:22.238 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:14:52.300 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:14:52.304 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:15:22.365 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:15:22.369 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:15:52.433 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:15:52.436 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:16:22.499 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:16:22.502 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:16:52.568 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:16:52.572 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:17:22.632 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:17:22.635 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:17:52.699 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:17:52.703 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:18:22.762 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:18:22.766 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:18:52.831 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:18:52.835 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:19:22.896 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:19:22.900 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:19:52.964 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:19:52.968 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:20:23.029 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:20:23.032 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:20:53.094 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:20:53.098 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:21:23.159 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:21:23.162 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:21:53.224 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:21:53.228 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:22:23.284 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:22:23.288 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:22:53.354 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:22:53.358 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:23:23.436 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:23:23.439 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:23:53.633 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:23:53.637 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:24:23.699 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:24:23.703 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:24:53.913 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:24:53.916 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:25:24.119 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:25:24.122 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:25:54.196 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:25:54.200 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:26:24.263 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:26:24.267 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:26:54.329 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:26:54.332 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:27:24.395 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:27:24.399 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:27:54.481 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:27:54.484 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:28:24.545 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:28:24.549 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:28:54.668 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:28:54.672 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:29:24.733 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:29:24.737 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:29:54.805 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:29:54.808 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:30:24.869 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:30:24.872 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:30:54.958 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:30:54.961 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:31:25.025 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:31:25.028 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:31:55.107 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:31:55.129 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:32:25.193 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:32:25.196 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:32:55.307 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:32:55.311 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:33:25.368 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:33:25.371 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:33:55.428 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:33:55.432 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:34:25.493 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:34:25.496 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:34:55.565 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:34:55.569 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:35:25.638 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:35:25.641 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:35:55.712 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:35:55.716 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:36:25.784 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:36:25.793 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:36:55.857 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:36:55.861 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:37:25.922 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:37:25.926 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:37:55.994 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:37:55.997 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:38:26.063 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:38:26.067 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:38:56.131 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:38:56.135 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:39:26.196 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:39:26.200 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:39:56.262 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:39:56.265 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:40:26.351 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:40:26.355 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:40:56.432 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:40:56.435 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:41:26.504 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:41:26.508 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:41:56.572 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:41:56.576 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:42:26.641 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:42:26.645 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:42:56.706 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:42:56.710 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:43:26.799 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:43:26.802 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:43:56.869 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:43:56.873 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:44:26.954 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:44:26.958 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:44:57.022 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:44:57.026 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:45:27.087 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:45:27.091 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:45:57.152 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:45:57.155 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:46:27.241 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:46:27.245 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:46:57.313 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:46:57.317 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:47:27.396 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:47:27.400 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:47:57.472 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:47:57.487 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:48:27.546 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:48:27.551 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:48:57.616 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:48:57.619 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:49:27.688 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:49:27.692 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:49:57.754 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:49:57.757 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:50:27.826 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:50:27.830 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:50:57.890 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:50:57.894 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:51:27.962 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:51:27.967 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:51:58.029 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:51:58.033 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:52:28.095 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:52:28.100 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:52:58.175 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:52:58.180 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:53:28.247 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:53:28.251 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:53:58.321 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:53:58.325 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:54:28.378 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:54:28.381 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:54:58.449 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:54:58.453 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:55:28.522 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:55:28.526 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:55:58.579 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:55:58.582 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:56:28.645 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:56:28.648 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:56:58.717 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:56:58.720 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:57:28.781 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:57:28.785 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:57:58.846 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:57:58.849 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:58:28.911 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:58:28.915 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-27T14:58:54.518 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2024-05-27T14:58:54.519 DEBUG:teuthology.task.console_log:Killing console logger for smithi055 2024-05-27T14:58:54.519 DEBUG:teuthology.task.console_log:Killing console logger for smithi072 2024-05-27T14:58:54.520 DEBUG:teuthology.exit:Finished running handlers